System

Abstract

To provide a system for smoothing and activating communication in a company by providing means for inter-avatar conversation.SOLUTION: A system includes: means for displaying an avatar created for each employee in a virtual digital space; means for acquiring an attendance status of each employee in cooperation with an attendance management system and periodically updating a display state of the avatar in accordance with the attendance status; and means for communicating between an employee corresponding to an avatar selected by a user and the user through a chat or a video call.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, there are many issues with internal communication. In particular, there are problems such as difficulty in communicating with employees, delays in sharing information, and not being able to contact employees on vacation or public holidays. Another issue is that there is no effort to stimulate internal communication. [Means for solving the problem]

[0005] This invention provides a means for all employees to create avatars and communicate in a virtual reality world. It uses generative AI to act as a temporary responder for internal inquiries, and provides a means for connecting the temporary responder to various responders and related party avatars. It provides a means for avatars to be turned off during public holidays or days off, and only those who can be contacted are displayed. By providing a means for avatars to converse with each other, it facilitates and stimulates communication within the company. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, the coded communication I / F (Interface) refers to a communication processor and

[0013] The communication I / F is an interface that includes a network interface (NIC) and an antenna. The communication I / F controls communication between multiple computers. Examples of communication standards that can be applied to the communication I / F include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0014] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0015] [First embodiment]

[0016] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0017] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0019] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0020] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0021] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0023] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0024] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0025] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0026] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0027] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0028] "Example 1"

[0029] The present invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. Specifically, each employee creates their own avatar and communicates with other employees through that avatar. The avatar reflects the employee's employment status (working, vacation, public holidays, etc.) and presents employees who can be contacted accordingly.

[0030] "Example 2"

[0031] The present invention is a system that uses generative AI to temporarily handle internal inquiries and then connects them to various responders and related party avatars. Specifically, the generative AI temporarily receives inquiries from employees and connects them to the appropriate responders and related party avatars. This generative AI has the ability to understand the content of employees' inquiries and select the appropriate responders and related parties.

[0032] "Example 3"

[0033] The present invention is a system that turns off the avatar when an employee is on a public holiday or vacation, and displays only those who can be contacted. Specifically, an employee's avatar reflects the employee's employment status, and the avatar turns off when the employee is on a public holiday or vacation. In this case, only those employees who can be contacted are displayed, preventing unnecessary contact.

[0034] The processing flow of each embodiment will be described below.

[0035] "Example 1"

[0036] Step 1: Employees create their own avatars, which reflect their employment status (working, vacation, public holidays, etc.).

[0037] Step 2: An employee communicates with another employee's avatar in the virtual reality world. The avatar reflects the employee's presence status, and is turned off if the employee is on a public holiday or vacation.

[0038] Step 3: Only available employees are displayed, avoiding unnecessary contact.

[0039] "Example 2"

[0040] Step 1: The generative AI temporarily receives inquiries from employees.

[0041] Step 2: The generative AI understands the content of the inquiry and selects the appropriate responder or person involved. Step 3: The generative AI connects the inquiry to the avatar of the responder or person involved that it has selected. "Example 3"

[0042] Step 1: Employee avatars reflect their employment status, and are turned off when they are on public holidays or vacation.

[0043] Step 2: Only available employees are displayed, avoiding unnecessary contact.

[0044] Example 1

[0045] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0046] With the conventional internal communication system, communication between employees was complicated, and it was particularly difficult to confirm the employee's status and identify employees who could be contacted. In addition, when employees were on vacation or public holidays, they were often unable to be contacted, which led to a decrease in work efficiency. Furthermore, temporary responses to internal inquiries were insufficient, and a quick response was required.

[0047] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0048] In this invention, the server includes a means for displaying an avatar created for each employee in a virtual digital space, a means for acquiring the attendance status of each employee in cooperation with an attendance management system and periodically updating the display status of the avatar according to the attendance status, and a means for communicating via chat or video call between the employee corresponding to the avatar selected by the user and the user. This enables employees to communicate efficiently in a virtual reality world. The server also includes a prompt message that instructs the system to present candidate employees who can respond to the internal inquiry based on an internal inquiry input by the user and a list storing information about each employee, and a means for presenting candidate employees who can respond to the internal inquiry using a generative AI. The updating means also updates the display status of the employee's avatar to be turned off when the employee is on leave.

[0049] An "avatar" is a digital character created by a user for use in a virtual reality world.

[0050] A "virtual reality society" is a virtual environment that resembles the real world and is constructed using computer technology.

[0051] "Generative AI" is a system that uses artificial intelligence technology to provide temporary responses to user inquiries.

[0052] An "attendance management system" is software for managing employee attendance and vacation status.

[0053] A "server" is a computer system that stores and processes data on a network.

[0054] A "terminal" is a device such as a computer or smartphone that is operated by a user.

[0055] "Employment status" is information indicating whether an employee is currently working, on vacation, or on a public holiday.

[0056] "Chat" is a means of communicating in real time using text messages.

[0057] A "video call" is a means of communicating in real time using video and audio.

[0058] This invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. A specific embodiment of this system will be described below.

[0059] Creating an avatar

[0060] Users create their own avatars using a dedicated application. This application uses 3D modeling software such as Unity or Unreal Engine. Users can customize their appearance, clothing, accessories, etc. For example, when users select a hairstyle, multiple hairstyle options are displayed and can be selected by clicking.

[0061] Avatar Registration

[0062] The device sends the created avatar data to the server. The avatar data includes 3D model information, textures, and customized parameters. The server receives this data and stores it in a relational database such as MySQL (registered trademark) or PostgreSQL. For example, the avatar data is sent in JSON format, which is parsed on the server side and stored in the database.

[0063] Obtaining and updating enrollment status

[0064] The server works with an attendance management system to manage employee attendance status. The server periodically retrieves data from the attendance management system via API and updates each employee's attendance status (working, vacation, public holidays, etc.). For example, the server sends an API request every morning at 9:00 to retrieve the latest attendance status data.

[0065] Show contactable employees

[0066] When a user opens the application, the device retrieves the latest attendance status data from the server. Based on this data, the device displays avatars of available employees. The user can start a chat or video call with that employee by clicking on the displayed avatar. For example, when a user opens the application, the avatars of employees currently working are displayed in a list format.

[0067] Start a conversation

[0068] The user clicks on the avatar of the employee they want to contact. The device sends the information of the avatar to the server, which starts a chat or video call session. The server returns the necessary communication information to the device, supporting real-time communication. For example, when a user clicks on the avatar of a specific employee, a chat window opens, allowing them to send a message.

[0069] Specific examples

[0070] For example, if a user wants to contact a specific employee, they open the application and search for the employee's avatar. If the employee is currently at work, the avatar will be displayed and they can click to chat or video call.

[0071] This system allows employees to communicate effectively with each other in a virtual reality world.

[0072] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0073] Step 1:

[0074] A user launches a dedicated application and creates an avatar. As input, the user selects customization options such as face shape, hairstyle, clothing, and accessories. As output, 3D model data of the customized avatar is generated. Specifically, when the user selects a hairstyle, the application applies the 3D model of the selected hairstyle to the avatar.

[0075] Step 2:

[0076] The device sends the created avatar data to the server. The input includes the avatar's 3D model data. The output is saved to the server. Specifically, the device sends the avatar data in JSON format to the server, which parses the data and stores it in a database.

[0077] Step 3:

[0078] The server works with the attendance management system to obtain employee attendance status and updates it periodically. The input includes attendance status data from the attendance management system. The output is the latest attendance status data stored on the server. Specifically, the server sends an API request every morning at 9:00 to obtain the latest attendance status data from the attendance management system.

[0079] Step 4:

[0080] When a user opens the application, the device retrieves the latest attendance status data from the server. The input includes the attendance status data from the server. The output displays the avatars of available employees. Specifically, the device sends a request to the server and displays a list of avatars of employees who are currently working based on the attendance status data received from the server. At this time, if an employee is on leave, the display status of that employee's avatar is turned off.

[0081] Step 5:

[0082] The user clicks on the avatar of the employee they want to contact. The input includes information about the avatar they clicked on. The output is the start of a chat or video call session. In concrete terms, when a user clicks on a specific employee's avatar, the device sends that information to the server, and the server returns the necessary communication information to the device. This opens a chat window, allowing them to send a message.

[0083] Furthermore, when an internal inquiry is input by a user, the server uses a prompt sentence instructing the server to present candidate employees who can handle the internal inquiry based on the input internal inquiry and a list storing information about each employee, and uses generative AI to present candidate employees who can handle the internal inquiry.The user can refer to the presented candidate employees who can handle the internal inquiry, select the employee to inquire about, and click the employee's avatar to contact them and make an inquiry. Example prompt sentence: After inputting an internal inquiry from the user and a list that stores information about each employee, you can say, "This is a list that stores an internal inquiry and information about each employee. Please provide candidates for employees who can handle this internal inquiry."

[0084] (Application example 1)

[0085] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0086] Conventional communication systems in virtual reality have had problems such as difficulty reflecting employee availability in real time and making it difficult for customers to communicate with store clerks smoothly. Furthermore, there was a lack of a way to quickly provide appropriate answers to customer questions.

[0087] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0088] In this invention, the server includes a means for all employees to create avatars and communicate in the virtual reality world, a means for using generative AI to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, a means for avatars to converse with each other, a means for customer and store clerk avatars to communicate in the virtual reality space, a means for reflecting store clerk availability in real time and notifying customers, and a means for using generative AI to perform natural language processing on customer questions and generate appropriate answers, which enables smoother communication in the virtual reality world and improved customer service.

[0089] An "avatar" is a digital character that represents a user in a virtual reality society.

[0090] A "virtual reality society" is a virtual environment constructed using computer technology, a space in which users can engage in activities and communicate.

[0091] "Generative AI" is a system that uses artificial intelligence technology to generate data and automatically process specific tasks.

[0092] A "first responder" is a system or person who acts to quickly respond to initial inquiries or problems and transfers them to the appropriate personnel as needed.

[0093] "Employment status" is information indicating the working status of an employee or store clerk, such as whether they are currently working or on vacation.

[0094] "Natural language processing" is the technology that enables computers to understand, generate, and respond to human language.

[0095] "Real-time" means that data and information are processed immediately and reflected without delay.

[0096] "Customer" means a user who accesses the virtual reality society to use services or products.

[0097] A "store clerk" is a user whose role is to provide information about services and products to customers in the virtual reality society.

[0098] "Communication" is the act of exchanging information and opinions, and in a virtual reality society, this is done through avatars.

[0099] A system for carrying out this invention has the following configuration: The server includes means for all employees to create avatars and communicate in a virtual reality world, means for using generative AI to temporarily respond to internal inquiries and for the temporary response to connect with various responders and related party avatars, means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, means for the avatars to converse with each other, means for customer and store clerk avatars to communicate in the virtual reality space, means for reflecting store clerk availability in real time and notifying customers, and means for using generative AI to perform natural language processing on customer questions and generate appropriate answers.

[0100] Hardware and software used

[0101] Hardware: Smartphone, head-mounted display (e.g., Oculus Quest 2)

[0102] Software: Unity (game engine), Photon (real-time communication), Azure (registered trademark) AI (generative AI model)

[0103] Data processing and calculation

[0104] Avatar Creation

[0105] Users create their own avatar using Unity, and the avatar's design is customized based on prompts generated using Azure AI, such as:

[0106] "Female staff in their 20s, casual clothing, friendly smile"

[0107] Reflection of enrollment status

[0108] The server updates the availability status of store staff in real time and notifies customers via Photon. Availability data is obtained from the staff's work shift information and analyzed by Azure AI. For example, the following notifications are sent:

[0109] "Currently, we have three staff members on duty. The following staff members are available: Avatar 1 (Yamada-san), Avatar 2 (Sato-san), Avatar 3 (Suzuki-san)"

[0110] communication

[0111] When a customer has a question or wants to ask for advice, they connect to a store clerk avatar in real time using Photon. The store clerk avatar uses Azure AI to perform natural language processing and generate an appropriate answer to the customer's question. For example, it uses prompt sentences like the following:

[0112] "I have a question about the product you're looking for. What product are you looking for?"

[0113] In this way, smoother communication and improved customer service can be achieved in the virtual reality society.

[0114] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0115] Step 1:

[0116] Users launch Unity using a terminal and create their own avatar. As input, the user provides a prompt, and Azure AI generates an avatar design based on the prompt. As output, a customized avatar is generated.

[0117] Step 2:

[0118] The server obtains the employee's attendance status in real time. Employee work shift information is sent to the server as input. The server analyzes this information using Azure AI and generates current attendance status data as output.

[0119] Step 3:

[0120] The server notifies the customer of the attendance status data through Photon. As input, the attendance status data updated in real time is used. As output, the attendance status is displayed on the customer's device.

[0121] Step 4:

[0122] A customer uses a terminal to ask a question or ask for advice. The customer's question is entered into the terminal as input. The terminal sends this information to the server via Photon. The question arrives at the server as output.

[0123] Step 5:

[0124] The server uses Azure AI to analyze the customer's question and generate an appropriate answer. The customer's question is used as input, and the generated answer is obtained as output.

[0125] Step 6:

[0126] The server sends the generated answer to the customer's device via Photon. The generated answer is used as input. The answer is displayed on the customer's device as output.

[0127] Step 7:

[0128] Customer and store clerk avatars communicate in a virtual reality space. Avatar information of the customer and store clerk is used as input. The output is a conversation in the virtual reality space.

[0129] Example 2

[0130] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0131] With conventional internal inquiry systems, it was difficult to quickly identify and contact the appropriate person to respond to an inquiry. Furthermore, when the person in charge was unavailable, inquiries often stalled, making smooth internal communication an issue. Furthermore, there was a lack of resources to temporarily respond to inquiries, so efficient responses were required.

[0132] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0133] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using a generative AI model to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for analyzing the content of the inquiry and selecting an appropriate responder, a means for transferring the inquiry to the selected responder's avatar, a means for turning off the avatars on public holidays or days off and displaying only contactable people, and a means for the avatars to converse with each other. This enables prompt and appropriate responses to internal inquiries, facilitates internal communication, and realizes efficient resource utilization.

[0134] An "avatar" is a digital character that represents a user in a virtual reality world.

[0135] A "generative AI model" is an artificial intelligence model that uses natural language processing to generate and analyze text.

[0136] An "internal inquiry" is an inquiry made by an employee to resolve a work-related question or problem.

[0137] The "first responder" is a system or function that handles inquiries at an initial stage and transfers them to an appropriate responder.

[0138] A "responder" is an employee or department that provides appropriate answers or responses to inquiries.

[0139] "Related parties" are employees or departments that provide information or support related to the inquiry.

[0140] A "virtual reality society" is a virtual space constructed using digital technology, in which users interact through avatars.

[0141] "Query analysis" is the process of analyzing the text of a received query and understanding its content.

[0142] "Selection of the appropriate responder" is the process of identifying the most appropriate responder based on the content of the inquiry.

[0143] "Query forwarding" is the process of sending the parsed query content to the selected responder avatar.

[0144] "A means to turn off avatars on public holidays or days off and display only contactable people" is a function that hides the avatar when the person in charge is absent and displays only contactable people.

[0145] "Means for avatars to converse with each other" is a function that allows users to communicate with each other through avatars.

[0146] MODE FOR CARRYING OUT THE INVENTION

[0147] This invention is a system that uses a generative AI model to handle internal inquiries temporarily and connects the inquiries to the appropriate person or avatar of the relevant person. Specific embodiments of this system are described below.

[0148] System configuration

[0149] This system consists of three main components: a server, a terminal, and a user. The server runs a generative AI model to analyze inquiries and select a responder. The terminal is a device where users can enter inquiries and receive responses. The user is an employee who uses the system to make inquiries.

[0150] Hardware and software used

[0151] Server: A server with high-performance computing power is required. Specifically, a server equipped with a GPU to run generative AI models (e.g., OpenAI's GPT-4) is recommended.

[0152] Device: A device used by a user, such as a PC or smartphone. These devices must have an internet connection and a browser.

[0153] Generative AI model: An AI model for natural language processing. Specifically, OpenAI's GPT-4 is used.

[0154] Data processing and calculation

[0155] The server receives the inquiry sent from the device and inputs it into the generative AI model. The generative AI model analyzes the inquiry and selects an appropriate responder. The inquiry is then forwarded to the selected responder's avatar, which generates an answer. The server then sends the generated answer to the user's device.

[0156] Specific examples

[0157] Consider a case where a user makes an inquiry such as "Please tell me the procedure for starting a new project."

[0158] 1. User: Enter "How do I start a new project?" into the terminal and press the send button.

[0159] 2. Server: Receives the query and sends the prompt "Please tell me the procedure for starting a new project" to the generative AI model.

[0160] 3. Generative AI model: Analyzes the inquiry content and selects a project management department representative.

[0161] 4. Server: Transfers the inquiry to a selected project management department representative avatar.

[0162] 5. Avatar: Generate a response based on the inquiry: "To start a new project, please go to the project management section of our internal portal."

[0163] 6. Server: Sends the generated answer to the user's device.

[0164] 7. User: Check the answer on the device.

[0165] In this way, a system is realized in which the server, terminals, and users work together to provide a temporary response to internal inquiries. This system enables prompt and appropriate responses to internal inquiries, facilitating smooth internal communication and efficient resource utilization.

[0166] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0167] Program processing flow

[0168] Step 1: Receiving an inquiry

[0169] Device:

[0170] The user enters an inquiry using their own device (PC or smartphone) and presses the send button.

[0171] Input: The inquiry typed by the user (e.g., "How do I start a new project?").

[0172] Output: The query is sent to the server.

[0173] Step 2: Receiving your inquiry

[0174] server:

[0175] The server receives the inquiry sent from the terminal.

[0176] Input: The inquiry sent from the device.

[0177] Output: Prepare the received query content for input into the generative AI model.

[0178] Step 3: Analyzing the inquiry

[0179] server:

[0180] The server inputs the received inquiry content into a generative AI model and analyzes it.

[0181] Input: Received inquiry (prompt text).

[0182] Data processing: A generative AI model analyzes the inquiry content and identifies the appropriate person to respond.

[0183] Output: Analysis results and information for appropriate responders (e.g., project management personnel).

[0184] Step 4: Select the right responder

[0185] Generative AI models:

[0186] The generative AI model selects the appropriate responder based on the content of the inquiry.

[0187] Input: Analysis results of the inquiry.

[0188] Data calculation: The inquiry content is compared with a database of responders to select the most suitable responder.

[0189] Output: Information on the selected responder (e.g., project management department personnel).

[0190] Step 5: Transferring the inquiry

[0191] server:

[0192] The server forwards the query to the selected respondent's avatar.

[0193] Input: Information about the selected responder and the inquiry.

[0194] Data processing: The inquiry content is transferred to the responder's avatar in an appropriate format.

[0195] Output: The inquiry content forwarded to the responder's avatar.

[0196] Step 6: Generate an answer

[0197] Avatar:

[0198] The avatar generates an answer based on the query.

[0199] Input: The transferred inquiry.

[0200] Data calculation: Create answers by referencing pre-set answer templates and databases.

[0201] Output: The generated answer (e.g., "To start a new project, please visit the project management section of our intranet portal").

[0202] Step 7: Submit your response

[0203] server:

[0204] The server receives the response from the avatar and sends it to the user's terminal.

[0205] Input: A generated answer from the avatar.

[0206] Data processing: Send the answers to the user's device in an appropriate format.

[0207] Output: The answer sent to the user's device.

[0208] Step 8: View your answers

[0209] Device:

[0210] The user's terminal displays the response sent from the server.

[0211] Input: The answer sent by the server.

[0212] Output: The answer displayed on the user's device (e.g., "To start a new project, please visit the project management section of our internal portal.").

[0213] In this way, a system is realized in which the server, terminals, and users work together to provide a temporary response to internal inquiries.

[0214] (Application example 2)

[0215] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0216] Staff at logistics centers are required to respond to inquiries quickly and accurately, but the traditional system makes it difficult to select and contact the right person to respond, making it difficult to respond efficiently. Furthermore, there were many cases where the right person was unavailable, or it took a long time to find the right person, which caused delays in operations.

[0217] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for all employees to create avatars and communicate in a virtual reality world; a means for using a generative AI to act as a temporary responder for internal inquiries and for connecting the temporary responder to various responders and related party avatars; a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted; a means for the avatars to converse with each other; a means for logistics center staff to make inquiries using their smartphones and for the generative AI to connect the inquiries to the avatars of appropriate responders or related parties; and a means for the generative AI to generate a response based on the inquiry content and select the appropriate responder or related party. This enables inquiries to be handled quickly and accurately at the logistics center, improving work efficiency.

[0218] "All employees" refers to all employees of a company or organization.

[0219] An "avatar" refers to a digital character that represents an individual in a virtual reality society.

[0220] "Virtual reality society" refers to a virtual environment or space constructed using computer technology.

[0221] "Means of contact" refers to the methods and tools used to communicate.

[0222] "Generative AI" refers to a system that uses artificial intelligence technology to generate information and perform specific tasks.

[0223] "Internal inquiries" refer to questions or requests that arise within a company or organization.

[0224] "Temporary responder" refers to the role of responding at the initial stage.

[0225] "Various responders and parties" refers to the people and departments necessary to respond to specific inquiries or issues.

[0226] "In the case of an official holiday or leave of absence" refers to a situation in which an employee is officially on leave.

[0227] "Avatar is turned off" refers to the avatar becoming inactive in the virtual reality world.

[0228] "Contactable persons" refers to persons who are currently available and available for communication.

[0229] "Presentation means" refers to the way information is displayed or presented.

[0230] "Means for avatars to communicate with each other" refers to methods for avatars to communicate with each other in a virtual reality society.

[0231] "Logistics center" refers to a facility that stores, manages, and distributes goods.

[0232] "Staff" refers to employees working at the logistics center.

[0233] A "smartphone" refers to a mobile phone that can connect to the Internet and use applications.

[0234] "Making an inquiry" refers to the act of submitting a question or request.

[0235] "Appropriate responders and parties" refers to the people or departments best suited to a particular inquiry or issue.

[0236] "Inquiry routing" refers to the method by which an inquiry is routed to the appropriate responder or party.

[0237] "Generating a response based on the content of a query" refers to understanding the content of a query and creating a response to it.

[0238] "Means of selection" refers to the method of selecting the best option from multiple options.

[0239] As an embodiment of the present invention, a system for improving the efficiency of inquiries handled by staff at a logistics center is provided. Specific embodiments of the system are described below.

[0240] System configuration

[0241] The system consists of the following major components:

[0242] 1. Server: Hosts the generative AI model, analyzes the inquiry content, and selects the appropriate responder.

[0243] 2. Smartphone: A device used by logistics center staff to input inquiries.

[0244] 3. Avatar: A digital character that represents each employee in a virtual reality world.

[0245] 4. Communication network: Infrastructure for data communication between smartphones and servers.

[0246] Program processing

[0247] Hardware used

[0248] Smartphones: Used by logistics center staff to input inquiries.

[0249] Server: Runs the generative AI model and analyzes the query content.

[0250] Software used

[0251] OpenAI API: Uses generative AI models to generate responses based on queries.

[0252] Python: The primary programming language for programs that run on the server side.

[0253] requests library: Used to communicate between the server and the smartphone.

[0254] Data processing and calculation

[0255] 1. Entering the inquiry details: The staff member enters the inquiry details using a smartphone application.

[0256] 2. Response generation using generative AI: The server uses OpenAI's API to generate a response based on the query.

[0257] 3. Selection of appropriate responders and stakeholders: Based on the generated responses, the server selects appropriate responder and stakeholder avatars.

[0258] 4. Connect to avatar: The server sends an API request to connect to the appropriate avatar.

[0259] Specific examples

[0260] For example, if a staff member at a logistics center types, "I would like to inquire about an error in the inventory management system," the server will use generative AI to respond, "For inquiries about errors in the inventory management system, please connect to the system administrator's avatar," and connect to the system administrator's avatar.

[0261] Prompt Sentence Examples

[0262] Inquiry from logistics center staff: I would like to inquire about an error in the inventory management system.

[0263] Select the appropriate person or party and connect the inquiry to an avatar.

[0264] In this way, inquiries at the logistics center can be handled quickly and accurately, making operations more efficient.

[0265] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0266] Step 1:

[0267] The user uses a smartphone to input the inquiry. The input inquiry is sent as text data from the smartphone to the server. For example, the input data is text such as "I would like to inquire about an error in the inventory management system."

[0268] Step 2:

[0269] The server passes the received query content to the generative AI model. The generative AI model analyzes the query content and generates an appropriate response. The input data is the text of the query content, and the output data is the text of the generated response. For example, a response might be generated that reads, "Inquiries regarding errors in the inventory management system will be connected to the system administrator's avatar."

[0270] Step 3:

[0271] The server selects the appropriate responder or avatar based on the generated response. The input data is the text of the generated response, and the output data is the identification information of the selected avatar. For example, the ID of the system administrator's avatar is selected.

[0272] Step 4:

[0273] The server sends an API request to connect the query to the selected avatar. The input data is the identification information of the selected avatar, and the output data is the result of connecting to the avatar. For example, the result is that the connection to the system administrator's avatar was successful.

[0274] Step 5:

[0275] The server returns the connection result to the smartphone. The input data is the connection result to the avatar, and the output data is a connection result message to be displayed on the smartphone. For example, the message "Connected to the system administrator's avatar" is displayed on the smartphone.

[0276] Step 6:

[0277] The user starts a conversation with the selected avatar via their smartphone. The input data is the user's spoken text, and the output data is the avatar's response text. For example, if the user types "Please tell me the details of the error," the avatar will respond with "Error code 1234 has occurred."

[0278] Through the above steps, inquiries can be handled quickly and accurately at the logistics center.

[0279] Example 3

[0280] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0281] With conventional internal communication systems, it was often impossible to contact employees even when they were on public holidays or vacations, resulting in unnecessary communication. It was also difficult to grasp employees' attendance status in real time, which hindered efficient communication. Furthermore, if the person in charge of handling internal inquiries was unavailable, responses were sometimes delayed, hindering the smooth progress of business.

[0282] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0283] In this invention, the server includes a means for checking the database and acquiring each employee's work schedule and vacation information, a means for updating the status of each employee's virtual character based on the acquired data, and a means for creating a list of available employees and sending it to the terminal. This makes it possible to turn off the virtual character when an employee is on a public holiday or vacation, and to present only those who can be contacted.

[0284] A "virtual persona" is a digital avatar that reflects an employee's employment status and is a means of communicating with other employees within a virtual environment.

[0285] A "virtual environment" is a system that allows employees to communicate with each other through virtual people in a digital space.

[0286] The "generative AI model" is a system that uses artificial intelligence technology to act as a temporary responder for internal inquiries, connecting them to various responders and virtual people involved as needed.

[0287] The "server" is a computer system that manages the database, obtains each employee's work schedule and vacation information, and updates the status of the virtual characters.

[0288] A "database" is a data storage system that stores employee work schedules and vacation information and allows the server to retrieve the necessary information.

[0289] A "terminal" is a device through which a user accesses the system and checks the list of available employees.

[0290] A "user" is an individual who uses the system to view a list of available employees and make any necessary contacts.

[0291] The "list of available employees" is a list of employees who are currently available to be contacted, which is created by the server and sent to the terminal.

[0292] This invention is a system for realizing efficient internal communication using virtual characters that reflect the employment status of employees. A specific embodiment of this system will be described below.

[0293] Server Roles

[0294] The server uses a database management system (e.g., MySQL) to manage employee work schedules and vacation information. The server periodically checks the database to obtain the latest attendance data. Based on the obtained data, it updates the status of each employee's virtual character. Specifically, if an employee is on a public holiday or vacation, the server sets the employee's virtual character to off, and if the employee is working, it sets the character to on. Furthermore, the server creates a list of employees who can be contacted and sends it to the terminal.

[0295] Device Role

[0296] The terminal provides an interface for users to access the system. When a user accesses the system through the terminal, the terminal retrieves the latest employee attendance data from the server. Based on this data, the terminal displays a list of available employees. Specifically, the terminal sends an HTTP request to the server and receives data in JSON format. The received data is analyzed, a list of available employees is generated in HTML format, and displayed on the user's screen.

[0297] User Roles

[0298] Users access the system through their devices and check a list of available employees. If a user wants to contact a specific employee, they can confirm that the employee is not on a public holiday or vacation. This allows users to avoid unnecessary contact and communicate efficiently. Users click on the employee's name in the list to contact them via email or chat app.

[0299] Hardware and software used

[0300] Server: Database management system (e.g., MySQL), web server (e.g., Apache (registered trademark))

[0301] Device: Web browser (e.g., GOOGLE CHROME (registered trademark))

[0302] Software: Front-end frameworks (e.g., React), back-end frameworks (e.g., Node.js)

[0303] Specific examples

[0304] Example 1: When employee A is on a public holiday

[0305] The server checks the database and finds that Employee A is on a public holiday. The server turns off Employee A's virtual persona and removes Employee A from the list of available employees. When a user accesses the system through a terminal, Employee A does not appear on the list, which helps avoid unnecessary contact.

[0306] Example 2: When employee B is at work

[0307] The server checks the database and finds that employee B is at work. The server turns on the virtual persona for employee B and adds employee B to the list of available employees. When a user accesses the system through a terminal, employee B appears in the list and the user can contact employee B.

[0308] Example prompts to input to the generative AI model

[0309] "Please describe the system for tracking employee attendance and turning off virtual people on public holidays or vacations. Include names of specific hardware and software."

[0310] By inputting this prompt sentence into the generative AI model, a detailed explanation of the system can be obtained. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0311] Step 1:

[0312] The server checks the database to obtain each employee's work schedule and vacation information.

[0313] Specifically, the server executes an SQL query against the MySQL database to retrieve the latest enrollment status data.

[0314] Input: Work schedule and vacation information in the database

[0315] Output: Latest enrollment status data

[0316] Step 2:

[0317] The server updates the status of each employee's virtual person based on the acquired data.

[0318] Specifically, the server turns off the employee's virtual persona when the employee is on a public holiday or vacation, and turns it on when the employee is at work.

[0319] Input: Latest enrollment status data

[0320] Output: Updated virtual person state

[0321] Step 3:

[0322] The server creates a list of available employees and sends it to the terminal.

[0323] Specifically, the server generates information about employees who have virtual people turned on in JSON format and sends it to the terminal as an HTTP response.

[0324] Input: Updated virtual person state

[0325] Output: A list of available employees (JSON format)

[0326] Step 4:

[0327] The terminal acquires the latest employee attendance status data from the server.

[0328] Specifically, the terminal sends an HTTP request to the server and receives data in JSON format.

[0329] Input: HTTP response from the server

[0330] Output: Latest employee status data (JSON format)

[0331] Step 5:

[0332] The terminal analyzes the received data and generates a list of available employees.

[0333] Specifically, the terminal uses JavaScript (registered trademark) to analyze the JSON data and generate a list of contactable employees in HTML format.

[0334] Input: Latest employee status data (JSON format)

[0335] Output: List of available employees (HTML format)

[0336] Step 6:

[0337] The terminal displays to the user a list of available employees.

[0338] Specifically, the device uses HTML and CSS to display the list on the user's screen.

[0339] Input: List of available employees (HTML format)

[0340] Output: A list of available employees displayed on the user's screen.

[0341] Step 7:

[0342] A user accesses the system through a terminal and checks a list of employees who can be contacted.

[0343] Specifically, the user opens a web browser and accesses the system's URL.

[0344] Input: System URL

[0345] Output: Display a list of available employees

[0346] Step 8:

[0347] The user selects the employee they wish to contact from the list and makes contact.

[0348] Specifically, users click on an employee's name in the list and contact them via email or a chat app.

[0349] Input: List of available employees

[0350] Output: Contact selected employees

[0351] (Application example 3)

[0352] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0353] In traditional brick-and-mortar stores, it was difficult to grasp the employee status in real time, and there were many cases where employees on holidays or public holidays were contacted unnecessarily. In addition, there was a problem of in-house communication not being carried out smoothly, which led to a decline in work efficiency.

[0354] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative AI to act as a temporary responder for internal inquiries and connect the temporary responder to various responders and related party avatars, a means for turning off avatars on public holidays or days off and displaying only contactable people, a means for avatars to converse with each other, a means for reflecting employee attendance status in real time at physical stores and turning off the avatars of employees on days off or public holidays, and a means for displaying only contactable employees. This makes it possible to avoid unnecessary communication, smooth internal communication, and improve work efficiency.

[0355] An "employee" is someone who belongs to a company or organization and performs work.

[0356] An "avatar" is a digital character that represents an individual in a virtual reality society.

[0357] A "virtual reality society" refers to a virtual environment or space created using computer technology.

[0358] "Generative AI" refers to a system that uses artificial intelligence technology to generate data and automatically process specific tasks.

[0359] "Internal inquiries" are questions or requests that arise within a company or organization.

[0360] The "first responder" is the role that responds first to initial inquiries and problems.

[0361] A "public holiday" is a day on which employees are permitted to take time off based on law or company regulations.

[0362] "Days off" refers to days or times when an employee does not work.

[0363] "Real-time" means reflecting current events and situations immediately.

[0364] "Contactable" means that a particular person or system is able to communicate or exchange information.

[0365] "Communication" is the act of exchanging information and opinions.

[0366] "Operational efficiency" means minimizing wasted effort and time when carrying out work and maximizing results.

[0367] As an embodiment of the present invention, a system is constructed that reflects the employee status of a physical store in real time and turns off the avatar of that employee when they are off or on a public holiday. A specific embodiment of this system is shown below.

[0368] System Configuration

[0369] The system is composed of a server, employee smartphones, and a generative AI model. The server manages employee attendance data and updates it in real time. Employee smartphones are used as devices to display avatars and lists of available employees. The generative AI model acts as a first line of defense for internal inquiries, connecting them from the initial response to various responders and related party avatars.

[0370] Program processing explanation

[0371] The server manages employee attendance data in real time. Specifically, when an employee comes to work, their login information is sent from their smartphone to the server, and the server uses that information to set the employee's avatar to "on." Conversely, if an employee is on leave or a public holiday, the server sets the employee's avatar to "off."

[0372] The generative AI model accepts inquiries from employees and provides temporary responses. For example, when an employee enters a prompt such as "Show me the staff members who are currently available," the generative AI model retrieves real-time attendance data from the server and generates a list of available employees. This list is then displayed on the employee's smartphone.

[0373] Hardware and software used

[0374] Hardware: Servers, smartphones

[0375] Software: Python, JSON, generative AI models

[0376] Specific examples

[0377] For example, if a store manager wants to contact a staff member, they can use this system to check who is currently available, which helps avoid unnecessary contact with staff who are on vacation or have a public holiday.

[0378] Prompt Sentence Examples

[0379] "View currently available staff."

[0380] By inputting this prompt into a generative AI model, a list of available staff members can be obtained.

[0381] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0382] Step 1:

[0383] A user logs in to the system using a smartphone. User authentication information (user ID, password) is required as input. The server receives this authentication information and authenticates the user by checking it against the database. If authentication is successful, the user's attendance status is set to "On" and an avatar is displayed.

[0384] Step 2:

[0385] The user inputs the prompt sentence "Show me the staff who are currently available" into the generative AI model. The prompt sentence is required as input. The generative AI model parses this prompt sentence and requests a list of available staff from the server.

[0386] Step 3:

[0387] The server receives the request from the generative AI model and retrieves the current availability data from the database. It takes the request from the generative AI model as input. The server queries the database and generates a list of staff whose availability status is "on."

[0388] Step 4:

[0389] The server returns the generated list of available staff members to the generative AI model, which requires staff availability data as input. The generative AI model takes this data and generates a list in a format appropriate for the user.

[0390] Step 5:

[0391] The generative AI model sends a list of available staff members to the user's smartphone. As input, it requires the staff list received from the server. The user's smartphone receives this list and displays it on its screen.

[0392] Step 6:

[0393] The user checks the list of available staff members displayed on the smartphone screen and contacts them as necessary. The list of available staff members is required as input. Based on the list, the user can avoid unnecessary contact and communicate efficiently.

[0394] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0395] "Example 1"

[0396] One embodiment of the present invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. This system uses generative AI to act as a temporary responder for internal inquiries, connecting the temporary responder to various responders and related avatars. During public holidays or vacations, the avatars are turned off, and only contactable people are displayed. Furthermore, by combining an emotion engine, it is possible to recognize the user's emotions and change the avatar's facial expressions and behaviors accordingly. Specifically, when the user is feeling happy, the avatar will smile. Conversely, when the user is feeling angry, the avatar will display an angry expression.

[0397] "Example 2"

[0398] In another embodiment, a generative AI acts as a temporary responder, creating employee avatars to stimulate communication. In this system, an emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly. Specifically, when the user feels confused, the generative AI provides a more detailed explanation. Conversely, when the user is satisfied, the generative AI provides a concise answer.

[0399] "Example 3"

[0400] In yet another embodiment, a generative AI acts as a hub for contacts and avatar conversation partners to facilitate internal communication within a company. In this system, an emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly. Specifically, when the user is feeling impatient, the generative AI responds quickly. Conversely, when the user is relaxed, the generative AI responds slowly.

[0401] The processing flow of each embodiment will be described below.

[0402] "Example 1"

[0403] Step 1: All employees create avatars.

[0404] Step 2: Build a system for communication in the virtual reality world.

[0405] Step 3: Using generative AI, the system acts as a temporary responder for internal inquiries, and connects the temporary responder to various responders and related party avatars.

[0406] Step 4: If you are on a public holiday or vacation, your avatar will be turned off and only those who are available to contact you will be displayed.

[0407] Step 5: By combining the emotion engine, the user's emotions are recognized and the avatar's facial expressions and movements are changed accordingly.

[0408] "Example 2"

[0409] Step 1: Generative AI acts as a temporary responder.

[0410] Step 2: Create employee avatars and use them to stimulate communication.

[0411] Step 3: The emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly.

[0412] "Example 3"

[0413] Step 1: Generative AI acts as a hub for contacts and avatar conversation partners.

[0414] Step 2: Facilitate internal communication.

[0415] Step 3: The emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly.

[0416] Example 1

[0417] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0418] Conventional internal communication systems lacked contact methods that took into account employees' employment status and emotions, making efficient communication difficult. Furthermore, when responding to internal inquiries, the system was unable to quickly connect employees to the appropriate person in charge, which led to a decline in work efficiency. Furthermore, the system was unable to respond to users' emotions, which led to a decline in the quality of communication.

[0419] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0420] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative artificial intelligence to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars, a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, a means for recognizing the user's emotions using an emotion engine and changing the avatar's facial expressions and movements according to those emotions, and a means for the avatars to converse with each other. This enables efficient communication that takes into account the employment status and emotions of employees, resulting in a quick response to internal inquiries and improved communication quality.

[0421] An "avatar" is a character that represents a user in a virtual reality society and imitates the user's appearance and movements.

[0422] A "virtual reality society" is a virtual environment constructed using computer technology, where users can communicate with other users through avatars.

[0423] "Generative AI" is an AI technology that generates appropriate responses based on user input and acts as a temporary response to internal inquiries.

[0424] The "emotion engine" is a technology that recognizes emotions from the user's facial expressions and tone of voice, and changes the avatar's facial expressions and movements according to those emotions.

[0425] "Employment status" is information indicating the working status of an employee, such as whether the employee is currently working, on vacation, or on a public holiday.

[0426] "Temporary response" is the process of providing an initial response to a user inquiry and connecting the user to the appropriate person in charge or involved party.

[0427] A "contactable employee" is an employee who is currently at work and can be contacted by other employees or users.

[0428] "Expressions and movements" refer to facial expressions and body movements that the avatar shows in response to the user's emotions.

[0429] An "internal inquiry" is an inquiry made by an employee seeking information or support related to their work.

[0430] "Communication activation" refers to activities aimed at facilitating information exchange and communication between employees and improving work efficiency.

[0431] MODE FOR CARRYING OUT THE INVENTION

[0432] This invention relates to a system in which all employees create avatars and communicate with each other in a virtual reality world. A specific embodiment of this system will be described below.

[0433] 1. Generate the system program

[0434] The server generates a program that allows all employees to create avatars and communicate with each other in the virtual reality world. This program allows each employee to create their own avatar and communicate with other employees through that avatar.

[0435] 2. Explain the program's processing in natural language

[0436] The server processes and calculates data using the following hardware and software.

[0437] Hardware: High-performance servers, VR headsets, PCs

[0438] Software: Unity (building virtual reality environments), Emotion AI (emotion engine), generative AI model (temporary response to internal inquiries)

[0439] The server first retrieves the employee's status (working, vacation, public holiday, etc.) from the database and displays the avatars of available employees accordingly. For example, if employee A is on vacation, his avatar will be turned off and he will not appear in the list of available employees.

[0440] Next, the generative AI model is used to temporarily respond to internal inquiries. When a user makes an inquiry, the generative AI model analyzes the content and connects them to the avatar of the appropriate person to respond or the relevant person. For example, if a user makes an inquiry such as "I would like to know the progress of Project X," the generative AI model will connect them to the avatar of the person in charge of Project X.

[0441] Furthermore, by combining it with an emotion engine, the system can recognize the user's emotions and change the avatar's facial expressions and movements accordingly. For example, when the user is feeling happy, the avatar will show a smile. Conversely, when the user is feeling angry, the avatar will show an angry expression.

[0442] 3. Add examples to your description

[0443] As a concrete example, consider the following scenario.

[0444] Scenario 1: Employee B is at work and the user requests, "Please send me the materials for today's meeting." In this case, the generative AI model connects to Employee B's avatar, and Employee B sends the materials.

[0445] Scenario 2: Employee C is on vacation, and the user asks, "I want to know the progress of Project Y." In this case, the generative AI model recognizes that Employee C's avatar is off, and connects them to the avatar of another person in charge of Project Y instead.

[0446] Examples of prompts to be input to a generative AI model include:

[0447] "Please tell me the progress of Project X."

[0448] "Please send me the materials for today's meeting."

[0449] "Please check if employee A is on vacation."

[0450] This allows the user to efficiently obtain the necessary information.

[0451] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0452] Step 1:

[0453] A user logs in to the system.

[0454] The user opens the system's login screen using a terminal (PC or smartphone) and enters their employee ID and password. When they click the login button, the server performs authentication and logs the user into the system. The input is the employee ID and password, and the output is the authentication result. The server references the authentication database and verifies whether the entered information is correct.

[0455] Step 2:

[0456] The user creates and configures an avatar.

[0457] After logging in, users create and configure their own avatars. They can customize the avatar's appearance, clothing, accessories, etc. The input is the user's customization selection, and the output is the customized avatar data. The server uses Unity to generate a 3D model of the avatar and customizes the avatar based on the user's selection.

[0458] Step 3:

[0459] The server obtains the employee's employment status.

[0460] The server retrieves the attendance status (working, vacation, public holidays, etc.) of all employees from the database. The input is a database query, and the output is attendance status data. The server periodically queries the database to retrieve the latest attendance status.

[0461] Step 4:

[0462] The server presents avatars of available employees.

[0463] When a user logs in to the system, the server displays the avatars of available employees on the user's screen. The input is the employee status data, and the output is a list of available employees. The server filters the available employee avatars based on the acquired employee status and displays them on the user's terminal.

[0464] Step 5:

[0465] The user makes a query.

[0466] A user makes an inquiry within the system. For example, they enter a prompt such as "Please tell me the progress of project X." The input is the prompt, and the output is the inquiry. The user enters the prompt into the inquiry form and clicks the submit button.

[0467] Step 6:

[0468] A generative AI model analyzes the query.

[0469] The server uses a generative AI model to analyze the user's inquiry. The input is the inquiry and the output is the analysis result. The generative AI model analyzes the inquiry using natural language processing technology and identifies the appropriate person to respond.

[0470] Step 7:

[0471] A generative AI model connects you to the appropriate responder avatar.

[0472] The generative AI model connects to the appropriate responder avatar based on the analysis results. The input is the analysis results, and the output is the responder avatar. The generative AI model connects to the identified responder avatar and displays a message to the user saying, "You will be connected to the person in charge of Project X."

[0473] Step 8:

[0474] The emotion engine recognizes the user's emotions.

[0475] The server uses an emotion engine to recognize the user's emotions. The input is the user's facial expression and tone of voice, and the output is emotion data. The emotion engine analyzes the user's facial expression and tone of voice to recognize whether the user is happy or angry.

[0476] Step 9:

[0477] The avatar changes its facial expressions and movements depending on the user's emotions.

[0478] The server changes the avatar's facial expressions and movements based on the analysis results of the emotion engine. The input is emotion data, and the output is the changed avatar's facial expressions and movements. For example, if the user is happy, the avatar will smile and wave. Conversely, if the user is angry, the avatar will show an angry expression and fold its arms.

[0479] (Application example 1)

[0480] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0481] In conventional communication systems for virtual reality, it was difficult to manage avatars that reflected employee status and emotions, and it was difficult to provide consistent customer service. In addition, customers in virtual stores could not receive appropriate guidance, which could lead to a decline in customer satisfaction.

[0482] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a means for all employees to create avatars and communicate in the virtual reality world; a means for using generative AI to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars; a means for the avatars to turn off during public holidays or days off and display only contactable people; a means for the avatars to converse with each other; a means for an avatar to greet a customer when they access the virtual store and guide them around the store; a means for recognizing customer emotions and responding with appropriate facial expressions and actions; a means for the generative AI to temporarily respond to customer questions and connect them to a specialized staff avatar as needed; and a means for displaying contactable staff avatars depending on the staff availability. This enables avatar management that reflects the availability and emotions of employees, enabling consistent service in customer service.

[0483] An "avatar" is a character that represents a user in a virtual reality society.

[0484] A "virtual reality society" is a virtual environment constructed using computer technology, a space in which users can act.

[0485] "Generative AI" is a type of artificial intelligence technology, a system that responds or generates appropriate responses based on user input.

[0486] A "first responder" is a system or person whose role is to provide a rapid response to initial inquiries or problems.

[0487] "Employment status" is information indicating the status of an employee, such as whether they are working, on vacation, or on public holidays.

[0488] "Emotion recognition" is a technology that determines a user's emotions from their facial expressions, voice, etc.

[0489] A "virtual store" is a store built in a virtual reality world, where users can browse and purchase products.

[0490] A "staff avatar" is an avatar of a staff member created to deal with customers in a virtual store.

[0491] "Customer satisfaction" is an indicator that shows the degree of satisfaction that customers feel with a service or product.

[0492] "Consistent service delivery" means always providing the same quality of service to customers.

[0493] A system for carrying out this invention has the following configuration: The server includes means for all employees to create avatars and communicate in a virtual reality world, means for using generative AI to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars, means for avatars to turn off on public holidays or days off and only display contactable people, means for avatars to converse with each other, means for avatars to greet customers when they access the virtual store and guide them around the store, means for recognizing customer emotions and responding with appropriate facial expressions and actions, means for generative AI to temporarily respond to customer questions and connect them to specialized staff avatars as needed, and means for displaying contactable staff avatars depending on staff availability.

[0494] Explaining the program's processing in natural language

[0495] The server first provides an interface for all employees to create their own avatars. This interface allows users to customize their own avatars and use them in a virtual reality world. 3D modeling software and avatar generation tools are used to create the avatars.

[0496] Next, the generative AI is responsible for handling internal inquiries on an interim basis. The generative AI receives inquiries from users and generates appropriate responses. In doing so, it uses natural language processing technology to understand the user's intent and provide an appropriate answer. Examples of software used include generative AI models such as GPT-3 (registered trademark) and BERT.

[0497] Furthermore, the server manages the employee attendance status and has the function of turning off the avatar when the employee is on a public holiday or vacation. This allows only employees who can be contacted to be displayed. Employee attendance status is obtained by linking with the work management system and calendar application.

[0498] In a virtual store, an avatar greets customers when they enter and guides them around the store. An emotion recognition engine is used to recognize the customer's emotions. For example, OpenCV and Emotion API can be used to determine the customer's emotions from their facial expressions and voice, and the avatar's facial expressions and movements can be changed appropriately.

[0499] When a customer asks a question, the generative AI will provide a temporary response and, if necessary, connect them to a specialized staff avatar. At this time, the AI ​​will present a contactable staff avatar depending on the staff availability, allowing customers to receive a prompt and appropriate response.

[0500] Specific examples

[0501] For example, consider a scene in which a customer visits a virtual store and is greeted by an avatar. In this scene, when the customer asks, "Tell me about our new products," the generative AI responds by saying, "Our new product is ____. If you would like more information, we will connect you to a specialized staff member." A specialized staff avatar then appears and provides a detailed explanation.

[0502] Example prompts to input to a generative AI model:

[0503] "Generate a scene where a customer visits a virtual store, is greeted by an avatar, and guides them through the store."

[0504] This prompt sentence can be used to make the generative AI model generate a scene.

[0505] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0506] Step 1:

[0507] The server provides an interface for all employees to create avatars. Users use this interface to customize their own avatars. The input includes the user's personal information and preferred designs, and the output is the generation of the user's avatar. Specific operations include creating the avatar using 3D modeling software and avatar generation tools.

[0508] Step 2:

[0509] The server uses generative AI to act as a temporary responder for internal inquiries. Upon receiving an inquiry from a user, the generative AI uses natural language processing technology to understand the user's intent and generate an appropriate response. The input contains the user's inquiry, and the output is an answer provided by the generative AI. Specifically, the response is generated using a generative AI model such as GPT-3 or BERT.

[0510] Step 3:

[0511] The server manages the employee attendance status and turns off the avatar when the employee is on a public holiday or vacation. The input includes attendance status obtained from a work management system or calendar application, and the output shows only employees who can be contacted. Specifically, the server analyzes the attendance status data and updates the avatar status.

[0512] Step 4:

[0513] When a customer accesses the virtual store, an avatar greets them and guides them around the store. The input includes the customer's access information, and the output is guidance provided by the avatar. Specifically, the avatar provides appropriate guidance based on the customer's location information and behavioral history.

[0514] Step 5:

[0515] The server recognizes the customer's emotions and responds with appropriate facial expressions and actions. The input includes the customer's facial and voice data, and the output updates the avatar's facial expressions and actions. Specifically, OpenCV and Emotion API are used to analyze emotions and change the avatar's facial expressions and actions.

[0516] Step 6:

[0517] The server uses a generative AI to temporarily respond to customer questions and connect to a specialized staff avatar if necessary. The input contains the customer's question, and the output is an answer from the generative AI or a connection to a specialized staff avatar. Specifically, the generative AI responds to the question and, if necessary, checks the availability of staff and connects.

[0518] Step 7:

[0519] The server presents contactable staff avatars according to the staff's attendance status. Staff attendance status data is included as input, and contactable staff avatars are presented as output. Specific operations include analyzing the attendance status data and listing contactable staff avatars.

[0520] Example 2

[0521] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0522] With conventional internal communication systems, there were often delays in responding to inquiries between employees, making it difficult to quickly connect inquiries to the appropriate person. Furthermore, the system was unable to respond flexibly to the user's emotions, which could result in a decline in the quality of communication. Furthermore, when employees were on vacation, they were often unable to be contacted, which led to a decline in work efficiency.

[0523] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0524] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using a generative AI model to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars, a means for analyzing the content of the inquiry and selecting an appropriate responder or related party, a means for recognizing the user's emotions using an emotion engine and adjusting the response of the generative AI model according to the emotions, a means for turning off the avatars on public holidays or days off and displaying only contactable people, and a means for the avatars to converse with each other. This enables prompt and appropriate responses to inquiries between employees, flexible responses according to the user's emotions, and improved work efficiency.

[0525] An "avatar" is a digital character that represents a user in a virtual reality world.

[0526] A "generative AI model" is an artificial intelligence system that uses natural language processing technology to analyze the content of a user's inquiry and generate an appropriate response.

[0527] An "emotion engine" is a software component that recognizes a user's emotions and adjusts the system's response accordingly.

[0528] A "virtual reality society" is a virtual space constructed using digital technology, where users communicate with each other through avatars.

[0529] The "temporary responder" is a system component that accepts inquiries from users at an early stage and transfers them to the appropriate responder or related party.

[0530] "Analysis of inquiry content" is the process of understanding the user's inquiry and selecting the appropriate person or parties to respond based on the content of the inquiry.

[0531] "A means to turn off avatars when on public holidays or vacations and display only contactable people" is a function that hides an employee's avatar when they are on vacation and displays only other employees who can be contacted.

[0532] "Means for avatars to converse with each other" refers to a function that allows avatars to communicate with each other through text or voice in a virtual reality society.

[0533] This invention is a system that uses a generative AI model to handle internal inquiries temporarily and connects them to the appropriate person or avatar of the relevant person. This system allows all employees to create avatars and contact them in a virtual reality world. It also uses an emotion engine to respond according to the user's emotions.

[0534] Hardware and software used

[0535] Hardware: Servers, terminals (PCs, smartphones)

[0536] Software: Generative AI models (e.g., GPT-4), emotion engines, avatar generation software

[0537] Specific operation of the system

[0538] 1. Receiving user inquiries

[0539] A user makes an internal inquiry using a terminal.

[0540] The terminal receives the user's input and sends the query to the server.

[0541] The server receives the query and sends it to the generative AI model.

[0542] Examples:

[0543] User types, "How's project X going?"

[0544] The terminal sends this input to the server.

[0545] The server passes the query to the generative AI model.

[0546] 2. Analysis of inquiry content

[0547] The server has the generated AI model analyze the query content.

[0548] The generative AI model analyzes the inquiry content and selects the appropriate responder or relevant parties.

[0549] Examples:

[0550] A generative AI model analyzes the query, "What's the progress on project X?"

[0551] The generative AI model determines that the project manager is the appropriate responder.

[0552] 3. Implementing temporary measures

[0553] The generative AI model generates an initial response to the inquiry as a temporary response.

[0554] The server sends the generated initial response to the user's terminal.

[0555] Examples:

[0556] The generative AI model generates the answer, "Project X is currently at 50% progress. If you need more information, we will connect you to the project manager."

[0557] The server sends this response to the user's terminal.

[0558] 4. Transferring inquiries to an avatar

[0559] The server routes the query to the appropriate responder or avatar of the person involved.

[0560] The avatar begins communicating with the user.

[0561] Examples:

[0562] The server forwards the query to the project manager's avatar.

[0563] The avatar responds to the user, "Hello, this is your project manager avatar. What information would you like to share?"

[0564] 5. Emotional engine for response adjustment

[0565] The emotion engine recognizes the user's emotions and adjusts the generative AI model's response.

[0566] The generative AI model responds appropriately to the user based on feedback from the emotion engine.

[0567] Examples:

[0568] The emotion engine recognizes the user's confusion.

[0569] The generative AI model provides a detailed explanation, saying, "Here's some more information about this problem..."

[0570] Prompt Sentence Examples

[0571] "Please tell me the progress of Project X."

[0572] "Please tell me more about this issue."

[0573] The above is an embodiment of the present invention. This system is expected to improve work efficiency by enabling employees to respond to inquiries quickly and appropriately and by enabling flexible responses that reflect the user's emotions.

[0574] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0575] Step 1:

[0576] Receiving user inquiries

[0577] A user makes an internal inquiry using a terminal.

[0578] Input: The query the user types into the device (e.g., "How's project X progressing?").

[0579] The terminal receives the user's input and sends the query to the server.

[0580] Output: The query sent to the server.

[0581] What happens: The user types "How's project X going?" into the terminal, and the terminal sends this input to the server.

[0582] Step 2:

[0583] Analysis of inquiry content

[0584] The server sends the query to the generative AI model.

[0585] Input: The query sent to the server.

[0586] The generative AI model analyzes the inquiry content and selects the appropriate responder or relevant parties.

[0587] Output: Information for appropriate responders and stakeholders.

[0588] How it works: A generative AI model analyzes the query "What's the progress on project X?" and determines that the project manager is the appropriate person to respond.

[0589] Step 3:

[0590] Temporary measures implemented

[0591] The generative AI model generates an initial response to the inquiry as a temporary response.

[0592] Input: Parsed inquiry details and appropriate responder information.

[0593] The server sends the generated initial response to the user's terminal.

[0594] Output: The initial answer sent to the user's device.

[0595] Specific operation: The generative AI model generates a response such as "Project X is currently at 50% progress. If you need more information, we will connect you to the project manager." The server then sends this response to the user's device.

[0596] Step 4:

[0597] Call forwarding to an avatar

[0598] The server routes the query to the appropriate responder or avatar of the person involved.

[0599] Input: Initial response and appropriate responder information.

[0600] The avatar begins communicating with the user.

[0601] Output: Initiation of communication between avatar and user.

[0602] What happens: The server forwards the query to the project manager avatar, who responds to the user with "Hello, this is the project manager avatar. What information do you need?"

[0603] Step 5:

[0604] Emotion engine for response adjustment

[0605] The emotion engine recognizes the user's emotions and adjusts the generative AI model's response.

[0606] Input: User emotion data.

[0607] The generative AI model responds appropriately to the user based on feedback from the emotion engine.

[0608] Output: The adjusted response.

[0609] What it does: The emotion engine recognizes the user's confusion, and the generative AI model provides a detailed explanation: "For this issue, here's more information..."

[0610] (Application example 2)

[0611] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0612] Conventional in-house inquiry response systems often have delays in contacting the appropriate person depending on the content of the inquiry, and are unable to respond to the emotions of workers, making it difficult to ensure smooth communication. In particular, when responding to inquiries within a factory, a quick and appropriate response is required, so solving these issues is important.

[0613] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0614] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative AI to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for turning off the avatars during public holidays or days off and displaying only those who can be contacted, a means for the avatars to converse with each other, a means for recognizing the user's emotions using an emotion recognition engine and adjusting the generative AI's response according to those emotions, and a means for accepting inquiries from workers in the factory and connecting them to the appropriate responder or related party avatar. This enables quick and appropriate responses and allows responses according to the workers' emotions, thereby facilitating smooth communication.

[0615] An "avatar" is a character that represents a user in a virtual reality world.

[0616] "Generative AI" is a system that uses artificial intelligence technology to generate answers to user inquiries.

[0617] An "emotion recognition engine" is a technology that analyzes a user's emotions and responds appropriately based on those emotions.

[0618] A "virtual reality society" is a virtual environment constructed using computer technology, in which users can communicate with each other through avatars.

[0619] The "temporary responder" is a system that accepts inquiries at an early stage and connects them to the appropriate responders or relevant parties.

[0620] A "responder" is a person or system that provides appropriate answers or support for a specific inquiry.

[0621] A "participant" is a person or system that provides information or support related to a particular inquiry.

[0622] "Factory workers" are employees who work in the factory and are the subjects making inquiries.

[0623] An "Inquiry" is a question or request made by a User seeking specific information or support.

[0624] "Public holidays and days off" refer to days and times when employees do not work.

[0625] A "contactable person" is someone who is currently working and available to respond to inquiries.

[0626] The system for implementing this invention is configured as follows: First, all employees are provided with a means to create avatars and communicate with each other in a virtual reality world, allowing employees to communicate with each other in a virtual space.

[0627] Next, we provide a means to use generative AI to temporarily handle internal inquiries. This generative AI accepts inquiries from employees, analyzes their content, and connects them to the appropriate person or avatar of the relevant person. Furthermore, we also include a means to turn off the avatar on public holidays or vacations, and only display people who can be contacted.

[0628] It also provides a way to recognize user emotions using an emotion recognition engine and adjust the generative AI's response accordingly, so that it can provide detailed explanations if the user is confused, or succinct answers if the user is satisfied.

[0629] It also includes a means of accepting inquiries from workers in the factory and connecting them to the appropriate person or avatar of the relevant person, enabling prompt and appropriate responses within the factory.

[0630] A specific example of such a system is shown below. The server implements a generative AI model using the OpenAI API and an emotion recognition engine using EmotionRecognizer. Robot terminals in the factory accept inquiries from workers and send them to the server. The server analyzes the content of the inquiry and connects it to the appropriate person or avatar of the relevant person.

[0631] For example, if a worker asks, "My machine has stopped working. What should I do?", the emotion recognition engine will recognize the "confusion" and the generative AI will provide a detailed explanation. The inquiry will then be connected to a technician avatar.

[0632] An example of a prompt is as follows:

[0633] Employee question: My machine has stopped working. What should I do?

[0634] Emotion: Confused

[0635] Generate a response that connects you to the right person.

[0636] In this way, the system can provide a quick and appropriate response and respond according to the emotions of the workers, which will improve communication within the factory.

[0637] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0638] Step 1:

[0639] A user inputs a query through a terminal.

[0640] Input: User query text

[0641] Output: The query text is sent to the server

[0642] Specific operation: When the user enters the query content in the input field of the terminal and presses the send button, the query text is sent to the server.

[0643] Step 2:

[0644] The server receives the query text and analyzes the user's emotions using an emotion recognition engine.

[0645] Input: Query text

[0646] Output: User emotion (e.g., confusion, satisfaction)

[0647] Specific operation: The server uses EmotionRecognizer to analyze the user's emotions from the query text and obtains the results.

[0648] Step 3:

[0649] The server uses a generative AI model to generate a temporary response based on the inquiry content.

[0650] Input: query text, user sentiment

[0651] Output: Answer text generated by generative AI

[0652] Specific operation: The server uses the OpenAI API to input the query text and the user's emotions as prompts into the generative AI model and generate an appropriate answer.

[0653] Step 4:

[0654] The server selects an appropriate responder or avatar of a related person based on the content of the inquiry.

[0655] Input: Query text

[0656] Output: Avatar information of appropriate responders and related parties

[0657] Specific operation: The server analyzes the content of the inquiry and selects the appropriate responder or avatar of the person involved based on pre-set rules.

[0658] Step 5:

[0659] The server sends the answer text generated by the generative AI and avatar information of the appropriate responder and related parties to the user's device.

[0660] Input: Answer text generated by generative AI, avatar information of appropriate responders and related parties

[0661] Output: Answer text and avatar information displayed on the user's device

[0662] Specific operation: The server sends the generated answer text and the selected avatar information to the user's terminal and displays them on the user's screen.

[0663] Step 6:

[0664] The user checks the displayed answer text and avatar information, and starts a conversation with the avatar if necessary.

[0665] Input: Answer text, avatar information

[0666] Output: User action (e.g., starting a conversation with an avatar)

[0667] Specific operation: The user checks the answer text and avatar information displayed on the terminal, and presses a button to start a conversation with the avatar if necessary.

[0668] In this way, the system can provide a quick and appropriate response to the user's inquiry and respond in accordance with the user's feelings.

[0669] Example 3

[0670] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0671] In conventional internal communication systems, there was a problem that the display control of avatars according to the employee's attendance status was insufficient, resulting in unnecessary contact with employees on public holidays or days off. There was also an issue that the system could not respond according to the user's emotions, making it difficult to facilitate smooth communication.

[0672] The identification process by the identification processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes a means for an employee to create an avatar and communicate in a virtual reality world, a means for using a generative AI to act as a temporary responder for internal inquiries and for connecting the temporary responder to various responders and related party avatars, a means for turning off the avatar in the event of a public holiday or vacation and displaying only those who can be contacted, a means for recognizing the user's emotions using an emotion engine and adjusting the generative AI's response according to the emotion, and a means for the avatars to converse with each other. This makes it possible to control the display of avatars according to the employee's employment status, avoiding unnecessary communications and enabling appropriate responses according to the user's emotions.

[0673] An "employee" is an individual who belongs to a company or organization and performs work for that company or organization.

[0674] An "avatar" is a digital character that represents an individual in a virtual reality society.

[0675] A "virtual reality society" is a virtual environment constructed using computer technology, and is a space in which users can act.

[0676] "Generative AI" is a system that uses artificial intelligence technology to generate appropriate responses and responses based on user input.

[0677] "Internal inquiries" refer to various questions and requests that arise within a company or organization.

[0678] A "first responder" is a system or individual whose role is to respond first to an initial inquiry or request.

[0679] "Various responders" are employees or systems that provide specialized responses to specific inquiries or requests.

[0680] "Stakeholder avatars" are digital characters that represent employees involved in a particular task or project.

[0681] A "public holiday" is a day off designated by a company or organization on which employees do not work.

[0682] A "day off" is a day when an employee does not work for personal reasons.

[0683] An "emotion engine" is a technology that recognizes a user's emotions and responds appropriately based on those emotions.

[0684] A "user" is an individual who uses the system.

[0685] "Adjusting the response" refers to changing the system's response or behavior depending on the user's situation and emotions.

[0686] "Having a conversation" refers to multiple avatars exchanging information and communicating with each other.

[0687] This invention is a system that controls the display of avatars based on employee status and displays only available employees. In addition, generative AI functions as a hub between contacts and avatar conversation partners, facilitating communication within the company.

[0688] Hardware and software used

[0689] Server: Database server (e.g. MySQL), application server (e.g. Node.js)

[0690] Device: User's PC or smartphone

[0691] Software: Generative AI models (e.g., GPT-4), emotion engines (e.g., Affectiva)

[0692] Data processing and calculation

[0693] 1. Reflection of employee enrollment status

[0694] The server periodically retrieves employee employment status data from the database.

[0695] The terminal provides an interface for the user to input their employment status, for example, by displaying a drop-down menu from which the user can select "public holiday" or "day off."

[0696] The user inputs his / her employment status through the terminal.

[0697] 2. Update the avatar display state

[0698] The server updates the display status of each employee's avatar based on the acquired employment status data.

[0699] The server turns off the avatars of employees who are on public holidays or days off. For example, if employee A is on public holiday, the avatar of employee A will be set to "offline."

[0700] The terminal displays the updated avatar status to the user in real time.

[0701] 3. Generate a list of employees who can be contacted

[0702] The server generates a list of employees who can be contacted based on the employment status data.

[0703] The server retrieves information about the employees included in the list (e.g., name, title, contact information) from a database.

[0704] The terminal displays the generated list to the user. For example, when the user clicks on "List of Contactable Employees," a list of employees who can be contacted is displayed.

[0705] 4. User Emotion Recognition Using Generative AI

[0706] The user sends a message to the generative AI through the device, for example, typing, "I have an urgent matter."

[0707] The terminal sends the user's message to the server.

[0708] The server uses an emotion engine to recognize the user's emotions, for example, detecting "impatience" from the user's message.

[0709] 5. Adjustments to generative AI

[0710] The server adjusts the response of the generative AI based on the results of the emotion engine.

[0711] The generative AI responds appropriately depending on the user's emotions. For example, if the user is feeling impatient, the generative AI will quickly respond by saying, "We will respond immediately."

[0712] The device displays the generative AI's response to the user.

[0713] Specific examples

[0714] Reflection of employee enrollment status

[0715] Example: The server retrieves the attendance status of all employees from the database every morning at 9:00. The user enters his / her attendance status as "office leave" into the terminal.

[0716] Update the avatar display state

[0717] Example: The server confirms that employee A's attendance status is "official holiday" and sets employee A's avatar to offline. The device displays to the user that employee A's avatar is offline.

[0718] Generate a list of available employees

[0719] Example: The server retrieves information about current employees B and C from the database and generates a list of available employees. When the user clicks on "List of available employees," the terminal displays the information about employees B and C.

[0720] Recognizing user emotions using generative AI

[0721] Example: A user types "I have an urgent matter" into a terminal and sends it. The server uses an emotion engine to detect "impatience" from the user's message.

[0722] Generative AI adjustments

[0723] Example: Based on the results of the emotion engine, the server instructs the generative AI to respond quickly. The generative AI responds, "We will respond immediately," and the device displays that response to the user.

[0724] Prompt Sentence Examples

[0725] "Please explain the system that reflects employee status and displays only those employees who are available for contact."

[0726] "Please give us a concrete example of a system in which generative AI adjusts its response according to the user's emotions." The flow of the specific processing in Example 3 will be explained with reference to FIG. 21.

[0727] Step 1: Obtain employee status data

[0728] The server periodically retrieves employee attendance status data from the database, executing a database query as input and obtaining employee attendance status data as output.

[0729] Specific operation: The server executes the query "SELECT FROM Attendance Status" every morning at 9:00 and retrieves the attendance status data of all employees.

[0730] Step 2: Enter your enrollment status

[0731] The terminal provides an interface for the user to input the employment status, where the user selects the employment status as input, and transmits the information to the server as output.

[0732] Specific operation: The user selects "Public Holiday" or "Day Off" from the drop-down menu on the device and clicks the send button.

[0733] Step 3: Update the avatar's appearance

[0734] The server updates the display state of each employee's avatar based on the acquired attendance status data. It receives the attendance status data as input and sets the display state of the avatar as output.

[0735] Specific operation: The server confirms that employee A's attendance status is "office leave" and sets employee A's avatar to "offline."

[0736] Step 4: Generate a list of available employees

[0737] The server generates a list of available employees based on the employment status data. The server receives the employment status data as input and generates a list of available employees as output.

[0738] Specific operation: The server retrieves information on current employees B and C from the database and generates a list of employees who can be contacted.

[0739] Step 5: View a list of available employees

[0740] The terminal displays the generated list to the user, receives the list of available employees received from the server as input, and displays the list to the user as output.

[0741] Specific operation: When the user clicks on "List of contactable employees", the terminal displays information about employees B and C.

[0742] Step 6: Recognizing user emotions using generative AI

[0743] The user sends a message to the generative AI through the terminal. The AI ​​receives the user's message as input and sends it to the server as output.

[0744] The server uses an emotion engine to recognize the user's emotion, receiving the user's message as input and obtaining the emotion recognition result as output.

[0745] Specific operation: The user types "I have an urgent matter to discuss" and sends it. The server uses the emotion engine to detect "impatience" from the user's message.

[0746] Step 7: Adjusting the generative AI

[0747] The server adjusts the generative AI's response based on the results of the emotion engine. It receives emotion recognition results as input and generates the generative AI's response as output.

[0748] Generative AI responds appropriately to the user's emotions. It receives emotion recognition results as input and generates an appropriate response as output.

[0749] Specific operation: Based on the results of the emotion engine, the server instructs the generative AI to respond quickly. The generative AI responds, "We will respond immediately," and the device displays the response to the user.

[0750] (Application example 3)

[0751] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0752] With conventional internal communication systems, it was difficult to grasp employee attendance status in real time, resulting in frequent unnecessary communication. Furthermore, communication sometimes did not proceed smoothly because the system was unable to respond to the user's emotions. Furthermore, there was a lack of efficient means for factory robots to communicate with employees. A new system that could solve these issues was needed.

[0753] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0754] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world; a means for using generative AI to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars; a means for turning off the avatars during public holidays or days off and displaying only those who can be contacted; a means for recognizing the user's emotions using an emotion recognition engine and adjusting the generative AI's response according to those emotions; and a means for a robot in the factory to grasp employee status in real time and efficiently communicate as needed. This makes it possible to grasp employee status in real time, avoid unnecessary communication, and respond according to the user's emotions, resulting in smoother communication. It also enables the robot in the factory to efficiently communicate with employees.

[0755] An "avatar" is a digital character that represents a user in a virtual reality world.

[0756] "Generative AI" is artificial intelligence that generates appropriate responses based on user input.

[0757] An "emotion recognition engine" is software that analyzes a user's emotions and responds accordingly.

[0758] A "virtual reality society" is a virtual communication space constructed using digital technology.

[0759] The "first responder" is a system that responds quickly to initial inquiries and problems and transfers them to the appropriate person as needed.

[0760] "Employment status" is information indicating the working status of an employee, such as whether the employee is currently working or on vacation.

[0761] A "factory robot" is an automated machine that performs work in a factory.

[0762] "Real-time" means that information is processed immediately, without delay.

[0763] "Efficient means" are methods that eliminate waste and achieve maximum effect with minimum resources.

[0764] "Means for facilitating communication" are methods for smoothly transmitting information and communicating with others.

[0765] A system for carrying out this invention has the following configuration: The server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative AI to temporarily respond to internal inquiries and for the temporary response to connect to various responders and related party avatars, a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, a means for recognizing the user's emotions using an emotion recognition engine and adjusting the generative AI's response according to those emotions, and a means for a robot in the factory to grasp the employee status in real time and efficiently make necessary contact.

[0766] Hardware and software used

[0767] Hardware: Factory robots, microphones, cameras

[0768] Software: EmotionEngine (emotion recognition engine), AIChatbot (generative AI chatbot)

[0769] Data processing and calculation flow

[0770] The server first creates avatars for all employees and provides an environment for communication in a virtual reality world. The generative AI acts as a temporary contact point for internal inquiries, quickly responding to initial inquiries and problems. If necessary, it transfers the work to the appropriate person or avatar of the relevant person.

[0771] In the case of public holidays or days off, the server turns off the employee's avatar and displays only available employees, thereby avoiding unnecessary contact.

[0772] The emotion recognition engine analyzes the user's input and recognizes their emotion. For example, if the user says, "I'm worried about the production schedule," the emotion recognition engine recognizes "worried." The generative AI generates an appropriate response based on this emotion. For example, it responds, "Don't worry. The production schedule is going well."

[0773] Robots in factories can track employee status in real time and efficiently communicate as needed. For example, if a robot asks, "Please tell me who the current employees are," the server will respond, "Alice is currently employed."

[0774] Examples of specific examples and prompts

[0775] For example, if a robot in a factory asks, "Is Alice working here now?", the robot will respond, "Yes, Alice is working here." If a user says, "I'm worried about the production schedule," the robot's emotion engine will recognize the word "worry," and the generative AI will respond, "Don't worry. The production schedule is going smoothly."

[0776] An example of a prompt is as follows:

[0777] Please tell us about your current employees.

[0778] "I'm worried about the production schedule. What should I do?"

[0779] In this way, it is possible to grasp the employee status in real time, avoid unnecessary contact, and respond according to the user's feelings, which makes communication smoother. It also enables robots in factories to communicate with employees efficiently.

[0780] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0781] Step 1:

[0782] The server creates avatars for all employees. It receives profile information provided by users as input and generates avatars based on that information. The generated avatars are then used in the virtual reality world.

[0783] Step 2:

[0784] The server uses generative AI to act as a first line of defense for internal inquiries. It receives user inquiries as input and the generative AI responds by providing appropriate information based on the inquiry content, for example.

[0785] Step 3:

[0786] The server connects the initial response to various responders and related party avatars. If the generative AI cannot respond, it passes the inquiry on to the appropriate person's avatar. This ensures that the user's inquiry is delivered to the appropriate person.

[0787] Step 4:

[0788] The server turns off the avatars for public holidays and holidays, and only displays contactable people. It receives employee attendance data as input and turns off the avatars of employees who are on vacation. This helps avoid unnecessary contact.

[0789] Step 5:

[0790] The server uses an emotion recognition engine to recognize the user's emotions. The user's input (text or voice) is input to the emotion recognition engine, and emotion data is output. For example, emotions such as "worried" or "relaxed" are recognized.

[0791] Step 6:

[0792] The server adjusts the generative AI's response based on the user's emotions. The generative AI receives emotional data from the emotion recognition engine as input and generates an appropriate response. For example, if the user is "worried," it responds quickly.

[0793] Step 7:

[0794] The robots in the factory grasp the employee status in real time. They receive the employee status data as input from the server and efficiently communicate the necessary information. For example, in response to a query such as "Please tell me who the current employees are," they output a list of the current employees.

[0795] Step 8:

[0796] The user makes a query to the robot. For example, they provide a prompt sentence such as "I'm worried about the production schedule" as input. The robot uses an emotion recognition engine to recognize the "worry," and the generative AI outputs a response such as "Don't worry. The production schedule is going smoothly."

[0797] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0798] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0799] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0800] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0801] [Second embodiment]

[0802] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0803] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0804] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0805] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0806] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0807] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0808] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0809] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0810] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0811] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0812] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0813] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0814] "Example 1"

[0815] The present invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. Specifically, each employee creates their own avatar and communicates with other employees through that avatar. The avatar reflects the employee's employment status (working, vacation, public holidays, etc.) and presents employees who can be contacted accordingly.

[0816] "Example 2"

[0817] The present invention is a system that uses generative AI to temporarily handle internal inquiries and then connects them to various responders and related party avatars. Specifically, the generative AI temporarily receives inquiries from employees and connects them to the appropriate responders and related party avatars. This generative AI has the ability to understand the content of employees' inquiries and select the appropriate responders and related parties.

[0818] "Example 3"

[0819] The present invention is a system that turns off the avatar when an employee is on a public holiday or vacation, and displays only those who can be contacted. Specifically, an employee's avatar reflects the employee's employment status, and the avatar turns off when the employee is on a public holiday or vacation. In this case, only those employees who can be contacted are displayed, preventing unnecessary contact.

[0820] The processing flow of each embodiment will be described below.

[0821] "Example 1"

[0822] Step 1: Employees create their own avatars, which reflect their employment status (working, vacation, public holidays, etc.).

[0823] Step 2: An employee communicates with another employee's avatar in the virtual reality world. The avatar reflects the employee's presence status, and is turned off if the employee is on a public holiday or vacation.

[0824] Step 3: Only available employees are displayed, avoiding unnecessary contact.

[0825] "Example 2"

[0826] Step 1: The generative AI temporarily receives inquiries from employees.

[0827] Step 2: The generative AI understands the content of the inquiry and selects the appropriate responder or person involved. Step 3: The generative AI connects the inquiry to the avatar of the responder or person involved that it has selected. "Example 3"

[0828] Step 1: Employee avatars reflect their employment status, and are turned off when they are on public holidays or vacation.

[0829] Step 2: Only available employees are displayed, avoiding unnecessary contact.

[0830] Example 1

[0831] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0832] With the conventional internal communication system, communication between employees was complicated, and it was particularly difficult to confirm the employee's status and identify employees who could be contacted. In addition, when employees were on vacation or public holidays, they were often unable to be contacted, which led to a decrease in work efficiency. Furthermore, temporary responses to internal inquiries were insufficient, and a quick response was required.

[0833] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0834] In this invention, the server includes a means for displaying an avatar created for each employee in a virtual digital space, a means for acquiring the attendance status of each employee in cooperation with an attendance management system and periodically updating the display status of the avatar according to the attendance status, and a means for communicating via chat or video call between the employee corresponding to the avatar selected by the user and the user. This enables employees to communicate efficiently in a virtual reality world. The server also includes a prompt message that instructs the system to present candidate employees who can respond to the internal inquiry based on an internal inquiry input by the user and a list storing information about each employee, and a means for presenting candidate employees who can respond to the internal inquiry using a generative AI. The updating means also updates the display status of the employee's avatar to be turned off when the employee is on leave.

[0835] An "avatar" is a digital character created by a user for use in a virtual reality world.

[0836] A "virtual reality society" is a virtual environment that resembles the real world and is constructed using computer technology.

[0837] "Generative AI" is a system that uses artificial intelligence technology to provide temporary responses to user inquiries.

[0838] An "attendance management system" is software for managing employee attendance and vacation status.

[0839] A "server" is a computer system that stores and processes data on a network.

[0840] A "terminal" is a device such as a computer or smartphone that is operated by a user.

[0841] "Employment status" is information indicating whether an employee is currently working, on vacation, or on a public holiday.

[0842] "Chat" is a means of communicating in real time using text messages.

[0843] A "video call" is a means of communicating in real time using video and audio.

[0844] This invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. A specific embodiment of this system will be described below.

[0845] Creating an avatar

[0846] Users create their own avatars using a dedicated application. This application uses 3D modeling software such as Unity or Unreal Engine. Users can customize their appearance, clothing, accessories, etc. For example, when users select a hairstyle, multiple hairstyle options are displayed and can be selected by clicking.

[0847] Avatar Registration

[0848] The device sends the created avatar data to the server. The avatar data includes 3D model information, textures, and customized parameters. The server receives this data and stores it in a relational database such as MySQL (registered trademark) or PostgreSQL. For example, the avatar data is sent in JSON format, which is parsed on the server side and stored in the database.

[0849] Obtaining and updating enrollment status

[0850] The server works with an attendance management system to manage employee attendance status. The server periodically retrieves data from the attendance management system via API and updates each employee's attendance status (working, vacation, public holidays, etc.). For example, the server sends an API request every morning at 9:00 to retrieve the latest attendance status data.

[0851] Show contactable employees

[0852] When a user opens the application, the device retrieves the latest attendance status data from the server. Based on this data, the device displays avatars of available employees. The user can start a chat or video call with that employee by clicking on the displayed avatar. For example, when a user opens the application, the avatars of employees currently working are displayed in a list format.

[0853] Start a conversation

[0854] The user clicks on the avatar of the employee they want to contact. The device sends the information of the avatar to the server, which starts a chat or video call session. The server returns the necessary communication information to the device, supporting real-time communication. For example, when a user clicks on the avatar of a specific employee, a chat window opens, allowing them to send a message.

[0855] Specific examples

[0856] For example, if a user wants to contact a specific employee, they open the application and search for the employee's avatar. If the employee is currently at work, the avatar will be displayed and they can click to chat or video call.

[0857] This system allows employees to communicate effectively with each other in a virtual reality world.

[0858] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0859] Step 1:

[0860] A user launches a dedicated application and creates an avatar. As input, the user selects customization options such as face shape, hairstyle, clothing, and accessories. As output, 3D model data of the customized avatar is generated. Specifically, when the user selects a hairstyle, the application applies the 3D model of the selected hairstyle to the avatar.

[0861] Step 2:

[0862] The device sends the created avatar data to the server. The input includes the avatar's 3D model data. The output is saved to the server. Specifically, the device sends the avatar data in JSON format to the server, which parses the data and stores it in a database.

[0863] Step 3:

[0864] The server works with the attendance management system to obtain employee attendance status and updates it periodically. The input includes attendance status data from the attendance management system. The output is the latest attendance status data stored on the server. Specifically, the server sends an API request every morning at 9:00 to obtain the latest attendance status data from the attendance management system.

[0865] Step 4:

[0866] When a user opens the application, the device retrieves the latest attendance status data from the server. The input includes the attendance status data from the server. The output displays the avatars of available employees. Specifically, the device sends a request to the server and displays a list of avatars of employees who are currently working based on the attendance status data received from the server. At this time, if an employee is on leave, the display status of that employee's avatar is turned off.

[0867] Step 5:

[0868] The user clicks on the avatar of the employee they want to contact. The input includes information about the avatar they clicked on. The output is the start of a chat or video call session. In concrete terms, when a user clicks on a specific employee's avatar, the device sends that information to the server, and the server returns the necessary communication information to the device. This opens a chat window, allowing them to send a message.

[0869] Furthermore, when an internal inquiry is input by a user, the server uses a prompt sentence instructing the server to present candidate employees who can handle the internal inquiry based on the input internal inquiry and a list storing information about each employee, and uses generative AI to present candidate employees who can handle the internal inquiry.The user can refer to the presented candidate employees who can handle the internal inquiry, select the employee to inquire about, and click the employee's avatar to contact them and make an inquiry. Example prompt sentence: After inputting an internal inquiry from the user and a list that stores information about each employee, you can say, "This is a list that stores an internal inquiry and information about each employee. Please provide candidates for employees who can handle this internal inquiry."

[0870] (Application example 1)

[0871] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0872] Conventional communication systems in virtual reality have had problems such as difficulty reflecting employee availability in real time and making it difficult for customers to communicate with store clerks smoothly. Furthermore, there was a lack of a way to quickly provide appropriate answers to customer questions.

[0873] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0874] In this invention, the server includes a means for all employees to create avatars and communicate in the virtual reality world, a means for using generative AI to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, a means for avatars to converse with each other, a means for customer and store clerk avatars to communicate in the virtual reality space, a means for reflecting store clerk availability in real time and notifying customers, and a means for using generative AI to perform natural language processing on customer questions and generate appropriate answers, which enables smoother communication in the virtual reality world and improved customer service.

[0875] An "avatar" is a digital character that represents a user in a virtual reality society.

[0876] A "virtual reality society" is a virtual environment constructed using computer technology, a space in which users can engage in activities and communicate.

[0877] "Generative AI" is a system that uses artificial intelligence technology to generate data and automatically process specific tasks.

[0878] A "first responder" is a system or person who acts to quickly respond to initial inquiries or problems and transfers them to the appropriate personnel as needed.

[0879] "Employment status" is information indicating the working status of an employee or store clerk, such as whether they are currently working or on vacation.

[0880] "Natural language processing" is the technology that enables computers to understand, generate, and respond to human language.

[0881] "Real-time" means that data and information are processed immediately and reflected without delay.

[0882] "Customer" means a user who accesses the virtual reality society to use services or products.

[0883] A "store clerk" is a user whose role is to provide information about services and products to customers in the virtual reality society.

[0884] "Communication" is the act of exchanging information and opinions, and in a virtual reality society, this is done through avatars.

[0885] A system for carrying out this invention has the following configuration: The server includes means for all employees to create avatars and communicate in a virtual reality world, means for using generative AI to temporarily respond to internal inquiries and for the temporary response to connect with various responders and related party avatars, means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, means for the avatars to converse with each other, means for customer and store clerk avatars to communicate in the virtual reality space, means for reflecting store clerk availability in real time and notifying customers, and means for using generative AI to perform natural language processing on customer questions and generate appropriate answers.

[0886] Hardware and software used

[0887] Hardware: Smartphone, head-mounted display (e.g., Oculus Quest 2)

[0888] Software: Unity (game engine), Photon (real-time communication), Azure AI (generative AI model)

[0889] Data processing and calculation

[0890] Avatar Creation

[0891] Users create their own avatar using Unity, and the avatar's design is customized based on prompts generated using Azure AI, such as:

[0892] "Female staff in their 20s, casual clothing, friendly smile"

[0893] Reflection of enrollment status

[0894] The server updates the availability status of store staff in real time and notifies customers via Photon. Availability data is obtained from the staff's work shift information and analyzed by Azure AI. For example, the following notifications are sent:

[0895] "Currently, we have three staff members on duty. The following staff members are available: Avatar 1 (Yamada-san), Avatar 2 (Sato-san), Avatar 3 (Suzuki-san)"

[0896] communication

[0897] When a customer has a question or wants to ask for advice, they connect to a store clerk avatar in real time using Photon. The store clerk avatar uses Azure AI to perform natural language processing and generate an appropriate answer to the customer's question. For example, it uses prompt sentences like the following:

[0898] "I have a question about the product you're looking for. What product are you looking for?"

[0899] In this way, smoother communication and improved customer service can be achieved in the virtual reality society.

[0900] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0901] Step 1:

[0902] Users launch Unity using a terminal and create their own avatar. As input, the user provides a prompt, and Azure AI generates an avatar design based on the prompt. As output, a customized avatar is generated.

[0903] Step 2:

[0904] The server obtains the employee's attendance status in real time. Employee work shift information is sent to the server as input. The server analyzes this information using Azure AI and generates current attendance status data as output.

[0905] Step 3:

[0906] The server notifies the customer of the attendance status data through Photon. As input, the attendance status data updated in real time is used. As output, the attendance status is displayed on the customer's device.

[0907] Step 4:

[0908] A customer uses a terminal to ask a question or ask for advice. The customer's question is entered into the terminal as input. The terminal sends this information to the server via Photon. The question arrives at the server as output.

[0909] Step 5:

[0910] The server uses Azure AI to analyze the customer's question and generate an appropriate answer. The customer's question is used as input, and the generated answer is obtained as output.

[0911] Step 6:

[0912] The server sends the generated answer to the customer's device via Photon. The generated answer is used as input. The answer is displayed on the customer's device as output.

[0913] Step 7:

[0914] Customer and store clerk avatars communicate in a virtual reality space. Avatar information of the customer and store clerk is used as input. The output is a conversation in the virtual reality space.

[0915] Example 2

[0916] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0917] With conventional internal inquiry systems, it was difficult to quickly identify and contact the appropriate person to respond to an inquiry. Furthermore, when the person in charge was unavailable, inquiries often stalled, making smooth internal communication an issue. Furthermore, there was a lack of resources to temporarily respond to inquiries, so efficient responses were required.

[0918] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0919] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using a generative AI model to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for analyzing the content of the inquiry and selecting an appropriate responder, a means for transferring the inquiry to the selected responder's avatar, a means for turning off the avatars on public holidays or days off and displaying only contactable people, and a means for the avatars to converse with each other. This enables prompt and appropriate responses to internal inquiries, facilitates internal communication, and realizes efficient resource utilization.

[0920] An "avatar" is a digital character that represents a user in a virtual reality world.

[0921] A "generative AI model" is an artificial intelligence model that uses natural language processing to generate and analyze text.

[0922] An "internal inquiry" is an inquiry made by an employee to resolve a work-related question or problem.

[0923] The "first responder" is a system or function that handles inquiries at an initial stage and transfers them to an appropriate responder.

[0924] A "responder" is an employee or department that provides appropriate answers or responses to inquiries.

[0925] "Related parties" are employees or departments that provide information or support related to the inquiry.

[0926] A "virtual reality society" is a virtual space constructed using digital technology, in which users interact through avatars.

[0927] "Query analysis" is the process of analyzing the text of a received query and understanding its content.

[0928] "Selection of the appropriate responder" is the process of identifying the most appropriate responder based on the content of the inquiry.

[0929] "Query forwarding" is the process of sending the parsed query content to the selected responder avatar.

[0930] "A means to turn off avatars on public holidays or days off and display only contactable people" is a function that hides the avatar when the person in charge is absent and displays only contactable people.

[0931] "Means for avatars to converse with each other" is a function that allows users to communicate with each other through avatars.

[0932] MODE FOR CARRYING OUT THE INVENTION

[0933] This invention is a system that uses a generative AI model to handle internal inquiries temporarily and connects the inquiries to the appropriate person or avatar of the relevant person. Specific embodiments of this system are described below.

[0934] System configuration

[0935] This system consists of three main components: a server, a terminal, and a user. The server runs a generative AI model to analyze inquiries and select a responder. The terminal is a device where users can enter inquiries and receive responses. The user is an employee who uses the system to make inquiries.

[0936] Hardware and software used

[0937] Server: A server with high-performance computing power is required. Specifically, a server equipped with a GPU to run generative AI models (e.g., OpenAI's GPT-4) is recommended.

[0938] Device: A device used by a user, such as a PC or smartphone. These devices must have an internet connection and a browser.

[0939] Generative AI model: An AI model for natural language processing. Specifically, OpenAI's GPT-4 is used.

[0940] Data processing and calculation

[0941] The server receives the inquiry sent from the device and inputs it into the generative AI model. The generative AI model analyzes the inquiry and selects an appropriate responder. The inquiry is then forwarded to the selected responder's avatar, which generates an answer. The server then sends the generated answer to the user's device.

[0942] Specific examples

[0943] Consider a case where a user makes an inquiry such as "Please tell me the procedure for starting a new project."

[0944] 1. User: Enter "How do I start a new project?" into the terminal and press the send button.

[0945] 2. Server: Receives the query and sends the prompt "Please tell me the procedure for starting a new project" to the generative AI model.

[0946] 3. Generative AI model: Analyzes the inquiry content and selects a project management department representative.

[0947] 4. Server: Transfers the inquiry to a selected project management department representative avatar.

[0948] 5. Avatar: Generate a response based on the inquiry: "To start a new project, please go to the project management section of our internal portal."

[0949] 6. Server: Sends the generated answer to the user's device.

[0950] 7. User: Check the answer on the device.

[0951] In this way, a system is realized in which the server, terminals, and users work together to provide a temporary response to internal inquiries. This system enables prompt and appropriate responses to internal inquiries, facilitating smooth internal communication and efficient resource utilization.

[0952] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0953] Program processing flow

[0954] Step 1: Receiving an inquiry

[0955] Device:

[0956] The user enters an inquiry using their own device (PC or smartphone) and presses the send button.

[0957] Input: The inquiry typed by the user (e.g., "How do I start a new project?").

[0958] Output: The query is sent to the server.

[0959] Step 2: Receiving your inquiry

[0960] server:

[0961] The server receives the inquiry sent from the terminal.

[0962] Input: The inquiry sent from the device.

[0963] Output: Prepare the received query content for input into the generative AI model.

[0964] Step 3: Analyzing the inquiry

[0965] server:

[0966] The server inputs the received inquiry content into a generative AI model and analyzes it.

[0967] Input: Received inquiry (prompt text).

[0968] Data processing: A generative AI model analyzes the inquiry content and identifies the appropriate person to respond.

[0969] Output: Analysis results and information for appropriate responders (e.g., project management personnel).

[0970] Step 4: Select the right responder

[0971] Generative AI models:

[0972] The generative AI model selects the appropriate responder based on the content of the inquiry.

[0973] Input: Analysis results of the inquiry.

[0974] Data calculation: The inquiry content is compared with a database of responders to select the most suitable responder.

[0975] Output: Information on the selected responder (e.g., project management department personnel).

[0976] Step 5: Transferring the inquiry

[0977] server:

[0978] The server forwards the query to the selected respondent's avatar.

[0979] Input: Information about the selected responder and the inquiry.

[0980] Data processing: The inquiry content is transferred to the responder's avatar in an appropriate format.

[0981] Output: The inquiry content forwarded to the responder's avatar.

[0982] Step 6: Generate an answer

[0983] Avatar:

[0984] The avatar generates an answer based on the query.

[0985] Input: The transferred inquiry.

[0986] Data calculation: Create answers by referencing pre-set answer templates and databases.

[0987] Output: The generated answer (e.g., "To start a new project, please visit the project management section of our intranet portal").

[0988] Step 7: Submit your response

[0989] server:

[0990] The server receives the response from the avatar and sends it to the user's terminal.

[0991] Input: A generated answer from the avatar.

[0992] Data processing: Send the answers to the user's device in an appropriate format.

[0993] Output: The answer sent to the user's device.

[0994] Step 8: View your answers

[0995] Device:

[0996] The user's terminal displays the response sent from the server.

[0997] Input: The answer sent by the server.

[0998] Output: The answer displayed on the user's device (e.g., "To start a new project, please visit the project management section of our internal portal.").

[0999] In this way, a system is realized in which the server, terminals, and users work together to provide a temporary response to internal inquiries.

[1000] (Application example 2)

[1001] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1002] Staff at logistics centers are required to respond to inquiries quickly and accurately, but the traditional system makes it difficult to select and contact the right person to respond, making it difficult to respond efficiently. Furthermore, there were many cases where the right person was unavailable, or it took a long time to find the right person, which caused delays in operations.

[1003] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for all employees to create avatars and communicate in a virtual reality world; a means for using a generative AI to act as a temporary responder for internal inquiries and for connecting the temporary responder to various responders and related party avatars; a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted; a means for the avatars to converse with each other; a means for logistics center staff to make inquiries using their smartphones and for the generative AI to connect the inquiries to the avatars of appropriate responders or related parties; and a means for the generative AI to generate a response based on the inquiry content and select the appropriate responder or related party. This enables inquiries to be handled quickly and accurately at the logistics center, improving work efficiency.

[1004] "All employees" refers to all employees of a company or organization.

[1005] An "avatar" refers to a digital character that represents an individual in a virtual reality society.

[1006] "Virtual reality society" refers to a virtual environment or space constructed using computer technology.

[1007] "Means of contact" refers to the methods and tools used to communicate.

[1008] "Generative AI" refers to a system that uses artificial intelligence technology to generate information and perform specific tasks.

[1009] "Internal inquiries" refer to questions or requests that arise within a company or organization.

[1010] "Temporary responder" refers to the role of responding at the initial stage.

[1011] "Various responders and parties" refers to the people and departments necessary to respond to specific inquiries or issues.

[1012] "In the case of an official holiday or leave of absence" refers to a situation in which an employee is officially on leave.

[1013] "Avatar is turned off" refers to the avatar becoming inactive in the virtual reality world.

[1014] "Contactable persons" refers to persons who are currently available and available for communication.

[1015] "Presentation means" refers to the way information is displayed or presented.

[1016] "Means for avatars to communicate with each other" refers to methods for avatars to communicate with each other in a virtual reality society.

[1017] "Logistics center" refers to a facility that stores, manages, and distributes goods.

[1018] "Staff" refers to employees working at the logistics center.

[1019] A "smartphone" refers to a mobile phone that can connect to the Internet and use applications.

[1020] "Making an inquiry" refers to the act of submitting a question or request.

[1021] "Appropriate responders and parties" refers to the people or departments best suited to a particular inquiry or issue.

[1022] "Inquiry routing" refers to the method by which an inquiry is routed to the appropriate responder or party.

[1023] "Generating a response based on the content of a query" refers to understanding the content of a query and creating a response to it.

[1024] "Means of selection" refers to the method of selecting the best option from multiple options.

[1025] As an embodiment of the present invention, a system for improving the efficiency of inquiries handled by staff at a logistics center is provided. Specific embodiments of the system are described below.

[1026] System configuration

[1027] The system consists of the following major components:

[1028] 1. Server: Hosts the generative AI model, analyzes the inquiry content, and selects the appropriate responder.

[1029] 2. Smartphone: A device used by logistics center staff to input inquiries.

[1030] 3. Avatar: A digital character that represents each employee in a virtual reality world.

[1031] 4. Communication network: Infrastructure for data communication between smartphones and servers.

[1032] Program processing

[1033] Hardware used

[1034] Smartphones: Used by logistics center staff to input inquiries.

[1035] Server: Runs the generative AI model and analyzes the query content.

[1036] Software used

[1037] OpenAI API: Uses generative AI models to generate responses based on queries.

[1038] Python: The primary programming language for programs that run on the server side.

[1039] requests library: Used to communicate between the server and the smartphone.

[1040] Data processing and calculation

[1041] 1. Entering the inquiry details: The staff member enters the inquiry details using a smartphone application.

[1042] 2. Response generation using generative AI: The server uses OpenAI's API to generate a response based on the query.

[1043] 3. Selection of appropriate responders and stakeholders: Based on the generated responses, the server selects appropriate responder and stakeholder avatars.

[1044] 4. Connect to avatar: The server sends an API request to connect to the appropriate avatar.

[1045] Specific examples

[1046] For example, if a staff member at a logistics center types, "I would like to inquire about an error in the inventory management system," the server will use generative AI to respond, "For inquiries about errors in the inventory management system, please connect to the system administrator's avatar," and connect to the system administrator's avatar.

[1047] Prompt Sentence Examples

[1048] Inquiry from logistics center staff: I would like to inquire about an error in the inventory management system.

[1049] Select the appropriate person or party and connect the inquiry to an avatar.

[1050] In this way, inquiries at the logistics center can be handled quickly and accurately, making operations more efficient.

[1051] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1052] Step 1:

[1053] The user uses a smartphone to input the inquiry. The input inquiry is sent as text data from the smartphone to the server. For example, the input data is text such as "I would like to inquire about an error in the inventory management system."

[1054] Step 2:

[1055] The server passes the received query content to the generative AI model. The generative AI model analyzes the query content and generates an appropriate response. The input data is the text of the query content, and the output data is the text of the generated response. For example, a response might be generated that reads, "Inquiries regarding errors in the inventory management system will be connected to the system administrator's avatar."

[1056] Step 3:

[1057] The server selects the appropriate responder or avatar based on the generated response. The input data is the text of the generated response, and the output data is the identification information of the selected avatar. For example, the ID of the system administrator's avatar is selected.

[1058] Step 4:

[1059] The server sends an API request to connect the query to the selected avatar. The input data is the identification information of the selected avatar, and the output data is the result of connecting to the avatar. For example, the result is that the connection to the system administrator's avatar was successful.

[1060] Step 5:

[1061] The server returns the connection result to the smartphone. The input data is the connection result to the avatar, and the output data is a connection result message to be displayed on the smartphone. For example, the message "Connected to the system administrator's avatar" is displayed on the smartphone.

[1062] Step 6:

[1063] The user starts a conversation with the selected avatar via their smartphone. The input data is the user's spoken text, and the output data is the avatar's response text. For example, if the user types "Please tell me the details of the error," the avatar will respond with "Error code 1234 has occurred."

[1064] Through the above steps, inquiries can be handled quickly and accurately at the logistics center.

[1065] Example 3

[1066] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1067] With conventional internal communication systems, it was often impossible to contact employees even when they were on public holidays or vacations, resulting in unnecessary communication. It was also difficult to grasp employees' attendance status in real time, which hindered efficient communication. Furthermore, if the person in charge of handling internal inquiries was unavailable, responses were sometimes delayed, hindering the smooth progress of business.

[1068] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1069] In this invention, the server includes a means for checking the database and acquiring each employee's work schedule and vacation information, a means for updating the status of each employee's virtual character based on the acquired data, and a means for creating a list of available employees and sending it to the terminal. This makes it possible to turn off the virtual character when an employee is on a public holiday or vacation, and to present only those who can be contacted.

[1070] A "virtual persona" is a digital avatar that reflects an employee's employment status and is a means of communicating with other employees within a virtual environment.

[1071] A "virtual environment" is a system that allows employees to communicate with each other through virtual people in a digital space.

[1072] The "generative AI model" is a system that uses artificial intelligence technology to act as a temporary responder for internal inquiries, connecting them to various responders and virtual people involved as needed.

[1073] The "server" is a computer system that manages the database, obtains each employee's work schedule and vacation information, and updates the status of the virtual characters.

[1074] A "database" is a data storage system that stores employee work schedules and vacation information and allows the server to retrieve the necessary information.

[1075] A "terminal" is a device through which a user accesses the system and checks the list of available employees.

[1076] A "user" is an individual who uses the system to view a list of available employees and make any necessary contacts.

[1077] The "list of available employees" is a list of employees who are currently available to be contacted, which is created by the server and sent to the terminal.

[1078] This invention is a system for realizing efficient internal communication using virtual characters that reflect the employment status of employees. A specific embodiment of this system will be described below.

[1079] Server Roles

[1080] The server uses a database management system (e.g., MySQL) to manage employee work schedules and vacation information. The server periodically checks the database to obtain the latest attendance data. Based on the obtained data, it updates the status of each employee's virtual character. Specifically, if an employee is on a public holiday or vacation, the server sets the employee's virtual character to off, and if the employee is working, it sets the character to on. Furthermore, the server creates a list of employees who can be contacted and sends it to the terminal.

[1081] Device Role

[1082] The terminal provides an interface for users to access the system. When a user accesses the system through the terminal, the terminal retrieves the latest employee attendance data from the server. Based on this data, the terminal displays a list of available employees. Specifically, the terminal sends an HTTP request to the server and receives data in JSON format. The received data is analyzed, a list of available employees is generated in HTML format, and displayed on the user's screen.

[1083] User Roles

[1084] Users access the system through their devices and check a list of available employees. If a user wants to contact a specific employee, they can confirm that the employee is not on a public holiday or vacation. This allows users to avoid unnecessary contact and communicate efficiently. Users click on the employee's name in the list to contact them via email or chat app.

[1085] Hardware and software used

[1086] Server: Database management system (e.g., MySQL), web server (e.g., Apache)

[1087] Device: Web browser (e.g., Google Chrome)

[1088] Software: Front-end frameworks (e.g., React), back-end frameworks (e.g., Node.js)

[1089] Specific examples

[1090] Example 1: When employee A is on a public holiday

[1091] The server checks the database and finds that Employee A is on a public holiday. The server turns off Employee A's virtual persona and removes Employee A from the list of available employees. When a user accesses the system through a terminal, Employee A does not appear on the list, which helps avoid unnecessary contact.

[1092] Example 2: When employee B is at work

[1093] The server checks the database and finds that employee B is at work. The server turns on the virtual persona for employee B and adds employee B to the list of available employees. When a user accesses the system through a terminal, employee B appears in the list and the user can contact employee B.

[1094] Example prompts to input to the generative AI model

[1095] "Please describe the system for tracking employee attendance and turning off virtual people on public holidays or vacations. Include names of specific hardware and software."

[1096] By inputting this prompt sentence into the generative AI model, a detailed explanation of the system can be obtained. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1097] Step 1:

[1098] The server checks the database to obtain each employee's work schedule and vacation information.

[1099] Specifically, the server executes an SQL query against the MySQL database to retrieve the latest enrollment status data.

[1100] Input: Work schedule and vacation information in the database

[1101] Output: Latest enrollment status data

[1102] Step 2:

[1103] The server updates the status of each employee's virtual person based on the acquired data.

[1104] Specifically, the server turns off the employee's virtual persona when the employee is on a public holiday or vacation, and turns it on when the employee is at work.

[1105] Input: Latest enrollment status data

[1106] Output: Updated virtual person state

[1107] Step 3:

[1108] The server creates a list of available employees and sends it to the terminal.

[1109] Specifically, the server generates information about employees who have virtual people turned on in JSON format and sends it to the terminal as an HTTP response.

[1110] Input: Updated virtual person state

[1111] Output: A list of available employees (JSON format)

[1112] Step 4:

[1113] The terminal acquires the latest employee attendance status data from the server.

[1114] Specifically, the terminal sends an HTTP request to the server and receives data in JSON format.

[1115] Input: HTTP response from the server

[1116] Output: Latest employee status data (JSON format)

[1117] Step 5:

[1118] The terminal analyzes the received data and generates a list of available employees.

[1119] Specifically, the device uses JavaScript to parse the JSON data and generate a list of contactable employees in HTML format.

[1120] Input: Latest employee status data (JSON format)

[1121] Output: List of available employees (HTML format)

[1122] Step 6:

[1123] The terminal displays to the user a list of available employees.

[1124] Specifically, the device uses HTML and CSS to display the list on the user's screen.

[1125] Input: List of available employees (HTML format)

[1126] Output: A list of available employees displayed on the user's screen.

[1127] Step 7:

[1128] A user accesses the system through a terminal and checks a list of employees who can be contacted.

[1129] Specifically, the user opens a web browser and accesses the system's URL.

[1130] Input: System URL

[1131] Output: Display a list of available employees

[1132] Step 8:

[1133] The user selects the employee they wish to contact from the list and makes contact.

[1134] Specifically, users click on an employee's name in the list and contact them via email or a chat app.

[1135] Input: List of available employees

[1136] Output: Contact selected employees

[1137] (Application example 3)

[1138] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1139] In traditional brick-and-mortar stores, it was difficult to grasp the employee status in real time, and there were many cases where employees on holidays or public holidays were contacted unnecessarily. In addition, there was a problem of in-house communication not being carried out smoothly, which led to a decline in work efficiency.

[1140] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative AI to act as a temporary responder for internal inquiries and connect the temporary responder to various responders and related party avatars, a means for turning off avatars on public holidays or days off and displaying only contactable people, a means for avatars to converse with each other, a means for reflecting employee attendance status in real time at physical stores and turning off the avatars of employees on days off or public holidays, and a means for displaying only contactable employees. This makes it possible to avoid unnecessary communication, smooth internal communication, and improve work efficiency.

[1141] An "employee" is someone who belongs to a company or organization and performs work.

[1142] An "avatar" is a digital character that represents an individual in a virtual reality society.

[1143] A "virtual reality society" refers to a virtual environment or space created using computer technology.

[1144] "Generative AI" refers to a system that uses artificial intelligence technology to generate data and automatically process specific tasks.

[1145] "Internal inquiries" are questions or requests that arise within a company or organization.

[1146] The "first responder" is the role that responds first to initial inquiries and problems.

[1147] A "public holiday" is a day on which employees are permitted to take time off based on law or company regulations.

[1148] "Days off" refers to days or times when an employee does not work.

[1149] "Real-time" means reflecting current events and situations immediately.

[1150] "Contactable" means that a particular person or system is able to communicate or exchange information.

[1151] "Communication" is the act of exchanging information and opinions.

[1152] "Operational efficiency" means minimizing wasted effort and time when carrying out work and maximizing results.

[1153] As an embodiment of the present invention, a system is constructed that reflects the employee status of a physical store in real time and turns off the avatar of that employee when they are off or on a public holiday. A specific embodiment of this system is shown below.

[1154] System Configuration

[1155] The system is composed of a server, employee smartphones, and a generative AI model. The server manages employee attendance data and updates it in real time. Employee smartphones are used as devices to display avatars and lists of available employees. The generative AI model acts as a first line of defense for internal inquiries, connecting them from the initial response to various responders and related party avatars.

[1156] Program processing explanation

[1157] The server manages employee attendance data in real time. Specifically, when an employee comes to work, their login information is sent from their smartphone to the server, and the server uses that information to set the employee's avatar to "on." Conversely, if an employee is on leave or a public holiday, the server sets the employee's avatar to "off."

[1158] The generative AI model accepts inquiries from employees and provides temporary responses. For example, when an employee enters a prompt such as "Show me the staff members who are currently available," the generative AI model retrieves real-time attendance data from the server and generates a list of available employees. This list is then displayed on the employee's smartphone.

[1159] Hardware and software used

[1160] Hardware: Servers, smartphones

[1161] Software: Python, JSON, generative AI models

[1162] Specific examples

[1163] For example, if a store manager wants to contact a staff member, they can use this system to check who is currently available, which helps avoid unnecessary contact with staff who are on vacation or have a public holiday.

[1164] Prompt Sentence Examples

[1165] "View currently available staff."

[1166] By inputting this prompt into a generative AI model, a list of available staff members can be obtained.

[1167] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1168] Step 1:

[1169] A user logs in to the system using a smartphone. User authentication information (user ID, password) is required as input. The server receives this authentication information and authenticates the user by checking it against the database. If authentication is successful, the user's attendance status is set to "On" and an avatar is displayed.

[1170] Step 2:

[1171] The user inputs the prompt sentence "Show me the staff who are currently available" into the generative AI model. The prompt sentence is required as input. The generative AI model parses this prompt sentence and requests a list of available staff from the server.

[1172] Step 3:

[1173] The server receives the request from the generative AI model and retrieves the current availability data from the database. It takes the request from the generative AI model as input. The server queries the database and generates a list of staff whose availability status is "on."

[1174] Step 4:

[1175] The server returns the generated list of available staff members to the generative AI model, which requires staff availability data as input. The generative AI model takes this data and generates a list in a format appropriate for the user.

[1176] Step 5:

[1177] The generative AI model sends a list of available staff members to the user's smartphone. As input, it requires the staff list received from the server. The user's smartphone receives this list and displays it on its screen.

[1178] Step 6:

[1179] The user checks the list of available staff members displayed on the smartphone screen and contacts them as necessary. The list of available staff members is required as input. Based on the list, the user can avoid unnecessary contact and communicate efficiently.

[1180] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1181] "Example 1"

[1182] One embodiment of the present invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. This system uses generative AI to act as a temporary responder for internal inquiries, connecting the temporary responder to various responders and related avatars. During public holidays or vacations, the avatars are turned off, and only contactable people are displayed. Furthermore, by combining an emotion engine, it is possible to recognize the user's emotions and change the avatar's facial expressions and behaviors accordingly. Specifically, when the user is feeling happy, the avatar will smile. Conversely, when the user is feeling angry, the avatar will display an angry expression.

[1183] "Example 2"

[1184] In another embodiment, a generative AI acts as a temporary responder, creating employee avatars to stimulate communication. In this system, an emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly. Specifically, when the user feels confused, the generative AI provides a more detailed explanation. Conversely, when the user is satisfied, the generative AI provides a concise answer.

[1185] "Example 3"

[1186] In yet another embodiment, a generative AI acts as a hub for contacts and avatar conversation partners to facilitate internal communication within a company. In this system, an emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly. Specifically, when the user is feeling impatient, the generative AI responds quickly. Conversely, when the user is relaxed, the generative AI responds slowly.

[1187] The processing flow of each embodiment will be described below.

[1188] "Example 1"

[1189] Step 1: All employees create avatars.

[1190] Step 2: Build a system for communication in the virtual reality world.

[1191] Step 3: Using generative AI, the system acts as a temporary responder for internal inquiries, and connects the temporary responder to various responders and related party avatars.

[1192] Step 4: If you are on a public holiday or vacation, your avatar will be turned off and only those who are available to contact you will be displayed.

[1193] Step 5: By combining the emotion engine, the user's emotions are recognized and the avatar's facial expressions and movements are changed accordingly.

[1194] "Example 2"

[1195] Step 1: Generative AI acts as a temporary responder.

[1196] Step 2: Create employee avatars and use them to stimulate communication.

[1197] Step 3: The emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly.

[1198] "Example 3"

[1199] Step 1: Generative AI acts as a hub for contacts and avatar conversation partners.

[1200] Step 2: Facilitate internal communication.

[1201] Step 3: The emotion engine recognizes the user's emotions and adjusts the generative AI's response accordingly.

[1202] Example 1

[1203] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1204] Conventional internal communication systems lacked contact methods that took into account employees' employment status and emotions, making efficient communication difficult. Furthermore, when responding to internal inquiries, the system was unable to quickly connect employees to the appropriate person in charge, which led to a decline in work efficiency. Furthermore, the system was unable to respond to users' emotions, which led to a decline in the quality of communication.

[1205] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1206] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative artificial intelligence to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars, a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, a means for recognizing the user's emotions using an emotion engine and changing the avatar's facial expressions and movements according to those emotions, and a means for the avatars to converse with each other. This enables efficient communication that takes into account the employment status and emotions of employees, resulting in a quick response to internal inquiries and improved communication quality.

[1207] An "avatar" is a character that represents a user in a virtual reality society and imitates the user's appearance and movements.

[1208] A "virtual reality society" is a virtual environment constructed using computer technology, where users can communicate with other users through avatars.

[1209] "Generative AI" is an AI technology that generates appropriate responses based on user input and acts as a temporary response to internal inquiries.

[1210] The "emotion engine" is a technology that recognizes emotions from the user's facial expressions and tone of voice, and changes the avatar's facial expressions and movements according to those emotions.

[1211] "Employment status" is information indicating the working status of an employee, such as whether the employee is currently working, on vacation, or on a public holiday.

[1212] "Temporary response" is the process of providing an initial response to a user inquiry and connecting the user to the appropriate person in charge or involved party.

[1213] A "contactable employee" is an employee who is currently at work and can be contacted by other employees or users.

[1214] "Expressions and movements" refer to facial expressions and body movements that the avatar shows in response to the user's emotions.

[1215] An "internal inquiry" is an inquiry made by an employee seeking information or support related to their work.

[1216] "Communication activation" refers to activities aimed at facilitating information exchange and communication between employees and improving work efficiency.

[1217] MODE FOR CARRYING OUT THE INVENTION

[1218] This invention relates to a system in which all employees create avatars and communicate with each other in a virtual reality world. A specific embodiment of this system will be described below.

[1219] 1. Generate the system program

[1220] The server generates a program that allows all employees to create avatars and communicate with each other in the virtual reality world. This program allows each employee to create their own avatar and communicate with other employees through that avatar.

[1221] 2. Explain the program's processing in natural language

[1222] The server processes and calculates data using the following hardware and software.

[1223] Hardware: High-performance servers, VR headsets, PCs

[1224] Software: Unity (building virtual reality environments), Emotion AI (emotion engine), generative AI model (temporary response to internal inquiries)

[1225] The server first retrieves the employee's status (working, vacation, public holiday, etc.) from the database and displays the avatars of available employees accordingly. For example, if employee A is on vacation, his avatar will be turned off and he will not appear in the list of available employees.

[1226] Next, the generative AI model is used to temporarily respond to internal inquiries. When a user makes an inquiry, the generative AI model analyzes the content and connects them to the avatar of the appropriate person to respond or the relevant person. For example, if a user makes an inquiry such as "I would like to know the progress of Project X," the generative AI model will connect them to the avatar of the person in charge of Project X.

[1227] Furthermore, by combining it with an emotion engine, the system can recognize the user's emotions and change the avatar's facial expressions and movements accordingly. For example, when the user is feeling happy, the avatar will show a smile. Conversely, when the user is feeling angry, the avatar will show an angry expression.

[1228] 3. Add examples to your description

[1229] As a concrete example, consider the following scenario.

[1230] Scenario 1: Employee B is at work and the user requests, "Please send me the materials for today's meeting." In this case, the generative AI model connects to Employee B's avatar, and Employee B sends the materials.

[1231] Scenario 2: Employee C is on vacation, and the user asks, "I want to know the progress of Project Y." In this case, the generative AI model recognizes that Employee C's avatar is off, and connects them to the avatar of another person in charge of Project Y instead.

[1232] Examples of prompts to be input to a generative AI model include:

[1233] "Please tell me the progress of Project X."

[1234] "Please send me the materials for today's meeting."

[1235] "Please check if employee A is on vacation."

[1236] This allows the user to efficiently obtain the necessary information.

[1237] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1238] Step 1:

[1239] A user logs in to the system.

[1240] The user opens the system's login screen using a terminal (PC or smartphone) and enters their employee ID and password. When they click the login button, the server performs authentication and logs the user into the system. The input is the employee ID and password, and the output is the authentication result. The server references the authentication database and verifies whether the entered information is correct.

[1241] Step 2:

[1242] The user creates and configures an avatar.

[1243] After logging in, users create and configure their own avatars. They can customize the avatar's appearance, clothing, accessories, etc. The input is the user's customization selection, and the output is the customized avatar data. The server uses Unity to generate a 3D model of the avatar and customizes the avatar based on the user's selection.

[1244] Step 3:

[1245] The server obtains the employee's employment status.

[1246] The server retrieves the attendance status (working, vacation, public holidays, etc.) of all employees from the database. The input is a database query, and the output is attendance status data. The server periodically queries the database to retrieve the latest attendance status.

[1247] Step 4:

[1248] The server presents avatars of available employees.

[1249] When a user logs in to the system, the server displays the avatars of available employees on the user's screen. The input is the employee status data, and the output is a list of available employees. The server filters the available employee avatars based on the acquired employee status and displays them on the user's terminal.

[1250] Step 5:

[1251] The user makes a query.

[1252] A user makes an inquiry within the system. For example, they enter a prompt such as "Please tell me the progress of project X." The input is the prompt, and the output is the inquiry. The user enters the prompt into the inquiry form and clicks the submit button.

[1253] Step 6:

[1254] A generative AI model analyzes the query.

[1255] The server uses a generative AI model to analyze the user's inquiry. The input is the inquiry and the output is the analysis result. The generative AI model analyzes the inquiry using natural language processing technology and identifies the appropriate person to respond.

[1256] Step 7:

[1257] A generative AI model connects you to the appropriate responder avatar.

[1258] The generative AI model connects to the appropriate responder avatar based on the analysis results. The input is the analysis results, and the output is the responder avatar. The generative AI model connects to the identified responder avatar and displays a message to the user saying, "You will be connected to the person in charge of Project X."

[1259] Step 8:

[1260] The emotion engine recognizes the user's emotions.

[1261] The server uses an emotion engine to recognize the user's emotions. The input is the user's facial expression and tone of voice, and the output is emotion data. The emotion engine analyzes the user's facial expression and tone of voice to recognize whether the user is happy or angry.

[1262] Step 9:

[1263] The avatar changes its facial expressions and movements depending on the user's emotions.

[1264] The server changes the avatar's facial expressions and movements based on the analysis results of the emotion engine. The input is emotion data, and the output is the changed avatar's facial expressions and movements. For example, if the user is happy, the avatar will smile and wave. Conversely, if the user is angry, the avatar will show an angry expression and fold its arms.

[1265] (Application example 1)

[1266] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1267] In conventional communication systems for virtual reality, it was difficult to manage avatars that reflected employee status and emotions, and it was difficult to provide consistent customer service. In addition, customers in virtual stores could not receive appropriate guidance, which could lead to a decline in customer satisfaction.

[1268] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a means for all employees to create avatars and communicate in the virtual reality world; a means for using generative AI to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars; a means for the avatars to turn off during public holidays or days off and display only contactable people; a means for the avatars to converse with each other; a means for an avatar to greet a customer when they access the virtual store and guide them around the store; a means for recognizing customer emotions and responding with appropriate facial expressions and actions; a means for the generative AI to temporarily respond to customer questions and connect them to a specialized staff avatar as needed; and a means for displaying contactable staff avatars depending on the staff availability. This enables avatar management that reflects the availability and emotions of employees, enabling consistent service in customer service.

[1269] An "avatar" is a character that represents a user in a virtual reality society.

[1270] A "virtual reality society" is a virtual environment constructed using computer technology, a space in which users can act.

[1271] "Generative AI" is a type of artificial intelligence technology, a system that responds or generates appropriate responses based on user input.

[1272] A "first responder" is a system or person whose role is to provide a rapid response to initial inquiries or problems.

[1273] "Employment status" is information indicating the status of an employee, such as whether they are working, on vacation, or on public holidays.

[1274] "Emotion recognition" is a technology that determines a user's emotions from their facial expressions, voice, etc.

[1275] A "virtual store" is a store built in a virtual reality world, where users can browse and purchase products.

[1276] A "staff avatar" is an avatar of a staff member created to deal with customers in a virtual store.

[1277] "Customer satisfaction" is an indicator that shows the degree of satisfaction that customers feel with a service or product.

[1278] "Consistent service delivery" means always providing the same quality of service to customers.

[1279] A system for carrying out this invention has the following configuration: The server includes means for all employees to create avatars and communicate in a virtual reality world, means for using generative AI to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars, means for avatars to turn off on public holidays or days off and only display contactable people, means for avatars to converse with each other, means for avatars to greet customers when they access the virtual store and guide them around the store, means for recognizing customer emotions and responding with appropriate facial expressions and actions, means for generative AI to temporarily respond to customer questions and connect them to specialized staff avatars as needed, and means for displaying contactable staff avatars depending on staff availability.

[1280] Explaining the program's processing in natural language

[1281] The server first provides an interface for all employees to create their own avatars. This interface allows users to customize their own avatars and use them in a virtual reality world. 3D modeling software and avatar generation tools are used to create the avatars.

[1282] Next, generative AI is responsible for handling internal inquiries. It receives inquiries from users and generates appropriate responses. It uses natural language processing technology to understand the user's intent and provide appropriate answers. Examples of software used include generative AI models such as GPT-3 and BERT.

[1283] Furthermore, the server manages the employee attendance status and has the function of turning off the avatar when the employee is on a public holiday or vacation. This allows only employees who can be contacted to be displayed. Employee attendance status is obtained by linking with the work management system and calendar application.

[1284] In a virtual store, an avatar greets customers when they enter and guides them around the store. An emotion recognition engine is used to recognize the customer's emotions. For example, OpenCV and Emotion API can be used to determine the customer's emotions from their facial expressions and voice, and the avatar's facial expressions and movements can be changed appropriately.

[1285] When a customer asks a question, the generative AI will provide a temporary response and, if necessary, connect them to a specialized staff avatar. At this time, the AI ​​will present a contactable staff avatar depending on the staff availability, allowing customers to receive a prompt and appropriate response.

[1286] Specific examples

[1287] For example, consider a scene in which a customer visits a virtual store and is greeted by an avatar. In this scene, when the customer asks, "Tell me about our new products," the generative AI responds by saying, "Our new product is ____. If you would like more information, we will connect you to a specialized staff member." A specialized staff avatar then appears and provides a detailed explanation.

[1288] Example prompts to input to a generative AI model:

[1289] "Generate a scene where a customer visits a virtual store, is greeted by an avatar, and guides them through the store."

[1290] This prompt sentence can be used to make the generative AI model generate a scene.

[1291] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1292] Step 1:

[1293] The server provides an interface for all employees to create avatars. Users use this interface to customize their own avatars. The input includes the user's personal information and preferred designs, and the output is the generation of the user's avatar. Specific operations include creating the avatar using 3D modeling software and avatar generation tools.

[1294] Step 2:

[1295] The server uses generative AI to act as a temporary responder for internal inquiries. Upon receiving an inquiry from a user, the generative AI uses natural language processing technology to understand the user's intent and generate an appropriate response. The input contains the user's inquiry, and the output is an answer provided by the generative AI. Specifically, the response is generated using a generative AI model such as GPT-3 or BERT.

[1296] Step 3:

[1297] The server manages the employee attendance status and turns off the avatar when the employee is on a public holiday or vacation. The input includes attendance status obtained from a work management system or calendar application, and the output shows only employees who can be contacted. Specifically, the server analyzes the attendance status data and updates the avatar status.

[1298] Step 4:

[1299] When a customer accesses the virtual store, an avatar greets them and guides them around the store. The input includes the customer's access information, and the output is guidance provided by the avatar. Specifically, the avatar provides appropriate guidance based on the customer's location information and behavioral history.

[1300] Step 5:

[1301] The server recognizes the customer's emotions and responds with appropriate facial expressions and actions. The input includes the customer's facial and voice data, and the output updates the avatar's facial expressions and actions. Specifically, OpenCV and Emotion API are used to analyze emotions and change the avatar's facial expressions and actions.

[1302] Step 6:

[1303] The server uses a generative AI to temporarily respond to customer questions and connect to a specialized staff avatar if necessary. The input contains the customer's question, and the output is an answer from the generative AI or a connection to a specialized staff avatar. Specifically, the generative AI responds to the question and, if necessary, checks the availability of staff and connects.

[1304] Step 7:

[1305] The server presents contactable staff avatars according to the staff's attendance status. Staff attendance status data is included as input, and contactable staff avatars are presented as output. Specific operations include analyzing the attendance status data and listing contactable staff avatars.

[1306] Example 2

[1307] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1308] With conventional internal communication systems, there were often delays in responding to inquiries between employees, making it difficult to quickly connect inquiries to the appropriate person. Furthermore, the system was unable to respond flexibly to the user's emotions, which could result in a decline in the quality of communication. Furthermore, when employees were on vacation, they were often unable to be contacted, which led to a decline in work efficiency.

[1309] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1310] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using a generative AI model to temporarily respond to internal inquiries and connect the temporary response to various responders and related party avatars, a means for analyzing the content of the inquiry and selecting an appropriate responder or related party, a means for recognizing the user's emotions using an emotion engine and adjusting the response of the generative AI model according to the emotions, a means for turning off the avatars on public holidays or days off and displaying only contactable people, and a means for the avatars to converse with each other. This enables prompt and appropriate responses to inquiries between employees, flexible responses according to the user's emotions, and improved work efficiency.

[1311] An "avatar" is a digital character that represents a user in a virtual reality world.

[1312] A "generative AI model" is an artificial intelligence system that uses natural language processing technology to analyze the content of a user's inquiry and generate an appropriate response.

[1313] An "emotion engine" is a software component that recognizes a user's emotions and adjusts the system's response accordingly.

[1314] A "virtual reality society" is a virtual space constructed using digital technology, where users communicate with each other through avatars.

[1315] The "temporary responder" is a system component that accepts inquiries from users at an early stage and transfers them to the appropriate responder or related party.

[1316] "Analysis of inquiry content" is the process of understanding the user's inquiry and selecting the appropriate person or parties to respond based on the content of the inquiry.

[1317] "A means to turn off avatars when on public holidays or vacations and display only contactable people" is a function that hides an employee's avatar when they are on vacation and displays only other employees who can be contacted.

[1318] "Means for avatars to converse with each other" refers to a function that allows avatars to communicate with each other through text or voice in a virtual reality society.

[1319] This invention is a system that uses a generative AI model to handle internal inquiries temporarily and connects them to the appropriate person or avatar of the relevant person. This system allows all employees to create avatars and contact them in a virtual reality world. It also uses an emotion engine to respond according to the user's emotions.

[1320] Hardware and software used

[1321] Hardware: Servers, terminals (PCs, smartphones)

[1322] Software: Generative AI models (e.g., GPT-4), emotion engines, avatar generation software

[1323] Specific operation of the system

[1324] 1. Receiving user inquiries

[1325] A user makes an internal inquiry using a terminal.

[1326] The terminal receives the user's input and sends the query to the server.

[1327] The server receives the query and sends it to the generative AI model.

[1328] Examples:

[1329] User types, "How's project X going?"

[1330] The terminal sends this input to the server.

[1331] The server passes the query to the generative AI model.

[1332] 2. Analysis of inquiry content

[1333] The server has the generated AI model analyze the query content.

[1334] The generative AI model analyzes the inquiry content and selects the appropriate responder or relevant parties.

[1335] Examples:

[1336] A generative AI model analyzes the query, "What's the progress on project X?"

[1337] The generative AI model determines that the project manager is the appropriate responder.

[1338] 3. Implementing temporary measures

[1339] The generative AI model generates an initial response to the inquiry as a temporary response.

[1340] The server sends the generated initial response to the user's terminal.

[1341] Examples:

[1342] The generative AI model generates the answer, "Project X is currently at 50% progress. If you need more information, we will connect you to the project manager."

[1343] The server sends this response to the user's terminal.

[1344] 4. Transferring inquiries to an avatar

[1345] The server routes the query to the appropriate responder or avatar of the person involved.

[1346] The avatar begins communicating with the user.

[1347] Examples:

[1348] The server forwards the query to the project manager's avatar.

[1349] The avatar responds to the user, "Hello, this is your project manager avatar. What information would you like to share?"

[1350] 5. Emotional engine for response adjustment

[1351] The emotion engine recognizes the user's emotions and adjusts the generative AI model's response.

[1352] The generative AI model responds appropriately to the user based on feedback from the emotion engine.

[1353] Examples:

[1354] The emotion engine recognizes the user's confusion.

[1355] The generative AI model provides a detailed explanation, saying, "Here's some more information about this problem..."

[1356] Prompt Sentence Examples

[1357] "Please tell me the progress of Project X."

[1358] "Please tell me more about this issue."

[1359] The above is an embodiment of the present invention. This system is expected to improve work efficiency by enabling employees to respond to inquiries quickly and appropriately and by enabling flexible responses that reflect the user's emotions.

[1360] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1361] Step 1:

[1362] Receiving user inquiries

[1363] A user makes an internal inquiry using a terminal.

[1364] Input: The query the user types into the device (e.g., "How's project X progressing?").

[1365] The terminal receives the user's input and sends the query to the server.

[1366] Output: The query sent to the server.

[1367] What happens: The user types "How's project X going?" into the terminal, and the terminal sends this input to the server.

[1368] Step 2:

[1369] Analysis of inquiry content

[1370] The server sends the query to the generative AI model.

[1371] Input: The query sent to the server.

[1372] The generative AI model analyzes the inquiry content and selects the appropriate responder or relevant parties.

[1373] Output: Information for appropriate responders and stakeholders.

[1374] How it works: A generative AI model analyzes the query "What's the progress on project X?" and determines that the project manager is the appropriate person to respond.

[1375] Step 3:

[1376] Temporary measures implemented

[1377] The generative AI model generates an initial response to the inquiry as a temporary response.

[1378] Input: Parsed inquiry details and appropriate responder information.

[1379] The server sends the generated initial response to the user's terminal.

[1380] Output: The initial answer sent to the user's device.

[1381] Specific operation: The generative AI model generates a response such as "Project X is currently at 50% progress. If you need more information, we will connect you to the project manager." The server then sends this response to the user's device.

[1382] Step 4:

[1383] Call forwarding to an avatar

[1384] The server routes the query to the appropriate responder or avatar of the person involved.

[1385] Input: Initial response and appropriate responder information.

[1386] The avatar begins communicating with the user.

[1387] Output: Initiation of communication between avatar and user.

[1388] What happens: The server forwards the query to the project manager avatar, who responds to the user with "Hello, this is the project manager avatar. What information do you need?"

[1389] Step 5:

[1390] Emotion engine for response adjustment

[1391] The emotion engine recognizes the user's emotions and adjusts the generative AI model's response.

[1392] Input: User emotion data.

[1393] The generative AI model responds appropriately to the user based on feedback from the emotion engine.

[1394] Output: The adjusted response.

[1395] What it does: The emotion engine recognizes the user's confusion, and the generative AI model provides a detailed explanation: "For this issue, here's more information..."

[1396] (Application example 2)

[1397] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1398] Conventional in-house inquiry response systems often have delays in contacting the appropriate person depending on the content of the inquiry, and are unable to respond to the emotions of workers, making it difficult to ensure smooth communication. In particular, when responding to inquiries within a factory, a quick and appropriate response is required, so solving these issues is important.

[1399] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1400] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative AI to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for turning off the avatars during public holidays or days off and displaying only those who can be contacted, a means for the avatars to converse with each other, a means for recognizing the user's emotions using an emotion recognition engine and adjusting the generative AI's response according to those emotions, and a means for accepting inquiries from workers in the factory and connecting them to the appropriate responder or related party avatar. This enables quick and appropriate responses and allows responses according to the workers' emotions, thereby facilitating smooth communication.

[1401] An "avatar" is a character that represents a user in a virtual reality world.

[1402] "Generative AI" is a system that uses artificial intelligence technology to generate answers to user inquiries.

[1403] An "emotion recognition engine" is a technology that analyzes a user's emotions and responds appropriately based on those emotions.

[1404] A "virtual reality society" is a virtual environment constructed using computer technology, in which users can communicate with each other through avatars.

[1405] The "temporary responder" is a system that accepts inquiries at an early stage and connects them to the appropriate responders or relevant parties.

[1406] A "responder" is a person or system that provides appropriate answers or support for a specific inquiry.

[1407] A "participant" is a person or system that provides information or support related to a particular inquiry.

[1408] "Factory workers" are employees who work in the factory and are the subjects making inquiries.

[1409] An "Inquiry" is a question or request made by a User seeking specific information or support.

[1410] "Public holidays and days off" refer to days and times when employees do not work.

[1411] A "contactable person" is someone who is currently working and available to respond to inquiries.

[1412] The system for implementing this invention is configured as follows: First, all employees are provided with a means to create avatars and communicate with each other in a virtual reality world, allowing employees to communicate with each other in a virtual space.

[1413] Next, we provide a means to use generative AI to temporarily handle internal inquiries. This generative AI accepts inquiries from employees, analyzes their content, and connects them to the appropriate person or avatar of the relevant person. Furthermore, we also include a means to turn off the avatar on public holidays or vacations, and only display people who can be contacted.

[1414] It also provides a way to recognize user emotions using an emotion recognition engine and adjust the generative AI's response accordingly, so that it can provide detailed explanations if the user is confused, or succinct answers if the user is satisfied.

[1415] It also includes a means of accepting inquiries from workers in the factory and connecting them to the appropriate person or avatar of the relevant person, enabling prompt and appropriate responses within the factory.

[1416] A specific example of such a system is shown below. The server implements a generative AI model using the OpenAI API and an emotion recognition engine using EmotionRecognizer. Robot terminals in the factory accept inquiries from workers and send them to the server. The server analyzes the content of the inquiry and connects it to the appropriate person or avatar of the relevant person.

[1417] For example, if a worker asks, "My machine has stopped working. What should I do?", the emotion recognition engine will recognize the "confusion" and the generative AI will provide a detailed explanation. The inquiry will then be connected to a technician avatar.

[1418] An example of a prompt is as follows:

[1419] Employee question: My machine has stopped working. What should I do?

[1420] Emotion: Confused

[1421] Generate a response that connects you to the right person.

[1422] In this way, the system can provide a quick and appropriate response and respond according to the emotions of the workers, which will improve communication within the factory.

[1423] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1424] Step 1:

[1425] A user inputs a query through a terminal.

[1426] Input: User query text

[1427] Output: The query text is sent to the server

[1428] Specific operation: When the user enters the query content in the input field of the terminal and presses the send button, the query text is sent to the server.

[1429] Step 2:

[1430] The server receives the query text and analyzes the user's emotions using an emotion recognition engine.

[1431] Input: Query text

[1432] Output: User emotion (e.g., confusion, satisfaction)

[1433] Specific operation: The server uses EmotionRecognizer to analyze the user's emotions from the query text and obtains the results.

[1434] Step 3:

[1435] The server uses a generative AI model to generate a temporary response based on the inquiry content.

[1436] Input: query text, user sentiment

[1437] Output: Answer text generated by generative AI

[1438] Specific operation: The server uses the OpenAI API to input the query text and the user's emotions as prompts into the generative AI model and generate an appropriate answer.

[1439] Step 4:

[1440] The server selects an appropriate responder or avatar of a related person based on the content of the inquiry.

[1441] Input: Query text

[1442] Output: Avatar information of appropriate responders and related parties

[1443] Specific operation: The server analyzes the content of the inquiry and selects the appropriate responder or avatar of the person involved based on pre-set rules.

[1444] Step 5:

[1445] The server sends the answer text generated by the generative AI and avatar information of the appropriate responder and related parties to the user's device.

[1446] Input: Answer text generated by generative AI, avatar information of appropriate responders and related parties

[1447] Output: Answer text and avatar information displayed on the user's device

[1448] Specific operation: The server sends the generated answer text and the selected avatar information to the user's terminal and displays them on the user's screen.

[1449] Step 6:

[1450] The user checks the displayed answer text and avatar information, and starts a conversation with the avatar if necessary.

[1451] Input: Answer text, avatar information

[1452] Output: User action (e.g., starting a conversation with an avatar)

[1453] Specific operation: The user checks the answer text and avatar information displayed on the terminal, and presses a button to start a conversation with the avatar if necessary.

[1454] In this way, the system can provide a quick and appropriate response to the user's inquiry and respond in accordance with the user's feelings.

[1455] Example 3

[1456] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1457] In conventional internal communication systems, there was a problem that the display control of avatars according to the employee's attendance status was insufficient, resulting in unnecessary contact with employees on public holidays or days off. There was also an issue that the system could not respond according to the user's emotions, making it difficult to facilitate smooth communication.

[1458] The identification process by the identification processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means. In this invention, the server includes a means for an employee to create an avatar and communicate in a virtual reality world, a means for using a generative AI to act as a temporary responder for internal inquiries and for connecting the temporary responder to various responders and related party avatars, a means for turning off the avatar in the event of a public holiday or vacation and displaying only those who can be contacted, a means for recognizing the user's emotions using an emotion engine and adjusting the generative AI's response according to the emotion, and a means for the avatars to converse with each other. This makes it possible to control the display of avatars according to the employee's employment status, avoiding unnecessary communications and enabling appropriate responses according to the user's emotions.

[1459] An "employee" is an individual who belongs to a company or organization and performs work for that company or organization.

[1460] An "avatar" is a digital character that represents an individual in a virtual reality society.

[1461] A "virtual reality society" is a virtual environment constructed using computer technology, and is a space in which users can act.

[1462] "Generative AI" is a system that uses artificial intelligence technology to generate appropriate responses and responses based on user input.

[1463] "Internal inquiries" refer to various questions and requests that arise within a company or organization.

[1464] A "first responder" is a system or individual whose role is to respond first to an initial inquiry or request.

[1465] "Various responders" are employees or systems that provide specialized responses to specific inquiries or requests.

[1466] "Stakeholder avatars" are digital characters that represent employees involved in a particular task or project.

[1467] A "public holiday" is a day off designated by a company or organization on which employees do not work.

[1468] A "day off" is a day when an employee does not work for personal reasons.

[1469] An "emotion engine" is a technology that recognizes a user's emotions and responds appropriately based on those emotions.

[1470] A "user" is an individual who uses the system.

[1471] "Adjusting the response" refers to changing the system's response or behavior depending on the user's situation and emotions.

[1472] "Having a conversation" refers to multiple avatars exchanging information and communicating with each other.

[1473] This invention is a system that controls the display of avatars based on employee status and displays only available employees. In addition, generative AI functions as a hub between contacts and avatar conversation partners, facilitating communication within the company.

[1474] Hardware and software used

[1475] Server: Database server (e.g. MySQL), application server (e.g. Node.js)

[1476] Device: User's PC or smartphone

[1477] Software: Generative AI models (e.g., GPT-4), emotion engines (e.g., Affectiva)

[1478] Data processing and calculation

[1479] 1. Reflection of employee enrollment status

[1480] The server periodically retrieves employee employment status data from the database.

[1481] The terminal provides an interface for the user to input their employment status, for example, by displaying a drop-down menu from which the user can select "public holiday" or "day off."

[1482] The user inputs his / her employment status through the terminal.

[1483] 2. Update the avatar display state

[1484] The server updates the display status of each employee's avatar based on the acquired employment status data.

[1485] The server turns off the avatars of employees who are on public holidays or days off. For example, if employee A is on public holiday, the avatar of employee A will be set to "offline."

[1486] The terminal displays the updated avatar status to the user in real time.

[1487] 3. Generate a list of employees who can be contacted

[1488] The server generates a list of employees who can be contacted based on the employment status data.

[1489] The server retrieves information about the employees included in the list (e.g., name, title, contact information) from a database.

[1490] The terminal displays the generated list to the user. For example, when the user clicks on "List of Contactable Employees," a list of employees who can be contacted is displayed.

[1491] 4. User Emotion Recognition Using Generative AI

[1492] The user sends a message to the generative AI through the device, for example, typing, "I have an urgent matter."

[1493] The terminal sends the user's message to the server.

[1494] The server uses an emotion engine to recognize the user's emotions, for example, detecting "impatience" from the user's message.

[1495] 5. Adjustments to generative AI

[1496] The server adjusts the response of the generative AI based on the results of the emotion engine.

[1497] The generative AI responds appropriately depending on the user's emotions. For example, if the user is feeling impatient, the generative AI will quickly respond by saying, "We will respond immediately."

[1498] The device displays the generative AI's response to the user.

[1499] Specific examples

[1500] Reflection of employee enrollment status

[1501] Example: The server retrieves the attendance status of all employees from the database every morning at 9:00. The user enters his / her attendance status as "office leave" into the terminal.

[1502] Update the avatar display state

[1503] Example: The server confirms that employee A's attendance status is "official holiday" and sets employee A's avatar to offline. The device displays to the user that employee A's avatar is offline.

[1504] Generate a list of available employees

[1505] Example: The server retrieves information about current employees B and C from the database and generates a list of available employees. When the user clicks on "List of available employees," the terminal displays the information about employees B and C.

[1506] Recognizing user emotions using generative AI

[1507] Example: A user types "I have an urgent matter" into a terminal and sends it. The server uses an emotion engine to detect "impatience" from the user's message.

[1508] Generative AI adjustments

[1509] Example: Based on the results of the emotion engine, the server instructs the generative AI to respond quickly. The generative AI responds, "We will respond immediately," and the device displays that response to the user.

[1510] Prompt Sentence Examples

[1511] "Please explain the system that reflects employee status and displays only those employees who are available for contact."

[1512] "Please give us a concrete example of a system in which generative AI adjusts its response according to the user's emotions." The flow of the specific processing in Example 3 will be explained with reference to FIG. 21.

[1513] Step 1: Obtain employee status data

[1514] The server periodically retrieves employee attendance status data from the database, executing a database query as input and obtaining employee attendance status data as output.

[1515] Specific operation: The server executes the query "SELECT FROM Attendance Status" every morning at 9:00 and retrieves the attendance status data of all employees.

[1516] Step 2: Enter your enrollment status

[1517] The terminal provides an interface for the user to input the employment status, where the user selects the employment status as input, and transmits the information to the server as output.

[1518] Specific operation: The user selects "Public Holiday" or "Day Off" from the drop-down menu on the device and clicks the send button.

[1519] Step 3: Update the avatar's appearance

[1520] The server updates the display state of each employee's avatar based on the acquired attendance status data. It receives the attendance status data as input and sets the display state of the avatar as output.

[1521] Specific operation: The server confirms that employee A's attendance status is "office leave" and sets employee A's avatar to "offline."

[1522] Step 4: Generate a list of available employees

[1523] The server generates a list of available employees based on the employment status data. The server receives the employment status data as input and generates a list of available employees as output.

[1524] Specific operation: The server retrieves information on current employees B and C from the database and generates a list of employees who can be contacted.

[1525] Step 5: View a list of available employees

[1526] The terminal displays the generated list to the user, receives the list of available employees received from the server as input, and displays the list to the user as output.

[1527] Specific operation: When the user clicks on "List of contactable employees", the terminal displays information about employees B and C.

[1528] Step 6: Recognizing user emotions using generative AI

[1529] The user sends a message to the generative AI through the terminal. The AI ​​receives the user's message as input and sends it to the server as output.

[1530] The server uses an emotion engine to recognize the user's emotion, receiving the user's message as input and obtaining the emotion recognition result as output.

[1531] Specific operation: The user types "I have an urgent matter to discuss" and sends it. The server uses the emotion engine to detect "impatience" from the user's message.

[1532] Step 7: Adjusting the generative AI

[1533] The server adjusts the generative AI's response based on the results of the emotion engine. It receives emotion recognition results as input and generates the generative AI's response as output.

[1534] Generative AI responds appropriately to the user's emotions. It receives emotion recognition results as input and generates an appropriate response as output.

[1535] Specific operation: Based on the results of the emotion engine, the server instructs the generative AI to respond quickly. The generative AI responds, "We will respond immediately," and the device displays the response to the user.

[1536] (Application example 3)

[1537] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1538] With conventional internal communication systems, it was difficult to grasp employee attendance status in real time, resulting in frequent unnecessary communication. Furthermore, communication sometimes did not proceed smoothly because the system was unable to respond to the user's emotions. Furthermore, there was a lack of efficient means for factory robots to communicate with employees. A new system that could solve these issues was needed.

[1539] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1540] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world; a means for using generative AI to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars; a means for turning off the avatars during public holidays or days off and displaying only those who can be contacted; a means for recognizing the user's emotions using an emotion recognition engine and adjusting the generative AI's response according to those emotions; and a means for a robot in the factory to grasp employee status in real time and efficiently communicate as needed. This makes it possible to grasp employee status in real time, avoid unnecessary communication, and respond according to the user's emotions, resulting in smoother communication. It also enables the robot in the factory to efficiently communicate with employees.

[1541] An "avatar" is a digital character that represents a user in a virtual reality world.

[1542] "Generative AI" is artificial intelligence that generates appropriate responses based on user input.

[1543] An "emotion recognition engine" is software that analyzes a user's emotions and responds accordingly.

[1544] A "virtual reality society" is a virtual communication space constructed using digital technology.

[1545] The "first responder" is a system that responds quickly to initial inquiries and problems and transfers them to the appropriate person as needed.

[1546] "Employment status" is information indicating the working status of an employee, such as whether the employee is currently working or on vacation.

[1547] A "factory robot" is an automated machine that performs work in a factory.

[1548] "Real-time" means that information is processed immediately, without delay.

[1549] "Efficient means" are methods that eliminate waste and achieve maximum effect with minimum resources.

[1550] "Means for facilitating communication" are methods for smoothly transmitting information and communicating with others.

[1551] A system for carrying out this invention has the following configuration: The server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using generative AI to temporarily respond to internal inquiries and for the temporary response to connect to various responders and related party avatars, a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, a means for recognizing the user's emotions using an emotion recognition engine and adjusting the generative AI's response according to those emotions, and a means for a robot in the factory to grasp the employee status in real time and efficiently make necessary contact.

[1552] Hardware and software used

[1553] Hardware: Factory robots, microphones, cameras

[1554] Software: EmotionEngine (emotion recognition engine), AIChatbot (generative AI chatbot)

[1555] Data processing and calculation flow

[1556] The server first creates avatars for all employees and provides an environment for communication in a virtual reality world. The generative AI acts as a temporary contact point for internal inquiries, quickly responding to initial inquiries and problems. If necessary, it transfers the work to the appropriate person or avatar of the relevant person.

[1557] In the case of public holidays or days off, the server turns off the employee's avatar and displays only available employees, thereby avoiding unnecessary contact.

[1558] The emotion recognition engine analyzes the user's input and recognizes their emotion. For example, if the user says, "I'm worried about the production schedule," the emotion recognition engine recognizes "worried." The generative AI generates an appropriate response based on this emotion. For example, it responds, "Don't worry. The production schedule is going well."

[1559] Robots in factories can track employee status in real time and efficiently communicate as needed. For example, if a robot asks, "Please tell me who the current employees are," the server will respond, "Alice is currently employed."

[1560] Examples of specific examples and prompts

[1561] For example, if a robot in a factory asks, "Is Alice working here now?", the robot will respond, "Yes, Alice is working here." If a user says, "I'm worried about the production schedule," the robot's emotion engine will recognize the word "worry," and the generative AI will respond, "Don't worry. The production schedule is going smoothly."

[1562] An example of a prompt is as follows:

[1563] Please tell us about your current employees.

[1564] "I'm worried about the production schedule. What should I do?"

[1565] In this way, it is possible to grasp the employee status in real time, avoid unnecessary contact, and respond according to the user's feelings, which makes communication smoother. It also enables robots in factories to communicate with employees efficiently.

[1566] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1567] Step 1:

[1568] The server creates avatars for all employees. It receives profile information provided by users as input and generates avatars based on that information. The generated avatars are then used in the virtual reality world.

[1569] Step 2:

[1570] The server uses generative AI to act as a first line of defense for internal inquiries. It receives user inquiries as input and the generative AI responds by providing appropriate information based on the inquiry content, for example.

[1571] Step 3:

[1572] The server connects the initial response to various responders and related party avatars. If the generative AI cannot respond, it passes the inquiry on to the appropriate person's avatar. This ensures that the user's inquiry is delivered to the appropriate person.

[1573] Step 4:

[1574] The server turns off the avatars for public holidays and holidays, and only displays contactable people. It receives employee attendance data as input and turns off the avatars of employees who are on vacation. This helps avoid unnecessary contact.

[1575] Step 5:

[1576] The server uses an emotion recognition engine to recognize the user's emotions. The user's input (text or voice) is input to the emotion recognition engine, and emotion data is output. For example, emotions such as "worried" or "relaxed" are recognized.

[1577] Step 6:

[1578] The server adjusts the generative AI's response based on the user's emotions. The generative AI receives emotional data from the emotion recognition engine as input and generates an appropriate response. For example, if the user is "worried," it responds quickly.

[1579] Step 7:

[1580] The robots in the factory grasp the employee status in real time. They receive the employee status data as input from the server and efficiently communicate the necessary information. For example, in response to a query such as "Please tell me who the current employees are," they output a list of the current employees.

[1581] Step 8:

[1582] The user makes a query to the robot. For example, they provide a prompt sentence such as "I'm worried about the production schedule" as input. The robot uses an emotion recognition engine to recognize the "worry," and the generative AI outputs a response such as "Don't worry. The production schedule is going smoothly."

[1583] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1584] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1585] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1586] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1587] [Third embodiment]

[1588] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1589] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1590] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1591] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1592] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1593] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1594] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1595] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1596] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1597] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1598] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1599] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1600] "Example 1"

[1601] The present invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. Specifically, each employee creates their own avatar and communicates with other employees through that avatar. The avatar reflects the employee's employment status (working, vacation, public holidays, etc.) and presents employees who can be contacted accordingly.

[1602] "Example 2"

[1603] The present invention is a system that uses generative AI to temporarily handle internal inquiries and then connects them to various responders and related party avatars. Specifically, the generative AI temporarily receives inquiries from employees and connects them to the appropriate responders and related party avatars. This generative AI has the ability to understand the content of employees' inquiries and select the appropriate responders and related parties.

[1604] "Example 3"

[1605] The present invention is a system that turns off the avatar when an employee is on a public holiday or vacation, and displays only those who can be contacted. Specifically, an employee's avatar reflects the employee's employment status, and the avatar turns off when the employee is on a public holiday or vacation. In this case, only those employees who can be contacted are displayed, preventing unnecessary contact.

[1606] The processing flow of each embodiment will be described below.

[1607] "Example 1"

[1608] Step 1: Employees create their own avatars, which reflect their employment status (working, vacation, public holidays, etc.).

[1609] Step 2: An employee communicates with another employee's avatar in the virtual reality world. The avatar reflects the employee's presence status, and is turned off if the employee is on a public holiday or vacation.

[1610] Step 3: Only available employees are displayed, avoiding unnecessary contact.

[1611] "Example 2"

[1612] Step 1: The generative AI temporarily receives inquiries from employees.

[1613] Step 2: The generative AI understands the content of the inquiry and selects the appropriate responder or person involved. Step 3: The generative AI connects the inquiry to the avatar of the responder or person involved that it has selected. "Example 3"

[1614] Step 1: Employee avatars reflect their employment status, and are turned off when they are on public holidays or vacation.

[1615] Step 2: Only available employees are displayed, avoiding unnecessary contact.

[1616] Example 1

[1617] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1618] With the conventional internal communication system, communication between employees was complicated, and it was particularly difficult to confirm the employee's status and identify employees who could be contacted. In addition, when employees were on vacation or public holidays, they were often unable to be contacted, which led to a decrease in work efficiency. Furthermore, temporary responses to internal inquiries were insufficient, and a quick response was required.

[1619] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1620] In this invention, the server includes a means for displaying an avatar created for each employee in a virtual digital space, a means for acquiring the attendance status of each employee in cooperation with an attendance management system and periodically updating the display status of the avatar according to the attendance status, and a means for communicating via chat or video call between the employee corresponding to the avatar selected by the user and the user. This enables employees to communicate efficiently in a virtual reality world. The server also includes a prompt message that instructs the system to present candidate employees who can respond to the internal inquiry based on an internal inquiry input by the user and a list storing information about each employee, and a means for presenting candidate employees who can respond to the internal inquiry using a generative AI. The updating means also updates the display status of the employee's avatar to be turned off when the employee is on leave.

[1621] An "avatar" is a digital character created by a user for use in a virtual reality world.

[1622] A "virtual reality society" is a virtual environment that resembles the real world and is constructed using computer technology.

[1623] "Generative AI" is a system that uses artificial intelligence technology to provide temporary responses to user inquiries.

[1624] An "attendance management system" is software for managing employee attendance and vacation status.

[1625] A "server" is a computer system that stores and processes data on a network.

[1626] A "terminal" is a device such as a computer or smartphone that is operated by a user.

[1627] "Employment status" is information indicating whether an employee is currently working, on vacation, or on a public holiday.

[1628] "Chat" is a means of communicating in real time using text messages.

[1629] A "video call" is a means of communicating in real time using video and audio.

[1630] This invention is a system in which all employees create avatars and communicate with each other in a virtual reality world. A specific embodiment of this system will be described below.

[1631] Creating an avatar

[1632] Users create their own avatars using a dedicated application. This application uses 3D modeling software such as Unity or Unreal Engine. Users can customize their appearance, clothing, accessories, etc. For example, when users select a hairstyle, multiple hairstyle options are displayed and can be selected by clicking.

[1633] Avatar Registration

[1634] The device sends the created avatar data to the server. The avatar data includes 3D model information, textures, and customized parameters. The server receives this data and stores it in a relational database such as MySQL (registered trademark) or PostgreSQL. For example, the avatar data is sent in JSON format, which is parsed on the server side and stored in the database.

[1635] Obtaining and updating enrollment status

[1636] The server works with an attendance management system to manage employee attendance status. The server periodically retrieves data from the attendance management system via API and updates each employee's attendance status (working, vacation, public holidays, etc.). For example, the server sends an API request every morning at 9:00 to retrieve the latest attendance status data.

[1637] Show contactable employees

[1638] When a user opens the application, the device retrieves the latest attendance status data from the server. Based on this data, the device displays avatars of available employees. The user can start a chat or video call with that employee by clicking on the displayed avatar. For example, when a user opens the application, the avatars of employees currently working are displayed in a list format.

[1639] Start a conversation

[1640] The user clicks on the avatar of the employee they want to contact. The device sends the information of the avatar to the server, which starts a chat or video call session. The server returns the necessary communication information to the device, supporting real-time communication. For example, when a user clicks on the avatar of a specific employee, a chat window opens, allowing them to send a message.

[1641] Specific examples

[1642] For example, if a user wants to contact a specific employee, they open the application and search for the employee's avatar. If the employee is currently at work, the avatar will be displayed and they can click to chat or video call.

[1643] This system allows employees to communicate effectively with each other in a virtual reality world.

[1644] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1645] Step 1:

[1646] A user launches a dedicated application and creates an avatar. As input, the user selects customization options such as face shape, hairstyle, clothing, and accessories. As output, 3D model data of the customized avatar is generated. Specifically, when the user selects a hairstyle, the application applies the 3D model of the selected hairstyle to the avatar.

[1647] Step 2:

[1648] The device sends the created avatar data to the server. The input includes the avatar's 3D model data. The output is saved to the server. Specifically, the device sends the avatar data in JSON format to the server, which parses the data and stores it in a database.

[1649] Step 3:

[1650] The server works with the attendance management system to obtain employee attendance status and updates it periodically. The input includes attendance status data from the attendance management system. The output is the latest attendance status data stored on the server. Specifically, the server sends an API request every morning at 9:00 to obtain the latest attendance status data from the attendance management system.

[1651] Step 4:

[1652] When a user opens the application, the device retrieves the latest attendance status data from the server. The input includes the attendance status data from the server. The output displays the avatars of available employees. Specifically, the device sends a request to the server and displays a list of avatars of employees who are currently working based on the attendance status data received from the server. At this time, if an employee is on leave, the display status of that employee's avatar is turned off.

[1653] Step 5:

[1654] The user clicks on the avatar of the employee they want to contact. The input includes information about the avatar they clicked on. The output is the start of a chat or video call session. In concrete terms, when a user clicks on a specific employee's avatar, the device sends that information to the server, and the server returns the necessary communication information to the device. This opens a chat window, allowing them to send a message.

[1655] Furthermore, when an internal inquiry is input by a user, the server uses a prompt sentence instructing the server to present candidate employees who can handle the internal inquiry based on the input internal inquiry and a list storing information about each employee, and uses generative AI to present candidate employees who can handle the internal inquiry.The user can refer to the presented candidate employees who can handle the internal inquiry, select the employee to inquire about, and click the employee's avatar to contact them and make an inquiry. Example prompt sentence: After inputting an internal inquiry from the user and a list that stores information about each employee, you can say, "This is a list that stores an internal inquiry and information about each employee. Please provide candidates for employees who can handle this internal inquiry."

[1656] (Application example 1)

[1657] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1658] Conventional communication systems in virtual reality have had problems such as difficulty reflecting employee availability in real time and making it difficult for customers to communicate with store clerks smoothly. Furthermore, there was a lack of a way to quickly provide appropriate answers to customer questions.

[1659] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1660] In this invention, the server includes a means for all employees to create avatars and communicate in the virtual reality world, a means for using generative AI to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, a means for avatars to converse with each other, a means for customer and store clerk avatars to communicate in the virtual reality space, a means for reflecting store clerk availability in real time and notifying customers, and a means for using generative AI to perform natural language processing on customer questions and generate appropriate answers, which enables smoother communication in the virtual reality world and improved customer service.

[1661] An "avatar" is a digital character that represents a user in a virtual reality society.

[1662] A "virtual reality society" is a virtual environment constructed using computer technology, a space in which users can engage in activities and communicate.

[1663] "Generative AI" is a system that uses artificial intelligence technology to generate data and automatically process specific tasks.

[1664] A "first responder" is a system or person who acts to quickly respond to initial inquiries or problems and transfers them to the appropriate personnel as needed.

[1665] "Employment status" is information indicating the working status of an employee or store clerk, such as whether they are currently working or on vacation.

[1666] "Natural language processing" is the technology that enables computers to understand, generate, and respond to human language.

[1667] "Real-time" means that data and information are processed immediately and reflected without delay.

[1668] "Customer" means a user who accesses the virtual reality society to use services or products.

[1669] A "store clerk" is a user whose role is to provide information about services and products to customers in the virtual reality society.

[1670] "Communication" is the act of exchanging information and opinions, and in a virtual reality society, this is done through avatars.

[1671] A system for carrying out this invention has the following configuration: The server includes means for all employees to create avatars and communicate in a virtual reality world, means for using generative AI to temporarily respond to internal inquiries and for the temporary response to connect with various responders and related party avatars, means for turning off the avatars on public holidays or days off and displaying only those who can be contacted, means for the avatars to converse with each other, means for customer and store clerk avatars to communicate in the virtual reality space, means for reflecting store clerk availability in real time and notifying customers, and means for using generative AI to perform natural language processing on customer questions and generate appropriate answers.

[1672] Hardware and software used

[1673] Hardware: Smartphone, head-mounted display (e.g., Oculus Quest 2)

[1674] Software: Unity (game engine), Photon (real-time communication), Azure AI (generative AI model)

[1675] Data processing and calculation

[1676] Avatar Creation

[1677] Users create their own avatar using Unity, and the avatar's design is customized based on prompts generated using Azure AI, such as:

[1678] "Female staff in their 20s, casual clothing, friendly smile"

[1679] Reflection of enrollment status

[1680] The server updates the availability status of store staff in real time and notifies customers via Photon. Availability data is obtained from the staff's work shift information and analyzed by Azure AI. For example, the following notifications are sent:

[1681] "Currently, we have three staff members on duty. The following staff members are available: Avatar 1 (Yamada-san), Avatar 2 (Sato-san), Avatar 3 (Suzuki-san)"

[1682] communication

[1683] When a customer has a question or wants to ask for advice, they connect to a store clerk avatar in real time using Photon. The store clerk avatar uses Azure AI to perform natural language processing and generate an appropriate answer to the customer's question. For example, it uses prompt sentences like the following:

[1684] "I have a question about the product you're looking for. What product are you looking for?"

[1685] In this way, smoother communication and improved customer service can be achieved in the virtual reality society.

[1686] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1687] Step 1:

[1688] Users launch Unity using a terminal and create their own avatar. As input, the user provides a prompt, and Azure AI generates an avatar design based on the prompt. As output, a customized avatar is generated.

[1689] Step 2:

[1690] The server obtains the employee's attendance status in real time. Employee work shift information is sent to the server as input. The server analyzes this information using Azure AI and generates current attendance status data as output.

[1691] Step 3:

[1692] The server notifies the customer of the attendance status data through Photon. As input, the attendance status data updated in real time is used. As output, the attendance status is displayed on the customer's device.

[1693] Step 4:

[1694] A customer uses a terminal to ask a question or ask for advice. The customer's question is entered into the terminal as input. The terminal sends this information to the server via Photon. The question arrives at the server as output.

[1695] Step 5:

[1696] The server uses Azure AI to analyze the customer's question and generate an appropriate answer. The customer's question is used as input, and the generated answer is obtained as output.

[1697] Step 6:

[1698] The server sends the generated answer to the customer's device via Photon. The generated answer is used as input. The answer is displayed on the customer's device as output.

[1699] Step 7:

[1700] Customer and store clerk avatars communicate in a virtual reality space. Avatar information of the customer and store clerk is used as input. The output is a conversation in the virtual reality space.

[1701] Example 2

[1702] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1703] With conventional internal inquiry systems, it was difficult to quickly identify and contact the appropriate person to respond to an inquiry. Furthermore, when the person in charge was unavailable, inquiries often stalled, making smooth internal communication an issue. Furthermore, there was a lack of resources to temporarily respond to inquiries, so efficient responses were required.

[1704] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1705] In this invention, the server includes a means for all employees to create avatars and communicate in a virtual reality world, a means for using a generative AI model to temporarily respond to internal inquiries and connect the temporary responder to various responders and related party avatars, a means for analyzing the content of the inquiry and selecting an appropriate responder, a means for transferring the inquiry to the selected responder's avatar, a means for turning off the avatars on public holidays or days off and displaying only contactable people, and a means for the avatars to converse with each other. This enables prompt and appropriate responses to internal inquiries, facilitates internal communication, and realizes efficient resource utilization.

[1706] An "avatar" is a digital character that represents a user in a virtual reality world.

[1707] A "generative AI model" is an artificial intelligence model that uses natural language processing to generate and analyze text.

[1708] An "internal inquiry" is an inquiry made by an employee to resolve a work-related question or problem.

[1709] The "first responder" is a system or function that handles inquiries at an initial stage and transfers them to an appropriate responder.

[1710] A "responder" is an employee or department that provides appropriate answers or responses to inquiries.

[1711] "Related parties" are employees or departments that provide information or support related to the inquiry.

[1712] A "virtual reality society" is a virtual space constructed using digital technology, in which users interact through avatars.

[1713] "Query analysis" is the process of analyzing the text of a received query and understanding its content.

[1714] "Selection of the appropriate responder" is the process of identifying the most appropriate responder based on the content of the inquiry.

[1715] "Query forwarding" is the process of sending the parsed query content to the selected responder avatar.

[1716] "A means to turn off avatars on public holidays or days off and display only contactable people" is a function that hides the avatar when the person in charge is absent and displays only contactable people.

[1717] "Means for avatars to converse with each other" is a function that allows users to communicate with each other through avatars.

[1718] MODE FOR CARRYING OUT THE INVENTION

[1719] This invention is a system that uses a generative AI model to handle internal inquiries temporarily and connects the inquiries to the appropriate person or avatar of the relevant person. Specific embodiments of this system are described below.

[1720] System configuration

[1721] This system consists of three main components: a server, a terminal, and a user. The server runs a generative AI model to analyze inquiries and select a responder. The terminal is a device where users can enter inquiries and receive responses. The user is an employee who uses the system to make inquiries.

[1722] Hardware and software used

[1723] Server: A server with high-performance computing power is required. Specifically, a server equipped with a GPU to run generative AI models (e.g., OpenAI's GPT-4) is recommended.

[1724] Device: A device used by a user, such as a PC or smartphone. These devices must have an internet connection and a browser.

[1725] Generative AI model: An AI model for natural language processing. Specifically, OpenAI's GPT-4 is used.

[1726] Data processing and calculation

[1727] The server receives the inquiry sent from the device and inputs it into the generative AI model. The generative AI model analyzes the inquiry and selects an appropriate responder. The inquiry is then forwarded to the selected responder's avatar, which generates an answer. The server then sends the generated answer to the user's device.

[1728] Specific examples

[1729] Consider a case where a user makes an inquiry such as "Please tell me the procedure for starting a new project."

[1730] 1. User: Enter "How do I start a new project?" into the terminal and press the send button.

[1731] 2. Server: Receives the query and sends the prompt "Please tell me the procedure for starting a new project" to the generative AI model.

[1732] 3. Generative AI model: Analyzes the inquiry content and selects a project management department representative.

[1733] 4. Server: Transfers the inquiry to a selected project management department representative avatar.

[1734] 5. Avatar: Generate a response based on the inquiry: "To start a new project, please go to the project management section of our internal portal."

[1735] 6. Server: Sends the generated answer to the user's device.

[1736] 7. User: Check the answer on the device.

[1737] In this way, a system is realized in which the server, terminals, and users work together to provide a temporary response to internal inquiries. This system enables prompt and appropriate responses to internal inquiries, facilitating smooth internal communication and efficient resource utilization.

[1738] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1739] Program processing flow

[1740] Step 1: Receiving an inquiry

[1741] Device:

[1742] The user enters an inquiry using their own device (PC or smartphone) and presses the send button.

[1743] Input: The inquiry typed by the user (e.g., "How do I start a new project?").

[1744] Output: The query is sent to the server.

[1745] Step 2: Receiving your inquiry

[1746] server:

[1747] The server receives the inquiry sent from the terminal.

[1748] Input: The inquiry sent from the device.

[1749] Output: Prepare the received query content for input into the generative AI model.

[1750] Step 3: Analyzing the inquiry

[1751] server:

[1752] The server inputs the received inquiry content into a generative AI model and analyzes it.

[1753] Input: Received inquiry (prompt text).

[1754] Data processing: A generative AI model analyzes the inquiry content and identifies the appropriate person to respond.

[1755] Output: Analysis results and information for appropriate responders (e.g., project management personnel).

[1756] Step 4: Select the right responder

[1757] Generative AI models:

[1758] The generative AI model selects the appropriate responder based on the content of the inquiry.

[1759] Input: Analysis results of the inquiry.

[1760] Data calculation: The inquiry content is compared with a database of responders to select the most suitable responder.

[1761] Output: Information on the selected responder (e.g., project management department personnel).

[1762] Step 5: Transferring the inquiry

[1763] server:

[1764] The server forwards the query to the selected respondent's avatar.

[1765] Input: Information about the selected responder and the inquiry.

[1766] Data processing: The inquiry content is transferred to the responder's avatar in an appropriate format.

[1767] Output: The inquiry content forwarded to the responder's avatar.

[1768] Step 6: Generate an answer

[1769] Avatar:

[1770] The avatar generates an answer based on the query.

[1771] Input: The transferred inquiry.

[1772] Data calculation: Create answers by referencing pre-set answer templates and databases.

[1773] Output: The generated answer (e.g., "To start a new project, please visit the project management section of our intranet portal").

[1774] Step 7: Submit your response

[1775] server:

[1776] The server receives the response from the avatar and sends it to the user's terminal.

[1777] Input: A generated answer from the avatar.

[1778] Data processing: Send the answers to the user's device in an appropriate format.

[1779] Output: The answer sent to the user's device.

[1780] Step 8: View your answers

[1781] Device:

[1782] The user's terminal displays the response sent from the server.

[1783] Input: The answer sent by the server.

[1784] Output: The answer displayed on the user's device (e.g., "To start a new project, please visit the project management section of our internal portal.").

[1785] In this way, a system is realized in which the server, terminals, and users work together to provide a temporary response to internal inquiries.

[1786] (Application example 2)

[1787] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1788] Staff at logistics centers are required to respond to inquiries quickly and accurately, but the traditional system makes it difficult to select and contact the right person to respond, making it difficult to respond efficiently. Furthermore, there were many cases where the right person was unavailable, or it took a long time to find the right person, which caused delays in operations.

[1789] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a means for all employees to create avatars and communicate in a virtual reality world; a means for using a generative AI to act as a temporary responder for internal inquiries and for connecting the temporary responder to various responders and related party avatars; a means for turning off the avatars on public holidays or days off and displaying only those who can be contacted; a means for the avatars to converse with each other; a means for logistics center staff to make inquiries using their smartphones and for the generative AI to connect the inquiries to the avatars of appropriate responders or related parties; and a means for the generative AI to generate a response based on the inquiry content and select the appropriate responder or related party. This enables inquiries to be handled quickly and accurately at the logistics center, improving work efficiency.

[1790] "All employees" refers to all employees of a company or organization.

[1791] An "avatar" refers to a digital character that represents an individual in a virtual reality society.

[1792] "Virtual reality society" refers to a virtual environment or space constructed using computer technology.

[1793] "Means of contact" refers to the methods and tools used to communicate.

[1794] "Generative AI" refers to a system that uses artificial intelligence technology to generate information and perform specific tasks.

[1795] "Internal inquiries" refer to questions or requests that arise within a company or organization.

[1796] "Temporary responder" refers to the role of responding at the initial stage.

[1797] "Various responders and parties" refers to the people and departments necessary to respond to specific inquiries or issues.

[1798] "In the case of an official holiday or leave of absence" refers to a situation in which an employee is officially on leave.

[1799] "Avatar is turned off" refers to the avatar becoming inactive in the virtual reality world.

[1800] "Contactable persons" refers to persons who are currently available and available for communication.

[1801] "Presentation means" refers to the way information is displayed or presented.

[1802] "Means for avatars to communicate with each other" refers to methods for avatars to communicate with each other in a virtual reality society.

[1803] "Logistics center" refers to a facility that stores, manages, and distributes goods.

[1804] "Staff" refers to employees working at the logistics center.

[1805] A "smartphone" refers to a mobile phone that can connect to the Internet and use applications.

[1806] "Making an inquiry" refers to the act of submitting a question or request.

[1807] "Appropriate responders and parties" refers to the people or departments best suited to a particular inquiry or issue.

[1808] "Inquiry routing" refers to the method by which an inquiry is routed to the appropriate responder or party.

[1809] "Generating a response based on the content of a query" refers to understanding the content of a query and creating a response to it.

[1810] "Means of selection" refers to the method of selecting the best option from multiple options.

[1811] As an embodiment of the present invention, a system for improving the efficiency of inquiries handled by staff at a logistics center is provided. Specific embodiments of the system are described below.

[1812] System configuration

[1813] The system consists of the following major components:

[1814] 1. Server: Hosts the generative AI model, analyzes the inquiry content, and selects the appropriate responder.

[1815] 2. Smartphone: A device used by logistics center staff to input inquiries.

[1816] 3. Avatar: A digital character that represents each employee in a virtual reality world.

[1817] 4. Communication network: Infrastructure for data communication between smartphones and servers.

[1818] Program processing

[1819] Hardware used

[1820] Smartphones: Used by logistics center staff to input inquiries.

[1821] Server: Runs the generative AI model and analyzes the query content.

[1822] Software used

[1823] OpenAI API: Uses generative AI models to generate responses based on queries.

[1824] Python: The primary programming language for programs that run on the server side.

[1825] requests library: Used to communicate between the server and the smartphone.

[1826] Data processing and calculation

[1827] 1. Entering the inquiry details: The staff member enters the inquiry details using a smartphone application.

[1828] 2. Response generation using generative AI: The server uses OpenAI's API to generate a response based on the query.

[1829] 3. Selection of appropriate responders and stakeholders: Based on the generated responses, the server selects appropriate responder and stakeholder avatars.

[1830] 4. Connect to avatar: The server sends an API request to connect to the appropriate avatar.

[1831] Specific examples

[1832] For example, if a staff member at a logistics center types, "I would like to inquire about an error in the inventory management system," the server will use generative AI to respond, "For inquiries about errors in the inventory management system, please connect to the system administrator's avatar," and connect to the system administrator's avatar.

[1833] Prompt Sentence Examples

[1834] Inquiry from logistics center staff: I would like to inquire about an error in the inventory management system.

[1835] Select the appropriate person or party and connect the inquiry to an avatar.

[1836] In this way, inquiries at the logistics center can be handled quickly and accurately, making operations more efficient.

[1837] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1838] Step 1:

[1839] The user uses a smartphone to input the inquiry. The input inquiry is sent as text data from the smartphone to the server. For example, the input data is text such as "I would like to inquire about an error in the inventory management system."

[1840] Step 2:

[1841] The server passes the received query content to the generative AI model. The generative AI model analyzes the query content and generates an appropriate response. The input data is the text of the query content, and the output data is the text of the generated response. For example, a response might be generated that reads, "Inquiries regarding errors in the inventory management system will be connected to the system administrator's avatar."

[1842] Step 3:

[1843] The server selects the appropriate responder or avatar based on the generated response. The input data is the text of the generated response, and the output data is the identification information of the selected avatar. For example, the ID of the system administrator's avatar is selected.

[1844] Step 4:

[1845] The server sends an API request to connect the query to the selected avatar. The input data is the identification information of the selected avatar, and the output data is the result of connecting to the avatar. For example, the result is that the connection to the system administrator's avatar was successful.

[1846] Step 5:

[1847] The server returns the connection result to the smartphone. The input data is the connection result to the avatar, and the output data is a connection result message to be displayed on the smartphone. For example, the message "Connected to the system administrator's avatar" is displayed on the smartphone.

[1848] Step 6:

[1849] The user starts a conversation with the selected avatar via their smartphone. The input data is the user's spoken text, and the output data is the avatar's response text. For example, if the user types "Please tell me the details of the error," the avatar will respond with "Error code 1234 has occurred."

[1850] Through the above steps, inquiries can be handled quickly and accurately at the logistics center.

[1851] Example 3

[1852] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1853] With conventional internal communication systems, it was often impossible to contact employees even when they were on public holidays or vacations, resulting in unnecessary communication. It was also difficult to grasp employees' attendance status in real time, which hindered efficient communication. Furthermore, if the person in charge of handling internal inquiries was unavailable, responses were sometimes delayed, hindering the smooth progress of business.

[1854] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1855] In this invention, the server includes a means for checking the database and acquiring each employee's work schedule and vacation information, a means for updating the status of each employee's virtual character based on the acquired data, and a means for creating a list of available employees and sending it to the terminal. This makes it possible to turn off the virtual character when an employee is on a public holiday or vacation, and to present only those who can be contacted.

[1856] A "virtual persona" is a digital avatar that reflects an employee's employment status and is a means of communicating with other employees within a virtual environment.

[1857] A "virtual environment" is a system that allows employees to communicate with each other through virtual people in a digital space.

[1858] The "generative AI model" is a system that uses artificial intelligence technology to act as a temporary responder for internal inquiries, connecting them to various responders and virtual people involved as needed.

[1859] The "server" is a computer system that manages the database, obtains each employee's work schedule and vacation information, and updates the status of the virtual characters.

[1860] A "database" is a data storage system that stores employee work schedules and vacation information and allows the server to retrieve the necessary information.

[1861] A "terminal" is a device through which a user accesses the system and checks the list of available employees.

[1862] A "user" is an individual who uses the system to view a list of available employees and make any necessary contacts.

[1863] The "list of available employees" is a list of employees who are currently available to be contacted, which is created by the server and sent to the terminal.

[1864] This invention is a system for realizing efficient internal communication using virtual characters that reflect the employment status of employees. A specific embodiment of this system will be described below.

[1865] Server Roles

[1866] The server uses a database management system (e.g., MySQL) to manage employee work schedules and vacation information. The server periodically checks the database to obtain the latest attendance data. Based on the obtained data, it updates the status of each employee's virtual character. Specifically, if an employee is on a public holiday or vacation, the server sets the employee's virtual character to off, and if the employee is working, it sets the character to on. Furthermore, the server creates a list of employees who can be contacted and sends it to the terminal.

[1867] Device Role

[1868] The terminal provides an interface for users to access the system. When a user accesses the system through the terminal, the terminal retrieves the latest employee attendance data from the server. Based on this data, the terminal displays a list of available employees. Specifically, the terminal sends an HTTP request to the server and receives data in JSON format. The received data is analyzed, a list of available employees is generated in HTML format, and displayed on the user's screen.

[1869] User Roles

[1870] Users access the system through their devices and check a list of available employees. If a user wants to contact a specific employee, they can confirm that the employee is not on a public holiday or vacation. This allows users to avoid unnecessary contact and communicate efficiently. Users click on the employee's name in the list to contact them via email or chat app.

[1871] Hardware and software used

[1872] Server: Database management system (e.g., MySQL), web server (e.g., Apache)

[1873] Device: Web browser (e.g. Google Chrome)

[1874] Software: Front-end frameworks (e.g., React), back-end frameworks (e.g., Node.js)

[1875] Specific examples

[1876] Example 1: When employee A is on a public holiday

[1877] The server checks the database and finds that Employee A is on a public holiday. The server turns off Employee A's virtual persona and removes Employee A from the list of available employees. When a user accesses the system through a terminal, Employee A does not appear on the list, which helps avoid unnecessary contact.

[1878] Example 2: When employee B is at work

[1879] The server checks the database and finds that employee B is at work. The server turns on the virtual persona for employee B and adds employee B to the list of available employees. When a user accesses the system through a terminal, employee B appears in the list and the user can contact employee B.

[1880] Example prompts to input to the generative AI model

[1881] "Please describe the system for tracking employee attendance and turning off virtual people on public holidays or vacations. Include names of specific hardware and software."

[1882] By inputting this prompt sentence into the generative AI model, a detailed explanation of the system can be obtained. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1883] Step 1:

[1884] The server checks the database to obtain each employee's work schedule and vacation information.

[1885] Specifically, the server executes an SQL query against the MySQL database to retrieve the latest enrollment status data.

[1886] Input: Work schedule and vacation information in the database

[1887] Output: Latest enrollment status data

[1888] Step 2:

[1889] The server updates the status of each employee's virtual person based on the acquired data.

[1890] Specifically, the server turns off the employee's virtual persona when the employee is on a public holiday or vacation, and turns it on when the employee is at work.

[1891] Input: Latest enrollment status data

[1892] Output: Updated virtual person state

[1893] Step 3:

[1894] The server creates a list of available employees and sends it to the terminal.

[1895] Specifically, the server generates information about employees who have virtual people turned on in JSON format and sends it to the terminal as an HTTP response.

[1896] Input: Updated virtual person state

[1897] Output: A list of available employees (JSON format)

[1898] Step 4:

[1899] The terminal acquires the latest employee attendance status data from the server.

[1900] Specifically, the terminal sends an HTTP request to the server and receives data in JSON format.

[1901] Input: HTTP response from the server

[1902] Output: Latest employee status data (JSON format)

[1903] Step 5:

[1904] The terminal analyzes the received data and generates a list of available employees.

[1905] Specifically, the device uses JavaScript to parse the JSON data and generate a list of contactable employees in HTML format.

[1906] Input: Latest employee status data (JSON format)

[1907] Output: List of available employees (HTML format)

[1908] Step 6:

[1909] The terminal displays to the user a list of available employees.

[1910] Specifically, the device uses HTML and CSS to display the list on the user's screen.

[1911] Input: List of available employees (HTML format)

[1912] Output: A list of available employees displayed on the user's screen.

[1913] Step 7:

[1914] A user accesses the system through a terminal and checks a list of employees who can be contacted.

[1915] Specifically, the user opens a web browser and accesses the system's URL.

[1916] Input: System URL

[1917] Output: Display a list of available employees

[1918] Step 8:

[1919] The user selects the employee they wish to contact from the list and makes contact.

[1920] Specifically, users click on an employee's name in the list and contact them via email or a chat app.

[1921] I...

Claims

1. A means for displaying the avatar created for each employee in a virtual digital space; A means for acquiring the attendance status of each employee in cooperation with an attendance management system and periodically updating the display state of the avatar according to the attendance status; A means for communicating with an employee corresponding to an avatar selected by a user through chat or video calling; A system including:

2. The system of claim 1 further includes a means for presenting candidate employees who can respond to an internal inquiry based on an internal inquiry input by a user and a list storing information about each employee, using a prompt sentence that instructs the presentation of candidate employees who can respond to the internal inquiry and a generative AI.

3. 2. The system according to claim 1, wherein said updating means updates the display state of said employee's avatar so as to be turned off when said employee is on leave.

Images