System

The system addresses office worker challenges by integrating reservation and location management with personalized lunch suggestions, enhancing productivity and convenience.

JP2026023999APending Publication Date: 2026-02-13SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024126320
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2026-02-13

AI Technical Summary

Technical Problem

Office workers face challenges such as not knowing the reservation status of conference rooms or individual booths, difficulty in matching names of nearby colleagues, and lack of time for lunch decisions, leading to decreased productivity.

Method used

A system that monitors and updates conference room and individual booth reservations, provides employee location information, and generates lunch suggestions based on user profiles, all integrated through a server and user device interface.

Benefits of technology

Enhances office efficiency by allowing real-time access to reservation and location information, and personalized lunch suggestions, improving productivity and convenience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026023999000001_ABST
    Figure 2026023999000001_ABST
Patent Text Reader

Abstract

A system is provided.SOLUTION: The system includes a means for monitoring and updating the reservation situation of a conference room or an individual booth, a means for acquiring the present position information of a user, and for generating and displaying the list of other users who are present nearby, and a means for generating and presenting the proposal of a proper lunch based on the profile information of the user.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Employees working in offices often face challenges such as not knowing the reservation status of conference rooms or individual booths, not being able to match the names of nearby colleagues, and having trouble deciding what to eat for lunch. Furthermore, productivity can decline due to a lack of time to manage tasks or chat. The purpose of this invention is to provide a system that solves these challenges and improves employee work efficiency. [Means for solving the problem]

[0005] This invention provides a system that includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring a user's current location information to generate and display a list of other users nearby, and a means for generating and presenting appropriate lunch suggestions based on the user's profile information. This allows the usage status of conference rooms and individual booths to be displayed in real time, and allows users to acquire and display the schedule information of specific other users. It also provides lunch suggestions and task management support, comprehensively resolving employee concerns.

[0006] "Reservation status of conference rooms and individual booths" refers to information on whether conference rooms and individual booths are currently in use, reserved, or available.

[0007] "User's current location information" is data that indicates the physical location of the system user, and includes GPS data and Wi-Fi location information.

[0008] "List of other users" refers to a collection of names and identities of other system users generated based on certain criteria (e.g., users nearby, users in the same workplace, etc.).

[0009] "User profile information" is individual data about each user, including information such as name, job title, diet status, and preferences.

[0010] "Lunch Suggestions" refers to a feature that suggests suitable meal options based on a user's profile information.

[0011] "Means of monitoring and updating" refers to the system functions and processes for checking the reservation status of conference rooms and individual booths in real time and keeping that information up to date.

[0012] "Means of acquisition and display" refers to the system functions and processes for collecting various data and displaying it appropriately on the user interface.

[0013] "Means of generation and presentation" refers to the system functions and processes for creating new information and suggestions based on input from users and acquired data, and displaying them to users. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] This invention is a system that solves various issues faced by office workers, and provides comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[0036] System Configuration

[0037] 1. Server

[0038] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[0039] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[0040] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[0041] 2. Terminal (user device)

[0042] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[0043] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[0044] 3. Users

[0045] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[0046] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[0047] Program processing

[0048] 1. Conference room / individual booth reservation management

[0049] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[0050] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[0051] 2. Displaying nearby employees

[0052] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[0053] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[0054] 3. Lunch Suggestions

[0055] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[0056] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[0057] Specific examples

[0058] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[0059] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[0060] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve the efficiency of office work.

[0061] The processing flow will be explained below.

[0062] Specific flow of program processing

[0063] Check availability and reserve meeting rooms / individual booths

[0064] Step 1:

[0065] User: Launches the app.

[0066] Step 2:

[0067] Terminal: A user operates the terminal to send a "conference room availability" request to the server.

[0068] Step 3:

[0069] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[0070] Step 4:

[0071] Server: Returns data including availability to the device.

[0072] Step 5:

[0073] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[0074] Step 6:

[0075] User: Check availability, select the desired conference room and make a reservation.

[0076] Step 7:

[0077] Terminal: Enters reservation information and sends a reservation request to the server.

[0078] Step 8:

[0079] Server: Receives reservation requests and updates the reservation status in the database.

[0080] Step 9:

[0081] Server: Notifies the terminal that the reservation has been confirmed.

[0082] Step 10:

[0083] Terminal: Display a notification to the user that the reservation is complete.

[0084] Displaying nearby employees

[0085] Step 1:

[0086] User: Launches the app.

[0087] Step 2:

[0088] Terminal: The user operates the terminal to send a request to the server for a list of nearby employees.

[0089] Step 3:

[0090] Server: Receives the request and obtains the user's current location information.

[0091] Step 4:

[0092] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[0093] Step 5:

[0094] Server: Returns the generated employee list to the terminal.

[0095] Step 6:

[0096] Terminal: The received employee list is displayed to the user.

[0097] Step 7:

[0098] User: Tap a specific employee name.

[0099] Step 8:

[0100] Device: Sends a request to the server containing the tapped employee name.

[0101] Step 9:

[0102] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[0103] Step 10:

[0104] Server: Returns the acquired schedule information to the terminal.

[0105] Step 11:

[0106] Terminal: Displays the received schedule information to the user.

[0107] Buddy feature lunch suggestions

[0108] Step 1:

[0109] User: Activates the in-app buddy feature.

[0110] Step 2:

[0111] User: Enters a request such as "I'm not sure what to have for lunch."

[0112] Step 3:

[0113] Terminal: Sends user requests to the server.

[0114] Step 4:

[0115] Server: Receives the request and looks up the user's profile information in a database.

[0116] Step 5:

[0117] Server: Generates appropriate lunch suggestions based on the user's profile information.

[0118] Step 6:

[0119] Server: Sends the generated lunch suggestions back to the device.

[0120] Step 7:

[0121] Terminal: Displays received lunch suggestions to the user.

[0122] Step 8:

[0123] User: Review the lunch suggestions displayed and select.

[0124] Example 1

[0125] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0126] In modern workplaces, there are many tasks, such as reserving conference rooms or individual booths, tracking employees' current locations, and suggesting lunches based on individual employee needs. There is a need for a centralized system that can efficiently manage these tasks and is easy for users to use. However, current systems are unable to provide multiple functions in an integrated manner, resulting in a lack of convenience for users. Furthermore, the lack of real-time information updates and profile-based personalization results in a poor user experience. The goal of this project is to solve these issues.

[0127] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0128] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring the user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate lunch suggestions based on the user's profile information, a means for sending an information request from the terminal to the server and displaying the response, and a means for the user to acquire and manipulate information using a user interface. This allows users to grasp the reservation status of conference rooms and individual booths in real time and easily receive information and suggestions tailored to their individual needs. It also improves the efficiency of business interactions, such as displaying a list of other users based on location information.

[0129] "Reservation status of conference rooms and individual booths" is information indicating whether a conference room or individual booth is currently available or has already been reserved by another user.

[0130] "Means for monitoring and updating" refers to a function that checks the usage status of conference rooms and individual booths in real time and records the information in a database when any changes occur.

[0131] "User's current location information" refers to location information data such as GPS data and Wi-Fi location information for identifying the user's location.

[0132] The "list of other nearby users" is a list that compiles information about other users in the vicinity based on the user's current location.

[0133] "Means for generating and displaying" refers to the function of creating information based on data and displaying it to the user through a user interface.

[0134] "User profile information" is personal information including a user's individual settings, preferences, health status, etc.

[0135] "Lunch suggestion" refers to presenting a lunch menu that suits the user based on the user's profile information.

[0136] The "means for generating and presenting" is a function that creates appropriate lunch suggestions based on the user's profile information and provides them to the user through a user interface.

[0137] "Means for sending an information request from a terminal to a server and displaying the response" refers to a function in which a user uses a device to send a request for data to a server and displays the data received in response to the user.

[0138] A "user interface" is a screen or operating means that allows a user to interact with a system through a device.

[0139] "Means of obtaining and manipulating information" refers to the ability of a user to obtain the necessary data from the system and perform an action using that data.

[0140] MODE FOR CARRYING OUT THE INVENTION

[0141] This invention is a system for improving the work efficiency of office workers. This system includes functions such as reservation management for conference rooms and individual booths, management of employee location information, and lunch suggestions.

[0142] System Components

[0143] server

[0144] The server is the central part of the system and performs the following functions:

[0145] 1. Monitoring and updating of conference rooms and individual booths

[0146] The server uses a database to monitor the reservation status of conference rooms and individual booths, and updates the database when a reservation request comes in. For this purpose, it uses a relational database such as an SQL database.

[0147] 2. Acquisition and management of employee location information

[0148] The server uses GPS data and Wi-Fi location information to obtain the user's current location, and based on that information, generates a list of other users nearby. This location information is used to improve business efficiency.

[0149] 3. Lunch Suggestion Generation

[0150] The server references the user's profile information and generates lunch suggestions based on, for example, whether the user is on a diet or has certain food allergies. The suggestions are based on the user's health status and preferences.

[0151] Terminal (user's device)

[0152] The terminal communicates with the server through a user interface to realize the following operations:

[0153] 1. Submitting and Viewing Information Requests

[0154] When a user uses the app to request information such as available meeting rooms or lunch suggestions, the device sends an information request to the server, receives responses from the server, and displays them to the user.

[0155] 2. User Interface

[0156] The device provides an easy-to-use user interface, allowing users to easily obtain and operate the information they need. Intuitive operation is possible using swipes, taps, and other gestures.

[0157] User

[0158] By using this system, users can take advantage of the following functions:

[0159] 1. System Operation

[0160] Through the terminal, users can perform operations such as reserving conference rooms, checking employee locations, and receiving lunch suggestions.

[0161] 2. Update your profile

[0162] Users can update their profile information and receive more personalized suggestions from the system.

[0163] Specific examples

[0164] A specific example is given below.

[0165] 1. Conference Room Reservation

[0166] When user A checks the availability of a conference room and makes a reservation, he / she follows the steps below.

[0167] User A starts the app and sends a prompt message from the device to the server to request availability of conference rooms.

[0168] Example prompt: "What are the current conference room availability status?"

[0169] The server searches the database, obtains the latest reservation status, and returns it to the terminal.

[0170] The terminal displays the availability status to User A.

[0171] User A selects the desired conference room and time and sends a reservation request from the terminal to the server.

[0172] Example prompt: "Reserve conference room A from 10:00 AM to 11:00 AM."

[0173] The server saves the reservation information in its database and sends a confirmation message to User A.

[0174] 2. Lunch Suggestions

[0175] If User B wants lunch suggestions, he / she will take the following steps:

[0176] User B uses the app's lunch suggestion feature and submits a request.

[0177] Example prompt: "Suggest a good lunch for someone on a diet."

[0178] The server references User B's profile information and generates lunch suggestions based on his health status and preferences.

[0179] The terminal displays the generated lunch suggestions to User B.

[0180] Through this system, users can not only improve their work efficiency but also ensure that their daily work proceeds smoothly.

[0181] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0182] Program processing flow and specific operation explanation

[0183] Conference room / individual booth reservation management

[0184] Processing Steps

[0185] Step 1:

[0186] The user launches the app and makes a request to check the availability of conference rooms. Specifically, the user opens the app's conference room reservation screen and presses the button to check availability. The device receives this operation and sends a prompt message (e.g., "Tell me the current availability of conference rooms") to the server.

[0187] Input: Room availability request

[0188] Output: Request sent to the server

[0189] Step 2:

[0190] The server searches the database based on the request received from the terminal, specifically searching for the reservation status of conference rooms and individual booths and obtaining the latest information.

[0191] Input: Availability request

[0192] Output: Latest reservation status data

[0193] Step 3:

[0194] The server transmits the acquired latest reservation status data to the terminal.

[0195] Input: Latest reservation status data

[0196] Output: Reservation status data sent to the terminal

[0197] Step 4:

[0198] The terminal displays the latest reservation status data received from the server to the user. Specifically, the availability of conference rooms is displayed in a list.

[0199] Input: Reservation status data received from the server

[0200] Output: Availability information displayed on the screen

[0201] Step 5:

[0202] The user selects the desired conference room and time slot and confirms the reservation request. The terminal receives this selection and sends a reservation request (e.g., "Reserve conference room A from 10:00 AM to 11:00 AM") to the server.

[0203] Input: User's reservation selection

[0204] Output: Booking request sent to the server

[0205] Step 6:

[0206] The server updates the database based on the received reservation request, saves the new reservation information, and sends a confirmation message to the terminal after saving is complete.

[0207] Input: The booking request sent to the server

[0208] Output: Database update, new reservation information, confirmation message

[0209] Step 7:

[0210] The terminal receives a confirmation message from the server and notifies the user that the reservation is confirmed.

[0211] Input: Confirmation message

[0212] Output: Confirmation of reservation sent to user

[0213] Lunch Suggestions

[0214] Processing Steps

[0215] Step 1:

[0216] The user uses the app's lunch suggestion function to send a request. Specifically, the user opens the app's lunch suggestion screen and presses the button to accept the suggestion. The device receives this operation and sends a prompt message (e.g., "Suggest a lunch suitable for dieting") to the server.

[0217] Input: Lunch suggestion request

[0218] Output: Request sent to the server

[0219] Step 2:

[0220] The server retrieves the user's profile information from the database based on the request received from the device, specifically by referencing data such as health status and preferences.

[0221] Input: Lunch suggestion request

[0222] Output: Profile information

[0223] Step 3:

[0224] The server generates lunch suggestions that match the user's needs based on the profile information it has acquired, specifically by suggesting menus that take into account the user's health status and preferences.

[0225] Input: Profile Information

[0226] Output: Lunch suggestions data

[0227] Step 4:

[0228] The server transmits the generated lunch proposal data to the terminal.

[0229] Input: Lunch suggestion data

[0230] Output: Proposal data sent to the device

[0231] Step 5:

[0232] The terminal displays the lunch proposal data received from the server to the user. Specifically, the proposed menu is displayed on the screen.

[0233] Input: Proposal data received from the server

[0234] Output: Lunch suggestions displayed on screen

[0235] This allows users to conveniently and quickly receive conference room reservations and lunch suggestions, improving work efficiency.

[0236] (Application example 1)

[0237] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0238] Conventional office management systems provide functions such as reservation management for conference rooms and individual booths, location management for employees, and lunch suggestions, but they lack the flexibility to adapt to modern factory environments, where greater efficiency is required. In particular, there is a need for systems that can address the unique needs of factories, such as reservation management for work areas and machinery, location management for workers, and meal suggestions based on workers' health conditions.

[0239] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0240] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring a user's current location information and generating and displaying a list of other nearby users, means for generating and presenting appropriate lunch suggestions based on the user's profile information, means for monitoring and updating the reservation status of work areas and machinery, means for acquiring and managing the location information of workers in the work area, and means for generating and presenting appropriate meal suggestions based on the worker's profile information. This enables the efficiency of reservation management, location information management, and meal suggestions in a factory environment, just as in an office environment.

[0241] A "conference room" is a room set aside for holding meetings or discussions within an office or factory.

[0242] An "individual booth" is a small space separated for individual or small group work or meetings.

[0243] "Reservation status" refers to whether or not the use of conference rooms, individual booths, work areas, and machinery and equipment has been reserved in advance.

[0244] "User" refers to an employee, worker, administrator, or the like who uses this system.

[0245] "Location information" is information for identifying the current location of a user or worker.

[0246] A "work area" is a space designated for the performance of a particular task or activity.

[0247] "Machinery and equipment" is a general term for devices and machines that support work within a factory.

[0248] "Profile information" is information that records personal information, preferences, health status, etc., related to users and workers.

[0249] "Lunch suggestion" refers to presenting an appropriate lunch menu based on the user's profile information.

[0250] "Meal suggestions" refers to presenting an appropriate meal menu based on the worker's profile information, taking into consideration their health condition, etc.

[0251] The "list of other nearby users" is a list of other users who are located in the vicinity of a specific user based on the current location information of the user.

[0252] A "server" is a computer system used to manage and process data.

[0253] The system that embodies this invention consists of three elements: a server, a terminal, and a user. The server performs the main data processing and monitoring, and the terminal functions as an interface with the user. The user operates the system through the terminal and receives the necessary information and suggestions.

[0254] server

[0255] The server's main responsibilities are:

[0256] Reservation management of conference rooms and individual booths: The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[0257] Reservation management for work areas and machinery: Similarly, the reservation status of work areas and machinery is managed, and when a reservation request comes in, new reservation information is saved in the database.

[0258] Location information management: The server obtains the current location information of users and workers using GPS data and Wi-Fi location information, and generates a list of other users and workers who are nearby.

[0259] Proposal generation based on profile information: The server references the profile information of users and workers and generates lunch and meal suggestions based on that information.

[0260] Terminal (user's device)

[0261] The terminal has the following responsibilities:

[0262] Information request and display: The user operates the terminal to request the availability of conference rooms, individual booths, work areas, and machinery from the server, and the results are displayed. Also, a list of other nearby users and workers is displayed based on the user's or worker's current location information.

[0263] Updating profile information: Users and workers can update their own profile information through their terminals, and based on that information, they can receive appropriate suggestions from the server.

[0264] User

[0265] Users and workers use the terminals to access various functions of the system, including reserving conference rooms and individual booths, checking nearby users and workers, and receiving lunch and meal suggestions.

[0266] Hardware and software used

[0267] Hardware: Servers, factory robots, smart devices

[0268] Software: Python (programming), SQLite (database management), JSON (data format)

[0269] Specific examples

[0270] For example, when User A checks the availability of a conference room and makes a reservation, a request is sent from the terminal to the server, and the server retrieves the current availability from the database and returns it. User A checks the displayed information, selects the desired conference room, and confirms the reservation. This updates the server's database.

[0271] Similarly, when factory robot R1 reserves work area A for one hour, a request is sent to the server and the reservation information is saved in the database. Furthermore, if "Suggest a lunch for employee with ID 1" is entered as the prompt, the server generates a lunch suggestion suitable for the worker with the specified ID and sends it to the terminal.

[0272] In this way, the system of the present invention can flexibly respond to various needs in office and factory environments and can significantly improve business efficiency.

[0273] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0274] Step 1:

[0275] The terminal sends a request to the server to check the availability of conference rooms and work areas in response to user operation. The input includes information on the date, time, and location selected by the user. By sending this information to the server, the terminal provides the basic data for the server to check the reservation status.

[0276] Step 2:

[0277] The server searches the database based on the received request to obtain the latest reservation status for the specified date, time, and location. The server uses the received date, time, and location information as a key to find the appropriate reservation information from the database and obtain it in real time. The output is the current availability data.

[0278] Step 3:

[0279] The server returns the acquired reservation status data to the terminal, allowing the user to immediately check the reservation status for the date, time, and location specified by the user. The server creates the acquired availability status based on the information in the database and sends it to the terminal.

[0280] Step 4:

[0281] The terminal displays the reservation status data received from the server on the user interface. Based on this displayed information, the user can select an available conference room or work area and make a reservation. The input is the data received from the server, and the output is to provide the information to the user in a visually easy-to-reach format.

[0282] Step 5:

[0283] The user selects the desired conference room or work area using the terminal interface and confirms the reservation. Based on the user's operation, the terminal generates new reservation information and sends it to the server. It also compiles request data including the selected conference room or work area and date and time details.

[0284] Step 6:

[0285] The server updates the database based on the new reservation information received, thereby confirming the new reservation for the specified date, time, and location. The server receives reservation request data as input and processes the database record as output.

[0286] Step 7:

[0287] When a user wants to update their profile information, the device sends the profile information to the server. The user enters data about their health status and dietary preferences, which are then sent to the server via the device.

[0288] Step 8:

[0289] The server stores the profile information in a database and generates lunch and meal suggestions based on that information. Based on this information, the server uses a generative AI model to make appropriate suggestions. Based on the received profile information, the server updates the database and generates suggestions using the generative AI model.

[0290] Step 9:

[0291] The user sends a request to the server through the terminal and receives suggested lunch or meal information. The input is the profile information and the request, and the output is the suggested lunch or meal information sent from the server.

[0292] Step 10:

[0293] The terminal displays the received lunch and meal suggestions to the user, allowing the user to select the meal that best suits them. The terminal visually displays the data received from the server. The same process is followed when a prompt such as "Suggest a lunch for employee with ID 1" is entered.

[0294] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0295] This invention is a system designed to solve various issues faced by office workers, providing comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides even more advanced support. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[0296] System Configuration

[0297] 1. Server

[0298] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[0299] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[0300] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[0301] Emotion engine: The emotion engine built into the server recognizes emotions from the user's facial expressions, voice tone, text input, etc., and stores the information in a database. Based on this emotional information, various services can be provided in a more personalized manner.

[0302] 2. Terminal (user device)

[0303] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[0304] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[0305] 3. Users

[0306] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[0307] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[0308] Emotional information input: Users input facial expressions, voice, and text so that the emotion engine can properly recognize emotions.

[0309] Program processing

[0310] 1. Conference room / individual booth reservation management

[0311] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[0312] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[0313] 2. Displaying nearby employees

[0314] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[0315] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[0316] 3. Lunch Suggestions

[0317] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[0318] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[0319] 4. Use of Emotion Engine

[0320] Server: The emotion engine analyzes the user's emotions from their facial expressions, voice, and text, and stores the information in a database.

[0321] Terminal: Based on the emotional data analyzed by the emotion engine, the system displays appropriate suggestions and advice to the user. For example, if the user is feeling stressed, the system will suggest ways to relax.

[0322] Specific examples

[0323] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[0324] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[0325] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[0326] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve work efficiency in the office. By incorporating an emotion engine, even more advanced personalized support becomes possible.

[0327] The processing flow will be explained below.

[0328] Check availability and reserve meeting rooms / individual booths

[0329] Step 1:

[0330] User: Launches the app.

[0331] Step 2:

[0332] Terminal: Sends a "conference room availability" request to the server.

[0333] Step 3:

[0334] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[0335] Step 4:

[0336] Server: Returns availability information to the terminal.

[0337] Step 5:

[0338] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[0339] Step 6:

[0340] User: Check availability, select the desired conference room and make a reservation.

[0341] Step 7:

[0342] Terminal: Sends the user's reservation information to the server.

[0343] Step 8:

[0344] Server: Receives reservation requests and updates the reservation status in the database.

[0345] Step 9:

[0346] Server: Notifies the terminal of the confirmed reservation information.

[0347] Step 10:

[0348] Terminal: Display a notification to the user that the reservation is complete.

[0349] Displaying nearby employees

[0350] Step 1:

[0351] User: Launches the app.

[0352] Step 2:

[0353] Terminal: Sends a request to the server for a list of nearby employees.

[0354] Step 3:

[0355] Server: Obtains the user's current location information.

[0356] Step 4:

[0357] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[0358] Step 5:

[0359] Server: Returns the generated employee list to the terminal.

[0360] Step 6:

[0361] Terminal: The received employee list is displayed to the user.

[0362] Step 7:

[0363] User: Tap a specific employee name.

[0364] Step 8:

[0365] Device: Sends a request to the server containing the tapped employee name.

[0366] Step 9:

[0367] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[0368] Step 10:

[0369] Server: Returns the acquired schedule information to the terminal.

[0370] Step 11:

[0371] Terminal: Displays the received schedule information to the user.

[0372] Buddy feature lunch suggestions

[0373] Step 1:

[0374] User: Activate the Buddy feature.

[0375] Step 2:

[0376] User: Type "I'm not sure what to have for lunch."

[0377] Step 3:

[0378] Terminal: Sends requests to the server.

[0379] Step 4:

[0380] Server: Looks up the user's profile information from a database.

[0381] Step 5:

[0382] Server: Generates lunch suggestions based on the user's profile information.

[0383] Step 6:

[0384] Server: Sends proposals back to the device.

[0385] Step 7:

[0386] Device: Show lunch suggestions.

[0387] Step 8:

[0388] User: Review the suggestions and make a selection.

[0389] Use of emotion engine

[0390] Step 1:

[0391] User: Launches the app.

[0392] Step 2:

[0393] Terminal: Collects emotional data such as the user's facial expressions, voice, and text input.

[0394] Step 3:

[0395] Terminal: Sends collected emotion data to the server.

[0396] Step 4:

[0397] Server: The emotion engine analyzes the emotion data and identifies the user's emotional state.

[0398] Step 5:

[0399] Server: Generates appropriate suggestions and advice based on the user's emotional state.

[0400] Step 6:

[0401] Server: Sends generated suggestions and advice back to the device.

[0402] Step 7:

[0403] Device: Display emotion-based suggestions and advice to the user.

[0404] Step 8:

[0405] User: Review the suggestions and advice and act as needed.

[0406] This is the specific processing flow of the present invention. This system allows users to reserve conference rooms or booths, check nearby employees, suggest lunches, and receive comprehensive support based on their emotions.

[0407] Example 2

[0408] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0409] Employees face many challenges in modern office environments. Reservation management for conference rooms and individual booths is time-consuming, making it difficult to secure an appropriate workspace. It's also difficult to track colleagues' locations, reducing the efficiency of collaboration. Furthermore, there are no meal suggestions based on each employee's health status or preferences, which can lead to stress when choosing what to eat during work. Furthermore, stress management is difficult because employees' emotional states are not recognized and appropriate support based on them is not provided.

[0410] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0411] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring a user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate meal suggestions based on the user's profile information, and a means for recognizing a user's emotions and generating and presenting suggestions based on those emotions. This streamlines conference room reservation management in an office environment and enables quick collaboration with colleagues. It also provides meal suggestions tailored to individual health conditions and preferences, reducing stress during work. Furthermore, emotion recognition technology can support employees' mental health.

[0412] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system that has the function of understanding the usage status of conference rooms and individual booths in real time and updating the database in response to user reservation requests.

[0413] "Means for acquiring the user's current location information and generating and displaying a list of other users nearby" refers to a system that has the function of collecting the user's location information, identifying other users nearby based on that data, and displaying them as a list.

[0414] "Means for generating and presenting appropriate meal suggestions based on user profile information" refers to a system that has the function of generating optimal meal options based on information about the user's health condition and preferences and presenting them to the user.

[0415] "Means for recognizing the user's emotions and generating and presenting suggestions based on them" refers to a system that has the function of analyzing the user's emotions from facial expressions, voice, text, etc., and generating and presenting suggestions for stress management, relaxation methods, etc. based on the results.

[0416] This invention is a system that significantly improves the work efficiency of office workers by managing reservations for conference rooms and individual booths, managing employee location information, suggesting health-based meals, and utilizing an emotion engine that recognizes the user's emotions. This system is primarily composed of three elements: a server, a terminal (user device), and the user.

[0417] Hardware and software used

[0418] Server: Use an EC2 instance from Amazon Web Services (AWS).

[0419] Database: Use Amazon RDS (relational database service).

[0420] Various APIs: Utilize Google Maps API (to obtain location information) and Microsoft Azure Emotion API (for emotion recognition).

[0421] Devices: Use applications developed for iOS or Android devices.

[0422] Conference room / individual booth reservation management

[0423] The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. The terminal inquires about availability from the server in response to a user request and displays the retrieved data to the user. When the user confirms a reservation, the terminal sends the information to the server, which then updates the database.

[0424] Displaying nearby employees

[0425] The server acquires the user's location information and generates a list of nearby employees based on that information. The device queries the server for location information at the user's request and displays the received employee list to the user. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[0426] Lunch Suggestions

[0427] The server references the user's profile information from a database and generates appropriate lunch suggestions based on that data. The device queries the server for lunch suggestions in response to the user's request and displays the received suggestions to the user.

[0428] Use of emotion engine

[0429] The server uses an emotion engine to analyze the user's emotions from their facial expressions, voice, and text, and stores the results in a database. The device then displays appropriate suggestions and advice to the user based on the emotion data. For example, if the user is feeling stressed, the server generates relaxation suggestions, and the device displays that information to the user.

[0430] Examples of concrete examples and prompts

[0431] Here is a concrete example using this system:

[0432] Meeting room booking process

[0433] When User A starts the app and checks the availability of conference rooms, the device requests information from the server. The server retrieves the latest reservation information from the database and sends it back to the device. User A selects the desired conference room and confirms the reservation. The device sends a reservation request to the server, which updates the database.

[0434] The process of receiving lunch suggestions

[0435] When User B presses the "Lunch Suggestion" button, the device sends a request to the server. The server generates appropriate lunch suggestions based on User B's profile information and sends them to the device. User B can then select a lunch based on the suggestions.

[0436] Suggestions using an emotion engine

[0437] If user C feels stressed at work, the emotion engine recognizes that emotion and generates relaxation suggestions. The device displays the suggestions to user C, who can then perform relaxation activities such as stretching or taking a break.

[0438] An example prompt based on this system is:

[0439] "I want to check the reservation status of conference rooms and make new reservations."

[0440] "Please suggest some lunches for those on a diet."

[0441] "Please give me some relaxation tips based on my current stress level."

[0442] The present invention is extremely useful as a system for significantly improving work efficiency in an office environment and maximizing employee health and work efficiency.

[0443] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0444] The flow of this system's program processing

[0445] Conference room / individual booth reservation management

[0446] Step 1:

[0447] When a user opens a reservation application, the terminal sends a request to the server to find out the availability of conference rooms or individual booths. This request includes the user ID and the desired date and time.

[0448] Step 2:

[0449] The server retrieves the latest reservation status from the database based on the received request, and the output from the database is a list of available conference rooms and booths.

[0450] Step 3:

[0451] The server sends the acquired reservation information to the terminal, which receives this information and displays it to the user. The user then selects the desired conference room or booth from the list.

[0452] Step 4:

[0453] When the user selects the desired conference room or booth and presses the "reserve" button, the terminal sends a reservation request including the selected information to the server.

[0454] Step 5:

[0455] The server updates the database based on the received reservation request, and the updated reservation information is reflected in real time for other users.

[0456] Displaying nearby employees

[0457] Step 1:

[0458] When a user selects the "nearby coworkers" option, the device sends a location request to the server, which includes the user's current location.

[0459] Step 2:

[0460] The server analyzes the user's location information and retrieves the location information of other nearby employees from a database, resulting in a list of nearby employees.

[0461] Step 3:

[0462] The server sends the generated list to the terminal, which displays the list to the user, allowing the user to select a specific employee from the list.

[0463] Step 4:

[0464] When the user selects a particular employee's name, the terminal requests that employee's schedule information from the server.

[0465] Step 5:

[0466] The server retrieves the employee's schedule information from the database based on the received request and sends it to the terminal, which then displays the information to the user.

[0467] Lunch Suggestions

[0468] Step 1:

[0469] When a user presses the "Lunch Suggestion" button in the app, the device sends a lunch suggestion request to the server, which includes the user's profile information.

[0470] Step 2:

[0471] The server generates appropriate lunch suggestions based on the user's profile information, which includes information on health status and food allergies, and selects the optimal lunch menu based on this information.

[0472] Step 3:

[0473] The server sends the generated lunch suggestions to the terminal, which displays this information to the user, who can then choose a lunch based on the suggestions.

[0474] Use of emotion engine

[0475] Step 1:

[0476] Within the application, users can direct their facial expressions at the camera, speak, or input text, and this data is sent from the device to the server.

[0477] Step 2:

[0478] The server uses an emotion engine to analyze the received emotion data. During this process, emotions are identified from facial expressions, voice, and text. Emotion data is generated as a result of the analysis.

[0479] Step 3:

[0480] The server generates appropriate suggestions and advice for the user based on the emotion data. For example, if the user is feeling stressed, it generates suggestions for relaxation.

[0481] Step 4:

[0482] The server sends the generated suggestions to the device, which then displays the information to the user, who can then stretch or take a break based on the suggestions.

[0483] This concludes the detailed operation of each processing step. This system allows users to efficiently reserve conference rooms and booths, obtain information about nearby employees, receive health-based lunch suggestions, and manage stress.

[0484] (Application example 2)

[0485] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0486] In conventional office environments, multiple tasks, such as managing reservations for conference rooms and individual booths, keeping track of employee schedules, and suggesting lunch options, are often cumbersome, resulting in reduced work efficiency. In particular, there is a lack of personalized support that takes into account the user's emotional state, making it difficult to improve the user experience. Similarly, individual optimization based on user profile information is also difficult to achieve. Therefore, the present invention aims to provide a comprehensive system that solves these issues and improves work efficiency.

[0487] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0488] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring the user's current location information and generating and displaying a list of other users nearby, means for generating and presenting appropriate lunch suggestions based on the user's profile information, and means for analyzing the user's facial expressions and voice tone to recognize the user's emotional state and generate personalized suggestions. This allows for real-time and individualized optimization of support for users, thereby improving work efficiency in office environments.

[0489] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system or device for grasping and updating the reservation status of conference rooms and individual booths in real time.

[0490] "Means for acquiring the user's current location information and generating and displaying a list of other nearby users" refers to a system or device that collects the user's current location information and, based on that information, creates and displays a list of other nearby users.

[0491] "Means for generating and presenting appropriate lunch suggestions based on user profile information" refers to a system or device that refers to the user's profile information and suggests and presents the optimal lunch for the user based on that information.

[0492] "Means for analyzing a user's facial expressions and vocal tone to recognize the emotional state and generate personalized suggestions" refers to a system or device that recognizes a user's emotional state by analyzing the user's facial expressions and vocal tone, and generates individually optimized suggestions based on that information.

[0493] The present invention is a system for solving various problems faced by individuals working in an office, and provides comprehensive support by combining conference room and individual booth reservation management, current location information management, lunch suggestions, and an emotion recognition engine. Specific embodiments of the present invention are described below.

[0494] System configuration

[0495] 1. Server

[0496] Monitoring and updating reservation status: The server monitors and updates the reservation status of conference rooms and individual booths, and stores this information in a database. This allows the system to always provide the latest reservation status.

[0497] Location management: The server obtains the user's current location based on GPS data and Wi-Fi location information and generates a list of other users nearby.

[0498] Lunch suggestion generation: The server looks up the user's profile information and generates appropriate lunch suggestions based on that data.

[0499] Emotion Engine: The emotion engine analyzes the user's facial expressions and vocal tone to generate emotional data, which is then used to make personalized suggestions.

[0500] 2. Terminal (user device)

[0501] Information request and display: Based on the user's actions, the device sends an information request to the server and displays the received information to the user, including information about available conference rooms, a list of nearby employees, and lunch suggestions.

[0502] Acquiring emotion recognition data: The device uses the built-in camera and microphone to analyze the user's facial expressions and voice tone in real time to generate emotion data.

[0503] 3. Users

[0504] System operation: Users can operate the terminal to check conference room reservation information, make new reservations, check the schedules of nearby employees, and receive lunch suggestions.

[0505] Emotional information input: Users provide appropriate input through facial expressions and voice tone to ensure that the emotion engine obtains accurate data.

[0506] Examples and prompts

[0507] As a concrete example, we will explain the process by which User A checks the availability of a conference room and makes a reservation. When User A starts the application, the device sends a request for availability to the server, and the server retrieves the latest reservation status from the database and sends it back. User A selects the desired conference room from the available information displayed and confirms the reservation from the device. At this time, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[0508] As another example, consider the case where User B receives lunch suggestions. When User B sends a request using the application's lunch suggestion function, the server suggests suitable lunches based on the user profile and sends them to the device. User B can review the suggestions and select one.

[0509] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[0510] Prompt Sentence Examples

[0511] "Recommend the best food for the user, taking into account their food preferences, allergy information, past ordering history, and current emotional state. For example, if the user is feeling stressed, suggest a lunch that includes ingredients that will help them relax."

[0512] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0513] Step 1:

[0514] The server retrieves the latest reservation status of conference rooms and individual booths from the database. The input is a reservation status request, and the output is the latest reservation status data. This ensures the consistency of reservation information in real time.

[0515] Step 2:

[0516] When the user launches the application, the terminal sends a request for reservation status to the server. The input is the user's operation, and the output is the request sent to the server. This allows the user to obtain the latest information.

[0517] Step 3:

[0518] The server obtains the user's current location information and generates a list of other nearby users. The input is GPS data and Wi-Fi location information, and the output is a list of nearby users. Location analysis allows us to understand the distance between users in real time.

[0519] Step 4:

[0520] The device sends a location information request to the server and displays the obtained list to the user. The input is the list data from the server, and the output is the list information displayed on the user interface. This allows the user to easily check other users nearby.

[0521] Step 5:

[0522] The server references the user's profile information and generates appropriate lunch suggestions based on that data. The input is the user profile information, and the output is lunch suggestion data. Analysis of the profile information enables personalized suggestions.

[0523] Step 6:

[0524] The terminal requests lunch suggestions from the server and displays the received suggestions to the user. The input is the user's request and the suggestion data from the server, and the output is the displayed lunch suggestions, allowing the user to select a suitable lunch for themselves.

[0525] Step 7:

[0526] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time and generate emotion data. The input is the user's facial expressions and voice tone, and the output is emotion data. Emotion recognition libraries such as OpenCV and DeepFace are used for data analysis.

[0527] Step 8:

[0528] The server recognizes the user's current emotional state based on the emotional data received from the device and generates personalized suggestions. The input is emotional data, and the output is personalized suggestions. This enables more appropriate support for the user.

[0529] Step 9:

[0530] The device displays personalized suggestions to the user. The input is the suggestion data from the server, and the output is the displayed suggestion information. This allows the user to select an action that suits their emotional state.

[0531] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0532] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0533] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0534] [Second embodiment]

[0535] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0536] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0537] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0538] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0539] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0540] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0541] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0542] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0543] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0544] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0545] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0546] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0547] This invention is a system that solves various issues faced by office workers, and provides comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[0548] System Configuration

[0549] 1. Server

[0550] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[0551] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[0552] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[0553] 2. Terminal (user device)

[0554] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[0555] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[0556] 3. Users

[0557] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[0558] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[0559] Program processing

[0560] 1. Conference room / individual booth reservation management

[0561] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[0562] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[0563] 2. Displaying nearby employees

[0564] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[0565] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[0566] 3. Lunch Suggestions

[0567] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[0568] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[0569] Specific examples

[0570] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[0571] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[0572] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve the efficiency of office work.

[0573] The processing flow will be explained below.

[0574] Specific flow of program processing

[0575] Check availability and reserve meeting rooms / individual booths

[0576] Step 1:

[0577] User: Launches the app.

[0578] Step 2:

[0579] Terminal: A user operates the terminal to send a "conference room availability" request to the server.

[0580] Step 3:

[0581] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[0582] Step 4:

[0583] Server: Returns data including availability to the device.

[0584] Step 5:

[0585] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[0586] Step 6:

[0587] User: Check availability, select the desired conference room and make a reservation.

[0588] Step 7:

[0589] Terminal: Enters reservation information and sends a reservation request to the server.

[0590] Step 8:

[0591] Server: Receives reservation requests and updates the reservation status in the database.

[0592] Step 9:

[0593] Server: Notifies the terminal that the reservation has been confirmed.

[0594] Step 10:

[0595] Terminal: Display a notification to the user that the reservation is complete.

[0596] Displaying nearby employees

[0597] Step 1:

[0598] User: Launches the app.

[0599] Step 2:

[0600] Terminal: The user operates the terminal to send a request to the server for a list of nearby employees.

[0601] Step 3:

[0602] Server: Receives the request and obtains the user's current location information.

[0603] Step 4:

[0604] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[0605] Step 5:

[0606] Server: Returns the generated employee list to the terminal.

[0607] Step 6:

[0608] Terminal: The received employee list is displayed to the user.

[0609] Step 7:

[0610] User: Tap a specific employee name.

[0611] Step 8:

[0612] Device: Sends a request to the server containing the tapped employee name.

[0613] Step 9:

[0614] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[0615] Step 10:

[0616] Server: Returns the acquired schedule information to the terminal.

[0617] Step 11:

[0618] Terminal: Displays the received schedule information to the user.

[0619] Buddy feature lunch suggestions

[0620] Step 1:

[0621] User: Activates the in-app buddy feature.

[0622] Step 2:

[0623] User: Enters a request such as "I'm not sure what to have for lunch."

[0624] Step 3:

[0625] Terminal: Sends user requests to the server.

[0626] Step 4:

[0627] Server: Receives the request and looks up the user's profile information in a database.

[0628] Step 5:

[0629] Server: Generates appropriate lunch suggestions based on the user's profile information.

[0630] Step 6:

[0631] Server: Sends the generated lunch suggestions back to the device.

[0632] Step 7:

[0633] Terminal: Displays received lunch suggestions to the user.

[0634] Step 8:

[0635] User: Review the lunch suggestions displayed and select.

[0636] Example 1

[0637] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0638] In modern workplaces, there are many tasks, such as reserving conference rooms or individual booths, tracking employees' current locations, and suggesting lunches based on individual employee needs. There is a need for a centralized system that can efficiently manage these tasks and is easy for users to use. However, current systems are unable to provide multiple functions in an integrated manner, resulting in a lack of convenience for users. Furthermore, the lack of real-time information updates and profile-based personalization results in a poor user experience. The goal of this project is to solve these issues.

[0639] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0640] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring the user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate lunch suggestions based on the user's profile information, a means for sending an information request from the terminal to the server and displaying the response, and a means for the user to acquire and manipulate information using a user interface. This allows users to grasp the reservation status of conference rooms and individual booths in real time and easily receive information and suggestions tailored to their individual needs. It also improves the efficiency of business interactions, such as displaying a list of other users based on location information.

[0641] "Reservation status of conference rooms and individual booths" is information indicating whether a conference room or individual booth is currently available or has already been reserved by another user.

[0642] "Means for monitoring and updating" refers to a function that checks the usage status of conference rooms and individual booths in real time and records the information in a database when any changes occur.

[0643] "User's current location information" refers to location information data such as GPS data and Wi-Fi location information for identifying the user's location.

[0644] The "list of other nearby users" is a list that compiles information about other users in the vicinity based on the user's current location.

[0645] "Means for generating and displaying" refers to the function of creating information based on data and displaying it to the user through a user interface.

[0646] "User profile information" is personal information including a user's individual settings, preferences, health status, etc.

[0647] "Lunch suggestion" refers to presenting a lunch menu that suits the user based on the user's profile information.

[0648] The "means for generating and presenting" is a function that creates appropriate lunch suggestions based on the user's profile information and provides them to the user through a user interface.

[0649] "Means for sending an information request from a terminal to a server and displaying the response" refers to a function in which a user uses a device to send a request for data to a server and displays the data received in response to the user.

[0650] A "user interface" is a screen or operating means that allows a user to interact with a system through a device.

[0651] "Means of obtaining and manipulating information" refers to the ability of a user to obtain the necessary data from the system and perform an action using that data.

[0652] MODE FOR CARRYING OUT THE INVENTION

[0653] This invention is a system for improving the work efficiency of office workers. This system includes functions such as reservation management for conference rooms and individual booths, management of employee location information, and lunch suggestions.

[0654] System Components

[0655] server

[0656] The server is the central part of the system and performs the following functions:

[0657] 1. Monitoring and updating of conference rooms and individual booths

[0658] The server uses a database to monitor the reservation status of conference rooms and individual booths, and updates the database when a reservation request comes in. For this purpose, it uses a relational database such as an SQL database.

[0659] 2. Acquisition and management of employee location information

[0660] The server uses GPS data and Wi-Fi location information to obtain the user's current location, and based on that information, generates a list of other users nearby. This location information is used to improve business efficiency.

[0661] 3. Lunch Suggestion Generation

[0662] The server references the user's profile information and generates lunch suggestions based on, for example, whether the user is on a diet or has certain food allergies. The suggestions are based on the user's health status and preferences.

[0663] Terminal (user's device)

[0664] The terminal communicates with the server through a user interface to realize the following operations:

[0665] 1. Submitting and Viewing Information Requests

[0666] When a user uses the app to request information such as available meeting rooms or lunch suggestions, the device sends an information request to the server, receives responses from the server, and displays them to the user.

[0667] 2. User Interface

[0668] The device provides an easy-to-use user interface, allowing users to easily obtain and operate the information they need. Intuitive operation is possible using swipes, taps, and other gestures.

[0669] User

[0670] By using this system, users can take advantage of the following functions:

[0671] 1. System Operation

[0672] Through the terminal, users can perform operations such as reserving conference rooms, checking employee locations, and receiving lunch suggestions.

[0673] 2. Update your profile

[0674] Users can update their profile information and receive more personalized suggestions from the system.

[0675] Specific examples

[0676] A specific example is given below.

[0677] 1. Conference Room Reservation

[0678] When user A checks the availability of a conference room and makes a reservation, he / she follows the steps below.

[0679] User A starts the app and sends a prompt message from the device to the server to request availability of conference rooms.

[0680] Example prompt: "What are the current conference room availability status?"

[0681] The server searches the database, obtains the latest reservation status, and returns it to the terminal.

[0682] The terminal displays the availability status to User A.

[0683] User A selects the desired conference room and time and sends a reservation request from the terminal to the server.

[0684] Example prompt: "Reserve conference room A from 10:00 AM to 11:00 AM."

[0685] The server saves the reservation information in its database and sends a confirmation message to User A.

[0686] 2. Lunch Suggestions

[0687] If User B wants lunch suggestions, he / she will take the following steps:

[0688] User B uses the app's lunch suggestion feature and submits a request.

[0689] Example prompt: "Suggest a good lunch for someone on a diet."

[0690] The server references User B's profile information and generates lunch suggestions based on his health status and preferences.

[0691] The terminal displays the generated lunch suggestions to User B.

[0692] Through this system, users can not only improve their work efficiency but also ensure that their daily work proceeds smoothly.

[0693] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0694] Program processing flow and specific operation explanation

[0695] Conference room / individual booth reservation management

[0696] Processing Steps

[0697] Step 1:

[0698] The user launches the app and makes a request to check the availability of conference rooms. Specifically, the user opens the app's conference room reservation screen and presses the button to check availability. The device receives this operation and sends a prompt message (e.g., "Tell me the current availability of conference rooms") to the server.

[0699] Input: Room availability request

[0700] Output: Request sent to the server

[0701] Step 2:

[0702] The server searches the database based on the request received from the terminal, specifically searching for the reservation status of conference rooms and individual booths and obtaining the latest information.

[0703] Input: Availability request

[0704] Output: Latest reservation status data

[0705] Step 3:

[0706] The server transmits the acquired latest reservation status data to the terminal.

[0707] Input: Latest reservation status data

[0708] Output: Reservation status data sent to the terminal

[0709] Step 4:

[0710] The terminal displays the latest reservation status data received from the server to the user. Specifically, the availability of conference rooms is displayed in a list.

[0711] Input: Reservation status data received from the server

[0712] Output: Availability information displayed on the screen

[0713] Step 5:

[0714] The user selects the desired conference room and time slot and confirms the reservation request. The terminal receives this selection and sends a reservation request (e.g., "Reserve conference room A from 10:00 AM to 11:00 AM") to the server.

[0715] Input: User's reservation selection

[0716] Output: Booking request sent to the server

[0717] Step 6:

[0718] The server updates the database based on the received reservation request, saves the new reservation information, and sends a confirmation message to the terminal after saving is complete.

[0719] Input: The booking request sent to the server

[0720] Output: Database update, new reservation information, confirmation message

[0721] Step 7:

[0722] The terminal receives a confirmation message from the server and notifies the user that the reservation is confirmed.

[0723] Input: Confirmation message

[0724] Output: Confirmation of reservation sent to user

[0725] Lunch Suggestions

[0726] Processing Steps

[0727] Step 1:

[0728] The user uses the app's lunch suggestion function to send a request. Specifically, the user opens the app's lunch suggestion screen and presses the button to accept the suggestion. The device receives this operation and sends a prompt message (e.g., "Suggest a lunch suitable for dieting") to the server.

[0729] Input: Lunch suggestion request

[0730] Output: Request sent to the server

[0731] Step 2:

[0732] The server retrieves the user's profile information from the database based on the request received from the device, specifically by referencing data such as health status and preferences.

[0733] Input: Lunch suggestion request

[0734] Output: Profile information

[0735] Step 3:

[0736] The server generates lunch suggestions that match the user's needs based on the profile information it has acquired, specifically by suggesting menus that take into account the user's health status and preferences.

[0737] Input: Profile Information

[0738] Output: Lunch suggestions data

[0739] Step 4:

[0740] The server transmits the generated lunch proposal data to the terminal.

[0741] Input: Lunch suggestion data

[0742] Output: Proposal data sent to the device

[0743] Step 5:

[0744] The terminal displays the lunch proposal data received from the server to the user. Specifically, the proposed menu is displayed on the screen.

[0745] Input: Proposal data received from the server

[0746] Output: Lunch suggestions displayed on screen

[0747] This allows users to conveniently and quickly receive conference room reservations and lunch suggestions, improving work efficiency.

[0748] (Application example 1)

[0749] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0750] Conventional office management systems provide functions such as reservation management for conference rooms and individual booths, location management for employees, and lunch suggestions, but they lack the flexibility to adapt to modern factory environments, where greater efficiency is required. In particular, there is a need for systems that can address the unique needs of factories, such as reservation management for work areas and machinery, location management for workers, and meal suggestions based on workers' health conditions.

[0751] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0752] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring a user's current location information and generating and displaying a list of other nearby users, means for generating and presenting appropriate lunch suggestions based on the user's profile information, means for monitoring and updating the reservation status of work areas and machinery, means for acquiring and managing the location information of workers in the work area, and means for generating and presenting appropriate meal suggestions based on the worker's profile information. This enables the efficiency of reservation management, location information management, and meal suggestions in a factory environment, just as in an office environment.

[0753] A "conference room" is a room set aside for holding meetings or discussions within an office or factory.

[0754] An "individual booth" is a small space separated for individual or small group work or meetings.

[0755] "Reservation status" refers to whether or not the use of conference rooms, individual booths, work areas, and machinery and equipment has been reserved in advance.

[0756] "User" refers to an employee, worker, administrator, or the like who uses this system.

[0757] "Location information" is information for identifying the current location of a user or worker.

[0758] A "work area" is a space designated for the performance of a particular task or activity.

[0759] "Machinery and equipment" is a general term for devices and machines that support work within a factory.

[0760] "Profile information" is information that records personal information, preferences, health status, etc., related to users and workers.

[0761] "Lunch suggestion" refers to presenting an appropriate lunch menu based on the user's profile information.

[0762] "Meal suggestions" refers to presenting an appropriate meal menu based on the worker's profile information, taking into consideration their health condition, etc.

[0763] The "list of other nearby users" is a list of other users who are located in the vicinity of a specific user based on the current location information of the user.

[0764] A "server" is a computer system used to manage and process data.

[0765] The system that embodies this invention consists of three elements: a server, a terminal, and a user. The server performs the main data processing and monitoring, and the terminal functions as an interface with the user. The user operates the system through the terminal and receives the necessary information and suggestions.

[0766] server

[0767] The server's main responsibilities are:

[0768] Reservation management of conference rooms and individual booths: The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[0769] Reservation management for work areas and machinery: Similarly, the reservation status of work areas and machinery is managed, and when a reservation request comes in, new reservation information is saved in the database.

[0770] Location information management: The server obtains the current location information of users and workers using GPS data and Wi-Fi location information, and generates a list of other users and workers who are nearby.

[0771] Proposal generation based on profile information: The server references the profile information of users and workers and generates lunch and meal suggestions based on that information.

[0772] Terminal (user's device)

[0773] The terminal has the following responsibilities:

[0774] Information request and display: The user operates the terminal to request the availability of conference rooms, individual booths, work areas, and machinery from the server, and the results are displayed. Also, a list of other nearby users and workers is displayed based on the user's or worker's current location information.

[0775] Updating profile information: Users and workers can update their own profile information through their terminals, and based on that information, they can receive appropriate suggestions from the server.

[0776] User

[0777] Users and workers use the terminals to access various functions of the system, including reserving conference rooms and individual booths, checking nearby users and workers, and receiving lunch and meal suggestions.

[0778] Hardware and software used

[0779] Hardware: Servers, factory robots, smart devices

[0780] Software: Python (programming), SQLite (database management), JSON (data format)

[0781] Specific examples

[0782] For example, when User A checks the availability of a conference room and makes a reservation, a request is sent from the terminal to the server, and the server retrieves the current availability from the database and returns it. User A checks the displayed information, selects the desired conference room, and confirms the reservation. This updates the server's database.

[0783] Similarly, when factory robot R1 reserves work area A for one hour, a request is sent to the server and the reservation information is saved in the database. Furthermore, if "Suggest a lunch for employee with ID 1" is entered as the prompt, the server generates a lunch suggestion suitable for the worker with the specified ID and sends it to the terminal.

[0784] In this way, the system of the present invention can flexibly respond to various needs in office and factory environments and can significantly improve business efficiency.

[0785] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0786] Step 1:

[0787] The terminal sends a request to the server to check the availability of conference rooms and work areas in response to user operation. The input includes information on the date, time, and location selected by the user. By sending this information to the server, the terminal provides the basic data for the server to check the reservation status.

[0788] Step 2:

[0789] The server searches the database based on the received request to obtain the latest reservation status for the specified date, time, and location. The server uses the received date, time, and location information as a key to find the appropriate reservation information from the database and obtain it in real time. The output is the current availability data.

[0790] Step 3:

[0791] The server returns the acquired reservation status data to the terminal, allowing the user to immediately check the reservation status for the date, time, and location specified by the user. The server creates the acquired availability status based on the information in the database and sends it to the terminal.

[0792] Step 4:

[0793] The terminal displays the reservation status data received from the server on the user interface. Based on this displayed information, the user can select an available conference room or work area and make a reservation. The input is the data received from the server, and the output is to provide the information to the user in a visually easy-to-reach format.

[0794] Step 5:

[0795] The user selects the desired conference room or work area using the terminal interface and confirms the reservation. Based on the user's operation, the terminal generates new reservation information and sends it to the server. It also compiles request data including the selected conference room or work area and date and time details.

[0796] Step 6:

[0797] The server updates the database based on the new reservation information received, thereby confirming the new reservation for the specified date, time, and location. The server receives reservation request data as input and processes the database record as output.

[0798] Step 7:

[0799] When a user wants to update their profile information, the device sends the profile information to the server. The user enters data about their health status and dietary preferences, which are then sent to the server via the device.

[0800] Step 8:

[0801] The server stores the profile information in a database and generates lunch and meal suggestions based on that information. Based on this information, the server uses a generative AI model to make appropriate suggestions. Based on the received profile information, the server updates the database and generates suggestions using the generative AI model.

[0802] Step 9:

[0803] The user sends a request to the server through the terminal and receives suggested lunch or meal information. The input is the profile information and the request, and the output is the suggested lunch or meal information sent from the server.

[0804] Step 10:

[0805] The terminal displays the received lunch and meal suggestions to the user, allowing the user to select the meal that best suits them. The terminal visually displays the data received from the server. The same process is followed when a prompt such as "Suggest a lunch for employee with ID 1" is entered.

[0806] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0807] This invention is a system designed to solve various issues faced by office workers, providing comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides even more advanced support. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[0808] System Configuration

[0809] 1. Server

[0810] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[0811] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[0812] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[0813] Emotion engine: The emotion engine built into the server recognizes emotions from the user's facial expressions, voice tone, text input, etc., and stores the information in a database. Based on this emotional information, various services can be provided in a more personalized manner.

[0814] 2. Terminal (user device)

[0815] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[0816] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[0817] 3. Users

[0818] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[0819] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[0820] Emotional information input: Users input facial expressions, voice, and text so that the emotion engine can properly recognize emotions.

[0821] Program processing

[0822] 1. Conference room / individual booth reservation management

[0823] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[0824] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[0825] 2. Displaying nearby employees

[0826] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[0827] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[0828] 3. Lunch Suggestions

[0829] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[0830] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[0831] 4. Use of Emotion Engine

[0832] Server: The emotion engine analyzes the user's emotions from their facial expressions, voice, and text, and stores the information in a database.

[0833] Terminal: Based on the emotional data analyzed by the emotion engine, the system displays appropriate suggestions and advice to the user. For example, if the user is feeling stressed, the system will suggest ways to relax.

[0834] Specific examples

[0835] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[0836] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[0837] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[0838] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve work efficiency in the office. By incorporating an emotion engine, even more advanced personalized support becomes possible.

[0839] The processing flow will be explained below.

[0840] Check availability and reserve meeting rooms / individual booths

[0841] Step 1:

[0842] User: Launches the app.

[0843] Step 2:

[0844] Terminal: Sends a "conference room availability" request to the server.

[0845] Step 3:

[0846] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[0847] Step 4:

[0848] Server: Returns availability information to the terminal.

[0849] Step 5:

[0850] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[0851] Step 6:

[0852] User: Check availability, select the desired conference room and make a reservation.

[0853] Step 7:

[0854] Terminal: Sends the user's reservation information to the server.

[0855] Step 8:

[0856] Server: Receives reservation requests and updates the reservation status in the database.

[0857] Step 9:

[0858] Server: Notifies the terminal of the confirmed reservation information.

[0859] Step 10:

[0860] Terminal: Display a notification to the user that the reservation is complete.

[0861] Displaying nearby employees

[0862] Step 1:

[0863] User: Launches the app.

[0864] Step 2:

[0865] Terminal: Sends a request to the server for a list of nearby employees.

[0866] Step 3:

[0867] Server: Obtains the user's current location information.

[0868] Step 4:

[0869] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[0870] Step 5:

[0871] Server: Returns the generated employee list to the terminal.

[0872] Step 6:

[0873] Terminal: The received employee list is displayed to the user.

[0874] Step 7:

[0875] User: Tap a specific employee name.

[0876] Step 8:

[0877] Device: Sends a request to the server containing the tapped employee name.

[0878] Step 9:

[0879] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[0880] Step 10:

[0881] Server: Returns the acquired schedule information to the terminal.

[0882] Step 11:

[0883] Terminal: Displays the received schedule information to the user.

[0884] Buddy feature lunch suggestions

[0885] Step 1:

[0886] User: Activate the Buddy feature.

[0887] Step 2:

[0888] User: Type "I'm not sure what to have for lunch."

[0889] Step 3:

[0890] Terminal: Sends requests to the server.

[0891] Step 4:

[0892] Server: Looks up the user's profile information from a database.

[0893] Step 5:

[0894] Server: Generates lunch suggestions based on the user's profile information.

[0895] Step 6:

[0896] Server: Sends proposals back to the device.

[0897] Step 7:

[0898] Device: Show lunch suggestions.

[0899] Step 8:

[0900] User: Review the suggestions and make a selection.

[0901] Use of emotion engine

[0902] Step 1:

[0903] User: Launches the app.

[0904] Step 2:

[0905] Terminal: Collects emotional data such as the user's facial expressions, voice, and text input.

[0906] Step 3:

[0907] Terminal: Sends collected emotion data to the server.

[0908] Step 4:

[0909] Server: The emotion engine analyzes the emotion data and identifies the user's emotional state.

[0910] Step 5:

[0911] Server: Generates appropriate suggestions and advice based on the user's emotional state.

[0912] Step 6:

[0913] Server: Sends generated suggestions and advice back to the device.

[0914] Step 7:

[0915] Device: Display emotion-based suggestions and advice to the user.

[0916] Step 8:

[0917] User: Review the suggestions and advice and act as needed.

[0918] This is the specific processing flow of the present invention. This system allows users to reserve conference rooms or booths, check nearby employees, suggest lunches, and receive comprehensive support based on their emotions.

[0919] Example 2

[0920] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0921] Employees face many challenges in modern office environments. Reservation management for conference rooms and individual booths is time-consuming, making it difficult to secure an appropriate workspace. It's also difficult to track colleagues' locations, reducing the efficiency of collaboration. Furthermore, there are no meal suggestions based on each employee's health status or preferences, which can lead to stress when choosing what to eat during work. Furthermore, stress management is difficult because employees' emotional states are not recognized and appropriate support based on them is not provided.

[0922] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0923] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring a user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate meal suggestions based on the user's profile information, and a means for recognizing a user's emotions and generating and presenting suggestions based on those emotions. This streamlines conference room reservation management in an office environment and enables quick collaboration with colleagues. It also provides meal suggestions tailored to individual health conditions and preferences, reducing stress during work. Furthermore, emotion recognition technology can support employees' mental health.

[0924] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system that has the function of understanding the usage status of conference rooms and individual booths in real time and updating the database in response to user reservation requests.

[0925] "Means for acquiring the user's current location information and generating and displaying a list of other users nearby" refers to a system that has the function of collecting the user's location information, identifying other users nearby based on that data, and displaying them as a list.

[0926] "Means for generating and presenting appropriate meal suggestions based on user profile information" refers to a system that has the function of generating optimal meal options based on information about the user's health condition and preferences and presenting them to the user.

[0927] "Means for recognizing the user's emotions and generating and presenting suggestions based on them" refers to a system that has the function of analyzing the user's emotions from facial expressions, voice, text, etc., and generating and presenting suggestions for stress management, relaxation methods, etc. based on the results.

[0928] This invention is a system that significantly improves the work efficiency of office workers by managing reservations for conference rooms and individual booths, managing employee location information, suggesting health-based meals, and utilizing an emotion engine that recognizes the user's emotions. This system is primarily composed of three elements: a server, a terminal (user device), and the user.

[0929] Hardware and software used

[0930] Server: Use an EC2 instance from Amazon Web Services (AWS).

[0931] Database: Use Amazon RDS (relational database service).

[0932] Various APIs: Utilize Google Maps API (to obtain location information) and Microsoft Azure Emotion API (for emotion recognition).

[0933] Devices: Use applications developed for iOS or Android devices.

[0934] Conference room / individual booth reservation management

[0935] The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. The terminal inquires about availability from the server in response to a user request and displays the retrieved data to the user. When the user confirms a reservation, the terminal sends the information to the server, which then updates the database.

[0936] Displaying nearby employees

[0937] The server acquires the user's location information and generates a list of nearby employees based on that information. The device queries the server for location information at the user's request and displays the received employee list to the user. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[0938] Lunch Suggestions

[0939] The server references the user's profile information from a database and generates appropriate lunch suggestions based on that data. The device queries the server for lunch suggestions in response to the user's request and displays the received suggestions to the user.

[0940] Use of emotion engine

[0941] The server uses an emotion engine to analyze the user's emotions from their facial expressions, voice, and text, and stores the results in a database. The device then displays appropriate suggestions and advice to the user based on the emotion data. For example, if the user is feeling stressed, the server generates relaxation suggestions, and the device displays that information to the user.

[0942] Examples of concrete examples and prompts

[0943] Here is a concrete example using this system:

[0944] Meeting room booking process

[0945] When User A starts the app and checks the availability of conference rooms, the device requests information from the server. The server retrieves the latest reservation information from the database and sends it back to the device. User A selects the desired conference room and confirms the reservation. The device sends a reservation request to the server, which updates the database.

[0946] The process of receiving lunch suggestions

[0947] When User B presses the "Lunch Suggestion" button, the device sends a request to the server. The server generates appropriate lunch suggestions based on User B's profile information and sends them to the device. User B can then select a lunch based on the suggestions.

[0948] Suggestions using an emotion engine

[0949] If user C feels stressed at work, the emotion engine recognizes that emotion and generates relaxation suggestions. The device displays the suggestions to user C, who can then perform relaxation activities such as stretching or taking a break.

[0950] An example prompt based on this system is:

[0951] "I want to check the reservation status of conference rooms and make new reservations."

[0952] "Please suggest some lunches for those on a diet."

[0953] "Please give me some relaxation tips based on my current stress level."

[0954] The present invention is extremely useful as a system for significantly improving work efficiency in an office environment and maximizing employee health and work efficiency.

[0955] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0956] The flow of this system's program processing

[0957] Conference room / individual booth reservation management

[0958] Step 1:

[0959] When a user opens a reservation application, the terminal sends a request to the server to find out the availability of conference rooms or individual booths. This request includes the user ID and the desired date and time.

[0960] Step 2:

[0961] The server retrieves the latest reservation status from the database based on the received request, and the output from the database is a list of available conference rooms and booths.

[0962] Step 3:

[0963] The server sends the acquired reservation information to the terminal, which receives this information and displays it to the user. The user then selects the desired conference room or booth from the list.

[0964] Step 4:

[0965] When the user selects the desired conference room or booth and presses the "reserve" button, the terminal sends a reservation request including the selected information to the server.

[0966] Step 5:

[0967] The server updates the database based on the received reservation request, and the updated reservation information is reflected in real time for other users.

[0968] Displaying nearby employees

[0969] Step 1:

[0970] When a user selects the "nearby coworkers" option, the device sends a location request to the server, which includes the user's current location.

[0971] Step 2:

[0972] The server analyzes the user's location information and retrieves the location information of other nearby employees from a database, resulting in a list of nearby employees.

[0973] Step 3:

[0974] The server sends the generated list to the terminal, which displays the list to the user, allowing the user to select a specific employee from the list.

[0975] Step 4:

[0976] When the user selects a particular employee's name, the terminal requests that employee's schedule information from the server.

[0977] Step 5:

[0978] The server retrieves the employee's schedule information from the database based on the received request and sends it to the terminal, which then displays the information to the user.

[0979] Lunch Suggestions

[0980] Step 1:

[0981] When a user presses the "Lunch Suggestion" button in the app, the device sends a lunch suggestion request to the server, which includes the user's profile information.

[0982] Step 2:

[0983] The server generates appropriate lunch suggestions based on the user's profile information, which includes information on health status and food allergies, and selects the optimal lunch menu based on this information.

[0984] Step 3:

[0985] The server sends the generated lunch suggestions to the terminal, which displays this information to the user, who can then choose a lunch based on the suggestions.

[0986] Use of emotion engine

[0987] Step 1:

[0988] Within the application, users can direct their facial expressions at the camera, speak, or input text, and this data is sent from the device to the server.

[0989] Step 2:

[0990] The server uses an emotion engine to analyze the received emotion data. During this process, emotions are identified from facial expressions, voice, and text. Emotion data is generated as a result of the analysis.

[0991] Step 3:

[0992] The server generates appropriate suggestions and advice for the user based on the emotion data. For example, if the user is feeling stressed, it generates suggestions for relaxation.

[0993] Step 4:

[0994] The server sends the generated suggestions to the device, which then displays the information to the user, who can then stretch or take a break based on the suggestions.

[0995] This concludes the detailed operation of each processing step. This system allows users to efficiently reserve conference rooms and booths, obtain information about nearby employees, receive health-based lunch suggestions, and manage stress.

[0996] (Application example 2)

[0997] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0998] In conventional office environments, multiple tasks, such as managing reservations for conference rooms and individual booths, keeping track of employee schedules, and suggesting lunch options, are often cumbersome, resulting in reduced work efficiency. In particular, there is a lack of personalized support that takes into account the user's emotional state, making it difficult to improve the user experience. Similarly, individual optimization based on user profile information is also difficult to achieve. Therefore, the present invention aims to provide a comprehensive system that solves these issues and improves work efficiency.

[0999] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1000] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring the user's current location information and generating and displaying a list of other users nearby, means for generating and presenting appropriate lunch suggestions based on the user's profile information, and means for analyzing the user's facial expressions and voice tone to recognize the user's emotional state and generate personalized suggestions. This allows for real-time and individualized optimization of support for users, thereby improving work efficiency in office environments.

[1001] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system or device for grasping and updating the reservation status of conference rooms and individual booths in real time.

[1002] "Means for acquiring the user's current location information and generating and displaying a list of other nearby users" refers to a system or device that collects the user's current location information and, based on that information, creates and displays a list of other nearby users.

[1003] "Means for generating and presenting appropriate lunch suggestions based on user profile information" refers to a system or device that refers to the user's profile information and suggests and presents the optimal lunch for the user based on that information.

[1004] "Means for analyzing a user's facial expressions and vocal tone to recognize the emotional state and generate personalized suggestions" refers to a system or device that recognizes a user's emotional state by analyzing the user's facial expressions and vocal tone, and generates individually optimized suggestions based on that information.

[1005] The present invention is a system for solving various problems faced by individuals working in an office, and provides comprehensive support by combining conference room and individual booth reservation management, current location information management, lunch suggestions, and an emotion recognition engine. Specific embodiments of the present invention are described below.

[1006] System configuration

[1007] 1. Server

[1008] Monitoring and updating reservation status: The server monitors and updates the reservation status of conference rooms and individual booths, and stores this information in a database. This allows the system to always provide the latest reservation status.

[1009] Location management: The server obtains the user's current location based on GPS data and Wi-Fi location information and generates a list of other users nearby.

[1010] Lunch suggestion generation: The server looks up the user's profile information and generates appropriate lunch suggestions based on that data.

[1011] Emotion Engine: The emotion engine analyzes the user's facial expressions and vocal tone to generate emotional data, which is then used to make personalized suggestions.

[1012] 2. Terminal (user device)

[1013] Information request and display: Based on the user's actions, the device sends an information request to the server and displays the received information to the user, including information about available conference rooms, a list of nearby employees, and lunch suggestions.

[1014] Acquiring emotion recognition data: The device uses the built-in camera and microphone to analyze the user's facial expressions and voice tone in real time to generate emotion data.

[1015] 3. Users

[1016] System operation: Users can operate the terminal to check conference room reservation information, make new reservations, check the schedules of nearby employees, and receive lunch suggestions.

[1017] Emotional information input: Users provide appropriate input through facial expressions and voice tone to ensure that the emotion engine obtains accurate data.

[1018] Examples and prompts

[1019] As a concrete example, we will explain the process by which User A checks the availability of a conference room and makes a reservation. When User A starts the application, the device sends a request for availability to the server, and the server retrieves the latest reservation status from the database and sends it back. User A selects the desired conference room from the available information displayed and confirms the reservation from the device. At this time, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[1020] As another example, consider the case where User B receives lunch suggestions. When User B sends a request using the application's lunch suggestion function, the server suggests suitable lunches based on the user profile and sends them to the device. User B can review the suggestions and select one.

[1021] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[1022] Prompt Sentence Examples

[1023] "Recommend the best food for the user, taking into account their food preferences, allergy information, past ordering history, and current emotional state. For example, if the user is feeling stressed, suggest a lunch that includes ingredients that will help them relax."

[1024] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1025] Step 1:

[1026] The server retrieves the latest reservation status of conference rooms and individual booths from the database. The input is a reservation status request, and the output is the latest reservation status data. This ensures the consistency of reservation information in real time.

[1027] Step 2:

[1028] When the user launches the application, the terminal sends a request for reservation status to the server. The input is the user's operation, and the output is the request sent to the server. This allows the user to obtain the latest information.

[1029] Step 3:

[1030] The server obtains the user's current location information and generates a list of other nearby users. The input is GPS data and Wi-Fi location information, and the output is a list of nearby users. Location analysis allows us to understand the distance between users in real time.

[1031] Step 4:

[1032] The device sends a location information request to the server and displays the obtained list to the user. The input is the list data from the server, and the output is the list information displayed on the user interface. This allows the user to easily check other users nearby.

[1033] Step 5:

[1034] The server references the user's profile information and generates appropriate lunch suggestions based on that data. The input is the user profile information, and the output is lunch suggestion data. Analysis of the profile information enables personalized suggestions.

[1035] Step 6:

[1036] The terminal requests lunch suggestions from the server and displays the received suggestions to the user. The input is the user's request and the suggestion data from the server, and the output is the displayed lunch suggestions, allowing the user to select a suitable lunch for themselves.

[1037] Step 7:

[1038] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time and generate emotion data. The input is the user's facial expressions and voice tone, and the output is emotion data. Emotion recognition libraries such as OpenCV and DeepFace are used for data analysis.

[1039] Step 8:

[1040] The server recognizes the user's current emotional state based on the emotional data received from the device and generates personalized suggestions. The input is emotional data, and the output is personalized suggestions. This enables more appropriate support for the user.

[1041] Step 9:

[1042] The device displays personalized suggestions to the user. The input is the suggestion data from the server, and the output is the displayed suggestion information. This allows the user to select an action that suits their emotional state.

[1043] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1044] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1045] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1046] [Third embodiment]

[1047] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1048] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1049] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1050] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1051] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1052] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1053] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1054] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1055] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1056] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1057] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1058] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1059] This invention is a system that solves various issues faced by office workers, and provides comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[1060] System Configuration

[1061] 1. Server

[1062] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[1063] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[1064] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[1065] 2. Terminal (user device)

[1066] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[1067] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[1068] 3. Users

[1069] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[1070] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[1071] Program processing

[1072] 1. Conference room / individual booth reservation management

[1073] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[1074] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[1075] 2. Displaying nearby employees

[1076] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[1077] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[1078] 3. Lunch Suggestions

[1079] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[1080] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[1081] Specific examples

[1082] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[1083] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[1084] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve the efficiency of office work.

[1085] The processing flow will be explained below.

[1086] Specific flow of program processing

[1087] Check availability and reserve meeting rooms / individual booths

[1088] Step 1:

[1089] User: Launches the app.

[1090] Step 2:

[1091] Terminal: A user operates the terminal to send a "conference room availability" request to the server.

[1092] Step 3:

[1093] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[1094] Step 4:

[1095] Server: Returns data including availability to the device.

[1096] Step 5:

[1097] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[1098] Step 6:

[1099] User: Check availability, select the desired conference room and make a reservation.

[1100] Step 7:

[1101] Terminal: Enters reservation information and sends a reservation request to the server.

[1102] Step 8:

[1103] Server: Receives reservation requests and updates the reservation status in the database.

[1104] Step 9:

[1105] Server: Notifies the terminal that the reservation has been confirmed.

[1106] Step 10:

[1107] Terminal: Display a notification to the user that the reservation is complete.

[1108] Displaying nearby employees

[1109] Step 1:

[1110] User: Launches the app.

[1111] Step 2:

[1112] Terminal: The user operates the terminal to send a request to the server for a list of nearby employees.

[1113] Step 3:

[1114] Server: Receives the request and obtains the user's current location information.

[1115] Step 4:

[1116] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[1117] Step 5:

[1118] Server: Returns the generated employee list to the terminal.

[1119] Step 6:

[1120] Terminal: The received employee list is displayed to the user.

[1121] Step 7:

[1122] User: Tap a specific employee name.

[1123] Step 8:

[1124] Device: Sends a request to the server containing the tapped employee name.

[1125] Step 9:

[1126] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[1127] Step 10:

[1128] Server: Returns the acquired schedule information to the terminal.

[1129] Step 11:

[1130] Terminal: Displays the received schedule information to the user.

[1131] Buddy feature lunch suggestions

[1132] Step 1:

[1133] User: Activates the in-app buddy feature.

[1134] Step 2:

[1135] User: Enters a request such as "I'm not sure what to have for lunch."

[1136] Step 3:

[1137] Terminal: Sends user requests to the server.

[1138] Step 4:

[1139] Server: Receives the request and looks up the user's profile information in a database.

[1140] Step 5:

[1141] Server: Generates appropriate lunch suggestions based on the user's profile information.

[1142] Step 6:

[1143] Server: Sends the generated lunch suggestions back to the device.

[1144] Step 7:

[1145] Terminal: Displays received lunch suggestions to the user.

[1146] Step 8:

[1147] User: Review the lunch suggestions displayed and select.

[1148] Example 1

[1149] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1150] In modern workplaces, there are many tasks, such as reserving conference rooms or individual booths, tracking employees' current locations, and suggesting lunches based on individual employee needs. There is a need for a centralized system that can efficiently manage these tasks and is easy for users to use. However, current systems are unable to provide multiple functions in an integrated manner, resulting in a lack of convenience for users. Furthermore, the lack of real-time information updates and profile-based personalization results in a poor user experience. The goal of this project is to solve these issues.

[1151] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1152] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring the user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate lunch suggestions based on the user's profile information, a means for sending an information request from the terminal to the server and displaying the response, and a means for the user to acquire and manipulate information using a user interface. This allows users to grasp the reservation status of conference rooms and individual booths in real time and easily receive information and suggestions tailored to their individual needs. It also improves the efficiency of business interactions, such as displaying a list of other users based on location information.

[1153] "Reservation status of conference rooms and individual booths" is information indicating whether a conference room or individual booth is currently available or has already been reserved by another user.

[1154] "Means for monitoring and updating" refers to a function that checks the usage status of conference rooms and individual booths in real time and records the information in a database when any changes occur.

[1155] "User's current location information" refers to location information data such as GPS data and Wi-Fi location information for identifying the user's location.

[1156] The "list of other nearby users" is a list that compiles information about other users in the vicinity based on the user's current location.

[1157] "Means for generating and displaying" refers to the function of creating information based on data and displaying it to the user through a user interface.

[1158] "User profile information" is personal information including a user's individual settings, preferences, health status, etc.

[1159] "Lunch suggestion" refers to presenting a lunch menu that suits the user based on the user's profile information.

[1160] The "means for generating and presenting" is a function that creates appropriate lunch suggestions based on the user's profile information and provides them to the user through a user interface.

[1161] "Means for sending an information request from a terminal to a server and displaying the response" refers to a function in which a user uses a device to send a request for data to a server and displays the data received in response to the user.

[1162] A "user interface" is a screen or operating means that allows a user to interact with a system through a device.

[1163] "Means of obtaining and manipulating information" refers to the ability of a user to obtain the necessary data from the system and perform an action using that data.

[1164] MODE FOR CARRYING OUT THE INVENTION

[1165] This invention is a system for improving the work efficiency of office workers. This system includes functions such as reservation management for conference rooms and individual booths, management of employee location information, and lunch suggestions.

[1166] System Components

[1167] server

[1168] The server is the central part of the system and performs the following functions:

[1169] 1. Monitoring and updating of conference rooms and individual booths

[1170] The server uses a database to monitor the reservation status of conference rooms and individual booths, and updates the database when a reservation request comes in. For this purpose, it uses a relational database such as an SQL database.

[1171] 2. Acquisition and management of employee location information

[1172] The server uses GPS data and Wi-Fi location information to obtain the user's current location, and based on that information, generates a list of other users nearby. This location information is used to improve business efficiency.

[1173] 3. Lunch Suggestion Generation

[1174] The server references the user's profile information and generates lunch suggestions based on, for example, whether the user is on a diet or has certain food allergies. The suggestions are based on the user's health status and preferences.

[1175] Terminal (user's device)

[1176] The terminal communicates with the server through a user interface to realize the following operations:

[1177] 1. Submitting and Viewing Information Requests

[1178] When a user uses the app to request information such as available meeting rooms or lunch suggestions, the device sends an information request to the server, receives responses from the server, and displays them to the user.

[1179] 2. User Interface

[1180] The device provides an easy-to-use user interface, allowing users to easily obtain and operate the information they need. Intuitive operation is possible using swipes, taps, and other gestures.

[1181] User

[1182] By using this system, users can take advantage of the following functions:

[1183] 1. System Operation

[1184] Through the terminal, users can perform operations such as reserving conference rooms, checking employee locations, and receiving lunch suggestions.

[1185] 2. Update your profile

[1186] Users can update their profile information and receive more personalized suggestions from the system.

[1187] Specific examples

[1188] A specific example is given below.

[1189] 1. Conference Room Reservation

[1190] When user A checks the availability of a conference room and makes a reservation, he / she follows the steps below.

[1191] User A starts the app and sends a prompt message from the device to the server to request availability of conference rooms.

[1192] Example prompt: "What are the current conference room availability status?"

[1193] The server searches the database, obtains the latest reservation status, and returns it to the terminal.

[1194] The terminal displays the availability status to User A.

[1195] User A selects the desired conference room and time and sends a reservation request from the terminal to the server.

[1196] Example prompt: "Reserve conference room A from 10:00 AM to 11:00 AM."

[1197] The server saves the reservation information in its database and sends a confirmation message to User A.

[1198] 2. Lunch Suggestions

[1199] If User B wants lunch suggestions, he / she will take the following steps:

[1200] User B uses the app's lunch suggestion feature and submits a request.

[1201] Example prompt: "Suggest a good lunch for someone on a diet."

[1202] The server references User B's profile information and generates lunch suggestions based on his health status and preferences.

[1203] The terminal displays the generated lunch suggestions to User B.

[1204] Through this system, users can not only improve their work efficiency but also ensure that their daily work proceeds smoothly.

[1205] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1206] Program processing flow and specific operation explanation

[1207] Conference room / individual booth reservation management

[1208] Processing Steps

[1209] Step 1:

[1210] The user launches the app and makes a request to check the availability of conference rooms. Specifically, the user opens the app's conference room reservation screen and presses the button to check availability. The device receives this operation and sends a prompt message (e.g., "Tell me the current availability of conference rooms") to the server.

[1211] Input: Room availability request

[1212] Output: Request sent to the server

[1213] Step 2:

[1214] The server searches the database based on the request received from the terminal, specifically searching for the reservation status of conference rooms and individual booths and obtaining the latest information.

[1215] Input: Availability request

[1216] Output: Latest reservation status data

[1217] Step 3:

[1218] The server transmits the acquired latest reservation status data to the terminal.

[1219] Input: Latest reservation status data

[1220] Output: Reservation status data sent to the terminal

[1221] Step 4:

[1222] The terminal displays the latest reservation status data received from the server to the user. Specifically, the availability of conference rooms is displayed in a list.

[1223] Input: Reservation status data received from the server

[1224] Output: Availability information displayed on the screen

[1225] Step 5:

[1226] The user selects the desired conference room and time slot and confirms the reservation request. The terminal receives this selection and sends a reservation request (e.g., "Reserve conference room A from 10:00 AM to 11:00 AM") to the server.

[1227] Input: User's reservation selection

[1228] Output: Booking request sent to the server

[1229] Step 6:

[1230] The server updates the database based on the received reservation request, saves the new reservation information, and sends a confirmation message to the terminal after saving is complete.

[1231] Input: The booking request sent to the server

[1232] Output: Database update, new reservation information, confirmation message

[1233] Step 7:

[1234] The terminal receives a confirmation message from the server and notifies the user that the reservation is confirmed.

[1235] Input: Confirmation message

[1236] Output: Confirmation of reservation sent to user

[1237] Lunch Suggestions

[1238] Processing Steps

[1239] Step 1:

[1240] The user uses the app's lunch suggestion function to send a request. Specifically, the user opens the app's lunch suggestion screen and presses the button to accept the suggestion. The device receives this operation and sends a prompt message (e.g., "Suggest a lunch suitable for dieting") to the server.

[1241] Input: Lunch suggestion request

[1242] Output: Request sent to the server

[1243] Step 2:

[1244] The server retrieves the user's profile information from the database based on the request received from the device, specifically by referencing data such as health status and preferences.

[1245] Input: Lunch suggestion request

[1246] Output: Profile information

[1247] Step 3:

[1248] The server generates lunch suggestions that match the user's needs based on the profile information it has acquired, specifically by suggesting menus that take into account the user's health status and preferences.

[1249] Input: Profile Information

[1250] Output: Lunch suggestions data

[1251] Step 4:

[1252] The server transmits the generated lunch proposal data to the terminal.

[1253] Input: Lunch suggestion data

[1254] Output: Proposal data sent to the device

[1255] Step 5:

[1256] The terminal displays the lunch proposal data received from the server to the user. Specifically, the proposed menu is displayed on the screen.

[1257] Input: Proposal data received from the server

[1258] Output: Lunch suggestions displayed on screen

[1259] This allows users to conveniently and quickly receive conference room reservations and lunch suggestions, improving work efficiency.

[1260] (Application example 1)

[1261] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1262] Conventional office management systems provide functions such as reservation management for conference rooms and individual booths, location management for employees, and lunch suggestions, but they lack the flexibility to adapt to modern factory environments, where greater efficiency is required. In particular, there is a need for systems that can address the unique needs of factories, such as reservation management for work areas and machinery, location management for workers, and meal suggestions based on workers' health conditions.

[1263] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1264] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring a user's current location information and generating and displaying a list of other nearby users, means for generating and presenting appropriate lunch suggestions based on the user's profile information, means for monitoring and updating the reservation status of work areas and machinery, means for acquiring and managing the location information of workers in the work area, and means for generating and presenting appropriate meal suggestions based on the worker's profile information. This enables the efficiency of reservation management, location information management, and meal suggestions in a factory environment, just as in an office environment.

[1265] A "conference room" is a room set aside for holding meetings or discussions within an office or factory.

[1266] An "individual booth" is a small space separated for individual or small group work or meetings.

[1267] "Reservation status" refers to whether or not the use of conference rooms, individual booths, work areas, and machinery and equipment has been reserved in advance.

[1268] "User" refers to an employee, worker, administrator, or the like who uses this system.

[1269] "Location information" is information for identifying the current location of a user or worker.

[1270] A "work area" is a space designated for the performance of a particular task or activity.

[1271] "Machinery and equipment" is a general term for devices and machines that support work within a factory.

[1272] "Profile information" is information that records personal information, preferences, health status, etc., related to users and workers.

[1273] "Lunch suggestion" refers to presenting an appropriate lunch menu based on the user's profile information.

[1274] "Meal suggestions" refers to presenting an appropriate meal menu based on the worker's profile information, taking into consideration their health condition, etc.

[1275] The "list of other nearby users" is a list of other users who are located in the vicinity of a specific user based on the current location information of the user.

[1276] A "server" is a computer system used to manage and process data.

[1277] The system that embodies this invention consists of three elements: a server, a terminal, and a user. The server performs the main data processing and monitoring, and the terminal functions as an interface with the user. The user operates the system through the terminal and receives the necessary information and suggestions.

[1278] server

[1279] The server's main responsibilities are:

[1280] Reservation management of conference rooms and individual booths: The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[1281] Reservation management for work areas and machinery: Similarly, the reservation status of work areas and machinery is managed, and when a reservation request comes in, new reservation information is saved in the database.

[1282] Location information management: The server obtains the current location information of users and workers using GPS data and Wi-Fi location information, and generates a list of other users and workers who are nearby.

[1283] Proposal generation based on profile information: The server references the profile information of users and workers and generates lunch and meal suggestions based on that information.

[1284] Terminal (user's device)

[1285] The terminal has the following responsibilities:

[1286] Information request and display: The user operates the terminal to request the availability of conference rooms, individual booths, work areas, and machinery from the server, and the results are displayed. Also, a list of other nearby users and workers is displayed based on the user's or worker's current location information.

[1287] Updating profile information: Users and workers can update their own profile information through their terminals, and based on that information, they can receive appropriate suggestions from the server.

[1288] User

[1289] Users and workers use the terminals to access various functions of the system, including reserving conference rooms and individual booths, checking nearby users and workers, and receiving lunch and meal suggestions.

[1290] Hardware and software used

[1291] Hardware: Servers, factory robots, smart devices

[1292] Software: Python (programming), SQLite (database management), JSON (data format)

[1293] Specific examples

[1294] For example, when User A checks the availability of a conference room and makes a reservation, a request is sent from the terminal to the server, and the server retrieves the current availability from the database and returns it. User A checks the displayed information, selects the desired conference room, and confirms the reservation. This updates the server's database.

[1295] Similarly, when factory robot R1 reserves work area A for one hour, a request is sent to the server and the reservation information is saved in the database. Furthermore, if "Suggest a lunch for employee with ID 1" is entered as the prompt, the server generates a lunch suggestion suitable for the worker with the specified ID and sends it to the terminal.

[1296] In this way, the system of the present invention can flexibly respond to various needs in office and factory environments and can significantly improve business efficiency.

[1297] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1298] Step 1:

[1299] The terminal sends a request to the server to check the availability of conference rooms and work areas in response to user operation. The input includes information on the date, time, and location selected by the user. By sending this information to the server, the terminal provides the basic data for the server to check the reservation status.

[1300] Step 2:

[1301] The server searches the database based on the received request to obtain the latest reservation status for the specified date, time, and location. The server uses the received date, time, and location information as a key to find the appropriate reservation information from the database and obtain it in real time. The output is the current availability data.

[1302] Step 3:

[1303] The server returns the acquired reservation status data to the terminal, allowing the user to immediately check the reservation status for the date, time, and location specified by the user. The server creates the acquired availability status based on the information in the database and sends it to the terminal.

[1304] Step 4:

[1305] The terminal displays the reservation status data received from the server on the user interface. Based on this displayed information, the user can select an available conference room or work area and make a reservation. The input is the data received from the server, and the output is to provide the information to the user in a visually easy-to-reach format.

[1306] Step 5:

[1307] The user selects the desired conference room or work area using the terminal interface and confirms the reservation. Based on the user's operation, the terminal generates new reservation information and sends it to the server. It also compiles request data including the selected conference room or work area and date and time details.

[1308] Step 6:

[1309] The server updates the database based on the new reservation information received, thereby confirming the new reservation for the specified date, time, and location. The server receives reservation request data as input and processes the database record as output.

[1310] Step 7:

[1311] When a user wants to update their profile information, the device sends the profile information to the server. The user enters data about their health status and dietary preferences, which are then sent to the server via the device.

[1312] Step 8:

[1313] The server stores the profile information in a database and generates lunch and meal suggestions based on that information. Based on this information, the server uses a generative AI model to make appropriate suggestions. Based on the received profile information, the server updates the database and generates suggestions using the generative AI model.

[1314] Step 9:

[1315] The user sends a request to the server through the terminal and receives suggested lunch or meal information. The input is the profile information and the request, and the output is the suggested lunch or meal information sent from the server.

[1316] Step 10:

[1317] The terminal displays the received lunch and meal suggestions to the user, allowing the user to select the meal that best suits them. The terminal visually displays the data received from the server. The same process is followed when a prompt such as "Suggest a lunch for employee with ID 1" is entered.

[1318] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1319] This invention is a system designed to solve various issues faced by office workers, providing comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides even more advanced support. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[1320] System Configuration

[1321] 1. Server

[1322] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[1323] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[1324] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[1325] Emotion engine: The emotion engine built into the server recognizes emotions from the user's facial expressions, voice tone, text input, etc., and stores the information in a database. Based on this emotional information, various services can be provided in a more personalized manner.

[1326] 2. Terminal (user device)

[1327] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[1328] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[1329] 3. Users

[1330] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[1331] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[1332] Emotional information input: Users input facial expressions, voice, and text so that the emotion engine can properly recognize emotions.

[1333] Program processing

[1334] 1. Conference room / individual booth reservation management

[1335] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[1336] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[1337] 2. Displaying nearby employees

[1338] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[1339] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[1340] 3. Lunch Suggestions

[1341] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[1342] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[1343] 4. Use of Emotion Engine

[1344] Server: The emotion engine analyzes the user's emotions from their facial expressions, voice, and text, and stores the information in a database.

[1345] Terminal: Based on the emotional data analyzed by the emotion engine, the system displays appropriate suggestions and advice to the user. For example, if the user is feeling stressed, the system will suggest ways to relax.

[1346] Specific examples

[1347] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[1348] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[1349] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[1350] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve work efficiency in the office. By incorporating an emotion engine, even more advanced personalized support becomes possible.

[1351] The processing flow will be explained below.

[1352] Check availability and reserve meeting rooms / individual booths

[1353] Step 1:

[1354] User: Launches the app.

[1355] Step 2:

[1356] Terminal: Sends a "conference room availability" request to the server.

[1357] Step 3:

[1358] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[1359] Step 4:

[1360] Server: Returns availability information to the terminal.

[1361] Step 5:

[1362] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[1363] Step 6:

[1364] User: Check availability, select the desired conference room and make a reservation.

[1365] Step 7:

[1366] Terminal: Sends the user's reservation information to the server.

[1367] Step 8:

[1368] Server: Receives reservation requests and updates the reservation status in the database.

[1369] Step 9:

[1370] Server: Notifies the terminal of the confirmed reservation information.

[1371] Step 10:

[1372] Terminal: Display a notification to the user that the reservation is complete.

[1373] Displaying nearby employees

[1374] Step 1:

[1375] User: Launches the app.

[1376] Step 2:

[1377] Terminal: Sends a request to the server for a list of nearby employees.

[1378] Step 3:

[1379] Server: Obtains the user's current location information.

[1380] Step 4:

[1381] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[1382] Step 5:

[1383] Server: Returns the generated employee list to the terminal.

[1384] Step 6:

[1385] Terminal: The received employee list is displayed to the user.

[1386] Step 7:

[1387] User: Tap a specific employee name.

[1388] Step 8:

[1389] Device: Sends a request to the server containing the tapped employee name.

[1390] Step 9:

[1391] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[1392] Step 10:

[1393] Server: Returns the acquired schedule information to the terminal.

[1394] Step 11:

[1395] Terminal: Displays the received schedule information to the user.

[1396] Buddy feature lunch suggestions

[1397] Step 1:

[1398] User: Activate the Buddy feature.

[1399] Step 2:

[1400] User: Type "I'm not sure what to have for lunch."

[1401] Step 3:

[1402] Terminal: Sends requests to the server.

[1403] Step 4:

[1404] Server: Looks up the user's profile information from a database.

[1405] Step 5:

[1406] Server: Generates lunch suggestions based on the user's profile information.

[1407] Step 6:

[1408] Server: Sends proposals back to the device.

[1409] Step 7:

[1410] Device: Show lunch suggestions.

[1411] Step 8:

[1412] User: Review the suggestions and make a selection.

[1413] Use of emotion engine

[1414] Step 1:

[1415] User: Launches the app.

[1416] Step 2:

[1417] Terminal: Collects emotional data such as the user's facial expressions, voice, and text input.

[1418] Step 3:

[1419] Terminal: Sends collected emotion data to the server.

[1420] Step 4:

[1421] Server: The emotion engine analyzes the emotion data and identifies the user's emotional state.

[1422] Step 5:

[1423] Server: Generates appropriate suggestions and advice based on the user's emotional state.

[1424] Step 6:

[1425] Server: Sends generated suggestions and advice back to the device.

[1426] Step 7:

[1427] Device: Display emotion-based suggestions and advice to the user.

[1428] Step 8:

[1429] User: Review the suggestions and advice and act as needed.

[1430] This is the specific processing flow of the present invention. This system allows users to reserve conference rooms or booths, check nearby employees, suggest lunches, and receive comprehensive support based on their emotions.

[1431] Example 2

[1432] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1433] Employees face many challenges in modern office environments. Reservation management for conference rooms and individual booths is time-consuming, making it difficult to secure an appropriate workspace. It's also difficult to track colleagues' locations, reducing the efficiency of collaboration. Furthermore, there are no meal suggestions based on each employee's health status or preferences, which can lead to stress when choosing what to eat during work. Furthermore, stress management is difficult because employees' emotional states are not recognized and appropriate support based on them is not provided.

[1434] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1435] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring a user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate meal suggestions based on the user's profile information, and a means for recognizing a user's emotions and generating and presenting suggestions based on those emotions. This streamlines conference room reservation management in an office environment and enables quick collaboration with colleagues. It also provides meal suggestions tailored to individual health conditions and preferences, reducing stress during work. Furthermore, emotion recognition technology can support employees' mental health.

[1436] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system that has the function of understanding the usage status of conference rooms and individual booths in real time and updating the database in response to user reservation requests.

[1437] "Means for acquiring the user's current location information and generating and displaying a list of other users nearby" refers to a system that has the function of collecting the user's location information, identifying other users nearby based on that data, and displaying them as a list.

[1438] "Means for generating and presenting appropriate meal suggestions based on user profile information" refers to a system that has the function of generating optimal meal options based on information about the user's health condition and preferences and presenting them to the user.

[1439] "Means for recognizing the user's emotions and generating and presenting suggestions based on them" refers to a system that has the function of analyzing the user's emotions from facial expressions, voice, text, etc., and generating and presenting suggestions for stress management, relaxation methods, etc. based on the results.

[1440] This invention is a system that significantly improves the work efficiency of office workers by managing reservations for conference rooms and individual booths, managing employee location information, suggesting health-based meals, and utilizing an emotion engine that recognizes the user's emotions. This system is primarily composed of three elements: a server, a terminal (user device), and the user.

[1441] Hardware and software used

[1442] Server: Use an EC2 instance from Amazon Web Services (AWS).

[1443] Database: Use Amazon RDS (relational database service).

[1444] Various APIs: Utilize Google Maps API (to obtain location information) and Microsoft Azure Emotion API (for emotion recognition).

[1445] Devices: Use applications developed for iOS or Android devices.

[1446] Conference room / individual booth reservation management

[1447] The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. The terminal inquires about availability from the server in response to a user request and displays the retrieved data to the user. When the user confirms a reservation, the terminal sends the information to the server, which then updates the database.

[1448] Displaying nearby employees

[1449] The server acquires the user's location information and generates a list of nearby employees based on that information. The device queries the server for location information at the user's request and displays the received employee list to the user. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[1450] Lunch Suggestions

[1451] The server references the user's profile information from a database and generates appropriate lunch suggestions based on that data. The device queries the server for lunch suggestions in response to the user's request and displays the received suggestions to the user.

[1452] Use of emotion engine

[1453] The server uses an emotion engine to analyze the user's emotions from their facial expressions, voice, and text, and stores the results in a database. The device then displays appropriate suggestions and advice to the user based on the emotion data. For example, if the user is feeling stressed, the server generates relaxation suggestions, and the device displays that information to the user.

[1454] Examples of concrete examples and prompts

[1455] Here is a concrete example using this system:

[1456] Meeting room booking process

[1457] When User A starts the app and checks the availability of conference rooms, the device requests information from the server. The server retrieves the latest reservation information from the database and sends it back to the device. User A selects the desired conference room and confirms the reservation. The device sends a reservation request to the server, which updates the database.

[1458] The process of receiving lunch suggestions

[1459] When User B presses the "Lunch Suggestion" button, the device sends a request to the server. The server generates appropriate lunch suggestions based on User B's profile information and sends them to the device. User B can then select a lunch based on the suggestions.

[1460] Suggestions using an emotion engine

[1461] If user C feels stressed at work, the emotion engine recognizes that emotion and generates relaxation suggestions. The device displays the suggestions to user C, who can then perform relaxation activities such as stretching or taking a break.

[1462] An example prompt based on this system is:

[1463] "I want to check the reservation status of conference rooms and make new reservations."

[1464] "Please suggest some lunches for those on a diet."

[1465] "Please give me some relaxation tips based on my current stress level."

[1466] The present invention is extremely useful as a system for significantly improving work efficiency in an office environment and maximizing employee health and work efficiency.

[1467] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1468] The flow of this system's program processing

[1469] Conference room / individual booth reservation management

[1470] Step 1:

[1471] When a user opens a reservation application, the terminal sends a request to the server to find out the availability of conference rooms or individual booths. This request includes the user ID and the desired date and time.

[1472] Step 2:

[1473] The server retrieves the latest reservation status from the database based on the received request, and the output from the database is a list of available conference rooms and booths.

[1474] Step 3:

[1475] The server sends the acquired reservation information to the terminal, which receives this information and displays it to the user. The user then selects the desired conference room or booth from the list.

[1476] Step 4:

[1477] When the user selects the desired conference room or booth and presses the "reserve" button, the terminal sends a reservation request including the selected information to the server.

[1478] Step 5:

[1479] The server updates the database based on the received reservation request, and the updated reservation information is reflected in real time for other users.

[1480] Displaying nearby employees

[1481] Step 1:

[1482] When a user selects the "nearby coworkers" option, the device sends a location request to the server, which includes the user's current location.

[1483] Step 2:

[1484] The server analyzes the user's location information and retrieves the location information of other nearby employees from a database, resulting in a list of nearby employees.

[1485] Step 3:

[1486] The server sends the generated list to the terminal, which displays the list to the user, allowing the user to select a specific employee from the list.

[1487] Step 4:

[1488] When the user selects a particular employee's name, the terminal requests that employee's schedule information from the server.

[1489] Step 5:

[1490] The server retrieves the employee's schedule information from the database based on the received request and sends it to the terminal, which then displays the information to the user.

[1491] Lunch Suggestions

[1492] Step 1:

[1493] When a user presses the "Lunch Suggestion" button in the app, the device sends a lunch suggestion request to the server, which includes the user's profile information.

[1494] Step 2:

[1495] The server generates appropriate lunch suggestions based on the user's profile information, which includes information on health status and food allergies, and selects the optimal lunch menu based on this information.

[1496] Step 3:

[1497] The server sends the generated lunch suggestions to the terminal, which displays this information to the user, who can then choose a lunch based on the suggestions.

[1498] Use of emotion engine

[1499] Step 1:

[1500] Within the application, users can direct their facial expressions at the camera, speak, or input text, and this data is sent from the device to the server.

[1501] Step 2:

[1502] The server uses an emotion engine to analyze the received emotion data. During this process, emotions are identified from facial expressions, voice, and text. Emotion data is generated as a result of the analysis.

[1503] Step 3:

[1504] The server generates appropriate suggestions and advice for the user based on the emotion data. For example, if the user is feeling stressed, it generates suggestions for relaxation.

[1505] Step 4:

[1506] The server sends the generated suggestions to the device, which then displays the information to the user, who can then stretch or take a break based on the suggestions.

[1507] This concludes the detailed operation of each processing step. This system allows users to efficiently reserve conference rooms and booths, obtain information about nearby employees, receive health-based lunch suggestions, and manage stress.

[1508] (Application example 2)

[1509] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1510] In conventional office environments, multiple tasks, such as managing reservations for conference rooms and individual booths, keeping track of employee schedules, and suggesting lunch options, are often cumbersome, resulting in reduced work efficiency. In particular, there is a lack of personalized support that takes into account the user's emotional state, making it difficult to improve the user experience. Similarly, individual optimization based on user profile information is also difficult to achieve. Therefore, the present invention aims to provide a comprehensive system that solves these issues and improves work efficiency.

[1511] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1512] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring the user's current location information and generating and displaying a list of other users nearby, means for generating and presenting appropriate lunch suggestions based on the user's profile information, and means for analyzing the user's facial expressions and voice tone to recognize the user's emotional state and generate personalized suggestions. This allows for real-time and individualized optimization of support for users, thereby improving work efficiency in office environments.

[1513] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system or device for grasping and updating the reservation status of conference rooms and individual booths in real time.

[1514] "Means for acquiring the user's current location information and generating and displaying a list of other nearby users" refers to a system or device that collects the user's current location information and, based on that information, creates and displays a list of other nearby users.

[1515] "Means for generating and presenting appropriate lunch suggestions based on user profile information" refers to a system or device that refers to the user's profile information and suggests and presents the optimal lunch for the user based on that information.

[1516] "Means for analyzing a user's facial expressions and vocal tone to recognize the emotional state and generate personalized suggestions" refers to a system or device that recognizes a user's emotional state by analyzing the user's facial expressions and vocal tone, and generates individually optimized suggestions based on that information.

[1517] The present invention is a system for solving various problems faced by individuals working in an office, and provides comprehensive support by combining conference room and individual booth reservation management, current location information management, lunch suggestions, and an emotion recognition engine. Specific embodiments of the present invention are described below.

[1518] System configuration

[1519] 1. Server

[1520] Monitoring and updating reservation status: The server monitors and updates the reservation status of conference rooms and individual booths, and stores this information in a database. This allows the system to always provide the latest reservation status.

[1521] Location management: The server obtains the user's current location based on GPS data and Wi-Fi location information and generates a list of other users nearby.

[1522] Lunch suggestion generation: The server looks up the user's profile information and generates appropriate lunch suggestions based on that data.

[1523] Emotion Engine: The emotion engine analyzes the user's facial expressions and vocal tone to generate emotional data, which is then used to make personalized suggestions.

[1524] 2. Terminal (user device)

[1525] Information request and display: Based on the user's actions, the device sends an information request to the server and displays the received information to the user, including information about available conference rooms, a list of nearby employees, and lunch suggestions.

[1526] Acquiring emotion recognition data: The device uses the built-in camera and microphone to analyze the user's facial expressions and voice tone in real time to generate emotion data.

[1527] 3. Users

[1528] System operation: Users can operate the terminal to check conference room reservation information, make new reservations, check the schedules of nearby employees, and receive lunch suggestions.

[1529] Emotional information input: Users provide appropriate input through facial expressions and voice tone to ensure that the emotion engine obtains accurate data.

[1530] Examples and prompts

[1531] As a concrete example, we will explain the process by which User A checks the availability of a conference room and makes a reservation. When User A starts the application, the device sends a request for availability to the server, and the server retrieves the latest reservation status from the database and sends it back. User A selects the desired conference room from the available information displayed and confirms the reservation from the device. At this time, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[1532] As another example, consider the case where User B receives lunch suggestions. When User B sends a request using the application's lunch suggestion function, the server suggests suitable lunches based on the user profile and sends them to the device. User B can review the suggestions and select one.

[1533] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[1534] Prompt Sentence Examples

[1535] "Recommend the best food for the user, taking into account their food preferences, allergy information, past ordering history, and current emotional state. For example, if the user is feeling stressed, suggest a lunch that includes ingredients that will help them relax."

[1536] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1537] Step 1:

[1538] The server retrieves the latest reservation status of conference rooms and individual booths from the database. The input is a reservation status request, and the output is the latest reservation status data. This ensures the consistency of reservation information in real time.

[1539] Step 2:

[1540] When the user launches the application, the terminal sends a request for reservation status to the server. The input is the user's operation, and the output is the request sent to the server. This allows the user to obtain the latest information.

[1541] Step 3:

[1542] The server obtains the user's current location information and generates a list of other nearby users. The input is GPS data and Wi-Fi location information, and the output is a list of nearby users. Location analysis allows us to understand the distance between users in real time.

[1543] Step 4:

[1544] The device sends a location information request to the server and displays the obtained list to the user. The input is the list data from the server, and the output is the list information displayed on the user interface. This allows the user to easily check other users nearby.

[1545] Step 5:

[1546] The server references the user's profile information and generates appropriate lunch suggestions based on that data. The input is the user profile information, and the output is lunch suggestion data. Analysis of the profile information enables personalized suggestions.

[1547] Step 6:

[1548] The terminal requests lunch suggestions from the server and displays the received suggestions to the user. The input is the user's request and the suggestion data from the server, and the output is the displayed lunch suggestions, allowing the user to select a suitable lunch for themselves.

[1549] Step 7:

[1550] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time and generate emotion data. The input is the user's facial expressions and voice tone, and the output is emotion data. Emotion recognition libraries such as OpenCV and DeepFace are used for data analysis.

[1551] Step 8:

[1552] The server recognizes the user's current emotional state based on the emotional data received from the device and generates personalized suggestions. The input is emotional data, and the output is personalized suggestions. This enables more appropriate support for the user.

[1553] Step 9:

[1554] The device displays personalized suggestions to the user. The input is the suggestion data from the server, and the output is the displayed suggestion information. This allows the user to select an action that suits their emotional state.

[1555] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1556] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1557] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1558] [Fourth embodiment]

[1559] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1560] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1561] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1562] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1563] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1564] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1565] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1566] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1567] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1568] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1569] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1570] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1571] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1572] This invention is a system that solves various issues faced by office workers, and provides comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[1573] System Configuration

[1574] 1. Server

[1575] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[1576] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[1577] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[1578] 2. Terminal (user device)

[1579] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[1580] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[1581] 3. Users

[1582] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[1583] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[1584] Program processing

[1585] 1. Conference room / individual booth reservation management

[1586] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[1587] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[1588] 2. Displaying nearby employees

[1589] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[1590] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[1591] 3. Lunch Suggestions

[1592] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[1593] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[1594] Specific examples

[1595] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[1596] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[1597] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve the efficiency of office work.

[1598] The processing flow will be explained below.

[1599] Specific flow of program processing

[1600] Check availability and reserve meeting rooms / individual booths

[1601] Step 1:

[1602] User: Launches the app.

[1603] Step 2:

[1604] Terminal: A user operates the terminal to send a "conference room availability" request to the server.

[1605] Step 3:

[1606] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[1607] Step 4:

[1608] Server: Returns data including availability to the device.

[1609] Step 5:

[1610] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[1611] Step 6:

[1612] User: Check availability, select the desired conference room and make a reservation.

[1613] Step 7:

[1614] Terminal: Enters reservation information and sends a reservation request to the server.

[1615] Step 8:

[1616] Server: Receives reservation requests and updates the reservation status in the database.

[1617] Step 9:

[1618] Server: Notifies the terminal that the reservation has been confirmed.

[1619] Step 10:

[1620] Terminal: Display a notification to the user that the reservation is complete.

[1621] Displaying nearby employees

[1622] Step 1:

[1623] User: Launches the app.

[1624] Step 2:

[1625] Terminal: The user operates the terminal to send a request to the server for a list of nearby employees.

[1626] Step 3:

[1627] Server: Receives the request and obtains the user's current location information.

[1628] Step 4:

[1629] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[1630] Step 5:

[1631] Server: Returns the generated employee list to the terminal.

[1632] Step 6:

[1633] Terminal: The received employee list is displayed to the user.

[1634] Step 7:

[1635] User: Tap a specific employee name.

[1636] Step 8:

[1637] Device: Sends a request to the server containing the tapped employee name.

[1638] Step 9:

[1639] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[1640] Step 10:

[1641] Server: Returns the acquired schedule information to the terminal.

[1642] Step 11:

[1643] Terminal: Displays the received schedule information to the user.

[1644] Buddy feature lunch suggestions

[1645] Step 1:

[1646] User: Activates the in-app buddy feature.

[1647] Step 2:

[1648] User: Enters a request such as "I'm not sure what to have for lunch."

[1649] Step 3:

[1650] Terminal: Sends user requests to the server.

[1651] Step 4:

[1652] Server: Receives the request and looks up the user's profile information in a database.

[1653] Step 5:

[1654] Server: Generates appropriate lunch suggestions based on the user's profile information.

[1655] Step 6:

[1656] Server: Sends the generated lunch suggestions back to the device.

[1657] Step 7:

[1658] Terminal: Displays received lunch suggestions to the user.

[1659] Step 8:

[1660] User: Review the lunch suggestions displayed and select.

[1661] Example 1

[1662] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1663] In modern workplaces, there are many tasks, such as reserving conference rooms or individual booths, tracking employees' current locations, and suggesting lunches based on individual employee needs. There is a need for a centralized system that can efficiently manage these tasks and is easy for users to use. However, current systems are unable to provide multiple functions in an integrated manner, resulting in a lack of convenience for users. Furthermore, the lack of real-time information updates and profile-based personalization results in a poor user experience. The goal of this project is to solve these issues.

[1664] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1665] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring the user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate lunch suggestions based on the user's profile information, a means for sending an information request from the terminal to the server and displaying the response, and a means for the user to acquire and manipulate information using a user interface. This allows users to grasp the reservation status of conference rooms and individual booths in real time and easily receive information and suggestions tailored to their individual needs. It also improves the efficiency of business interactions, such as displaying a list of other users based on location information.

[1666] "Reservation status of conference rooms and individual booths" is information indicating whether a conference room or individual booth is currently available or has already been reserved by another user.

[1667] "Means for monitoring and updating" refers to a function that checks the usage status of conference rooms and individual booths in real time and records the information in a database when any changes occur.

[1668] "User's current location information" refers to location information data such as GPS data and Wi-Fi location information for identifying the user's location.

[1669] The "list of other nearby users" is a list that compiles information about other users in the vicinity based on the user's current location.

[1670] "Means for generating and displaying" refers to the function of creating information based on data and displaying it to the user through a user interface.

[1671] "User profile information" is personal information including a user's individual settings, preferences, health status, etc.

[1672] "Lunch suggestion" refers to presenting a lunch menu that suits the user based on the user's profile information.

[1673] The "means for generating and presenting" is a function that creates appropriate lunch suggestions based on the user's profile information and provides them to the user through a user interface.

[1674] "Means for sending an information request from a terminal to a server and displaying the response" refers to a function in which a user uses a device to send a request for data to a server and displays the data received in response to the user.

[1675] A "user interface" is a screen or operating means that allows a user to interact with a system through a device.

[1676] "Means of obtaining and manipulating information" refers to the ability of a user to obtain the necessary data from the system and perform an action using that data.

[1677] MODE FOR CARRYING OUT THE INVENTION

[1678] This invention is a system for improving the work efficiency of office workers. This system includes functions such as reservation management for conference rooms and individual booths, management of employee location information, and lunch suggestions.

[1679] System Components

[1680] server

[1681] The server is the central part of the system and performs the following functions:

[1682] 1. Monitoring and updating of conference rooms and individual booths

[1683] The server uses a database to monitor the reservation status of conference rooms and individual booths, and updates the database when a reservation request comes in. For this purpose, it uses a relational database such as an SQL database.

[1684] 2. Acquisition and management of employee location information

[1685] The server uses GPS data and Wi-Fi location information to obtain the user's current location, and based on that information, generates a list of other users nearby. This location information is used to improve business efficiency.

[1686] 3. Lunch Suggestion Generation

[1687] The server references the user's profile information and generates lunch suggestions based on, for example, whether the user is on a diet or has certain food allergies. The suggestions are based on the user's health status and preferences.

[1688] Terminal (user's device)

[1689] The terminal communicates with the server through a user interface to realize the following operations:

[1690] 1. Submitting and Viewing Information Requests

[1691] When a user uses the app to request information such as available meeting rooms or lunch suggestions, the device sends an information request to the server, receives responses from the server, and displays them to the user.

[1692] 2. User Interface

[1693] The device provides an easy-to-use user interface, allowing users to easily obtain and operate the information they need. Intuitive operation is possible using swipes, taps, and other gestures.

[1694] User

[1695] By using this system, users can take advantage of the following functions:

[1696] 1. System Operation

[1697] Through the terminal, users can perform operations such as reserving conference rooms, checking employee locations, and receiving lunch suggestions.

[1698] 2. Update your profile

[1699] Users can update their profile information and receive more personalized suggestions from the system.

[1700] Specific examples

[1701] A specific example is given below.

[1702] 1. Conference Room Reservation

[1703] When user A checks the availability of a conference room and makes a reservation, he / she follows the steps below.

[1704] User A starts the app and sends a prompt message from the device to the server to request availability of conference rooms.

[1705] Example prompt: "What are the current conference room availability status?"

[1706] The server searches the database, obtains the latest reservation status, and returns it to the terminal.

[1707] The terminal displays the availability status to User A.

[1708] User A selects the desired conference room and time and sends a reservation request from the terminal to the server.

[1709] Example prompt: "Reserve conference room A from 10:00 AM to 11:00 AM."

[1710] The server saves the reservation information in its database and sends a confirmation message to User A.

[1711] 2. Lunch Suggestions

[1712] If User B wants lunch suggestions, he / she will take the following steps:

[1713] User B uses the app's lunch suggestion feature and submits a request.

[1714] Example prompt: "Suggest a good lunch for someone on a diet."

[1715] The server references User B's profile information and generates lunch suggestions based on his health status and preferences.

[1716] The terminal displays the generated lunch suggestions to User B.

[1717] Through this system, users can not only improve their work efficiency but also ensure that their daily work proceeds smoothly.

[1718] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1719] Program processing flow and specific operation explanation

[1720] Conference room / individual booth reservation management

[1721] Processing Steps

[1722] Step 1:

[1723] The user launches the app and makes a request to check the availability of conference rooms. Specifically, the user opens the app's conference room reservation screen and presses the button to check availability. The device receives this operation and sends a prompt message (e.g., "Tell me the current availability of conference rooms") to the server.

[1724] Input: Room availability request

[1725] Output: Request sent to the server

[1726] Step 2:

[1727] The server searches the database based on the request received from the terminal, specifically searching for the reservation status of conference rooms and individual booths and obtaining the latest information.

[1728] Input: Availability request

[1729] Output: Latest reservation status data

[1730] Step 3:

[1731] The server transmits the acquired latest reservation status data to the terminal.

[1732] Input: Latest reservation status data

[1733] Output: Reservation status data sent to the terminal

[1734] Step 4:

[1735] The terminal displays the latest reservation status data received from the server to the user. Specifically, the availability of conference rooms is displayed in a list.

[1736] Input: Reservation status data received from the server

[1737] Output: Availability information displayed on the screen

[1738] Step 5:

[1739] The user selects the desired conference room and time slot and confirms the reservation request. The terminal receives this selection and sends a reservation request (e.g., "Reserve conference room A from 10:00 AM to 11:00 AM") to the server.

[1740] Input: User's reservation selection

[1741] Output: Booking request sent to the server

[1742] Step 6:

[1743] The server updates the database based on the received reservation request, saves the new reservation information, and sends a confirmation message to the terminal after saving is complete.

[1744] Input: The booking request sent to the server

[1745] Output: Database update, new reservation information, confirmation message

[1746] Step 7:

[1747] The terminal receives a confirmation message from the server and notifies the user that the reservation is confirmed.

[1748] Input: Confirmation message

[1749] Output: Confirmation of reservation sent to user

[1750] Lunch Suggestions

[1751] Processing Steps

[1752] Step 1:

[1753] The user uses the app's lunch suggestion function to send a request. Specifically, the user opens the app's lunch suggestion screen and presses the button to accept the suggestion. The device receives this operation and sends a prompt message (e.g., "Suggest a lunch suitable for dieting") to the server.

[1754] Input: Lunch suggestion request

[1755] Output: Request sent to the server

[1756] Step 2:

[1757] The server retrieves the user's profile information from the database based on the request received from the device, specifically by referencing data such as health status and preferences.

[1758] Input: Lunch suggestion request

[1759] Output: Profile information

[1760] Step 3:

[1761] The server generates lunch suggestions that match the user's needs based on the profile information it has acquired, specifically by suggesting menus that take into account the user's health status and preferences.

[1762] Input: Profile Information

[1763] Output: Lunch suggestions data

[1764] Step 4:

[1765] The server transmits the generated lunch proposal data to the terminal.

[1766] Input: Lunch suggestion data

[1767] Output: Proposal data sent to the device

[1768] Step 5:

[1769] The terminal displays the lunch proposal data received from the server to the user. Specifically, the proposed menu is displayed on the screen.

[1770] Input: Proposal data received from the server

[1771] Output: Lunch suggestions displayed on screen

[1772] This allows users to conveniently and quickly receive conference room reservations and lunch suggestions, improving work efficiency.

[1773] (Application example 1)

[1774] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1775] Conventional office management systems provide functions such as reservation management for conference rooms and individual booths, location management for employees, and lunch suggestions, but they lack the flexibility to adapt to modern factory environments, where greater efficiency is required. In particular, there is a need for systems that can address the unique needs of factories, such as reservation management for work areas and machinery, location management for workers, and meal suggestions based on workers' health conditions.

[1776] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1777] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring a user's current location information and generating and displaying a list of other nearby users, means for generating and presenting appropriate lunch suggestions based on the user's profile information, means for monitoring and updating the reservation status of work areas and machinery, means for acquiring and managing the location information of workers in the work area, and means for generating and presenting appropriate meal suggestions based on the worker's profile information. This enables the efficiency of reservation management, location information management, and meal suggestions in a factory environment, just as in an office environment.

[1778] A "conference room" is a room set aside for holding meetings or discussions within an office or factory.

[1779] An "individual booth" is a small space separated for individual or small group work or meetings.

[1780] "Reservation status" refers to whether or not the use of conference rooms, individual booths, work areas, and machinery and equipment has been reserved in advance.

[1781] "User" refers to an employee, worker, administrator, or the like who uses this system.

[1782] "Location information" is information for identifying the current location of a user or worker.

[1783] A "work area" is a space designated for the performance of a particular task or activity.

[1784] "Machinery and equipment" is a general term for devices and machines that support work within a factory.

[1785] "Profile information" is information that records personal information, preferences, health status, etc., related to users and workers.

[1786] "Lunch suggestion" refers to presenting an appropriate lunch menu based on the user's profile information.

[1787] "Meal suggestions" refers to presenting an appropriate meal menu based on the worker's profile information, taking into consideration their health condition, etc.

[1788] The "list of other nearby users" is a list of other users who are located in the vicinity of a specific user based on the current location information of the user.

[1789] A "server" is a computer system used to manage and process data.

[1790] The system that embodies this invention consists of three elements: a server, a terminal, and a user. The server performs the main data processing and monitoring, and the terminal functions as an interface with the user. The user operates the system through the terminal and receives the necessary information and suggestions.

[1791] server

[1792] The server's main responsibilities are:

[1793] Reservation management of conference rooms and individual booths: The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[1794] Reservation management for work areas and machinery: Similarly, the reservation status of work areas and machinery is managed, and when a reservation request comes in, new reservation information is saved in the database.

[1795] Location information management: The server obtains the current location information of users and workers using GPS data and Wi-Fi location information, and generates a list of other users and workers who are nearby.

[1796] Proposal generation based on profile information: The server references the profile information of users and workers and generates lunch and meal suggestions based on that information.

[1797] Terminal (user's device)

[1798] The terminal has the following responsibilities:

[1799] Information request and display: The user operates the terminal to request the availability of conference rooms, individual booths, work areas, and machinery from the server, and the results are displayed. Also, a list of other nearby users and workers is displayed based on the user's or worker's current location information.

[1800] Updating profile information: Users and workers can update their own profile information through their terminals, and based on that information, they can receive appropriate suggestions from the server.

[1801] User

[1802] Users and workers use the terminals to access various functions of the system, including reserving conference rooms and individual booths, checking nearby users and workers, and receiving lunch and meal suggestions.

[1803] Hardware and software used

[1804] Hardware: Servers, factory robots, smart devices

[1805] Software: Python (programming), SQLite (database management), JSON (data format)

[1806] Specific examples

[1807] For example, when User A checks the availability of a conference room and makes a reservation, a request is sent from the terminal to the server, and the server retrieves the current availability from the database and returns it. User A checks the displayed information, selects the desired conference room, and confirms the reservation. This updates the server's database.

[1808] Similarly, when factory robot R1 reserves work area A for one hour, a request is sent to the server and the reservation information is saved in the database. Furthermore, if "Suggest a lunch for employee with ID 1" is entered as the prompt, the server generates a lunch suggestion suitable for the worker with the specified ID and sends it to the terminal.

[1809] In this way, the system of the present invention can flexibly respond to various needs in office and factory environments and can significantly improve business efficiency.

[1810] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1811] Step 1:

[1812] The terminal sends a request to the server to check the availability of conference rooms and work areas in response to user operation. The input includes information on the date, time, and location selected by the user. By sending this information to the server, the terminal provides the basic data for the server to check the reservation status.

[1813] Step 2:

[1814] The server searches the database based on the received request to obtain the latest reservation status for the specified date, time, and location. The server uses the received date, time, and location information as a key to find the appropriate reservation information from the database and obtain it in real time. The output is the current availability data.

[1815] Step 3:

[1816] The server returns the acquired reservation status data to the terminal, allowing the user to immediately check the reservation status for the date, time, and location specified by the user. The server creates the acquired availability status based on the information in the database and sends it to the terminal.

[1817] Step 4:

[1818] The terminal displays the reservation status data received from the server on the user interface. Based on this displayed information, the user can select an available conference room or work area and make a reservation. The input is the data received from the server, and the output is to provide the information to the user in a visually easy-to-reach format.

[1819] Step 5:

[1820] The user selects the desired conference room or work area using the terminal interface and confirms the reservation. Based on the user's operation, the terminal generates new reservation information and sends it to the server. It also compiles request data including the selected conference room or work area and date and time details.

[1821] Step 6:

[1822] The server updates the database based on the new reservation information received, thereby confirming the new reservation for the specified date, time, and location. The server receives reservation request data as input and processes the database record as output.

[1823] Step 7:

[1824] When a user wants to update their profile information, the device sends the profile information to the server. The user enters data about their health status and dietary preferences, which are then sent to the server via the device.

[1825] Step 8:

[1826] The server stores the profile information in a database and generates lunch and meal suggestions based on that information. Based on this information, the server uses a generative AI model to make appropriate suggestions. Based on the received profile information, the server updates the database and generates suggestions using the generative AI model.

[1827] Step 9:

[1828] The user sends a request to the server through the terminal and receives suggested lunch or meal information. The input is the profile information and the request, and the output is the suggested lunch or meal information sent from the server.

[1829] Step 10:

[1830] The terminal displays the received lunch and meal suggestions to the user, allowing the user to select the meal that best suits them. The terminal visually displays the data received from the server. The same process is followed when a prompt such as "Suggest a lunch for employee with ID 1" is entered.

[1831] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1832] This invention is a system designed to solve various issues faced by office workers, providing comprehensive support for meeting room and individual booth reservation management, employee name recognition, lunch suggestions, advice on casual conversation, and task management. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides even more advanced support. The system is primarily composed of three elements: a server, a terminal (user device), and the user.

[1833] System Configuration

[1834] 1. Server

[1835] Reservation management for conference rooms and individual booths: The server monitors and updates the reservation status of conference rooms and individual booths, and stores the information in a database. The reservation status is updated in real time, ensuring that the occupied / vacant status of each conference room and booth is always up to date.

[1836] Employee location management: The server collects the user's current location and generates a list of other nearby users. Location information is obtained through GPS data and Wi-Fi location information.

[1837] Profile Information and Lunch Suggestions: The server references the user's profile information from a database and generates lunch suggestions based on individual needs (e.g., dieting, allergies to certain ingredients, etc.).

[1838] Emotion engine: The emotion engine built into the server recognizes emotions from the user's facial expressions, voice tone, text input, etc., and stores the information in a database. Based on this emotional information, various services can be provided in a more personalized manner.

[1839] 2. Terminal (user device)

[1840] Information request and display: The terminal sends information requests to the server according to the user's operations and displays the information received from the server to the user, such as the availability of conference rooms, employee lists, and lunch suggestions.

[1841] User Interface: The device's user interface is designed with ease of use in mind, allowing users to easily obtain and operate information.

[1842] 3. Users

[1843] System operation: Users operate their devices and use various system functions through the app, such as checking the status of conference room reservations, making new reservations, checking the schedules of nearby employees, and receiving lunch suggestions.

[1844] Profile Update: Users can update their profile information and receive appropriate support from the system based on that information.

[1845] Emotional information input: Users input facial expressions, voice, and text so that the emotion engine can properly recognize emotions.

[1846] Program processing

[1847] 1. Conference room / individual booth reservation management

[1848] Server: Retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. When a reservation request comes in, the database is updated and the new reservation information is saved.

[1849] Device: When a user launches the app, it requests availability from the server and displays the availability of conference rooms based on the received data. When the user confirms the reservation, it sends the reservation information to the server.

[1850] 2. Displaying nearby employees

[1851] Server: Obtains the user's location information and generates a list of nearby employees based on that information. The location information is updated in real time.

[1852] Device: Sends a location request to the server and displays the obtained employee list. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[1853] 3. Lunch Suggestions

[1854] Server: Looks up the user's profile information and generates appropriate lunch suggestions based on that data, taking into account the user's health status and preferences.

[1855] Terminal: When a user requests lunch suggestions, it sends the request to the server and displays the suggestions received from the server.

[1856] 4. Use of Emotion Engine

[1857] Server: The emotion engine analyzes the user's emotions from their facial expressions, voice, and text, and stores the information in a database.

[1858] Terminal: Based on the emotional data analyzed by the emotion engine, the system displays appropriate suggestions and advice to the user. For example, if the user is feeling stressed, the system will suggest ways to relax.

[1859] Specific examples

[1860] As a concrete example, we will explain the process by which User A checks the availability of conference rooms and makes a reservation. When User A launches the app, the device requests the server for the availability of conference rooms. The server retrieves the latest reservation status from the database and sends it back to the device. User A then selects the desired conference room from the available information displayed and confirms the reservation. At this point, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[1861] If User B wants to receive lunch suggestions, he or she can send a request using the app's buddy function. The server will generate appropriate lunch suggestions based on User B's profile information and send them to the device. User B can then review and select from the suggestions.

[1862] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[1863] In this way, the system of the present invention can flexibly respond to the diverse needs of users and significantly improve work efficiency in the office. By incorporating an emotion engine, even more advanced personalized support becomes possible.

[1864] The processing flow will be explained below.

[1865] Check availability and reserve meeting rooms / individual booths

[1866] Step 1:

[1867] User: Launches the app.

[1868] Step 2:

[1869] Terminal: Sends a "conference room availability" request to the server.

[1870] Step 3:

[1871] Server: Receives the request and retrieves the latest reservation status of conference rooms and individual booths from the database.

[1872] Step 4:

[1873] Server: Returns availability information to the terminal.

[1874] Step 5:

[1875] Terminal: Based on the received data, conference rooms in use are displayed in red and empty conference rooms in blue.

[1876] Step 6:

[1877] User: Check availability, select the desired conference room and make a reservation.

[1878] Step 7:

[1879] Terminal: Sends the user's reservation information to the server.

[1880] Step 8:

[1881] Server: Receives reservation requests and updates the reservation status in the database.

[1882] Step 9:

[1883] Server: Notifies the terminal of the confirmed reservation information.

[1884] Step 10:

[1885] Terminal: Display a notification to the user that the reservation is complete.

[1886] Displaying nearby employees

[1887] Step 1:

[1888] User: Launches the app.

[1889] Step 2:

[1890] Terminal: Sends a request to the server for a list of nearby employees.

[1891] Step 3:

[1892] Server: Obtains the user's current location information.

[1893] Step 4:

[1894] Server: Obtains location information of other employees from the database and generates a list of nearby employees.

[1895] Step 5:

[1896] Server: Returns the generated employee list to the terminal.

[1897] Step 6:

[1898] Terminal: The received employee list is displayed to the user.

[1899] Step 7:

[1900] User: Tap a specific employee name.

[1901] Step 8:

[1902] Device: Sends a request to the server containing the tapped employee name.

[1903] Step 9:

[1904] Server: Receives the request and retrieves the schedule information for a specific employee from the database.

[1905] Step 10:

[1906] Server: Returns the acquired schedule information to the terminal.

[1907] Step 11:

[1908] Terminal: Displays the received schedule information to the user.

[1909] Buddy feature lunch suggestions

[1910] Step 1:

[1911] User: Activate the Buddy feature.

[1912] Step 2:

[1913] User: Type "I'm not sure what to have for lunch."

[1914] Step 3:

[1915] Terminal: Sends requests to the server.

[1916] Step 4:

[1917] Server: Looks up the user's profile information from a database.

[1918] Step 5:

[1919] Server: Generates lunch suggestions based on the user's profile information.

[1920] Step 6:

[1921] Server: Sends proposals back to the device.

[1922] Step 7:

[1923] Device: Show lunch suggestions.

[1924] Step 8:

[1925] User: Review the suggestions and make a selection.

[1926] Use of emotion engine

[1927] Step 1:

[1928] User: Launches the app.

[1929] Step 2:

[1930] Terminal: Collects emotional data such as the user's facial expressions, voice, and text input.

[1931] Step 3:

[1932] Terminal: Sends collected emotion data to the server.

[1933] Step 4:

[1934] Server: The emotion engine analyzes the emotion data and identifies the user's emotional state.

[1935] Step 5:

[1936] Server: Generates appropriate suggestions and advice based on the user's emotional state.

[1937] Step 6:

[1938] Server: Sends generated suggestions and advice back to the device.

[1939] Step 7:

[1940] Device: Display emotion-based suggestions and advice to the user.

[1941] Step 8:

[1942] User: Review the suggestions and advice and act as needed.

[1943] This is the specific processing flow of the present invention. This system allows users to reserve conference rooms or booths, check nearby employees, suggest lunches, and receive comprehensive support based on their emotions.

[1944] Example 2

[1945] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1946] Employees face many challenges in modern office environments. Reservation management for conference rooms and individual booths is time-consuming, making it difficult to secure an appropriate workspace. It's also difficult to track colleagues' locations, reducing the efficiency of collaboration. Furthermore, there are no meal suggestions based on each employee's health status or preferences, which can lead to stress when choosing what to eat during work. Furthermore, stress management is difficult because employees' emotional states are not recognized and appropriate support based on them is not provided.

[1947] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1948] In this invention, the server includes a means for monitoring and updating the reservation status of conference rooms and individual booths, a means for acquiring a user's current location information and generating and displaying a list of other nearby users, a means for generating and presenting appropriate meal suggestions based on the user's profile information, and a means for recognizing a user's emotions and generating and presenting suggestions based on those emotions. This streamlines conference room reservation management in an office environment and enables quick collaboration with colleagues. It also provides meal suggestions tailored to individual health conditions and preferences, reducing stress during work. Furthermore, emotion recognition technology can support employees' mental health.

[1949] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system that has the function of understanding the usage status of conference rooms and individual booths in real time and updating the database in response to user reservation requests.

[1950] "Means for acquiring the user's current location information and generating and displaying a list of other users nearby" refers to a system that has the function of collecting the user's location information, identifying other users nearby based on that data, and displaying them as a list.

[1951] "Means for generating and presenting appropriate meal suggestions based on user profile information" refers to a system that has the function of generating optimal meal options based on information about the user's health condition and preferences and presenting them to the user.

[1952] "Means for recognizing the user's emotions and generating and presenting suggestions based on them" refers to a system that has the function of analyzing the user's emotions from facial expressions, voice, text, etc., and generating and presenting suggestions for stress management, relaxation methods, etc. based on the results.

[1953] This invention is a system that significantly improves the work efficiency of office workers by managing reservations for conference rooms and individual booths, managing employee location information, suggesting health-based meals, and utilizing an emotion engine that recognizes the user's emotions. This system is primarily composed of three elements: a server, a terminal (user device), and the user.

[1954] Hardware and software used

[1955] Server: Use an EC2 instance from Amazon Web Services (AWS).

[1956] Database: Use Amazon RDS (relational database service).

[1957] Various APIs: Utilize Google Maps API (to obtain location information) and Microsoft Azure Emotion API (for emotion recognition).

[1958] Devices: Use applications developed for iOS or Android devices.

[1959] Conference room / individual booth reservation management

[1960] The server retrieves the latest reservation status of conference rooms and individual booths from the database and updates it in real time. The terminal inquires about availability from the server in response to a user request and displays the retrieved data to the user. When the user confirms a reservation, the terminal sends the information to the server, which then updates the database.

[1961] Displaying nearby employees

[1962] The server acquires the user's location information and generates a list of nearby employees based on that information. The device queries the server for location information at the user's request and displays the received employee list to the user. When the user taps on a specific employee's name, the server requests that employee's schedule information.

[1963] Lunch Suggestions

[1964] The server references the user's profile information from a database and generates appropriate lunch suggestions based on that data. The device queries the server for lunch suggestions in response to the user's request and displays the received suggestions to the user.

[1965] Use of emotion engine

[1966] The server uses an emotion engine to analyze the user's emotions from their facial expressions, voice, and text, and stores the results in a database. The device then displays appropriate suggestions and advice to the user based on the emotion data. For example, if the user is feeling stressed, the server generates relaxation suggestions, and the device displays that information to the user.

[1967] Examples of concrete examples and prompts

[1968] Here is a concrete example using this system:

[1969] Meeting room booking process

[1970] When User A starts the app and checks the availability of conference rooms, the device requests information from the server. The server retrieves the latest reservation information from the database and sends it back to the device. User A selects the desired conference room and confirms the reservation. The device sends a reservation request to the server, which updates the database.

[1971] The process of receiving lunch suggestions

[1972] When User B presses the "Lunch Suggestion" button, the device sends a request to the server. The server generates appropriate lunch suggestions based on User B's profile information and sends them to the device. User B can then select a lunch based on the suggestions.

[1973] Suggestions using an emotion engine

[1974] If user C feels stressed at work, the emotion engine recognizes that emotion and generates relaxation suggestions. The device displays the suggestions to user C, who can then perform relaxation activities such as stretching or taking a break.

[1975] An example prompt based on this system is:

[1976] "I want to check the reservation status of conference rooms and make new reservations."

[1977] "Please suggest some lunches for those on a diet."

[1978] "Please give me some relaxation tips based on my current stress level."

[1979] The present invention is extremely useful as a system for significantly improving work efficiency in an office environment and maximizing employee health and work efficiency.

[1980] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1981] The flow of this system's program processing

[1982] Conference room / individual booth reservation management

[1983] Step 1:

[1984] When a user opens a reservation application, the terminal sends a request to the server to find out the availability of conference rooms or individual booths. This request includes the user ID and the desired date and time.

[1985] Step 2:

[1986] The server retrieves the latest reservation status from the database based on the received request, and the output from the database is a list of available conference rooms and booths.

[1987] Step 3:

[1988] The server sends the acquired reservation information to the terminal, which receives this information and displays it to the user. The user then selects the desired conference room or booth from the list.

[1989] Step 4:

[1990] When the user selects the desired conference room or booth and presses the "reserve" button, the terminal sends a reservation request including the selected information to the server.

[1991] Step 5:

[1992] The server updates the database based on the received reservation request, and the updated reservation information is reflected in real time for other users.

[1993] Displaying nearby employees

[1994] Step 1:

[1995] When a user selects the "nearby coworkers" option, the device sends a location request to the server, which includes the user's current location.

[1996] Step 2:

[1997] The server analyzes the user's location information and retrieves the location information of other nearby employees from a database, resulting in a list of nearby employees.

[1998] Step 3:

[1999] The server sends the generated list to the terminal, which displays the list to the user, allowing the user to select a specific employee from the list.

[2000] Step 4:

[2001] When the user selects a particular employee's name, the terminal requests that employee's schedule information from the server.

[2002] Step 5:

[2003] The server retrieves the employee's schedule information from the database based on the received request and sends it to the terminal, which then displays the information to the user.

[2004] Lunch Suggestions

[2005] Step 1:

[2006] When a user presses the "Lunch Suggestion" button in the app, the device sends a lunch suggestion request to the server, which includes the user's profile information.

[2007] Step 2:

[2008] The server generates appropriate lunch suggestions based on the user's profile information, which includes information on health status and food allergies, and selects the optimal lunch menu based on this information.

[2009] Step 3:

[2010] The server sends the generated lunch suggestions to the terminal, which displays this information to the user, who can then choose a lunch based on the suggestions.

[2011] Use of emotion engine

[2012] Step 1:

[2013] Within the application, users can direct their facial expressions at the camera, speak, or input text, and this data is sent from the device to the server.

[2014] Step 2:

[2015] The server uses an emotion engine to analyze the received emotion data. During this process, emotions are identified from facial expressions, voice, and text. Emotion data is generated as a result of the analysis.

[2016] Step 3:

[2017] The server generates appropriate suggestions and advice for the user based on the emotion data. For example, if the user is feeling stressed, it generates suggestions for relaxation.

[2018] Step 4:

[2019] The server sends the generated suggestions to the device, which then displays the information to the user, who can then stretch or take a break based on the suggestions.

[2020] This concludes the detailed operation of each processing step. This system allows users to efficiently reserve conference rooms and booths, obtain information about nearby employees, receive health-based lunch suggestions, and manage stress.

[2021] (Application example 2)

[2022] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2023] In conventional office environments, multiple tasks, such as managing reservations for conference rooms and individual booths, keeping track of employee schedules, and suggesting lunch options, are often cumbersome, resulting in reduced work efficiency. In particular, there is a lack of personalized support that takes into account the user's emotional state, making it difficult to improve the user experience. Similarly, individual optimization based on user profile information is also difficult to achieve. Therefore, the present invention aims to provide a comprehensive system that solves these issues and improves work efficiency.

[2024] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2025] In this invention, the server includes means for monitoring and updating the reservation status of conference rooms and individual booths, means for acquiring the user's current location information and generating and displaying a list of other users nearby, means for generating and presenting appropriate lunch suggestions based on the user's profile information, and means for analyzing the user's facial expressions and voice tone to recognize the user's emotional state and generate personalized suggestions. This allows for real-time and individualized optimization of support for users, thereby improving work efficiency in office environments.

[2026] "Means for monitoring and updating the reservation status of conference rooms and individual booths" refers to a system or device for grasping and updating the reservation status of conference rooms and individual booths in real time.

[2027] "Means for acquiring the user's current location information and generating and displaying a list of other nearby users" refers to a system or device that collects the user's current location information and, based on that information, creates and displays a list of other nearby users.

[2028] "Means for generating and presenting appropriate lunch suggestions based on user profile information" refers to a system or device that refers to the user's profile information and suggests and presents the optimal lunch for the user based on that information.

[2029] "Means for analyzing a user's facial expressions and vocal tone to recognize the emotional state and generate personalized suggestions" refers to a system or device that recognizes a user's emotional state by analyzing the user's facial expressions and vocal tone, and generates individually optimized suggestions based on that information.

[2030] The present invention is a system for solving various problems faced by individuals working in an office, and provides comprehensive support by combining conference room and individual booth reservation management, current location information management, lunch suggestions, and an emotion recognition engine. Specific embodiments of the present invention are described below.

[2031] System configuration

[2032] 1. Server

[2033] Monitoring and updating reservation status: The server monitors and updates the reservation status of conference rooms and individual booths, and stores this information in a database. This allows the system to always provide the latest reservation status.

[2034] Location management: The server obtains the user's current location based on GPS data and Wi-Fi location information and generates a list of other users nearby.

[2035] Lunch suggestion generation: The server looks up the user's profile information and generates appropriate lunch suggestions based on that data.

[2036] Emotion Engine: The emotion engine analyzes the user's facial expressions and vocal tone to generate emotional data, which is then used to make personalized suggestions.

[2037] 2. Terminal (user device)

[2038] Information request and display: Based on the user's actions, the device sends an information request to the server and displays the received information to the user, including information about available conference rooms, a list of nearby employees, and lunch suggestions.

[2039] Acquiring emotion recognition data: The device uses the built-in camera and microphone to analyze the user's facial expressions and voice tone in real time to generate emotion data.

[2040] 3. Users

[2041] System operation: Users can operate the terminal to check conference room reservation information, make new reservations, check the schedules of nearby employees, and receive lunch suggestions.

[2042] Emotional information input: Users provide appropriate input through facial expressions and voice tone to ensure that the emotion engine obtains accurate data.

[2043] Examples and prompts

[2044] As a concrete example, we will explain the process by which User A checks the availability of a conference room and makes a reservation. When User A starts the application, the device sends a request for availability to the server, and the server retrieves the latest reservation status from the database and sends it back. User A selects the desired conference room from the available information displayed and confirms the reservation from the device. At this time, the device sends a reservation request to the server, and the server updates the database with the new reservation information.

[2045] As another example, consider the case where User B receives lunch suggestions. When User B sends a request using the application's lunch suggestion function, the server suggests suitable lunches based on the user profile and sends them to the device. User B can review the suggestions and select one.

[2046] Furthermore, if User C is feeling stressed, the emotion engine will detect this and display relaxation suggestions (for example, light stretching or a short break) on the terminal. User C can follow the suggestions to relax.

[2047] Prompt Sentence Examples

[2048] "Recommend the best food for the user, taking into account their food preferences, allergy information, past ordering history, and current emotional state. For example, if the user is feeling stressed, suggest a lunch that includes ingredients that will help them relax."

[2049] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2050] Step 1:

[2051] The server retrieves the latest reservation status of conference rooms and individual booths from the database. The input is a reservation status request, and the output is the latest reservation status data. This ensures the consistency of reservation information in real time.

[2052] Step 2:

[2053] When the user launches the application, the terminal sends a request for reservation status to the server. The input is the user's operation, and the output is the request sent to the server. This allows the user to obtain the latest information.

[2054] Step 3:

[2055] The server obtains the user's current location information and generates a list of other nearby users. The input is GPS data and Wi-Fi location information, and the output is a list of nearby users. Location analysis allows us to understand the distance between users in real time.

[2056] Step 4:

[2057] The device sends a location information request to the server and displays the obtained list to the user. The input is the list data from the server, and the output is the list information displayed on the user interface. This allows the user to easily check other users nearby.

[2058] Step 5:

[2059] The server references the user's profile information and generates appropriate lunch suggestions based on that data. The input is the user profile information, and the output is lunch suggestion data. Analysis of the profile information enables personalized suggestions.

[2060] Step 6:

[2061] The terminal requests lunch suggestions from the server and displays the received suggestions to the user. The input is the user's request and the suggestion data from the server, and the output is the displayed lunch suggestions, allowing the user to select a suitable lunch for themselves.

[2062] Step 7:

[2063] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time and generate emotion data. The input is the user's facial expressions and voice tone, and the output is emotion data. Emotion recognition libraries such as OpenCV and DeepFace are used for data analysis.

[2064] Step 8:

[2065] The server recognizes the user's current emotional state based on the emotional data received from the device and generates personalized suggestions. The input is emotional data, and the output is personalized suggestions. This enables more appropriate support for the user.

[2066] Step 9:

[2067] The device displays personalized suggestions to the user. The input is the suggestion data from the server, and the output is the displayed suggestion information. This allows the user to select an action that suits their emotional state.

[2068] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2069] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2070] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2071] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2072] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2073] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2074] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2075] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2076] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2077] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2078] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2079] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2080] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2081] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2082] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2083] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2084] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2085] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2086] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2087] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2088] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2089] The following is further disclosed regarding the above embodiment.

[2090] (Claim 1)

[2091] A means to monitor and update the reservation status of conference rooms and individual booths,

[2092] A means for acquiring the user's current location information and generating and displaying a list of other users nearby;

[2093] means for generating and presenting appropriate lunch suggestions based on the user's profile information;

[2094] A system including:

[2095] (Claim 2)

[2096] 2. The system according to claim 1, which displays the usage status of conference rooms and individual booths in real time.

[2097] (Claim 3)

[2098] The system of claim 1, wherein a user obtains and displays schedule information of specific other users.

[2099] "Example 1"

[2100] (Claim 1)

[2101] A means to monitor and update the reservation status of conference rooms and individual booths,

[2102] A means for acquiring the user's current location information and generating and displaying a list of other users nearby;

[2103] means for generating and presenting appropriate lunch suggestions based on the user's profile information;

[2104] means for sending an information request from the terminal to the server and displaying the response;

[2105] A means for a user to obtain and manipulate information using a user interface;

[2106] A system including:

[2107] (Claim 2)

[2108] 2. The system according to claim 1, which displays the usage status of conference rooms and individual booths in real time.

[2109] (Claim 3)

[2110] The system of claim 1, wherein a user obtains and displays schedule information of specific other users.

[2111] "Application Example 1"

[2112] (Claim 1)

[2113] A means to monitor and update the reservation status of conference rooms and individual booths,

[2114] A means for acquiring the user's current location information and generating and displaying a list of other users nearby;

[2115] means for generating and presenting appropriate lunch suggestions based on the user's profile information;

[2116] A means to monitor and update the availability of work areas and machinery;

[2117] A means for acquiring and managing location information of workers in a work area;

[2118] A means for generating and presenting appropriate meal suggestions based on the worker's profile information;

[2119] A system including:

[2120] (Claim 2)

[2121] 10. The system of claim 1, which displays the usage status of conference rooms, individual booths, work areas and machinery in real time.

[2122] (Claim 3)

[2123] The system according to claim 1, wherein a user obtains and displays schedule information of a specific other user, or a worker obtains and displays schedule information of another worker.

[2124] "Example 2: Combining Emotion Engines"

[2125] (Claim 1)

[2126] A means to monitor and update the reservation status of conference rooms and individual booths,

[2127] A means for acquiring the user's current location information and generating and displaying a list of other users nearby;

[2128] means for generating and presenting appropriate meal suggestions based on the user's profile information;

[2129] A means for recognizing a user's emotions and generating and presenting suggestions based on the emotions;

[2130] A system including:

[2131] (Claim 2)

[2132] 2. The system according to claim 1,...

Claims

1. A means to monitor and update the reservation status of conference rooms and individual booths, A means for acquiring current location information of a user and generating and displaying a list of other nearby users; means for generating and presenting appropriate lunch suggestions based on the user's profile information; A system including:

2. 2. The system according to claim 1, wherein the usage status of conference rooms and individual booths is displayed in real time.

3. 2. The system according to claim 1, wherein a user acquires and displays schedule information of a specific other user.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A