system

Abstract

We provide the system. [Solution] A natural language processing means that analyzes natural language instructions from the user and identifies their intent, A database search method for selecting an appropriate workspace based on the viewer's current location information, taking into account past usage records and personal preferences, A route optimization method that calculates the optimal travel route based on real-time travel conditions and weather data, Augmented reality / virtual reality generation means for visually presenting the recommended virtual environment of the workspace and information on available equipment, A reservation means for confirming the selected workspace, A visualization tool for examining and confirming the recommended workspace using augmented reality, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] [[ID=३4]] In recent years, as various work styles are becoming popular, there is a demand for an environment where workplaces such as offices, telecommuting, and satellite offices can be flexibly selected. However, it is difficult to efficiently utilize the idle time during movement associated with customer visits or business trips to select an optimal workplace including real-time congestion information and weather changes. In addition, there is a problem that there is a lack of means to quickly and intuitively select an optimal satellite office individually based on the user's preferences and past usage records.

Means for Solving the Problems

[0005] This invention provides a means for analyzing user-inputted instructions in natural language to identify intent, and then using that information to search a database for the optimal work location, taking into account past usage records and personal preferences. It also includes a route optimization means for calculating the optimal travel route using real-time traffic and weather data. Furthermore, by visually presenting the environment and facilities of recommended work locations using AR / VR technology, users can virtually confirm and improve the accuracy of their selection. Finally, by providing a means for immediately reserving the selected work location, the system enables efficient use of work time.

[0006] "Natural language processing means" refers to technologies that analyze natural language input from users, such as speech or text, to identify intentions and conditions.

[0007] A "database search method" is a technology that uses a database containing past usage records and user preferences to find the optimal workspace.

[0008] "Route optimization" refers to a technology that optimizes a user's travel route by taking into account real-time traffic information and weather data.

[0009] "Augmented reality / virtual reality generation means" refers to technology that virtually visualizes the environment and facilities of a satellite office to assist users in their selection.

[0010] "Reservation method" refers to a system function or method for immediately securing the use of a selected workspace. [Brief explanation of the drawing]

[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3]This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0013] First, let's explain the terminology used in the following explanation.

[0014] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0015] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0016] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0017] In the following embodiments, the numbered communication I / F (Interface) is an interface that includes a communication processor, an antenna, and the like. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0019] [First Embodiment]

[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0032] This invention is a system that uses an AI agent to suggest the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a terminal, a server, and the user.

[0033] Firstly, the user provides instructions using natural language via voice or text on their device. These instructions might be something like, "I have a 30-minute gap before my next appointment; where can I work?"

[0034] The device receives this natural language and analyzes the user's intent using natural language processing. The analyzed information includes time constraints, the next destination, and the required environmental characteristics.

[0035] Once the analysis is complete, the device sends the analysis results to the server along with the user's current location information. This includes data on past satellite office usage history and personal preferences.

[0036] The server uses a database search mechanism to identify the optimal workspace for the user. Factors such as location, available equipment, and availability are considered during this process.

[0037] Next, the server uses route optimization to calculate the optimal travel route from the user's current location to the recommended work location and the next destination. Real-time traffic information and weather data are incorporated into this to determine the user's optimal route.

[0038] Furthermore, the server uses augmented reality / virtual reality generation methods to generate visual information of the virtual environment and facilities of the selected work location. This data is transmitted to the terminal, allowing the user to view the environment through AR / VR.

[0039] Ultimately, the user reviews the available workspaces provided by the server via their terminal and selects the one they deem best. Once selected, the terminal immediately confirms the workspace reservation using the reservation system.

[0040] As a concrete example, suppose a user is near Tokyo Station, their next destination is Shibuya, and they want to secure 30 minutes of work time during their commute. Using this system, the user can find a quiet workspace called Tokyo Central Work Space, check out the facility using augmented reality (AR), and then complete the reservation. This process allows the user to efficiently utilize their travel time to their destination for work.

[0041] The following describes the processing flow.

[0042] Step 1:

[0043] The user inputs instructions using natural language via the device. If voice input is selected, the device captures voice data through the microphone; if text input is selected, it accepts text directly.

[0044] Step 2:

[0045] The device sends the acquired voice data to a natural language processing engine, which converts it into text data. The text data is then analyzed to identify the user's intent. This analysis includes information such as the length of the downtime, the next destination, and the required environmental conditions.

[0046] Step 3:

[0047] The device sends the analysis results to the server along with the user's location information. It also provides the server with data on the user's past usage history and preferences.

[0048] Step 4:

[0049] The server uses the received data to perform a database search. It narrows down the search to find the optimal work location that matches the user's criteria based on location, facilities, and availability.

[0050] Step 5:

[0051] The server activates a route optimization engine and, based on real-time traffic and weather data, calculates the optimal route from the user's current location to the selected work location and the next destination.

[0052] Step 6:

[0053] The server uses an augmented reality / virtual reality generation module to generate visual information about the environment and facilities of each candidate work location. This generated information is then sent to the terminal.

[0054] Step 7:

[0055] The terminal displays potential work locations received from the server, along with their visual information, to the user. The user can use AR / VR functionality to virtually check the environment and facilities of each candidate location.

[0056] Step 8:

[0057] The user selects a workspace from the presented options and confirms the selected workspace on their device.

[0058] Step 9:

[0059] The terminal executes the reservation process based on the user's selection. It sends the reservation information for the selected work location to the server and confirms the reservation status.

[0060] Step 10:

[0061] The server updates the database based on the received reservation information. A reservation confirmation notification is sent to the terminal, allowing the user to check the reservation result.

[0062] (Example 1)

[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0064] There is a need for users to quickly and appropriately find workspaces to efficiently utilize downtime while traveling for work. However, existing systems have the problem of not being able to make suggestions that adequately consider the preferences and current circumstances of individual users. Therefore, the challenge is to achieve more accurate workspace selection and appropriate information provision.

[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0066] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent; information retrieval means for selecting an appropriate work location based on the user's current location information, taking into account past usage records and personal preferences; and route optimization means for calculating the optimal travel route based on real-time traffic conditions and weather data. This enables the user to efficiently identify a work location while traveling and secure an optimal environment for performing tasks in a short amount of time.

[0067] "Information processing means" refers to a device or system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0068] "Information retrieval means" refers to a device or system that has the function of selecting an appropriate work location based on the user's current location information, past usage records, and personal preferences.

[0069] A "route optimization means" is a device or system that has the function of calculating the optimal travel route for a user, taking into account real-time traffic conditions and weather data.

[0070] "Visual environment generation means" refers to a device or system equipped with the function of visually presenting information about the virtual environment and available equipment of a proposed work site.

[0071] A "reservation method" refers to a device or system that has the function of making reservations necessary to confirm the use of a selected work area.

[0072] "Information transmission means" refers to a device or system that has the function of transmitting analyzed information and other related data to a server.

[0073] This invention is a system that suggests the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a server, a terminal, and a user.

[0074] The user provides instructions using natural language via voice or text on the device. For example, they might send an instruction like, "I have a 30-minute gap before my next appointment, where can I work?" Upon receiving this instruction, the device uses natural language processing capabilities and, with the help of a generative AI model, analyzes it to understand the user's intent. At this stage, information such as time constraints, the next destination, and the characteristics of the required environment are extracted.

[0075] Next, the terminal sends the analyzed information and the user's current location to the server. The server uses an information retrieval tool to search the database and selects the optimal work location, taking into account past usage history and personal preferences. Furthermore, the server uses a route optimization tool to calculate the optimal travel route from the user's current location to the recommended work location and the next destination, based on traffic conditions and weather data.

[0076] Furthermore, the server uses a visual environment generation mechanism to create a virtual environment for the selected workspace and generate data for visual presentation. This data is sent to the terminal, allowing the user to view the workspace through AR / VR technology.

[0077] Based on the information provided via the terminal, the user selects the most suitable workspace and makes a reservation for it. The terminal then confirms the use of the selected workspace using the reservation method, allowing the user to immediately access the workspace.

[0078] As a concrete example, if a user is in the city center and has a 30-minute gap before their next destination, this system can be used to find a quiet workspace. By using a prompt message such as "I have a 30-minute gap between the city center and my next destination. Please suggest a suitable workspace," a suitable work environment can be quickly secured.

[0079] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0080] Step 1:

[0081] The user uses a terminal to input natural language instructions about the work location in either voice or text format. An example input would be, "I have a 30-minute gap before my next appointment, where can I work?" The terminal receives the instruction and, in the case of voice input, begins by converting it into text data using speech recognition.

[0082] Step 2:

[0083] The device uses a generative AI model and natural language processing capabilities based on the converted text data to analyze user instructions and identify intent. This analysis process involves contextual understanding and extracting details such as time constraints, the next place to visit, and desired environmental characteristics. The analysis results are output.

[0084] Step 3:

[0085] The terminal packages the analysis results and the user's current location information and sends them to the server. The input includes the analyzed intent and location information, which are sent to the server as a data packet.

[0086] Step 4:

[0087] The server searches the database using information retrieval methods based on the received data. Input includes the user's current location, past usage history, and personal preferences. The database search considers location, environment, available facilities, and availability to select the optimal workspace. The selected workspace is then output.

[0088] Step 5:

[0089] The server uses route optimization techniques to calculate the optimal travel route from the user's current location, based on the selected work location. Inputs include traffic information, weather data, and the work location, and the optimal route is output. The purpose of this output is to enable the user to travel to the work location smoothly.

[0090] Step 6:

[0091] The server generates virtual environment data for the selected workspace using a visual environment generation mechanism. This includes information on available equipment. Visual information and environmental analysis data are output and presented to the user.

[0092] Step 7:

[0093] The terminal presents the user with candidate workspaces, optimal routes, and virtual environment data received from the server. The user reviews the provided information and selects the most suitable workspace.

[0094] Step 8:

[0095] After the user makes a selection, the terminal uses the reservation method to reserve the selected workspace and confirm the reservation. A reservation confirmation is printed and presented to the user, making it ready to begin work immediately.

[0096] (Application Example 1)

[0097] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0098] In modern urban life, efficiently utilizing downtime while on the go is crucial. However, the process of finding, booking, and actually using a suitable workspace while traveling is time-consuming and requires considerable effort. Therefore, there is a need for a system that allows users to flexibly secure workspaces and perform their work efficiently even while on the move. In particular, there is a need for technology that supports user decision-making by utilizing real-time information and employing visualization techniques.

[0099] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0100] In this invention, the server includes a natural language processing means for analyzing natural language instructions from the user and identifying their intent; a database search means for selecting an appropriate workspace based on the viewer's current location information, taking into account past usage records and personal preferences; a route optimization means for calculating the optimal travel route based on real-time travel conditions and weather data; an augmented reality / virtual reality generation means for visually presenting the virtual environment and available equipment information of the recommended workspace; and a visualization means for examining and confirming the recommended workspace in augmented reality. This enables the user to quickly find, visually confirm, and reserve the optimal workspace even while on the go, thereby efficiently utilizing their spare time.

[0101] "Natural language processing means" refers to technology that analyzes natural language instructions input by users via voice or text and identifies their intent.

[0102] A "database search method" is a technology that selects the optimal workspace for a user based on information such as the viewer's current location, past usage history, and personal preferences.

[0103] "Route optimization" refers to a technology that uses real-time travel conditions and weather data to calculate the optimal travel route for the user.

[0104] "Augmented reality / virtual reality generation means" refers to a technology that visually presents users with a virtual environment of a recommended workspace and information on available devices.

[0105] "Visualization means" refers to technologies that allow users to explore recommended workspaces using augmented reality.

[0106] A "reservation method" is a technology used to confirm the use of a selected workspace and complete the reservation.

[0107] This invention proposes a system that provides a workspace for users to perform tasks efficiently while on the go. In this system, three main entities—a server, a terminal, and the user—work together collaboratively.

[0108] First, users can give instructions to the device using natural language. These instructions are entered via voice or text to clarify the user's intent and are parsed by the device's natural language processing capabilities. The parsed information includes time constraints, the next destination, and the required environmental characteristics.

[0109] Next, the terminal sends the analysis results along with the user's current location information to the server. The server uses this information to select the optimal workspace, taking into account past usage records in the database and the user's personal preferences. In making the selection, it evaluates multiple factors, such as available equipment and vacancy status, based on the viewer's current location information.

[0110] Using route optimization techniques, the server calculates the optimal travel route to the user's recommended workspace and next destination. This calculation utilizes real-time traffic and weather data.

[0111] Furthermore, the server visualizes the environment and equipment information of the recommended workspace using augmented reality / virtual reality generation means and transfers it to the terminal. The user can review the workspace through this visual information and, based on the results, confirm the use of the workspace using the reservation means.

[0112] For executing computer programs, the terminal uses NLTK as its natural language processing library, and Google® Speech-to-Text API for speech recognition. On the server side, SQL is used for database operations, and the Google Maps API can be integrated for route optimization. Platforms such as ARKit or ARCore are used for augmented reality display. After the final workspace selection, reservations are made in conjunction with the service via a REST API.

[0113] For example, if a user is near a train station in a city and enters the prompt, "I have 30 minutes to spare before my next appointment, where can I work?", the system will search for recommended workspaces and visualize them to the user using augmented reality. Based on this information, the user can select and reserve a workspace.

[0114] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0115] Step 1:

[0116] The user inputs instructions into the device via voice or text, requesting suggestions for a workspace during a short break. For example, the prompt might say, "I have a 30-minute gap before my next appointment, where can I work?" The device receives this input, analyzes the instructions using natural language processing, and outputs it as a data structure that identifies the time constraints, the next appointment location, and the characteristics of the required environment.

[0117] Step 2:

[0118] The device obtains the user's current location using GPS and sends it to the server along with data obtained through natural language processing. Here, the input is location information and user instructions, and the output is request data containing these.

[0119] Step 3:

[0120] The server uses database search capabilities to select the most suitable workspace for the user based on the request data. In this process, it searches and analyzes past usage records, personal preferences, and availability using database queries, and outputs a list of candidates.

[0121] Step 4:

[0122] After obtaining a list of candidate workspaces, the server uses a route optimization method. Taking the current location and the next destination as input, it calculates the optimal route using real-time traffic information and weather data, and outputs the most efficient travel route to the user.

[0123] Step 5:

[0124] The server converts the selected workspace into visual data as a virtual environment through augmented reality / virtual reality generation means. This is then transmitted to the terminal, providing the user with AR-based visual information. The output of this step is the visualized workspace information.

[0125] Step 6:

[0126] The user reviews the visual information of the workspace provided via the terminal and selects the optimal workspace based on that information. The selection result is sent to the server via the terminal.

[0127] Step 7:

[0128] The server confirms the selected workspace and makes a reservation using the reservation mechanism. It sends a request to the reservation server via the API and returns a success or failure of the reservation. The final output is information about the workspace for which the reservation has been confirmed.

[0129] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0130] This invention is a system in which an AI agent suggests the optimal workspace so that users can effectively utilize their downtime while traveling for work. In particular, it has the function of recognizing the user's emotions and optimizing accordingly. The system mainly consists of three entities: a terminal, a server, and a user.

[0131] Firstly, the user issues instructions in natural language via the device. When using voice input, the device captures voice data from the microphone and converts it into text using speech recognition. The user's instructions are analyzed for intent by natural language processing and converted into specific requests—for example, "I have 30 minutes free before my next visit, where can I work?"

[0132] Next, the device sends data about the user's current location, past usage history, and preferences, as well as emotional information analyzed by an emotion engine from voice and facial expressions, to the server. Based on this information, the server uses a database search mechanism to find the most suitable workspace. In this search, the entire emotional state is incorporated into the selection process, and the environment can be adjusted according to the user's emotions.

[0133] The server calculates the optimal travel route to the recommended work location by optimizing the route using real-time traffic and weather data. Next, augmented reality / virtual reality generation means generate data to visually provide the user with details of the environment and facilities of the selected work location. This information is transmitted to the terminal, and the user can virtually view it using AR / VR technology.

[0134] For example, if a user is near a train station and the server determines that the user's analyzed emotions indicate a need for relaxation, it will prioritize recommending a quiet, cafe-style workspace. If the user is experiencing stress, the server will suggest a calm, Japanese-style satellite office, customizing the overall work environment in real time for the user.

[0135] Ultimately, the user selects the most suitable workspace from the presented options and makes a reservation via their device. The reservation confirmation is sent from the device to the server, updating the database and allowing the user to efficiently utilize their time and concentrate on their work in the optimal environment.

[0136] The following describes the processing flow.

[0137] Step 1:

[0138] Users input natural language instructions via voice or text through their device, for example, "I have 30 minutes until my next appointment, where can I work?"

[0139] Step 2:

[0140] When voice input is selected, the device converts the speech into text data using speech recognition technology. The resulting text is then analyzed by a natural language processing engine to determine the user's intent.

[0141] Step 3:

[0142] The device sends the analysis results to the server, which include data such as the user's location, past usage history, preferences, and emotional information. This emotional information is analyzed by an emotion engine based on voice tone and facial expression characteristics.

[0143] Step 4:

[0144] The server searches the database based on the received data and selects suitable workspace candidates. This selection process reflects the user's emotions; for example, if the user is seeking relaxation, a quiet location will be prioritized.

[0145] Step 5:

[0146] The server acquires real-time traffic and weather data and performs route optimization to calculate the optimal travel route to the selected work location.

[0147] Step 6:

[0148] The server utilizes an augmented reality / virtual reality generation module to generate a virtual environment and information on available facilities for the selected work location, and then transmits this information to the terminal.

[0149] Step 7:

[0150] The terminal displays a list of potential work locations received from the server, along with their detailed information, to the user. The user can virtually check the atmosphere and facilities of the work locations using AR / VR technology.

[0151] Step 8:

[0152] The user selects the workspace they feel is best from the presented options and confirms their selection on their device.

[0153] Step 9:

[0154] The terminal uses the user's selection information to immediately process reservations, sending the reservation information to the server to confirm the reservation of the workspace.

[0155] Step 10:

[0156] The server updates the database based on the received reservation information and sends notifications, including reservation confirmations, to the user via their terminal. This allows users to efficiently utilize their free time and work in a customized work environment.

[0157] (Example 2)

[0158] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0159] In recent years, there has been a growing demand for more efficient and comfortable use of downtime while traveling. However, current technology struggles to suggest optimal workspaces that take into account people's emotions and personal preferences, resulting in users being unable to work efficiently while reducing stress. Furthermore, the optimization of travel routes using real-time traffic and weather information is still insufficient.

[0160] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0161] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent, information retrieval means for selecting an appropriate location based on the user's location information, usage history, individual preferences, and emotions, and route calculation means for calculating the optimal travel route based on traffic and weather information. This makes it possible to provide a comfortable and efficient work environment that meets the user's needs.

[0162] An "information processing means" is a component of a system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0163] "Information retrieval means" refers to a system component that has the function of selecting an appropriate workspace based on the user's location information, usage history, individual preferences, and emotions.

[0164] A "route calculation means" is a component of a system that has the function of calculating the optimal travel route based on traffic conditions and climate data.

[0165] A "virtual display means" is a system component that has the function of visually presenting information about the proposed environment to the user.

[0166] "Arrangement means" refers to a system component that has the function of confirming the use of the selected work location.

[0167] This invention provides a system that allows users to effectively utilize spare time even while on the go. Specifically, it centers around three components: a terminal, a server, and the user.

[0168] The user first uses a device to input instructions in natural language via voice. The device collects this voice data and converts it into text using speech recognition software (e.g., a speech recognition API). Based on this text data, the device uses a natural language processing engine (e.g., a natural language processing API) to analyze the user's intent.

[0169] Based on the analyzed intent, the device sends the user's location information, past usage history, individual preferences, and emotional information analyzed using an emotion engine (e.g., an emotion analysis API) to the server. For example, the user might enter a prompt such as, "I have 30 minutes free before my next visit, tell me about a nearby cafe."

[0170] Based on the received information, the server uses information retrieval tools to select a suitable location from the database. For the selected location, the server uses traffic and weather information (e.g., map API and weather API) and route calculation tools to optimize the travel route. Subsequently, the server uses virtual display tools to visually provide the user with information about the proposed location using augmented reality and virtual reality technologies.

[0171] Finally, the user selects their preferred location from the options provided via their terminal and confirms the reservation using the booking system. This entire process allows the user to efficiently perform their work in the most suitable environment.

[0172] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0173] Step 1:

[0174] The user uses the device to input natural language instructions via voice. For example, the user might say, "I have 30 minutes free before my next appointment; tell me about a nearby cafe." Voice data is captured as input. Based on this, the device collects this voice data through its microphone device.

[0175] Step 2:

[0176] The device converts the collected audio data into text data using speech recognition software. Specifically, it uses a speech recognition API. The input is the audio data from step 1, the process involves speech analysis, and the output is text information. For example, the user's voice becomes the text "Tell me about nearby cafes."

[0177] Step 3:

[0178] The device uses a natural language processing engine to analyze the user's intent from the converted text data. Using a natural language processing API, it receives textual information as input, analyzes it, and identifies the user's request. The output is the analyzed intent, for example, "search for nearby cafes."

[0179] Step 4:

[0180] The device analyzes emotional information using the user's location, usage history, preferences, and emotion engine, and sends this information to the server. Specifically, it utilizes location APIs and emotion analysis APIs to aggregate input data. As output of the emotion analysis, for example, an emotional result such as "I want to relax" is sent to the server.

[0181] Step 5:

[0182] The server uses the received data to search for a location suitable for the usage conditions using information retrieval methods. It executes database queries using database search technology. The input is the data sent in step 4, and the output suggests the most suitable location, for example, "a quiet cafe."

[0183] Step 6:

[0184] The server uses traffic and weather information to optimize travel routes to selected locations using route calculation tools. It utilizes map APIs and weather APIs to process real-time data. The input is the traffic and weather data to be used, and the output is the optimal travel route.

[0185] Step 7:

[0186] The server uses virtual display means to generate augmented reality and virtual reality information about candidate locations and provides it to the terminal. Specifically, it visualizes the configured environment using AR / VR technology. The output is visual data that the user can use, such as a "3D view of the inside of a cafe."

[0187] Step 8:

[0188] Based on the information provided, the user selects their desired location and confirms the reservation on their terminal. The reservation information for the selected location is then sent to the server using the appropriate means. Specifically, the input is the user's selection, the output is a reservation confirmation notification, and the system's database is updated.

[0189] (Application Example 2)

[0190] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0191] The challenge lies in providing users with an environment that allows them to work efficiently and comfortably while traveling or at home. In particular, selecting and controlling an appropriate work environment according to the user's emotional state has been difficult with conventional technologies. The goal is to solve this problem and provide an environment in which users can concentrate on their work without stress.

[0192] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0193] In this invention, the server includes an information processing device that analyzes natural language instructions from the user and identifies their intent, an information storage device for selecting an appropriate work location based on the user's current location information, and a virtual environment generation device that visually presents a virtual environment of a recommended work location. This makes it possible to provide users with a comfortable and efficient work environment that responds to their emotional state, even when they are on the go or at home.

[0194] An "information processing device" is a device that analyzes instructions given by a user in natural language and identifies their intent.

[0195] An "information storage device" is a device that selects an appropriate workspace based on the user's current location information, taking into account past usage records and personal preferences.

[0196] A "route optimization device" is a device that calculates the optimal travel route based on real-time travel conditions and weather data.

[0197] A "virtual environment generation device" is a device that visually presents the recommended virtual environment and available equipment information for a work site.

[0198] A "device including a reservation function" is a device that makes the necessary reservations to confirm the use of the selected work location.

[0199] An "environmental control device" is a device that analyzes the emotional state of a user and sets the optimal environment accordingly.

[0200] In the system for implementing this invention, the user first gives instructions in natural language. The terminal acquires the voice and converts the instructions into text using speech recognition software. The textual instructions are analyzed using natural language processing technology to identify the user's intent. Subsequently, the information processing device suggests an appropriate workspace based on the user's current location, past usage history, personal preferences, and emotional state.

[0201] The server analyzes this information using a database and selects the optimal work location. For the selected work location, a route optimization device calculates the optimal travel route based on real-time traffic and weather data. In addition, a virtual environment generation device visually presents the selected work environment to the user using AR / VR technology.

[0202] Furthermore, the environmental control system analyzes the user's emotional state and automatically adjusts settings such as room lighting, temperature, and music. This utilizes Philips Hue smart lighting and Google Nest® automatic temperature control systems. This allows for the rapid provision of a comfortable working environment. A reservation function ensures that the selected workspace is reserved, guaranteeing smooth usage.

[0203] For example, if a user gives a command such as "I want to work in a relaxed environment," the system will select and suggest a quiet cafe or peaceful environment to the user. An example of a prompt message would be "Play music when the user recognizes their emotion as relaxed." In this way, the invention can provide an optimal work environment tailored to the user's emotions and preferences.

[0204] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0205] Step 1:

[0206] The device acquires voice data from the user. Voice recognition software converts the voice data into text data. The input is voice data, and the output is text data. This conversion allows the user's instructions to be analyzed in digital format.

[0207] Step 2:

[0208] The device sends text data to a natural language processing engine to identify the intent. The input is text data, and the output is analyzed intent data. Here, the user's request is translated into a specific action.

[0209] Step 3:

[0210] The server integrates the user's current location, past usage history, preferences, and sentiment information, and retrieves the data using an information storage device. It then selects the optimal workspace from the database. Inputs include location information, history data, and sentiment information, while output is a recommended workspace. This process selects the most suitable workspace for the user.

[0211] Step 4:

[0212] The server collects real-time traffic and weather data and uses a route optimization device to calculate the optimal travel route. The input is real-time data, and the output is optimal route information. This allows for the proposal of efficient travel routes.

[0213] Step 5:

[0214] The server uses a virtual environment generator to create a virtual model of the selected workspace and sends it to the terminal. The input is workspace information, and the output is virtual model data. The user can visualize the workspace through AR / VR.

[0215] Step 6:

[0216] The device operates an environmental control system, adjusting settings such as lighting and music based on the user's emotional state. The input is emotional data, and the output is environmental setting information. This automatically creates the optimal environment for the user.

[0217] Step 7:

[0218] The server, which includes a reservation function, confirms the reservation of the selected workspace and notifies the user. The input is the selected workspace information, and the output is the reservation confirmation information. This ensures that the user can reliably use the workspace.

[0219] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0220] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0221] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0222] [Second Embodiment]

[0223] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0224] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0225] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0226] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0227] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0228] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0229] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0230] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0231] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0232] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0233] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0234] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0235] This invention is a system that uses an AI agent to suggest the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a terminal, a server, and the user.

[0236] Firstly, the user provides instructions using natural language via voice or text on their device. These instructions might be something like, "I have a 30-minute gap before my next appointment; where can I work?"

[0237] The device receives this natural language and analyzes the user's intent using natural language processing. The analyzed information includes time constraints, the next destination, and the required environmental characteristics.

[0238] Once the analysis is complete, the device sends the analysis results to the server along with the user's current location information. This includes data on past satellite office usage history and personal preferences.

[0239] The server uses a database search mechanism to identify the optimal workspace for the user. Factors such as location, available equipment, and availability are considered during this process.

[0240] Next, the server uses route optimization to calculate the optimal travel route from the user's current location to the recommended work location and the next destination. Real-time traffic information and weather data are incorporated into this to determine the user's optimal route.

[0241] Furthermore, the server uses augmented reality / virtual reality generation methods to generate visual information of the virtual environment and facilities of the selected work location. This data is transmitted to the terminal, allowing the user to view the environment through AR / VR.

[0242] Ultimately, the user reviews the available workspaces provided by the server via their terminal and selects the one they deem best. Once selected, the terminal immediately confirms the workspace reservation using the reservation system.

[0243] As a concrete example, suppose a user is near Tokyo Station, their next destination is Shibuya, and they want to secure 30 minutes of work time during their commute. Using this system, the user can find a quiet workspace called Tokyo Central Work Space, check out the facility using augmented reality (AR), and then complete the reservation. This process allows the user to efficiently utilize their travel time to their destination for work.

[0244] The following describes the processing flow.

[0245] Step 1:

[0246] The user inputs instructions using natural language via the device. If voice input is selected, the device captures voice data through the microphone; if text input is selected, it accepts text directly.

[0247] Step 2:

[0248] The device sends the acquired voice data to a natural language processing engine, which converts it into text data. The text data is then analyzed to identify the user's intent. This analysis includes information such as the length of the downtime, the next destination, and the required environmental conditions.

[0249] Step 3:

[0250] The device sends the analysis results to the server along with the user's location information. It also provides the server with data on the user's past usage history and preferences.

[0251] Step 4:

[0252] The server uses the received data to perform a database search. It narrows down the search to find the optimal work location that matches the user's criteria based on location, facilities, and availability.

[0253] Step 5:

[0254] The server activates a route optimization engine and, based on real-time traffic and weather data, calculates the optimal route from the user's current location to the selected work location and the next destination.

[0255] Step 6:

[0256] The server uses an augmented reality / virtual reality generation module to generate visual information about the environment and facilities of each candidate work location. This generated information is then sent to the terminal.

[0257] Step 7:

[0258] The terminal displays potential work locations received from the server, along with their visual information, to the user. The user can use AR / VR functionality to virtually check the environment and facilities of each candidate location.

[0259] Step 8:

[0260] The user selects a workspace from the presented options and confirms the selected workspace on their device.

[0261] Step 9:

[0262] The terminal executes the reservation process based on the user's selection. It sends the reservation information for the selected work location to the server and confirms the reservation status.

[0263] Step 10:

[0264] The server updates the database based on the received reservation information. A reservation confirmation notification is sent to the terminal, allowing the user to check the reservation result.

[0265] (Example 1)

[0266] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0267] There is a need for users to quickly and appropriately find workspaces to efficiently utilize downtime while traveling for work. However, existing systems have the problem of not being able to make suggestions that adequately consider the preferences and current circumstances of individual users. Therefore, the challenge is to achieve more accurate workspace selection and appropriate information provision.

[0268] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0269] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent; information retrieval means for selecting an appropriate work location based on the user's current location information, taking into account past usage records and personal preferences; and route optimization means for calculating the optimal travel route based on real-time traffic conditions and weather data. This enables the user to efficiently identify a work location while traveling and secure an optimal environment for performing tasks in a short amount of time.

[0270] "Information processing means" refers to a device or system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0271] "Information retrieval means" refers to a device or system that has the function of selecting an appropriate work location based on the user's current location information, past usage records, and personal preferences.

[0272] A "route optimization means" is a device or system that has the function of calculating the optimal travel route for a user, taking into account real-time traffic conditions and weather data.

[0273] "Visual environment generation means" refers to a device or system equipped with the function of visually presenting information about the virtual environment and available equipment of a proposed work site.

[0274] A "reservation method" refers to a device or system that has the function of making reservations necessary to confirm the use of a selected work area.

[0275] "Information transmission means" refers to a device or system that has the function of transmitting analyzed information and other related data to a server.

[0276] This invention is a system that suggests the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a server, a terminal, and a user.

[0277] The user provides instructions using natural language via voice or text on the device. For example, they might send an instruction like, "I have a 30-minute gap before my next appointment, where can I work?" Upon receiving this instruction, the device uses natural language processing capabilities and, with the help of a generative AI model, analyzes it to understand the user's intent. At this stage, information such as time constraints, the next destination, and the characteristics of the required environment are extracted.

[0278] Next, the terminal sends the analyzed information and the user's current location to the server. The server uses an information retrieval tool to search the database and selects the optimal work location, taking into account past usage history and personal preferences. Furthermore, the server uses a route optimization tool to calculate the optimal travel route from the user's current location to the recommended work location and the next destination, based on traffic conditions and weather data.

[0279] Furthermore, the server uses a visual environment generation mechanism to create a virtual environment for the selected workspace and generate data for visual presentation. This data is sent to the terminal, allowing the user to view the workspace through AR / VR technology.

[0280] Based on the information provided via the terminal, the user selects the most suitable workspace and makes a reservation for it. The terminal then confirms the use of the selected workspace using the reservation method, allowing the user to immediately access the workspace.

[0281] As a concrete example, if a user is in the city center and has a 30-minute gap before their next destination, this system can be used to find a quiet workspace. By using a prompt message such as "I have a 30-minute gap between the city center and my next destination. Please suggest a suitable workspace," a suitable work environment can be quickly secured.

[0282] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0283] Step 1:

[0284] The user uses the terminal to input natural language instructions regarding the workplace in voice or text form. As an input example, a sentence such as "There is a 30-minute gap until the next destination, but where can I work?" is provided. The terminal starts from receiving the instruction and, in the case of voice input, converting it into text data using voice recognition means.

[0285] Step 2:

[0286] The terminal utilizes the generated AI model and natural language processing function based on the converted text data to analyze the user's instruction and identify the intention. In this analysis process, context understanding is performed, and details such as time constraints, the next location to visit, and required environmental characteristics are extracted. The analysis result is taken as the output.

[0287] Step 3:

[0288] The terminal packages the analysis result and the user's current location information and sends it to the server. The input includes the analyzed intention and location information, which is sent to the server as a data packet.

[0289] Step 4:

[0290] The server searches the database using information retrieval means based on the received data. The input includes the user's current location, past usage history, and personal preferences. Through database search, considering location, environment, available facilities, and vacancy status, the optimal workplace is selected. The selected workplace is the output.

[0291] Step 5:

[0292] The server calculates the optimal movement route from the user's current location using route optimization means based on the selected workplace. The input includes traffic information, weather data, and the workplace, and the optimal route is output. This output aims to enable the user to move smoothly to the workplace.

[0293] Step 6:

[0294] The server generates virtual environment data for the selected workspace using a visual environment generation mechanism. This includes information on available equipment. Visual information and environmental analysis data are output and presented to the user.

[0295] Step 7:

[0296] The terminal presents the user with candidate workspaces, optimal routes, and virtual environment data received from the server. The user reviews the provided information and selects the most suitable workspace.

[0297] Step 8:

[0298] After the user makes a selection, the terminal uses the reservation method to reserve the selected workspace and confirm the reservation. A reservation confirmation is printed and presented to the user, making it ready to begin work immediately.

[0299] (Application Example 1)

[0300] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0301] In modern urban life, efficiently utilizing downtime while on the go is crucial. However, the process of finding, booking, and actually using a suitable workspace while traveling is time-consuming and requires considerable effort. Therefore, there is a need for a system that allows users to flexibly secure workspaces and perform their work efficiently even while on the move. In particular, there is a need for technology that supports user decision-making by utilizing real-time information and employing visualization techniques.

[0302] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0303] In this invention, the server includes natural language processing means for analyzing an instruction in natural language from a user and identifying the intention, database search means for selecting an appropriate working space considering past usage records and personal preferences based on the current location information of the viewer, route optimization means for calculating an optimal movement route based on real-time movement conditions and weather data, extended reality / virtual reality generation means for visually presenting the virtual environment of the recommended working space and the available device information, and visualization means for allowing the user to consider and confirm the recommended working space in extended reality. As a result, even while moving, the user can quickly find, visually confirm, and reserve an optimal working place, thus efficiently utilizing the idle time.

[0304] The "natural language processing means" is a technology for analyzing a natural language instruction input by a user through voice or text and identifying its intention.

[0305] The "database search means" is a technology for selecting an optimal working space for the user based on information such as the current location information of the viewer, past usage records, and personal preferences.

[0306] The "route optimization means" is a technology for calculating an optimal movement route for the user by utilizing real-time movement conditions and weather data.

[0307] The "extended reality / virtual reality generation means" is a technology for visually presenting to the user the virtual environment of the recommended working space and the available device information.

[0308] The "visualization means" is a technology for enabling the user to consider the recommended working space using extended reality.

[0309] The "reservation means" is a technology for finalizing the use of the selected working space and completing the reservation.

[0310] This invention proposes a system that provides a workspace for users to perform tasks efficiently while on the go. In this system, three main entities—a server, a terminal, and the user—work together collaboratively.

[0311] First, users can give instructions to the device using natural language. These instructions are entered via voice or text to clarify the user's intent and are parsed by the device's natural language processing capabilities. The parsed information includes time constraints, the next destination, and the required environmental characteristics.

[0312] Next, the terminal sends the analysis results along with the user's current location information to the server. The server uses this information to select the optimal workspace, taking into account past usage records in the database and the user's personal preferences. In making the selection, it evaluates multiple factors, such as available equipment and vacancy status, based on the viewer's current location information.

[0313] Using route optimization techniques, the server calculates the optimal travel route to the user's recommended workspace and next destination. This calculation utilizes real-time traffic and weather data.

[0314] Furthermore, the server visualizes the environment and equipment information of the recommended workspace using augmented reality / virtual reality generation means and transfers it to the terminal. The user can review the workspace through this visual information and, based on the results, confirm the use of the workspace using the reservation means.

[0315] For executing computer programs, the terminal uses NLTK as its natural language processing library and the Google Speech-to-Text API for speech recognition. On the server side, SQL is used for database operations, and the Google Maps API can be integrated for route optimization. Platforms such as ARKit or ARCore are used for augmented reality display. After the final workspace selection, reservations are made in conjunction with the service via a REST API.

[0316] For example, if a user is near a train station in a city and enters the prompt, "I have 30 minutes to spare before my next appointment, where can I work?", the system will search for recommended workspaces and visualize them to the user using augmented reality. Based on this information, the user can select and reserve a workspace.

[0317] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0318] Step 1:

[0319] The user inputs instructions into the device via voice or text, requesting suggestions for a workspace during a short break. For example, the prompt might say, "I have a 30-minute gap before my next appointment, where can I work?" The device receives this input, analyzes the instructions using natural language processing, and outputs it as a data structure that identifies the time constraints, the next appointment location, and the characteristics of the required environment.

[0320] Step 2:

[0321] The device obtains the user's current location using GPS and sends it to the server along with data obtained through natural language processing. Here, the input is location information and user instructions, and the output is request data containing these.

[0322] Step 3:

[0323] The server uses database search capabilities to select the most suitable workspace for the user based on the request data. In this process, it searches and analyzes past usage records, personal preferences, and availability using database queries, and outputs a list of candidates.

[0324] Step 4:

[0325] After obtaining a list of candidate workspaces, the server uses a route optimization method. Taking the current location and the next destination as input, it calculates the optimal route using real-time traffic information and weather data, and outputs the most efficient travel route to the user.

[0326] Step 5:

[0327] The server converts the selected workspace into visual data as a virtual environment through augmented reality / virtual reality generation means. This is then transmitted to the terminal, providing the user with AR-based visual information. The output of this step is the visualized workspace information.

[0328] Step 6:

[0329] The user reviews the visual information of the workspace provided via the terminal and selects the optimal workspace based on that information. The selection result is sent to the server via the terminal.

[0330] Step 7:

[0331] The server confirms the selected workspace and makes a reservation using the reservation mechanism. It sends a request to the reservation server via the API and returns a success or failure of the reservation. The final output is information about the workspace for which the reservation has been confirmed.

[0332] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0333] This invention is a system in which an AI agent suggests the optimal workspace so that users can effectively utilize their downtime while traveling for work. In particular, it has the function of recognizing the user's emotions and optimizing accordingly. The system mainly consists of three entities: a terminal, a server, and a user.

[0334] Firstly, the user issues instructions in natural language via the device. When using voice input, the device captures voice data from the microphone and converts it into text using speech recognition. The user's instructions are analyzed for intent by natural language processing and converted into specific requests—for example, "I have 30 minutes free before my next visit, where can I work?"

[0335] Next, the device sends data about the user's current location, past usage history, and preferences, as well as emotional information analyzed by an emotion engine from voice and facial expressions, to the server. Based on this information, the server uses a database search mechanism to find the most suitable workspace. In this search, the entire emotional state is incorporated into the selection process, and the environment can be adjusted according to the user's emotions.

[0336] The server calculates the optimal travel route to the recommended work location by optimizing the route using real-time traffic and weather data. Next, augmented reality / virtual reality generation means generate data to visually provide the user with details of the environment and facilities of the selected work location. This information is transmitted to the terminal, and the user can virtually view it using AR / VR technology.

[0337] For example, if a user is near a train station and the server determines that the user's analyzed emotions indicate a need for relaxation, it will prioritize recommending a quiet, cafe-style workspace. If the user is experiencing stress, the server will suggest a calm, Japanese-style satellite office, customizing the overall work environment in real time for the user.

[0338] Ultimately, the user selects the most suitable workspace from the presented options and makes a reservation via their device. The reservation confirmation is sent from the device to the server, updating the database and allowing the user to efficiently utilize their time and concentrate on their work in the optimal environment.

[0339] The following describes the processing flow.

[0340] Step 1:

[0341] Users input natural language instructions via voice or text through their device, for example, "I have 30 minutes until my next appointment, where can I work?"

[0342] Step 2:

[0343] When voice input is selected, the device converts the speech into text data using speech recognition technology. The resulting text is then analyzed by a natural language processing engine to determine the user's intent.

[0344] Step 3:

[0345] The device sends the analysis results to the server, which include data such as the user's location, past usage history, preferences, and emotional information. This emotional information is analyzed by an emotion engine based on voice tone and facial expression characteristics.

[0346] Step 4:

[0347] The server searches the database based on the received data and selects suitable workspace candidates. This selection process reflects the user's emotions; for example, if the user is seeking relaxation, a quiet location will be prioritized.

[0348] Step 5:

[0349] The server acquires real-time traffic and weather data and performs route optimization to calculate the optimal travel route to the selected work location.

[0350] Step 6:

[0351] The server utilizes an augmented reality / virtual reality generation module to generate a virtual environment and information on available facilities for the selected work location, and then transmits this information to the terminal.

[0352] Step 7:

[0353] The terminal displays a list of potential work locations received from the server, along with their detailed information, to the user. The user can virtually check the atmosphere and facilities of the work locations using AR / VR technology.

[0354] Step 8:

[0355] The user selects the workspace they feel is best from the presented options and confirms their selection on their device.

[0356] Step 9:

[0357] The terminal uses the user's selection information to immediately process reservations, sending the reservation information to the server to confirm the reservation of the workspace.

[0358] Step 10:

[0359] The server updates the database based on the received reservation information and sends notifications, including reservation confirmations, to the user via their terminal. This allows users to efficiently utilize their free time and work in a customized work environment.

[0360] (Example 2)

[0361] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0362] In recent years, there has been a growing demand for more efficient and comfortable use of downtime while traveling. However, current technology struggles to suggest optimal workspaces that take into account people's emotions and personal preferences, resulting in users being unable to work efficiently while reducing stress. Furthermore, the optimization of travel routes using real-time traffic and weather information is still insufficient.

[0363] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0364] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent, information retrieval means for selecting an appropriate location based on the user's location information, usage history, individual preferences, and emotions, and route calculation means for calculating the optimal travel route based on traffic and weather information. This makes it possible to provide a comfortable and efficient work environment that meets the user's needs.

[0365] An "information processing means" is a component of a system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0366] "Information retrieval means" refers to a system component that has the function of selecting an appropriate workspace based on the user's location information, usage history, individual preferences, and emotions.

[0367] A "route calculation means" is a component of a system that has the function of calculating the optimal travel route based on traffic conditions and climate data.

[0368] A "virtual display means" is a system component that has the function of visually presenting information about the proposed environment to the user.

[0369] "Arrangement means" refers to a system component that has the function of confirming the use of the selected work location.

[0370] This invention provides a system that allows users to effectively utilize spare time even while on the go. Specifically, it centers around three components: a terminal, a server, and the user.

[0371] The user first uses a device to input instructions in natural language via voice. The device collects this voice data and converts it into text using speech recognition software (e.g., a speech recognition API). Based on this text data, the device uses a natural language processing engine (e.g., a natural language processing API) to analyze the user's intent.

[0372] Based on the analyzed intent, the device sends the user's location information, past usage history, individual preferences, and emotional information analyzed using an emotion engine (e.g., an emotion analysis API) to the server. For example, the user might enter a prompt such as, "I have 30 minutes free before my next visit, tell me about a nearby cafe."

[0373] Based on the received information, the server uses information retrieval tools to select a suitable location from the database. For the selected location, the server uses traffic and weather information (e.g., map API and weather API) and route calculation tools to optimize the travel route. Subsequently, the server uses virtual display tools to visually provide the user with information about the proposed location using augmented reality and virtual reality technologies.

[0374] Finally, the user selects their preferred location from the options provided via their terminal and confirms the reservation using the booking system. This entire process allows the user to efficiently perform their work in the most suitable environment.

[0375] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0376] Step 1:

[0377] The user uses the device to input natural language instructions via voice. For example, the user might say, "I have 30 minutes free before my next appointment; tell me about a nearby cafe." Voice data is captured as input. Based on this, the device collects this voice data through its microphone device.

[0378] Step 2:

[0379] The device converts the collected audio data into text data using speech recognition software. Specifically, it uses a speech recognition API. The input is the audio data from step 1, the process involves speech analysis, and the output is text information. For example, the user's voice becomes the text "Tell me about nearby cafes."

[0380] Step 3:

[0381] The device uses a natural language processing engine to analyze the user's intent from the converted text data. Using a natural language processing API, it receives textual information as input, analyzes it, and identifies the user's request. The output is the analyzed intent, for example, "search for nearby cafes."

[0382] Step 4:

[0383] The device analyzes emotional information using the user's location, usage history, preferences, and emotion engine, and sends this information to the server. Specifically, it utilizes location APIs and emotion analysis APIs to aggregate input data. As output of the emotion analysis, for example, an emotional result such as "I want to relax" is sent to the server.

[0384] Step 5:

[0385] The server uses the received data to search for a location suitable for the usage conditions using information retrieval methods. It executes database queries using database search technology. The input is the data sent in step 4, and the output suggests the most suitable location, for example, "a quiet cafe."

[0386] Step 6:

[0387] The server uses traffic and weather information to optimize travel routes to selected locations using route calculation tools. It utilizes map APIs and weather APIs to process real-time data. The input is the traffic and weather data to be used, and the output is the optimal travel route.

[0388] Step 7:

[0389] The server uses virtual display means to generate augmented reality and virtual reality information about candidate locations and provides it to the terminal. Specifically, it visualizes the configured environment using AR / VR technology. The output is visual data that the user can use, such as a "3D view of the inside of a cafe."

[0390] Step 8:

[0391] Based on the information provided, the user selects their desired location and confirms the reservation on their terminal. The reservation information for the selected location is then sent to the server using the appropriate means. Specifically, the input is the user's selection, the output is a reservation confirmation notification, and the system's database is updated.

[0392] (Application Example 2)

[0393] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0394] The challenge lies in providing users with an environment that allows them to work efficiently and comfortably while traveling or at home. In particular, selecting and controlling an appropriate work environment according to the user's emotional state has been difficult with conventional technologies. The goal is to solve this problem and provide an environment in which users can concentrate on their work without stress.

[0395] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0396] In this invention, the server includes an information processing device that analyzes natural language instructions from the user and identifies their intent, an information storage device for selecting an appropriate work location based on the user's current location information, and a virtual environment generation device that visually presents a virtual environment of a recommended work location. This makes it possible to provide users with a comfortable and efficient work environment that responds to their emotional state, even when they are on the go or at home.

[0397] An "information processing device" is a device that analyzes instructions given by a user in natural language and identifies their intent.

[0398] An "information storage device" is a device that selects an appropriate workspace based on the user's current location information, taking into account past usage records and personal preferences.

[0399] A "route optimization device" is a device that calculates the optimal travel route based on real-time travel conditions and weather data.

[0400] A "virtual environment generation device" is a device that visually presents the recommended virtual environment and available equipment information for a work site.

[0401] A "device including a reservation function" is a device that makes the necessary reservations to confirm the use of the selected work location.

[0402] An "environmental control device" is a device that analyzes the emotional state of a user and sets the optimal environment accordingly.

[0403] In the system for implementing this invention, the user first gives instructions in natural language. The terminal acquires the voice and converts the instructions into text using speech recognition software. The textual instructions are analyzed using natural language processing technology to identify the user's intent. Subsequently, the information processing device suggests an appropriate workspace based on the user's current location, past usage history, personal preferences, and emotional state.

[0404] The server analyzes this information using a database and selects the optimal work location. For the selected work location, a route optimization device calculates the optimal travel route based on real-time traffic and weather data. In addition, a virtual environment generation device visually presents the selected work environment to the user using AR / VR technology.

[0405] Furthermore, the environmental control system analyzes the user's emotional state and automatically adjusts settings such as room lighting, temperature, and music. This utilizes technologies like Philips Hue smart lighting and Google Nest's automatic temperature control system. This allows for the rapid provision of a comfortable working environment. A reservation function ensures that selected workspaces are booked, guaranteeing smooth usage.

[0406] For example, if a user gives a command such as "I want to work in a relaxed environment," the system will select and suggest a quiet cafe or peaceful environment to the user. An example of a prompt message would be "Play music when the user recognizes their emotion as relaxed." In this way, the invention can provide an optimal work environment tailored to the user's emotions and preferences.

[0407] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0408] Step 1:

[0409] The device acquires voice data from the user. Voice recognition software converts the voice data into text data. The input is voice data, and the output is text data. This conversion allows the user's instructions to be analyzed in digital format.

[0410] Step 2:

[0411] The device sends text data to a natural language processing engine to identify the intent. The input is text data, and the output is analyzed intent data. Here, the user's request is translated into a specific action.

[0412] Step 3:

[0413] The server integrates the user's current location, past usage history, preferences, and sentiment information, and retrieves the data using an information storage device. It then selects the optimal workspace from the database. Inputs include location information, history data, and sentiment information, while output is a recommended workspace. This process selects the most suitable workspace for the user.

[0414] Step 4:

[0415] The server collects real-time traffic and weather data and uses a route optimization device to calculate the optimal travel route. The input is real-time data, and the output is optimal route information. This allows for the proposal of efficient travel routes.

[0416] Step 5:

[0417] The server uses a virtual environment generator to create a virtual model of the selected workspace and sends it to the terminal. The input is workspace information, and the output is virtual model data. The user can visualize the workspace through AR / VR.

[0418] Step 6:

[0419] The device operates an environmental control system, adjusting settings such as lighting and music based on the user's emotional state. The input is emotional data, and the output is environmental setting information. This automatically creates the optimal environment for the user.

[0420] Step 7:

[0421] The server, which includes a reservation function, confirms the reservation of the selected workspace and notifies the user. The input is the selected workspace information, and the output is the reservation confirmation information. This ensures that the user can reliably use the workspace.

[0422] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0423] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0424] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0425] [Third Embodiment]

[0426] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0427] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0428] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0429] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0430] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0431] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0432] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0433] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0434] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0435] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0436] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0437] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0438] This invention is a system that uses an AI agent to suggest the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a terminal, a server, and the user.

[0439] Firstly, the user provides instructions using natural language via voice or text on their device. These instructions might be something like, "I have a 30-minute gap before my next appointment; where can I work?"

[0440] The device receives this natural language and analyzes the user's intent using natural language processing. The analyzed information includes time constraints, the next destination, and the required environmental characteristics.

[0441] Once the analysis is complete, the device sends the analysis results to the server along with the user's current location information. This includes data on past satellite office usage history and personal preferences.

[0442] The server uses a database search mechanism to identify the optimal workspace for the user. Factors such as location, available equipment, and availability are considered during this process.

[0443] Next, the server uses route optimization to calculate the optimal travel route from the user's current location to the recommended work location and the next destination. Real-time traffic information and weather data are incorporated into this to determine the user's optimal route.

[0444] Furthermore, the server uses augmented reality / virtual reality generation methods to generate visual information of the virtual environment and facilities of the selected work location. This data is transmitted to the terminal, allowing the user to view the environment through AR / VR.

[0445] Ultimately, the user reviews the available workspaces provided by the server via their terminal and selects the one they deem best. Once selected, the terminal immediately confirms the workspace reservation using the reservation system.

[0446] As a concrete example, suppose a user is near Tokyo Station, their next destination is Shibuya, and they want to secure 30 minutes of work time during their commute. Using this system, the user can find a quiet workspace called Tokyo Central Work Space, check out the facility using augmented reality (AR), and then complete the reservation. This process allows the user to efficiently utilize their travel time to their destination for work.

[0447] The following describes the processing flow.

[0448] Step 1:

[0449] The user inputs instructions using natural language via the device. If voice input is selected, the device captures voice data through the microphone; if text input is selected, it accepts text directly.

[0450] Step 2:

[0451] The device sends the acquired voice data to a natural language processing engine, which converts it into text data. The text data is then analyzed to identify the user's intent. This analysis includes information such as the length of the downtime, the next destination, and the required environmental conditions.

[0452] Step 3:

[0453] The device sends the analysis results to the server along with the user's location information. It also provides the server with data on the user's past usage history and preferences.

[0454] Step 4:

[0455] The server uses the received data to perform a database search. It narrows down the search to find the optimal work location that matches the user's criteria based on location, facilities, and availability.

[0456] Step 5:

[0457] The server activates a route optimization engine and, based on real-time traffic and weather data, calculates the optimal route from the user's current location to the selected work location and the next destination.

[0458] Step 6:

[0459] The server uses an augmented reality / virtual reality generation module to generate visual information about the environment and facilities of each candidate work location. This generated information is then sent to the terminal.

[0460] Step 7:

[0461] The terminal displays potential work locations received from the server, along with their visual information, to the user. The user can use AR / VR functionality to virtually check the environment and facilities of each candidate location.

[0462] Step 8:

[0463] The user selects a workspace from the presented options and confirms the selected workspace on their device.

[0464] Step 9:

[0465] The terminal executes the reservation process based on the user's selection. It sends the reservation information for the selected work location to the server and confirms the reservation status.

[0466] Step 10:

[0467] The server updates the database based on the received reservation information. A reservation confirmation notification is sent to the terminal, allowing the user to check the reservation result.

[0468] (Example 1)

[0469] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0470] There is a need for users to quickly and appropriately find workspaces to efficiently utilize downtime while traveling for work. However, existing systems have the problem of not being able to make suggestions that adequately consider the preferences and current circumstances of individual users. Therefore, the challenge is to achieve more accurate workspace selection and appropriate information provision.

[0471] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0472] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent; information retrieval means for selecting an appropriate work location based on the user's current location information, taking into account past usage records and personal preferences; and route optimization means for calculating the optimal travel route based on real-time traffic conditions and weather data. This enables the user to efficiently identify a work location while traveling and secure an optimal environment for performing tasks in a short amount of time.

[0473] "Information processing means" refers to a device or system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0474] "Information retrieval means" refers to a device or system that has the function of selecting an appropriate work location based on the user's current location information, past usage records, and personal preferences.

[0475] A "route optimization means" is a device or system that has the function of calculating the optimal travel route for a user, taking into account real-time traffic conditions and weather data.

[0476] "Visual environment generation means" refers to a device or system equipped with the function of visually presenting information about the virtual environment and available equipment of a proposed work site.

[0477] A "reservation method" refers to a device or system that has the function of making reservations necessary to confirm the use of a selected work area.

[0478] "Information transmission means" refers to a device or system that has the function of transmitting analyzed information and other related data to a server.

[0479] This invention is a system that suggests the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a server, a terminal, and a user.

[0480] The user provides instructions using natural language via voice or text on the device. For example, they might send an instruction like, "I have a 30-minute gap before my next appointment, where can I work?" Upon receiving this instruction, the device uses natural language processing capabilities and, with the help of a generative AI model, analyzes it to understand the user's intent. At this stage, information such as time constraints, the next destination, and the characteristics of the required environment are extracted.

[0481] Next, the terminal sends the analyzed information and the user's current location to the server. The server uses an information retrieval tool to search the database and selects the optimal work location, taking into account past usage history and personal preferences. Furthermore, the server uses a route optimization tool to calculate the optimal travel route from the user's current location to the recommended work location and the next destination, based on traffic conditions and weather data.

[0482] Furthermore, the server uses a visual environment generation mechanism to create a virtual environment for the selected workspace and generate data for visual presentation. This data is sent to the terminal, allowing the user to view the workspace through AR / VR technology.

[0483] Based on the information provided via the terminal, the user selects the most suitable workspace and makes a reservation for it. The terminal then confirms the use of the selected workspace using the reservation method, allowing the user to immediately access the workspace.

[0484] As a concrete example, if a user is in the city center and has a 30-minute gap before their next destination, this system can be used to find a quiet workspace. By using a prompt message such as "I have a 30-minute gap between the city center and my next destination. Please suggest a suitable workspace," a suitable work environment can be quickly secured.

[0485] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0486] Step 1:

[0487] The user uses a terminal to input natural language instructions about the work location in either voice or text format. An example input would be, "I have a 30-minute gap before my next appointment, where can I work?" The terminal receives the instruction and, in the case of voice input, begins by converting it into text data using speech recognition.

[0488] Step 2:

[0489] The device uses a generative AI model and natural language processing capabilities based on the converted text data to analyze user instructions and identify intent. This analysis process involves contextual understanding and extracting details such as time constraints, the next place to visit, and desired environmental characteristics. The analysis results are output.

[0490] Step 3:

[0491] The terminal packages the analysis results and the user's current location information and sends them to the server. The input includes the analyzed intent and location information, which are sent to the server as a data packet.

[0492] Step 4:

[0493] The server searches the database using information retrieval methods based on the received data. Input includes the user's current location, past usage history, and personal preferences. The database search considers location, environment, available facilities, and availability to select the optimal workspace. The selected workspace is then output.

[0494] Step 5:

[0495] The server uses route optimization techniques to calculate the optimal travel route from the user's current location, based on the selected work location. Inputs include traffic information, weather data, and the work location, and the optimal route is output. The purpose of this output is to enable the user to travel to the work location smoothly.

[0496] Step 6:

[0497] The server generates virtual environment data for the selected workspace using a visual environment generation mechanism. This includes information on available equipment. Visual information and environmental analysis data are output and presented to the user.

[0498] Step 7:

[0499] The terminal presents the user with candidate workspaces, optimal routes, and virtual environment data received from the server. The user reviews the provided information and selects the most suitable workspace.

[0500] Step 8:

[0501] After the user makes a selection, the terminal uses the reservation method to reserve the selected workspace and confirm the reservation. A reservation confirmation is printed and presented to the user, making it ready to begin work immediately.

[0502] (Application Example 1)

[0503] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0504] In modern urban life, efficiently utilizing downtime while on the go is crucial. However, the process of finding, booking, and actually using a suitable workspace while traveling is time-consuming and requires considerable effort. Therefore, there is a need for a system that allows users to flexibly secure workspaces and perform their work efficiently even while on the move. In particular, there is a need for technology that supports user decision-making by utilizing real-time information and employing visualization techniques.

[0505] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0506] In this invention, the server includes a natural language processing means for analyzing natural language instructions from the user and identifying their intent; a database search means for selecting an appropriate workspace based on the viewer's current location information, taking into account past usage records and personal preferences; a route optimization means for calculating the optimal travel route based on real-time travel conditions and weather data; an augmented reality / virtual reality generation means for visually presenting the virtual environment and available equipment information of the recommended workspace; and a visualization means for examining and confirming the recommended workspace in augmented reality. This enables the user to quickly find, visually confirm, and reserve the optimal workspace even while on the go, thereby efficiently utilizing their spare time.

[0507] "Natural language processing means" refers to technology that analyzes natural language instructions input by users via voice or text and identifies their intent.

[0508] A "database search method" is a technology that selects the optimal workspace for a user based on information such as the viewer's current location, past usage history, and personal preferences.

[0509] "Route optimization" refers to a technology that uses real-time travel conditions and weather data to calculate the optimal travel route for the user.

[0510] "Augmented reality / virtual reality generation means" refers to a technology that visually presents users with a virtual environment of a recommended workspace and information on available devices.

[0511] "Visualization means" refers to technologies that allow users to explore recommended workspaces using augmented reality.

[0512] A "reservation method" is a technology used to confirm the use of a selected workspace and complete the reservation.

[0513] This invention proposes a system that provides a workspace for users to perform tasks efficiently while on the go. In this system, three main entities—a server, a terminal, and the user—work together collaboratively.

[0514] First, users can give instructions to the device using natural language. These instructions are entered via voice or text to clarify the user's intent and are parsed by the device's natural language processing capabilities. The parsed information includes time constraints, the next destination, and the required environmental characteristics.

[0515] Next, the terminal sends the analysis results along with the user's current location information to the server. The server uses this information to select the optimal workspace, taking into account past usage records in the database and the user's personal preferences. In making the selection, it evaluates multiple factors, such as available equipment and vacancy status, based on the viewer's current location information.

[0516] Using route optimization techniques, the server calculates the optimal travel route to the user's recommended workspace and next destination. This calculation utilizes real-time traffic and weather data.

[0517] Furthermore, the server visualizes the environment and equipment information of the recommended workspace using augmented reality / virtual reality generation means and transfers it to the terminal. The user can review the workspace through this visual information and, based on the results, confirm the use of the workspace using the reservation means.

[0518] For executing computer programs, the terminal uses NLTK as its natural language processing library and the Google Speech-to-Text API for speech recognition. On the server side, SQL is used for database operations, and the Google Maps API can be integrated for route optimization. Platforms such as ARKit or ARCore are used for augmented reality display. After the final workspace selection, reservations are made in conjunction with the service via a REST API.

[0519] For example, if a user is near a train station in a city and enters the prompt, "I have 30 minutes to spare before my next appointment, where can I work?", the system will search for recommended workspaces and visualize them to the user using augmented reality. Based on this information, the user can select and reserve a workspace.

[0520] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0521] Step 1:

[0522] The user inputs instructions into the device via voice or text, requesting suggestions for a workspace during a short break. For example, the prompt might say, "I have a 30-minute gap before my next appointment, where can I work?" The device receives this input, analyzes the instructions using natural language processing, and outputs it as a data structure that identifies the time constraints, the next appointment location, and the characteristics of the required environment.

[0523] Step 2:

[0524] The device obtains the user's current location using GPS and sends it to the server along with data obtained through natural language processing. Here, the input is location information and user instructions, and the output is request data containing these.

[0525] Step 3:

[0526] The server uses database search capabilities to select the most suitable workspace for the user based on the request data. In this process, it searches and analyzes past usage records, personal preferences, and availability using database queries, and outputs a list of candidates.

[0527] Step 4:

[0528] After obtaining a list of candidate workspaces, the server uses a route optimization method. Taking the current location and the next destination as input, it calculates the optimal route using real-time traffic information and weather data, and outputs the most efficient travel route to the user.

[0529] Step 5:

[0530] The server converts the selected workspace into visual data as a virtual environment through augmented reality / virtual reality generation means. This is then transmitted to the terminal, providing the user with AR-based visual information. The output of this step is the visualized workspace information.

[0531] Step 6:

[0532] The user reviews the visual information of the workspace provided via the terminal and selects the optimal workspace based on that information. The selection result is sent to the server via the terminal.

[0533] Step 7:

[0534] The server confirms the selected workspace and makes a reservation using the reservation mechanism. It sends a request to the reservation server via the API and returns a success or failure of the reservation. The final output is information about the workspace for which the reservation has been confirmed.

[0535] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0536] This invention is a system in which an AI agent suggests the optimal workspace so that users can effectively utilize their downtime while traveling for work. In particular, it has the function of recognizing the user's emotions and optimizing accordingly. The system mainly consists of three entities: a terminal, a server, and a user.

[0537] Firstly, the user issues instructions in natural language via the device. When using voice input, the device captures voice data from the microphone and converts it into text using speech recognition. The user's instructions are analyzed for intent by natural language processing and converted into specific requests—for example, "I have 30 minutes free before my next visit, where can I work?"

[0538] Next, the device sends data about the user's current location, past usage history, and preferences, as well as emotional information analyzed by an emotion engine from voice and facial expressions, to the server. Based on this information, the server uses a database search mechanism to find the most suitable workspace. In this search, the entire emotional state is incorporated into the selection process, and the environment can be adjusted according to the user's emotions.

[0539] The server calculates the optimal travel route to the recommended work location by optimizing the route using real-time traffic and weather data. Next, augmented reality / virtual reality generation means generate data to visually provide the user with details of the environment and facilities of the selected work location. This information is transmitted to the terminal, and the user can virtually view it using AR / VR technology.

[0540] For example, if a user is near a train station and the server determines that the user's analyzed emotions indicate a need for relaxation, it will prioritize recommending a quiet, cafe-style workspace. If the user is experiencing stress, the server will suggest a calm, Japanese-style satellite office, customizing the overall work environment in real time for the user.

[0541] Ultimately, the user selects the most suitable workspace from the presented options and makes a reservation via their device. The reservation confirmation is sent from the device to the server, updating the database and allowing the user to efficiently utilize their time and concentrate on their work in the optimal environment.

[0542] The following describes the processing flow.

[0543] Step 1:

[0544] Users input natural language instructions via voice or text through their device, for example, "I have 30 minutes until my next appointment, where can I work?"

[0545] Step 2:

[0546] When voice input is selected, the device converts the speech into text data using speech recognition technology. The resulting text is then analyzed by a natural language processing engine to determine the user's intent.

[0547] Step 3:

[0548] The device sends the analysis results to the server, which include data such as the user's location, past usage history, preferences, and emotional information. This emotional information is analyzed by an emotion engine based on voice tone and facial expression characteristics.

[0549] Step 4:

[0550] The server searches the database based on the received data and selects suitable workspace candidates. This selection process reflects the user's emotions; for example, if the user is seeking relaxation, a quiet location will be prioritized.

[0551] Step 5:

[0552] The server acquires real-time traffic and weather data and performs route optimization to calculate the optimal travel route to the selected work location.

[0553] Step 6:

[0554] The server utilizes an augmented reality / virtual reality generation module to generate a virtual environment and information on available facilities for the selected work location, and then transmits this information to the terminal.

[0555] Step 7:

[0556] The terminal displays a list of potential work locations received from the server, along with their detailed information, to the user. The user can virtually check the atmosphere and facilities of the work locations using AR / VR technology.

[0557] Step 8:

[0558] The user selects the workspace they feel is best from the presented options and confirms their selection on their device.

[0559] Step 9:

[0560] The terminal uses the user's selection information to immediately process reservations, sending the reservation information to the server to confirm the reservation of the workspace.

[0561] Step 10:

[0562] The server updates the database based on the received reservation information and sends notifications, including reservation confirmations, to the user via their terminal. This allows users to efficiently utilize their free time and work in a customized work environment.

[0563] (Example 2)

[0564] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0565] In recent years, there has been a growing demand for more efficient and comfortable use of downtime while traveling. However, current technology struggles to suggest optimal workspaces that take into account people's emotions and personal preferences, resulting in users being unable to work efficiently while reducing stress. Furthermore, the optimization of travel routes using real-time traffic and weather information is still insufficient.

[0566] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0567] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent, information retrieval means for selecting an appropriate location based on the user's location information, usage history, individual preferences, and emotions, and route calculation means for calculating the optimal travel route based on traffic and weather information. This makes it possible to provide a comfortable and efficient work environment that meets the user's needs.

[0568] An "information processing means" is a component of a system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0569] "Information retrieval means" refers to a system component that has the function of selecting an appropriate workspace based on the user's location information, usage history, individual preferences, and emotions.

[0570] A "route calculation means" is a component of a system that has the function of calculating the optimal travel route based on traffic conditions and climate data.

[0571] A "virtual display means" is a system component that has the function of visually presenting information about the proposed environment to the user.

[0572] "Arrangement means" refers to a system component that has the function of confirming the use of the selected work location.

[0573] This invention provides a system that allows users to effectively utilize spare time even while on the go. Specifically, it centers around three components: a terminal, a server, and the user.

[0574] The user first uses a device to input instructions in natural language via voice. The device collects this voice data and converts it into text using speech recognition software (e.g., a speech recognition API). Based on this text data, the device uses a natural language processing engine (e.g., a natural language processing API) to analyze the user's intent.

[0575] Based on the analyzed intent, the device sends the user's location information, past usage history, individual preferences, and emotional information analyzed using an emotion engine (e.g., an emotion analysis API) to the server. For example, the user might enter a prompt such as, "I have 30 minutes free before my next visit, tell me about a nearby cafe."

[0576] Based on the received information, the server uses information retrieval tools to select a suitable location from the database. For the selected location, the server uses traffic and weather information (e.g., map API and weather API) and route calculation tools to optimize the travel route. Subsequently, the server uses virtual display tools to visually provide the user with information about the proposed location using augmented reality and virtual reality technologies.

[0577] Finally, the user selects their preferred location from the options provided via their terminal and confirms the reservation using the booking system. This entire process allows the user to efficiently perform their work in the most suitable environment.

[0578] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0579] Step 1:

[0580] The user uses the device to input natural language instructions via voice. For example, the user might say, "I have 30 minutes free before my next appointment; tell me about a nearby cafe." Voice data is captured as input. Based on this, the device collects this voice data through its microphone device.

[0581] Step 2:

[0582] The device converts the collected audio data into text data using speech recognition software. Specifically, it uses a speech recognition API. The input is the audio data from step 1, the process involves speech analysis, and the output is text information. For example, the user's voice becomes the text "Tell me about nearby cafes."

[0583] Step 3:

[0584] The device uses a natural language processing engine to analyze the user's intent from the converted text data. Using a natural language processing API, it receives textual information as input, analyzes it, and identifies the user's request. The output is the analyzed intent, for example, "search for nearby cafes."

[0585] Step 4:

[0586] The device analyzes emotional information using the user's location, usage history, preferences, and emotion engine, and sends this information to the server. Specifically, it utilizes location APIs and emotion analysis APIs to aggregate input data. As output of the emotion analysis, for example, an emotional result such as "I want to relax" is sent to the server.

[0587] Step 5:

[0588] The server uses the received data to search for a location suitable for the usage conditions using information retrieval methods. It executes database queries using database search technology. The input is the data sent in step 4, and the output suggests the most suitable location, for example, "a quiet cafe."

[0589] Step 6:

[0590] The server uses traffic and weather information to optimize travel routes to selected locations using route calculation tools. It utilizes map APIs and weather APIs to process real-time data. The input is the traffic and weather data to be used, and the output is the optimal travel route.

[0591] Step 7:

[0592] The server uses virtual display means to generate augmented reality and virtual reality information about candidate locations and provides it to the terminal. Specifically, it visualizes the configured environment using AR / VR technology. The output is visual data that the user can use, such as a "3D view of the inside of a cafe."

[0593] Step 8:

[0594] Based on the information provided, the user selects their desired location and confirms the reservation on their terminal. The reservation information for the selected location is then sent to the server using the appropriate means. Specifically, the input is the user's selection, the output is a reservation confirmation notification, and the system's database is updated.

[0595] (Application Example 2)

[0596] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0597] The challenge lies in providing users with an environment that allows them to work efficiently and comfortably while traveling or at home. In particular, selecting and controlling an appropriate work environment according to the user's emotional state has been difficult with conventional technologies. The goal is to solve this problem and provide an environment in which users can concentrate on their work without stress.

[0598] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0599] In this invention, the server includes an information processing device that analyzes natural language instructions from the user and identifies their intent, an information storage device for selecting an appropriate work location based on the user's current location information, and a virtual environment generation device that visually presents a virtual environment of a recommended work location. This makes it possible to provide users with a comfortable and efficient work environment that responds to their emotional state, even when they are on the go or at home.

[0600] An "information processing device" is a device that analyzes instructions given by a user in natural language and identifies their intent.

[0601] An "information storage device" is a device that selects an appropriate workspace based on the user's current location information, taking into account past usage records and personal preferences.

[0602] A "route optimization device" is a device that calculates the optimal travel route based on real-time travel conditions and weather data.

[0603] A "virtual environment generation device" is a device that visually presents the recommended virtual environment and available equipment information for a work site.

[0604] A "device including a reservation function" is a device that makes the necessary reservations to confirm the use of the selected work location.

[0605] An "environmental control device" is a device that analyzes the emotional state of a user and sets the optimal environment accordingly.

[0606] In the system for implementing this invention, the user first gives instructions in natural language. The terminal acquires the voice and converts the instructions into text using speech recognition software. The textual instructions are analyzed using natural language processing technology to identify the user's intent. Subsequently, the information processing device suggests an appropriate workspace based on the user's current location, past usage history, personal preferences, and emotional state.

[0607] The server analyzes this information using a database and selects the optimal work location. For the selected work location, a route optimization device calculates the optimal travel route based on real-time traffic and weather data. In addition, a virtual environment generation device visually presents the selected work environment to the user using AR / VR technology.

[0608] Furthermore, the environmental control system analyzes the user's emotional state and automatically adjusts settings such as room lighting, temperature, and music. This utilizes technologies like Philips Hue smart lighting and Google Nest's automatic temperature control system. This allows for the rapid provision of a comfortable working environment. A reservation function ensures that selected workspaces are booked, guaranteeing smooth usage.

[0609] For example, if a user gives a command such as "I want to work in a relaxed environment," the system will select and suggest a quiet cafe or peaceful environment to the user. An example of a prompt message would be "Play music when the user recognizes their emotion as relaxed." In this way, the invention can provide an optimal work environment tailored to the user's emotions and preferences.

[0610] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0611] Step 1:

[0612] The device acquires voice data from the user. Voice recognition software converts the voice data into text data. The input is voice data, and the output is text data. This conversion allows the user's instructions to be analyzed in digital format.

[0613] Step 2:

[0614] The device sends text data to a natural language processing engine to identify the intent. The input is text data, and the output is analyzed intent data. Here, the user's request is translated into a specific action.

[0615] Step 3:

[0616] The server integrates the user's current location, past usage history, preferences, and sentiment information, and retrieves the data using an information storage device. It then selects the optimal workspace from the database. Inputs include location information, history data, and sentiment information, while output is a recommended workspace. This process selects the most suitable workspace for the user.

[0617] Step 4:

[0618] The server collects real-time traffic and weather data and uses a route optimization device to calculate the optimal travel route. The input is real-time data, and the output is optimal route information. This allows for the proposal of efficient travel routes.

[0619] Step 5:

[0620] The server uses a virtual environment generator to create a virtual model of the selected workspace and sends it to the terminal. The input is workspace information, and the output is virtual model data. The user can visualize the workspace through AR / VR.

[0621] Step 6:

[0622] The device operates an environmental control system, adjusting settings such as lighting and music based on the user's emotional state. The input is emotional data, and the output is environmental setting information. This automatically creates the optimal environment for the user.

[0623] Step 7:

[0624] The server, which includes a reservation function, confirms the reservation of the selected workspace and notifies the user. The input is the selected workspace information, and the output is the reservation confirmation information. This ensures that the user can reliably use the workspace.

[0625] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0626] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0627] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0628] [Fourth Embodiment]

[0629] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0630] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0631] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0632] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0633] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0634] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0635] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0636] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0637] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0638] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0639] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0640] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0641] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0642] This invention is a system that uses an AI agent to suggest the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a terminal, a server, and the user.

[0643] Firstly, the user provides instructions using natural language via voice or text on their device. These instructions might be something like, "I have a 30-minute gap before my next appointment; where can I work?"

[0644] The device receives this natural language and analyzes the user's intent using natural language processing. The analyzed information includes time constraints, the next destination, and the required environmental characteristics.

[0645] Once the analysis is complete, the device sends the analysis results to the server along with the user's current location information. This includes data on past satellite office usage history and personal preferences.

[0646] The server uses a database search mechanism to identify the optimal workspace for the user. Factors such as location, available equipment, and availability are considered during this process.

[0647] Next, the server uses route optimization to calculate the optimal travel route from the user's current location to the recommended work location and the next destination. Real-time traffic information and weather data are incorporated into this to determine the user's optimal route.

[0648] Furthermore, the server uses augmented reality / virtual reality generation methods to generate visual information of the virtual environment and facilities of the selected work location. This data is transmitted to the terminal, allowing the user to view the environment through AR / VR.

[0649] Ultimately, the user reviews the available workspaces provided by the server via their terminal and selects the one they deem best. Once selected, the terminal immediately confirms the workspace reservation using the reservation system.

[0650] As a concrete example, suppose a user is near Tokyo Station, their next destination is Shibuya, and they want to secure 30 minutes of work time during their commute. Using this system, the user can find a quiet workspace called Tokyo Central Work Space, check out the facility using augmented reality (AR), and then complete the reservation. This process allows the user to efficiently utilize their travel time to their destination for work.

[0651] The following describes the processing flow.

[0652] Step 1:

[0653] The user inputs instructions using natural language via the device. If voice input is selected, the device captures voice data through the microphone; if text input is selected, it accepts text directly.

[0654] Step 2:

[0655] The device sends the acquired voice data to a natural language processing engine, which converts it into text data. The text data is then analyzed to identify the user's intent. This analysis includes information such as the length of the downtime, the next destination, and the required environmental conditions.

[0656] Step 3:

[0657] The device sends the analysis results to the server along with the user's location information. It also provides the server with data on the user's past usage history and preferences.

[0658] Step 4:

[0659] The server uses the received data to perform a database search. It narrows down the search to find the optimal work location that matches the user's criteria based on location, facilities, and availability.

[0660] Step 5:

[0661] The server activates a route optimization engine and, based on real-time traffic and weather data, calculates the optimal route from the user's current location to the selected work location and the next destination.

[0662] Step 6:

[0663] The server uses an augmented reality / virtual reality generation module to generate visual information about the environment and facilities of each candidate work location. This generated information is then sent to the terminal.

[0664] Step 7:

[0665] The terminal displays potential work locations received from the server, along with their visual information, to the user. The user can use AR / VR functionality to virtually check the environment and facilities of each candidate location.

[0666] Step 8:

[0667] The user selects a workspace from the presented options and confirms the selected workspace on their device.

[0668] Step 9:

[0669] The terminal executes the reservation process based on the user's selection. It sends the reservation information for the selected work location to the server and confirms the reservation status.

[0670] Step 10:

[0671] The server updates the database based on the received reservation information. A reservation confirmation notification is sent to the terminal, allowing the user to check the reservation result.

[0672] (Example 1)

[0673] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0674] There is a need for users to quickly and appropriately find workspaces to efficiently utilize downtime while traveling for work. However, existing systems have the problem of not being able to make suggestions that adequately consider the preferences and current circumstances of individual users. Therefore, the challenge is to achieve more accurate workspace selection and appropriate information provision.

[0675] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0676] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent; information retrieval means for selecting an appropriate work location based on the user's current location information, taking into account past usage records and personal preferences; and route optimization means for calculating the optimal travel route based on real-time traffic conditions and weather data. This enables the user to efficiently identify a work location while traveling and secure an optimal environment for performing tasks in a short amount of time.

[0677] "Information processing means" refers to a device or system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0678] "Information retrieval means" refers to a device or system that has the function of selecting an appropriate work location based on the user's current location information, past usage records, and personal preferences.

[0679] A "route optimization means" is a device or system that has the function of calculating the optimal travel route for a user, taking into account real-time traffic conditions and weather data.

[0680] "Visual environment generation means" refers to a device or system equipped with the function of visually presenting information about the virtual environment and available equipment of a proposed work site.

[0681] A "reservation method" refers to a device or system that has the function of making reservations necessary to confirm the use of a selected work area.

[0682] "Information transmission means" refers to a device or system that has the function of transmitting analyzed information and other related data to a server.

[0683] This invention is a system that suggests the optimal workspace so that users can efficiently utilize their spare time while traveling for work. The system mainly consists of three components: a server, a terminal, and a user.

[0684] The user provides instructions using natural language via voice or text on the device. For example, they might send an instruction like, "I have a 30-minute gap before my next appointment, where can I work?" Upon receiving this instruction, the device uses natural language processing capabilities and, with the help of a generative AI model, analyzes it to understand the user's intent. At this stage, information such as time constraints, the next destination, and the characteristics of the required environment are extracted.

[0685] Next, the terminal sends the analyzed information and the user's current location to the server. The server uses an information retrieval tool to search the database and selects the optimal work location, taking into account past usage history and personal preferences. Furthermore, the server uses a route optimization tool to calculate the optimal travel route from the user's current location to the recommended work location and the next destination, based on traffic conditions and weather data.

[0686] Furthermore, the server uses a visual environment generation mechanism to create a virtual environment for the selected workspace and generate data for visual presentation. This data is sent to the terminal, allowing the user to view the workspace through AR / VR technology.

[0687] Based on the information provided via the terminal, the user selects the most suitable workspace and makes a reservation for it. The terminal then confirms the use of the selected workspace using the reservation method, allowing the user to immediately access the workspace.

[0688] As a concrete example, if a user is in the city center and has a 30-minute gap before their next destination, this system can be used to find a quiet workspace. By using a prompt message such as "I have a 30-minute gap between the city center and my next destination. Please suggest a suitable workspace," a suitable work environment can be quickly secured.

[0689] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0690] Step 1:

[0691] The user uses a terminal to input natural language instructions about the work location in either voice or text format. An example input would be, "I have a 30-minute gap before my next appointment, where can I work?" The terminal receives the instruction and, in the case of voice input, begins by converting it into text data using speech recognition.

[0692] Step 2:

[0693] The device uses a generative AI model and natural language processing capabilities based on the converted text data to analyze user instructions and identify intent. This analysis process involves contextual understanding and extracting details such as time constraints, the next place to visit, and desired environmental characteristics. The analysis results are output.

[0694] Step 3:

[0695] The terminal packages the analysis results and the user's current location information and sends them to the server. The input includes the analyzed intent and location information, which are sent to the server as a data packet.

[0696] Step 4:

[0697] The server searches the database using information retrieval methods based on the received data. Input includes the user's current location, past usage history, and personal preferences. The database search considers location, environment, available facilities, and availability to select the optimal workspace. The selected workspace is then output.

[0698] Step 5:

[0699] The server uses route optimization techniques to calculate the optimal travel route from the user's current location, based on the selected work location. Inputs include traffic information, weather data, and the work location, and the optimal route is output. The purpose of this output is to enable the user to travel to the work location smoothly.

[0700] Step 6:

[0701] The server generates virtual environment data for the selected workspace using a visual environment generation mechanism. This includes information on available equipment. Visual information and environmental analysis data are output and presented to the user.

[0702] Step 7:

[0703] The terminal presents the user with candidate workspaces, optimal routes, and virtual environment data received from the server. The user reviews the provided information and selects the most suitable workspace.

[0704] Step 8:

[0705] After the user makes a selection, the terminal uses the reservation method to reserve the selected workspace and confirm the reservation. A reservation confirmation is printed and presented to the user, making it ready to begin work immediately.

[0706] (Application Example 1)

[0707] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0708] In modern urban life, efficiently utilizing downtime while on the go is crucial. However, the process of finding, booking, and actually using a suitable workspace while traveling is time-consuming and requires considerable effort. Therefore, there is a need for a system that allows users to flexibly secure workspaces and perform their work efficiently even while on the move. In particular, there is a need for technology that supports user decision-making by utilizing real-time information and employing visualization techniques.

[0709] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0710] In this invention, the server includes a natural language processing means for analyzing natural language instructions from the user and identifying their intent; a database search means for selecting an appropriate workspace based on the viewer's current location information, taking into account past usage records and personal preferences; a route optimization means for calculating the optimal travel route based on real-time travel conditions and weather data; an augmented reality / virtual reality generation means for visually presenting the virtual environment and available equipment information of the recommended workspace; and a visualization means for examining and confirming the recommended workspace in augmented reality. This enables the user to quickly find, visually confirm, and reserve the optimal workspace even while on the go, thereby efficiently utilizing their spare time.

[0711] "Natural language processing means" refers to technology that analyzes natural language instructions input by users via voice or text and identifies their intent.

[0712] A "database search method" is a technology that selects the optimal workspace for a user based on information such as the viewer's current location, past usage history, and personal preferences.

[0713] "Route optimization" refers to a technology that uses real-time travel conditions and weather data to calculate the optimal travel route for the user.

[0714] "Augmented reality / virtual reality generation means" refers to a technology that visually presents users with a virtual environment of a recommended workspace and information on available devices.

[0715] "Visualization means" refers to technologies that allow users to explore recommended workspaces using augmented reality.

[0716] A "reservation method" is a technology used to confirm the use of a selected workspace and complete the reservation.

[0717] This invention proposes a system that provides a workspace for users to perform tasks efficiently while on the go. In this system, three main entities—a server, a terminal, and the user—work together collaboratively.

[0718] First, users can give instructions to the device using natural language. These instructions are entered via voice or text to clarify the user's intent and are parsed by the device's natural language processing capabilities. The parsed information includes time constraints, the next destination, and the required environmental characteristics.

[0719] Next, the terminal sends the analysis results along with the user's current location information to the server. The server uses this information to select the optimal workspace, taking into account past usage records in the database and the user's personal preferences. In making the selection, it evaluates multiple factors, such as available equipment and vacancy status, based on the viewer's current location information.

[0720] Using route optimization techniques, the server calculates the optimal travel route to the user's recommended workspace and next destination. This calculation utilizes real-time traffic and weather data.

[0721] Furthermore, the server visualizes the environment and equipment information of the recommended workspace using augmented reality / virtual reality generation means and transfers it to the terminal. The user can review the workspace through this visual information and, based on the results, confirm the use of the workspace using the reservation means.

[0722] For executing computer programs, the terminal uses NLTK as its natural language processing library and the Google Speech-to-Text API for speech recognition. On the server side, SQL is used for database operations, and the Google Maps API can be integrated for route optimization. Platforms such as ARKit or ARCore are used for augmented reality display. After the final workspace selection, reservations are made in conjunction with the service via a REST API.

[0723] For example, if a user is near a train station in a city and enters the prompt, "I have 30 minutes to spare before my next appointment, where can I work?", the system will search for recommended workspaces and visualize them to the user using augmented reality. Based on this information, the user can select and reserve a workspace.

[0724] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0725] Step 1:

[0726] The user inputs instructions into the device via voice or text, requesting suggestions for a workspace during a short break. For example, the prompt might say, "I have a 30-minute gap before my next appointment, where can I work?" The device receives this input, analyzes the instructions using natural language processing, and outputs it as a data structure that identifies the time constraints, the next appointment location, and the characteristics of the required environment.

[0727] Step 2:

[0728] The device obtains the user's current location using GPS and sends it to the server along with data obtained through natural language processing. Here, the input is location information and user instructions, and the output is request data containing these.

[0729] Step 3:

[0730] The server uses database search capabilities to select the most suitable workspace for the user based on the request data. In this process, it searches and analyzes past usage records, personal preferences, and availability using database queries, and outputs a list of candidates.

[0731] Step 4:

[0732] After obtaining a list of candidate workspaces, the server uses a route optimization method. Taking the current location and the next destination as input, it calculates the optimal route using real-time traffic information and weather data, and outputs the most efficient travel route to the user.

[0733] Step 5:

[0734] The server converts the selected workspace into visual data as a virtual environment through augmented reality / virtual reality generation means. This is then transmitted to the terminal, providing the user with AR-based visual information. The output of this step is the visualized workspace information.

[0735] Step 6:

[0736] The user reviews the visual information of the workspace provided via the terminal and selects the optimal workspace based on that information. The selection result is sent to the server via the terminal.

[0737] Step 7:

[0738] The server confirms the selected workspace and makes a reservation using the reservation mechanism. It sends a request to the reservation server via the API and returns a success or failure of the reservation. The final output is information about the workspace for which the reservation has been confirmed.

[0739] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0740] This invention is a system in which an AI agent suggests the optimal workspace so that users can effectively utilize their downtime while traveling for work. In particular, it has the function of recognizing the user's emotions and optimizing accordingly. The system mainly consists of three entities: a terminal, a server, and a user.

[0741] Firstly, the user issues instructions in natural language via the device. When using voice input, the device captures voice data from the microphone and converts it into text using speech recognition. The user's instructions are analyzed for intent by natural language processing and converted into specific requests—for example, "I have 30 minutes free before my next visit, where can I work?"

[0742] Next, the device sends data about the user's current location, past usage history, and preferences, as well as emotional information analyzed by an emotion engine from voice and facial expressions, to the server. Based on this information, the server uses a database search mechanism to find the most suitable workspace. In this search, the entire emotional state is incorporated into the selection process, and the environment can be adjusted according to the user's emotions.

[0743] The server calculates the optimal travel route to the recommended work location by optimizing the route using real-time traffic and weather data. Next, augmented reality / virtual reality generation means generate data to visually provide the user with details of the environment and facilities of the selected work location. This information is transmitted to the terminal, and the user can virtually view it using AR / VR technology.

[0744] For example, if a user is near a train station and the server determines that the user's analyzed emotions indicate a need for relaxation, it will prioritize recommending a quiet, cafe-style workspace. If the user is experiencing stress, the server will suggest a calm, Japanese-style satellite office, customizing the overall work environment in real time for the user.

[0745] Ultimately, the user selects the most suitable workspace from the presented options and makes a reservation via their device. The reservation confirmation is sent from the device to the server, updating the database and allowing the user to efficiently utilize their time and concentrate on their work in the optimal environment.

[0746] The following describes the processing flow.

[0747] Step 1:

[0748] Users input natural language instructions via voice or text through their device, for example, "I have 30 minutes until my next appointment, where can I work?"

[0749] Step 2:

[0750] When voice input is selected, the device converts the speech into text data using speech recognition technology. The resulting text is then analyzed by a natural language processing engine to determine the user's intent.

[0751] Step 3:

[0752] The device sends the analysis results to the server, which include data such as the user's location, past usage history, preferences, and emotional information. This emotional information is analyzed by an emotion engine based on voice tone and facial expression characteristics.

[0753] Step 4:

[0754] The server searches the database based on the received data and selects suitable workspace candidates. This selection process reflects the user's emotions; for example, if the user is seeking relaxation, a quiet location will be prioritized.

[0755] Step 5:

[0756] The server acquires real-time traffic and weather data and performs route optimization to calculate the optimal travel route to the selected work location.

[0757] Step 6:

[0758] The server utilizes an augmented reality / virtual reality generation module to generate a virtual environment and information on available facilities for the selected work location, and then transmits this information to the terminal.

[0759] Step 7:

[0760] The terminal displays a list of potential work locations received from the server, along with their detailed information, to the user. The user can virtually check the atmosphere and facilities of the work locations using AR / VR technology.

[0761] Step 8:

[0762] The user selects the workspace they feel is best from the presented options and confirms their selection on their device.

[0763] Step 9:

[0764] The terminal uses the user's selection information to immediately process reservations, sending the reservation information to the server to confirm the reservation of the workspace.

[0765] Step 10:

[0766] The server updates the database based on the received reservation information and sends notifications, including reservation confirmations, to the user via their terminal. This allows users to efficiently utilize their free time and work in a customized work environment.

[0767] (Example 2)

[0768] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0769] In recent years, there has been a growing demand for more efficient and comfortable use of downtime while traveling. However, current technology struggles to suggest optimal workspaces that take into account people's emotions and personal preferences, resulting in users being unable to work efficiently while reducing stress. Furthermore, the optimization of travel routes using real-time traffic and weather information is still insufficient.

[0770] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0771] In this invention, the server includes information processing means for analyzing natural language instructions from the user and identifying their intent, information retrieval means for selecting an appropriate location based on the user's location information, usage history, individual preferences, and emotions, and route calculation means for calculating the optimal travel route based on traffic and weather information. This makes it possible to provide a comfortable and efficient work environment that meets the user's needs.

[0772] An "information processing means" is a component of a system that has the function of analyzing instructions given by a user in natural language and identifying their intent.

[0773] "Information retrieval means" refers to a system component that has the function of selecting an appropriate workspace based on the user's location information, usage history, individual preferences, and emotions.

[0774] A "route calculation means" is a component of a system that has the function of calculating the optimal travel route based on traffic conditions and climate data.

[0775] A "virtual display means" is a system component that has the function of visually presenting information about the proposed environment to the user.

[0776] "Arrangement means" refers to a system component that has the function of confirming the use of the selected work location.

[0777] This invention provides a system that allows users to effectively utilize spare time even while on the go. Specifically, it centers around three components: a terminal, a server, and the user.

[0778] The user first uses a device to input instructions in natural language via voice. The device collects this voice data and converts it into text using speech recognition software (e.g., a speech recognition API). Based on this text data, the device uses a natural language processing engine (e.g., a natural language processing API) to analyze the user's intent.

[0779] Based on the analyzed intent, the device sends the user's location information, past usage history, individual preferences, and emotional information analyzed using an emotion engine (e.g., an emotion analysis API) to the server. For example, the user might enter a prompt such as, "I have 30 minutes free before my next visit, tell me about a nearby cafe."

[0780] Based on the received information, the server uses information retrieval tools to select a suitable location from the database. For the selected location, the server uses traffic and weather information (e.g., map API and weather API) and route calculation tools to optimize the travel route. Subsequently, the server uses virtual display tools to visually provide the user with information about the proposed location using augmented reality and virtual reality technologies.

[0781] Finally, the user selects their preferred location from the options provided via their terminal and confirms the reservation using the booking system. This entire process allows the user to efficiently perform their work in the most suitable environment.

[0782] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0783] Step 1:

[0784] The user uses the device to input natural language instructions via voice. For example, the user might say, "I have 30 minutes free before my next appointment; tell me about a nearby cafe." Voice data is captured as input. Based on this, the device collects this voice data through its microphone device.

[0785] Step 2:

[0786] The device converts the collected audio data into text data using speech recognition software. Specifically, it uses a speech recognition API. The input is the audio data from step 1, the process involves speech analysis, and the output is text information. For example, the user's voice becomes the text "Tell me about nearby cafes."

[0787] Step 3:

[0788] The device uses a natural language processing engine to analyze the user's intent from the converted text data. Using a natural language processing API, it receives textual information as input, analyzes it, and identifies the user's request. The output is the analyzed intent, for example, "search for nearby cafes."

[0789] Step 4:

[0790] The device analyzes emotional information using the user's location, usage history, preferences, and emotion engine, and sends this information to the server. Specifically, it utilizes location APIs and emotion analysis APIs to aggregate input data. As output of the emotion analysis, for example, an emotional result such as "I want to relax" is sent to the server.

[0791] Step 5:

[0792] The server uses the received data to search for a location suitable for the usage conditions using information retrieval methods. It executes database queries using database search technology. The input is the data sent in step 4, and the output suggests the most suitable location, for example, "a quiet cafe."

[0793] Step 6:

[0794] The server uses traffic and weather information to optimize travel routes to selected locations using route calculation tools. It utilizes map APIs and weather APIs to process real-time data. The input is the traffic and weather data to be used, and the output is the optimal travel route.

[0795] Step 7:

[0796] The server uses virtual display means to generate augmented reality and virtual reality information about candidate locations and provides it to the terminal. Specifically, it visualizes the configured environment using AR / VR technology. The output is visual data that the user can use, such as a "3D view of the inside of a cafe."

[0797] Step 8:

[0798] Based on the information provided, the user selects their desired location and confirms the reservation on their terminal. The reservation information for the selected location is then sent to the server using the appropriate means. Specifically, the input is the user's selection, the output is a reservation confirmation notification, and the system's database is updated.

[0799] (Application Example 2)

[0800] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0801] The challenge lies in providing users with an environment that allows them to work efficiently and comfortably while traveling or at home. In particular, selecting and controlling an appropriate work environment according to the user's emotional state has been difficult with conventional technologies. The goal is to solve this problem and provide an environment in which users can concentrate on their work without stress.

[0802] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0803] In this invention, the server includes an information processing device that analyzes natural language instructions from the user and identifies their intent, an information storage device for selecting an appropriate work location based on the user's current location information, and a virtual environment generation device that visually presents a virtual environment of a recommended work location. This makes it possible to provide users with a comfortable and efficient work environment that responds to their emotional state, even when they are on the go or at home.

[0804] An "information processing device" is a device that analyzes instructions given by a user in natural language and identifies their intent.

[0805] An "information storage device" is a device that selects an appropriate workspace based on the user's current location information, taking into account past usage records and personal preferences.

[0806] A "route optimization device" is a device that calculates the optimal travel route based on real-time travel conditions and weather data.

[0807] A "virtual environment generation device" is a device that visually presents the recommended virtual environment and available equipment information for a work site.

[0808] A "device including a reservation function" is a device that makes the necessary reservations to confirm the use of the selected work location.

[0809] An "environmental control device" is a device that analyzes the emotional state of a user and sets the optimal environment accordingly.

[0810] In the system for implementing this invention, the user first gives instructions in natural language. The terminal acquires the voice and converts the instructions into text using speech recognition software. The textual instructions are analyzed using natural language processing technology to identify the user's intent. Subsequently, the information processing device suggests an appropriate workspace based on the user's current location, past usage history, personal preferences, and emotional state.

[0811] The server analyzes this information using a database and selects the optimal work location. For the selected work location, a route optimization device calculates the optimal travel route based on real-time traffic and weather data. In addition, a virtual environment generation device visually presents the selected work environment to the user using AR / VR technology.

[0812] Furthermore, the environmental control system analyzes the user's emotional state and automatically adjusts settings such as room lighting, temperature, and music. This utilizes technologies like Philips Hue smart lighting and Google Nest's automatic temperature control system. This allows for the rapid provision of a comfortable working environment. A reservation function ensures that selected workspaces are booked, guaranteeing smooth usage.

[0813] For example, if a user gives a command such as "I want to work in a relaxed environment," the system will select and suggest a quiet cafe or peaceful environment to the user. An example of a prompt message would be "Play music when the user recognizes their emotion as relaxed." In this way, the invention can provide an optimal work environment tailored to the user's emotions and preferences.

[0814] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0815] Step 1:

[0816] The device acquires voice data from the user. Voice recognition software converts the voice data into text data. The input is voice data, and the output is text data. This conversion allows the user's instructions to be analyzed in digital format.

[0817] Step 2:

[0818] The device sends text data to a natural language processing engine to identify the intent. The input is text data, and the output is analyzed intent data. Here, the user's request is translated into a specific action.

[0819] Step 3:

[0820] The server integrates the user's current location, past usage history, preferences, and sentiment information, and retrieves the data using an information storage device. It then selects the optimal workspace from the database. Inputs include location information, history data, and sentiment information, while output is a recommended workspace. This process selects the most suitable workspace for the user.

[0821] Step 4:

[0822] The server collects real-time traffic and weather data and uses a route optimization device to calculate the optimal travel route. The input is real-time data, and the output is optimal route information. This allows for the proposal of efficient travel routes.

[0823] Step 5:

[0824] The server uses a virtual environment generator to create a virtual model of the selected workspace and sends it to the terminal. The input is workspace information, and the output is virtual model data. The user can visualize the workspace through AR / VR.

[0825] Step 6:

[0826] The device operates an environmental control system, adjusting settings such as lighting and music based on the user's emotional state. The input is emotional data, and the output is environmental setting information. This automatically creates the optimal environment for the user.

[0827] Step 7:

[0828] The server, which includes a reservation function, confirms the reservation of the selected workspace and notifies the user. The input is the selected workspace information, and the output is the reservation confirmation information. This ensures that the user can reliably use the workspace.

[0829] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0830] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0831] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0832] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0833] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0834] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0835] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0836] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0837] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0838] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0839] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0840] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0841] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0842] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0843] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0844] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0845] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0846] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0847] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0848] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0849] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0850] The following is further disclosed regarding the embodiments described above.

[0851] (Claim 1)

[0852] A natural language processing means that analyzes natural language instructions from the user and identifies their intent,

[0853] A database search method for selecting an appropriate workspace based on the viewer's current location information, taking into account past usage records and personal preferences,

[0854] A route optimization method that calculates the optimal travel route based on real-time traffic conditions and weather data,

[0855] Augmented reality / virtual reality generation means for visually presenting the virtual environment and available equipment information of recommended work sites,

[0856] A reservation method for confirming the use of the selected work location,

[0857] A system that includes this.

[0858] (Claim 2)

[0859] The system according to claim 1, comprising means for correcting selected work locations by reflecting information acquired in real time.

[0860] (Claim 3)

[0861] The system according to claim 1, comprising speech recognition means for converting voice-input instructions into text data.

[0862] "Example 1"

[0863] (Claim 1)

[0864] An information processing means that analyzes natural language instructions from the user and identifies their intent,

[0865] An information retrieval method for selecting an appropriate work location based on the user's current location information, taking into account past usage records and personal preferences,

[0866] A route optimization method that calculates the optimal travel route based on real-time traffic conditions and weather data,

[0867] A visual environment generation means for visually presenting the virtual environment and available equipment information of the proposed work site,

[0868] A reservation means for confirming the use of the selected work area,

[0869] Information transmission means for sending the analyzed information and other related data to a server,

[0870] A system that includes this.

[0871] (Claim 2)

[0872] The system according to claim 1, comprising means for correcting selected work locations by reflecting information acquired in real time.

[0873] (Claim 3)

[0874] The system according to claim 1, comprising speech recognition means for converting voice-input instructions into text data.

[0875] "Application Example 1"

[0876] (Claim 1)

[0877] A natural language processing means that analyzes natural language instructions from the user and identifies their intent,

[0878] A database search method for selecting an appropriate workspace based on the viewer's current location information, taking into account past usage records and personal preferences,

[0879] A route optimization method that calculates the optimal travel route based on real-time travel conditions and weather data,

[0880] Augmented reality / virtual reality generation means for visually presenting the recommended virtual environment of the workspace and information on available equipment,

[0881] A reservation means for confirming the selected workspace,

[0882] A visualization tool for examining and confirming the recommended workspace using augmented reality,

[0883] A system that includes this.

[0884] (Claim 2)

[0885] The system according to claim 1, comprising means for correcting selected workspaces by reflecting information acquired in real time.

[0886] (Claim 3)

[0887] The system according to claim 1, comprising speech recognition means for converting voice-input instructions into text data.

[0888] "Example 2 of combining an emotion engine"

[0889] (Claim 1)

[0890] An information processing means that analyzes natural language instructions from the user and identifies their intent,

[0891] Information retrieval means for selecting an appropriate location based on the user's location information, usage history, individual preferences, and emotions,

[0892] A route calculation means that calculates the optimal travel route based on traffic and climate information,

[0893] A virtual display means for visually presenting information about the proposed environment,

[0894] Arrangements to confirm the use of the selected location,

[0895] A system that includes this.

[0896] (Claim 2)

[0897] The system according to claim 1, comprising means for reflecting information acquired in real time and adjusting the selected environment.

[0898] (Claim 3)

[0899] The system according to claim 1, comprising a voice conversion means for converting voice-input instructions into text information.

[0900] "Application example 2 when combining with an emotional engine"

[0901] (Claim 1)

[0902] An information processing device that analyzes natural language instructions from a user and identifies their intent,

[0903] An information storage device that selects an appropriate workspace based on the user's current location information, taking into account past usage records and personal preferences,

[0904] A route optimization device that calculates the optimal travel route based on real-time travel conditions and weather data,

[0905] A virtual environment generation device for visually presenting the virtual environment and available equipment information of recommended work sites,

[0906] A device including a reservation function for confirming the use of the selected work location,

[0907] An environmental control device that analyzes the emotional state of the user and sets the optimal environment,

[0908] A system that includes this.

[0909] (Claim 2)

[0910] The system according to claim 1, which includes a function to correct selected work sites by reflecting information acquired in real time.

[0911] (Claim 3)

[0912] The system according to claim 1, comprising a speech recognition device that converts voice-input instructions into text data. [Explanation of Symbols]

[0913] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A natural language processing means that analyzes natural language instructions from the user and identifies their intent, A database search method for selecting an appropriate workspace based on the viewer's current location information, taking into account past usage records and personal preferences, A route optimization method that calculates the optimal travel route based on real-time travel conditions and weather data, Augmented reality / virtual reality generation means for visually presenting the recommended virtual environment of the workspace and information on available equipment, A reservation means for confirming the selected workspace, A visualization tool for examining and confirming the recommended workspace using augmented reality, A system that includes this.

2. The system according to claim 1, comprising means for correcting selected workspaces by reflecting information acquired in real time.

3. The system according to claim 1, further comprising speech recognition means for converting voice-input instructions into text data.

Images