System

Abstract

A system is provided.SOLUTION: A system includes sensor means for acquiring environmental information, AI means for generating an optimum layout on the basis of the acquired environmental information, and moving means for autonomously moving according to the optimum layout.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's diverse spaces, including business meeting spaces, event spaces, cafes, and restaurants, fixed layouts hinder flexible use and result in missed revenue opportunities. In particular, when the number of users and their needs change over time, the inability to properly rearrange the space is often a problem. Furthermore, improper layout can lead to confusion in users' flow, detracting from a comfortable user experience. Technology is needed to solve these issues and improve the efficiency of space utilization. [Means for solving the problem]

[0005] To solve these problems, the present invention provides the following means. The present invention is a system including a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, and a transportation means for autonomously moving according to the optimal layout. The sensor means acquires location information, congestion level, and volume, which the AI ​​means analyzes to calculate the optimal arrangement of tables and chairs. The transportation means then moves the tables and chairs to their designated positions based on the generated optimal layout. The AI ​​means also learns from past usage data and uses it to optimize future layouts. Ultimately, the transportation means monitors user movement in real time and dynamically changes its layout based on that data, maximizing space utilization efficiency and improving the user experience.

[0006] A "sensor" is a device for acquiring information about the surrounding environment.

[0007] "Environmental information" is data related to the state of a space, such as location information, congestion level, and volume.

[0008] "AI" is an abbreviation for artificial intelligence, a system that has the ability to analyze data and generate optimal layouts.

[0009] The "optimal layout" is the arrangement of tables and chairs that best suits the user's movement patterns and needs based on the acquired environmental information.

[0010] The "moving means" is a device that autonomously moves tables and chairs to predetermined positions according to the generated optimal layout.

[0011] "Autonomous" refers to the ability to perform an action automatically without human intervention.

[0012] "Flow lines" are the routes or passages along which users move.

[0013] "Real-time" means that processing and response are carried out immediately in real time.

[0014] "Utilization efficiency" is an indicator of how effectively space and resources are used.

[0015] "User experience" refers to the overall satisfaction and comfort that users feel when using a system or service. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities. The specific operation of the system is described below.

[0038] Collection of environmental information

[0039] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. This information is updated regularly to keep it up to date.

[0040] Layout Optimization

[0041] The server provides the collected sensor information to the AI ​​means, which then calculates the optimal table and chair arrangement based on this data. Specifically, it considers seating arrangements that allow participants in a conference room to communicate smoothly with all other participants, and table arrangements that ensure smooth customer flow in a cafe.

[0042] Autonomous movement

[0043] The device autonomously moves tables and chairs to their designated positions based on the optimal layout provided by the server. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," which the device receives and executes. The tables and chairs automatically move to their designated positions and form a new layout.

[0044] Specific examples

[0045] For example, consider a scenario of a business meeting. Before the meeting begins, the device's sensors acquire the location information of the participants, and the device sends environmental information such as the level of congestion and volume to the server. The server passes this data to an AI means, which calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to the designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[0046] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[0047] This system allows users to maximize space utilization and operate the space more efficiently, while real-time optimization allows for quick response to unpredictable situations, enabling flexible operation.

[0048] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[0049] The processing flow will be explained below.

[0050] Step 1:

[0051] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[0052] Step 2:

[0053] The device sends the collected environmental information to a server, including information on people's current location, congestion level, and sound volume.

[0054] Step 3:

[0055] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means. The server inputs the data into the AI ​​in an appropriate data format to handle the data accurately and efficiently.

[0056] Step 4:

[0057] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the layout to avoid crowding, minimize traffic congestion, and optimally distribute sound levels. For example, in a conference room, it determines the layout so that all participants can communicate smoothly.

[0058] Step 5:

[0059] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[0060] Step 6:

[0061] The terminal starts to move based on the optimal layout information received from the server. Specifically, the terminal's movement means autonomously operates the tables and chairs to move them to the predetermined positions.

[0062] Step 7:

[0063] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[0064] Step 8:

[0065] The device collects sensor information again and provides it to the server. The server then uses this new information to further fine-tune the optimal layout, thereby realizing a system that can respond to dynamic environmental changes.

[0066] Through the above steps, the system of the present invention can obtain environmental information in real time, generate an optimal layout based on that information, and move autonomously, thereby maximizing utilization efficiency.

[0067] Example 1

[0068] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0069] Conventional space optimization systems are unable to respond immediately to environmental changes, making it difficult to make effective layout changes. Furthermore, when manual layout changes are required, the time and effort required hinders efficient space utilization. Furthermore, collecting environmental information that relies on human senses results in subjective judgments, making it difficult to provide an optimal layout immediately. As a result, the efficiency of meetings and work can decline, making it difficult to provide a comfortable space.

[0070] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0071] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a transportation means for autonomously moving according to the optimal layout. This enables rapid response to environmental changes and efficient layout changes. The environmental information acquired by the sensor means includes location information, congestion level, and volume, and the server calculates the optimal layout using a generative AI model based on this information. The terminal periodically updates the environmental information and transmits and receives information to the server using a secure communication protocol, achieving real-time optimization. This maximizes the use of space and makes it possible to quickly provide a comfortable environment.

[0072] "Environmental information" refers to data relating to the surrounding state and conditions, such as location information, congestion level, and volume.

[0073] "Sensor means" refers to a device or apparatus for acquiring environmental information. Examples include an infrared sensor for acquiring position information and a microphone for measuring sound volume.

[0074] "Artificial intelligence means" refers to an artificial intelligence system or algorithm for generating an optimal layout based on acquired environmental information.

[0075] "Moving means" refers to a device or mechanism that physically moves tables and chairs to their designated positions according to the optimal layout.

[0076] "Periodic" means repeated at regular intervals.

[0077] A "server" is a computer system that communicates with terminals via a network and processes and manages data.

[0078] "Terminal" refers to a device or equipment for controlling sensor means or mobile means.

[0079] A "generative AI model" is a part of an artificial intelligence tool and is a machine learning model that analyzes prompts based on environmental information and calculates the optimal layout.

[0080] A "prompt sentence" is a sentence of instructions or commands input to a generative AI model.

[0081] "Location information" is data relating to the coordinates or location of a particular object or person.

[0082] "Crowdness" is data about the number of people and objects in a particular area and their density.

[0083] "Volume" is data relating to the loudness of a sound in a particular environment.

[0084] A "secure communication protocol" is a communication rule for safely sending and receiving data.

[0085] The present invention is a system that includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities.

[0086] Collection of environmental information

[0087] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. These sensors include infrared sensors and microphones. The device activates the sensors, periodically updates the environmental information, and keeps the latest information. This makes it possible to acquire data in real time.

[0088] Sending data

[0089] The device periodically sends the collected environmental information to the server, using a secure communication protocol (e.g., HTTPS) to ensure safe data transmission and reception.

[0090] Layout optimization

[0091] The server provides the received sensor data to the artificial intelligence means. The artificial intelligence means analyzes the data using a generative AI model and calculates the optimal table and chair placement. Specifically, the server inputs the following prompt sentence to the generative AI model:

[0092] Please propose the optimal layout based on the current conference room environment information. The people's positions are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)] The ambient volume is 75dB.

[0093] Based on this, the generative AI model calculates the optimal layout and returns the results to the server.

[0094] Sending layout information

[0095] The server sends the optimal layout information calculated by the generative AI model to the device, including specific instructions such as moving table 1 to coordinates (20, 30).

[0096] Execution of autonomous movement

[0097] The terminals autonomously move tables and chairs to their designated positions based on instructions received from the server. Electric motors are used as the means of movement, allowing for quick and accurate physical movement. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," and the terminal receives and executes this instruction.

[0098] Specific examples

[0099] For example, consider a business meeting scenario. Before the meeting begins, the device's sensors acquire the participants' locations, and the device sends environmental information such as congestion level and volume to a server. The server passes this data to a generative AI model, and the AI ​​method calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to their designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[0100] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[0101] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[0102] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0103] Step 1: The device activates sensors and collects environmental information

[0104] Specific operation: The device activates infrared sensors, microphones, etc., and acquires data such as location information, congestion level, and volume within the conference room.

[0105] Input: Surrounding environment data from sensors

[0106] Data processing: The acquired data is converted into a format that includes the date, time, and sensor position, and then organized.

[0107] Output: Formatted environmental information data

[0108] Step 2: The device sends the collected environmental information to the server.

[0109] Specific operation: The device periodically sends collected data to a server using a secure protocol such as HTTPS.

[0110] Input: Formatted environmental information data

[0111] Data processing: Convert data into a sendable format (e.g., JSON format).

[0112] Output: Environment information data sent to the server

[0113] Step 3: The server analyzes the received sensor data

[0114] Specific operation: The server analyzes the received sensor data and extracts information such as people's location, congestion level, and volume.

[0115] Input: Environmental information data sent from the device

[0116] Data processing: Analyze the data and break it down into elements such as location, congestion level, and volume.

[0117] Output: Analysis results (location information, congestion level, volume, etc.)

[0118] Step 4: The server inputs a prompt to the generative AI model.

[0119] Specific operation: The server generates and inputs a prompt to the AI ​​model based on the analysis results. For example, "Please propose the optimal layout based on the current environmental information of the conference room. The positions of the people are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)]. The ambient volume is 75dB."

[0120] Input: Analysis results

[0121] Data processing: Generate a prompt statement.

[0122] Output: prompt statement

[0123] Step 5: Generative AI model calculates optimal layout

[0124] How it works: The generative AI model calculates the optimal table and chair arrangement based on the prompt.

[0125] Input: prompt statement

[0126] Data calculation: The generative AI model analyzes environmental information such as location, congestion level, and volume, and calculates the optimal layout.

[0127] Output: Optimal layout information

[0128] Step 6: The server sends the optimal layout information to the terminal.

[0129] Specific operation: The server sends the optimal layout information received from the generative AI model to the terminal.

[0130] Input: Optimal layout information

[0131] Data processing: Convert data into a sendable format (e.g., JSON format).

[0132] Output: Layout information sent to the device

[0133] Step 7: The device begins autonomous movement based on the optimal layout

[0134] Specific operation: Based on the layout information received, the terminal uses electric motors to move tables and chairs to the designated positions.

[0135] Input: Optimal layout information

[0136] Data calculation: Calculating physical travel routes and methods.

[0137] Output: Tables and chairs are moved into position

[0138] (Application example 1)

[0139] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0140] Current spatial layout management systems do not integrate environmental information collection, layout optimization, and autonomous movement, making it difficult to optimize layouts in real time. Furthermore, there are few ways to visually confirm optimized layout information, making it difficult for on-site staff to properly understand the layout. This results in situations where it is not possible to quickly respond to sudden congestion or environmental changes.

[0141] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0142] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal, thereby enabling real-time optimization of the spatial layout and providing visual information to on-site staff.

[0143] The "sensor means for acquiring environmental information" is a device for collecting data related to the environment, such as location information, congestion level, and volume.

[0144] The "artificial intelligence means for generating an optimal layout based on acquired environmental information" is an artificial intelligence system for analyzing environmental information acquired from the sensor means and calculating the most efficient spatial arrangement based on that information.

[0145] "A means of transportation that moves autonomously according to an optimal layout" is a device that automatically moves furniture such as tables and chairs based on the generated optimal layout.

[0146] "Means for displaying layout information using an application installed on a terminal" refers to a system for visually displaying optimal layout information to a user through an application installed on a terminal such as a smartphone or smart glasses.

[0147] "Location information" is information that indicates the specific coordinate data of a specific object or person in a space.

[0148] "Crowding level" is data that represents the degree of density of people and objects in a space.

[0149] "Volume" is data that measures the loudness of sound in a space.

[0150] An "artificial intelligence means" is a computer system that can analyze data based on knowledge and experience and propose optimal solutions.

[0151] An "autonomous vehicle" is a robot or device that has the ability to automatically move to a specified location.

[0152] "Layout information" is information that instructs the placement of objects in a space.

[0153] A specific system for implementing this invention comprises a sensor means for collecting environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a moving means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal.

[0154] System Configuration

[0155] Hardware Configuration

[0156] 1. Sensor means:

[0157] To obtain environmental information, various sensors (infrared cameras, microphones, distance sensors, etc.) are used to measure location, occupancy, and volume.

[0158] These sensors periodically collect environmental data and send it to a server.

[0159] 2. Transportation:

[0160] Robotic arms and autonomous mobile furniture are used to automatically move furniture such as tables and chairs.

[0161] The mobile means can be moved to a precise position using a control system such as the Robot Operating System (ROS).

[0162] 3. Terminal:

[0163] Portable devices such as smartphones and smart glasses have dedicated applications installed on them, allowing users to visually check optimal layout information.

[0164] Software Configuration

[0165] 1. Artificial Intelligence Means:

[0166] The artificial intelligence model uses a neural network model that analyzes environmental information using TENSORFLOW (registered trademark) and PyTorch and generates the optimal layout.

[0167] The artificial intelligence receives regularly updated sensor information and suggests optimal layouts in real time.

[0168] 2. Application Method:

[0169] The application installed on the device displays layout information that is optimal for the user.

[0170] The application is implemented using a mobile development framework such as Java or Swift.

[0171] Processing flow

[0172] 1. Environmental information collection:

[0173] The server periodically acquires environmental data such as location information, congestion level, and volume through sensor means.

[0174] 2. Layout optimization:

[0175] The acquired environmental information is transmitted to a server and analyzed by artificial intelligence means.

[0176] Artificial intelligence calculates the optimal table and chair placement based on the collected data.

[0177] 3. Autonomous Movement:

[0178] The moving means autonomously starts moving based on the optimal layout information provided by the server.

[0179] Each table and chair moves to a designated position to form the new layout.

[0180] 4. Display information:

[0181] The application installed on the terminal visually displays the layout information received from the server to the user.

[0182] Users can check the layout status through the application and manually make corrections if necessary.

[0183] Specific examples

[0184] For example, consider a scenario of a business meeting. Before the meeting begins, sensors acquire the location information of participants and send environmental information such as congestion level and volume to a server. The server passes this data to an artificial intelligence means, which calculates the optimal layout. The transportation means then receives instructions from the server and autonomously moves tables and chairs to their designated positions. An application on the device allows the meeting to proceed in a comfortable environment for all participants.

[0185] An example of a prompt might be:

[0186] "Generate the optimal seating arrangement for meeting participants so that they can communicate smoothly with all other participants. Participant location information: [20, 30, 40, 50]"

[0187] Also, in the case of application in a cafe,

[0188] "Improve table placement to ensure smooth customer flow within the cafe. Current location: [20, 10, 30, 25, 15]"

[0189] In this way, the system can optimize the spatial layout and provide visual information in real time.

[0190] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0191] Step 1:

[0192] The sensor means acquires environmental information. The input is location information, occupancy level, and volume within the environment, and the output is these data. Specifically, each sensor (infrared camera, microphone, distance sensor, etc.) collects data at predetermined intervals and sends it to the server. The sensors periodically update the data in real time at their locations.

[0193] Step 2:

[0194] The server receives environmental information acquired from the sensor means and provides it to the artificial intelligence means. The input is location information, congestion level, and volume data acquired from the sensor means, and the output is environmental data provided to the artificial intelligence means. Specifically, the server converts the data into a standard format and passes it to the artificial intelligence means.

[0195] Step 3:

[0196] The artificial intelligence means generates an optimal layout based on environmental information. The input is environmental data from the sensor means, and the output is optimal layout placement information. Specifically, the artificial intelligence means uses a generative AI model to analyze the data and calculate the optimal placement of tables and chairs. This calculation is performed using frameworks such as TensorFlow and PyTorch.

[0197] Step 4:

[0198] The server receives the optimal layout information generated by the artificial intelligence means and provides it to the moving means. The input is the layout arrangement information from the artificial intelligence means, and the output is specific movement instructions provided to the moving means. Specifically, the server converts the generated layout information into specific movement instructions for each piece of furniture and transmits them to the moving means.

[0199] Step 5:

[0200] The mobile device autonomously moves the furniture according to the optimal layout. The input is the movement instructions provided by the server, and the output is the physical environment with the new layout configured. Specifically, the robot arm or autonomous mobile furniture moves accurately to the specified position.

[0201] Step 6:

[0202] An application installed on the device displays optimal layout information to the user. The input is optimal layout information provided by the server, and the output is visual information displayed on the device's display. Specifically, the application is developed in Java or Swift, and the user can check the optimal layout in real time and make corrections as necessary.

[0203] Step 7:

[0204] The user operates the device to check the layout content and manually correct it if necessary. The input is the layout information displayed on the device and the user's operations, and the output is the final layout information. Specifically, the user performs operations such as tapping and swiping through the application to fine-tune the layout.

[0205] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0206] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, a vehicle that moves autonomously according to the optimal layout, and an emotion engine that recognizes the user's emotions. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities. Specific operations and overall system processing are described below.

[0207] Collection of environmental information

[0208] The terminal is equipped with a sensor for acquiring information about the surrounding environment. The sensor acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the terminal's sensor acquires the movements and positions of people in a conference room, the degree of crowding, and the sound levels in the room through the sensor means, and collects this as data.

[0209] Layout Optimization

[0210] The server receives the environmental information sent from the devices and uses AI to generate the optimal layout. Specifically, the AI ​​calculates the placement of tables and chairs to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[0211] Autonomous movement

[0212] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and chairs to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and chairs automatically move to the specified positions, and a new layout is formed.

[0213] Emotion engine integration

[0214] The system incorporates an emotion engine to recognize the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions, voice, and movements. Integrating this with data acquired by sensors, the emotion engine analyzes the user's current emotional state. For example, if the user is feeling dissatisfied, the emotion engine provides that information as feedback to the AI ​​means to readjust the optimal layout.

[0215] Specific examples

[0216] For example, consider a business meeting scenario. As participants enter the conference room, sensors on their devices collect location and environmental information such as volume, and send it to a server. The server uses AI tools to calculate the optimal seating arrangement that allows all participants to see and hear easily. The devices then automatically move tables and chairs based on this arrangement.

[0217] During the meeting, the sensor sends the user's facial expressions and voice to the emotion engine, which recognizes that the user is feeling stressed. The emotion engine then provides this information to the AI, which then adjusts the layout again to make the user feel comfortable, for example by lowering the volume or providing more space for the seats.

[0218] In this way, by integrating an emotion engine, the present invention realizes space creation that takes into consideration not only the optimization of the physical environment but also emotional comfort, thereby maximizing user satisfaction and utilization efficiency.

[0219] Through the above steps, the system of the present invention can obtain environmental information in real time, recognize the user's emotions using an emotion engine, generate an optimal layout based on that, and move autonomously, thereby maximizing utilization efficiency and user experience.

[0220] The processing flow will be explained below.

[0221] Step 1:

[0222] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[0223] Step 2:

[0224] The device sends the collected environmental information to a server, including information such as the current location of people, the level of congestion, and the volume of sound.

[0225] Step 3:

[0226] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means, which then inputs the data into the AI ​​means in an appropriate format.

[0227] Step 4:

[0228] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the placement of tables and chairs, taking into account people's flow, avoiding congestion, and optimally distributing sound levels. For example, it determines the seating arrangement that allows everyone in the conference room to communicate smoothly.

[0229] Step 5:

[0230] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[0231] Step 6:

[0232] The terminal automatically moves the tables and chairs to their designated positions using the movement means based on the optimal layout. Specifically, it executes the instruction "move table 1 to coordinates (20, 30)."

[0233] Step 7:

[0234] The device collects sensor information again to check whether the new layout is appropriate. If there are any changes in the environment information, it sends it to the server again.

[0235] Step 8:

[0236] The server then analyzes the received environmental information and adjusts the layout again using AI as necessary, thereby realizing a system that can respond to dynamic environmental changes.

[0237] Step 9:

[0238] The emotion engine is initialized by the device and recognizes the user's emotions by analyzing their facial expressions, voice, and movements. This information is sent to the emotion engine through sensors.

[0239] Step 10:

[0240] The device transmits the recognized user emotion data to the server. For example, if the user is feeling unhappy, the information is conveyed to the server.

[0241] Step 11:

[0242] The server's AI means analyzes the emotional data provided by the emotion engine and readjusts the layout based on that data, for example by providing more spacious seating to allow users to relax.

[0243] Step 12:

[0244] The terminal receives the new optimum layout instruction from the server and moves the tables and chairs to their predetermined positions again.

[0245] Step 13:

[0246] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[0247] In this way, the system of the present invention can maximize utilization efficiency and user experience by acquiring environmental information and user emotional information in real time, generating an optimal layout based on that information, and moving autonomously.

[0248] Example 2

[0249] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0250] In conventional conference rooms and event spaces, it was difficult to obtain environmental information in real time and change the layout to reflect user emotions, making it impossible to maximize user satisfaction and utilization efficiency. Also, when physical layout changes were made manually, it was labor-intensive and time-consuming.

[0251] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a detection means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously operating according to the optimal layout, and an emotion analysis means for analyzing the user's emotions. This makes it possible to acquire environmental information in real time and generate and execute an optimal layout that reflects the user's emotions.

[0252] "Environmental information" refers to data about the surrounding physical conditions and situations, such as location information, crowding level, and volume.

[0253] The term "detection means" refers to a device including sensors and devices for acquiring environmental information.

[0254] "Artificial intelligence means" refers to algorithms or programs for generating optimal placement based on acquired environmental information.

[0255] A "mobility means" is a device that autonomously moves objects such as tables and seats according to optimal placement.

[0256] The "emotion analysis means" is a system for analyzing the user's facial expressions, voice, and movements to recognize the user's emotional state.

[0257] "Feedback" is the process by which the emotional analysis means provides the artificial intelligence means with the user's emotional state as recognized by the emotion analysis means, and the system then readjusts based on that information.

[0258] The present invention provides a system that includes a detection unit that acquires environmental information, an artificial intelligence unit that generates an optimal layout based on the acquired environmental information, a transportation unit that operates autonomously according to the optimal layout, and an emotion analysis unit that analyzes the emotions of a user. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities.

[0259] Collection of environmental information

[0260] The device is equipped with a detection means for acquiring information about the surrounding environment. The detection means acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the detection means of the device acquires information about people's movements, positions, and crowding levels in a conference room, as well as the sound levels in the room, through sensors, and collects this information as data.

[0261] Layout Optimization

[0262] The server receives the environmental information sent from the terminals and uses artificial intelligence to generate the optimal layout. Specifically, the artificial intelligence calculates the arrangement of tables and seats to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[0263] Autonomous movement

[0264] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and seats to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and seats automatically move to the specified positions, and a new layout is formed.

[0265] Emotion engine integration

[0266] The system incorporates an emotion analysis means for recognizing the user's emotions. The emotion analysis means recognizes emotions by analyzing the user's facial expressions, voice, and movements. The emotion analysis means analyzes the user's current emotional state by integrating the data acquired by the detection means. For example, if the user is feeling dissatisfied, the emotion analysis means provides that information as feedback to the artificial intelligence means, which then readjusts the optimal layout.

[0267] Specific examples

[0268] Consider a business meeting scenario. When participants enter a conference room, the device's detection means collects environmental information, such as location information and volume, and sends it to a server. The server then uses artificial intelligence to calculate the optimal seating arrangement for all participants, ensuring easy visibility and hearing. The device then automatically moves the tables and seats based on this arrangement. During the meeting, the detection means transmits the user's facial expressions and voice to the emotion analysis means, which recognizes that the user is feeling stressed. The emotion analysis means provides this information to the artificial intelligence means, which then adjusts the layout to make the user feel comfortable. For example, it may lower the volume level or provide more space. In this way, by integrating emotion analysis means, the present invention not only optimizes the physical environment but also creates a space that takes emotional comfort into account. This maximizes user satisfaction and utilization efficiency.

[0269] Example prompt sentence:

[0270] Please explain the specific operation of a layout optimization system in a conference room. Please explain the series of processing steps, from collecting environmental information to layout optimization, autonomous movement, and emotion engine integration, along with the specific operations involved in each step.

[0271] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0272] Step 1:

[0273] The device acquires information about the surrounding environment using a detection means. The detection means acquires information about people's locations, the degree of crowding, and the volume of sound as input. This data is stored in temporary storage, and environmental information is obtained as output. Specifically, the device activates sensors installed throughout the room and constantly monitors the movements of people and objects.

[0274] Step 2:

[0275] The device sends the environmental information collected in step 1 to the server. As input, the acquired location information, congestion level, and volume data are sent from the device to the server. As output, the server receives the environmental information. Specifically, the device aggregates the collected data into a data packet and sends it to the server via the network.

[0276] Step 3:

[0277] The server analyzes the received environmental information. The environmental information sent from the device is used as input. The analyzed environmental information is obtained as output. The server uses a database and analytical algorithms to understand people's movements and congestion conditions based on the obtained data. Specifically, the server accesses the database and performs statistical analysis.

[0278] Step 4:

[0279] The server uses artificial intelligence to generate an optimal layout. The analyzed environmental information is input to the artificial intelligence. The optimal table and seating arrangement is obtained as output. Specifically, the artificial intelligence model executes a calculation algorithm to generate a layout pattern that takes into account people's movement, avoiding congestion, and sound distribution.

[0280] Step 5:

[0281] The server sends instructions for the generated optimal layout to the terminal. As input, the server sends data for the optimal layout to the terminal. As output, the terminal receives the new layout information. Specifically, the server converts the generated layout information into a data format and sends it to the terminal via the network.

[0282] Step 6:

[0283] The terminal performs actual movement based on the optimal layout sent from the server. The optimal layout instructions are received as input by the terminal. The output is that the tables and seats are placed in the specified positions. As a specific operation, the terminal operates the means of movement and executes instructions such as "move table 1 to coordinates (20, 30)."

[0284] Step 7:

[0285] The sensors capture the user's facial expressions, voice, and movements. As input, the sensors collect the user's facial and voice data. As output, the sensors obtain the user's emotional data. Specifically, the sensors run facial recognition and voice analysis algorithms to analyze the user's emotional state.

[0286] Step 8:

[0287] The terminal transmits emotional data obtained from the sensor to the emotional analysis means. As input, the terminal transmits data on the user's facial expressions and voice to the emotional analysis means. As output, the emotional analysis means provides the analysis results. As a specific operation, the terminal transmits the collected emotional data for feedback.

[0288] Step 9:

[0289] The emotion analysis means analyzes the user's emotional state and feeds back the results to the server. As input, the emotion analysis means takes in the transmitted user's emotional data. As output, the emotion analysis results are provided to the server. In concrete terms, the emotion analysis means detects the user's stress or dissatisfaction and transmits this information to the server.

[0290] Step 10:

[0291] The server readjusts the layout based on the results of the emotion analysis. The emotion analysis results are input to the artificial intelligence means. The readjusted optimal layout is obtained as the output. Specifically, the server generates a new layout that takes the user's emotions into consideration and sends instructions to the terminal again.

[0292] (Application example 2)

[0293] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0294] Conventional layout optimization systems based on environmental information have the problem of being unable to consider user emotions or real-time changes in traffic flow, making it difficult to improve user satisfaction. Furthermore, these systems can only perform static layout changes, making them unable to respond to dynamically changing situations.

[0295] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, transportation means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into the generation AI model using a prompt sentence. This makes it possible to dynamically generate an optimal layout while taking into account changes in the user's emotions and movement lines, thereby improving user satisfaction and efficiency.

[0296] The "sensor means" is a device for acquiring environmental information, specifically, a device that has the function of acquiring location information, congestion level, volume, and the like.

[0297] "AI means" is an artificial intelligence system that generates an optimal layout based on collected environmental information.

[0298] A "moving means" is a device that autonomously moves objects such as tables and chairs according to the generated optimal layout.

[0299] The "emotion engine means" is a device that can recognize the user's emotions and analyze those emotions.

[0300] "Generative AI Model" refers to an artificial intelligence model used to generate an optimal layout, which receives prompts and generates appropriate output.

[0301] A "prompt" is a textual instruction entered into a generative AI model, which specifically indicates the desired layout and operation.

[0302] A system for implementing this invention includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, movement means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into a generative AI model using a prompt sentence.

[0303] Collection of environmental information

[0304] The server collects environmental information in real time using various sensors (location sensor, microphone, temperature sensor, etc.) installed on the terminal. Specifically, it collects information on the location of customers in the store, the level of congestion, volume, temperature, etc. This allows the current environmental conditions to be accumulated as data.

[0305] Layout optimization

[0306] The server inputs the collected environmental information into the AI ​​means to generate the optimal layout. This AI means is built using artificial intelligence libraries such as TensorFlow. The AI ​​means analyzes the collected location information, congestion level, volume, temperature, etc., and calculates the optimal table and chair placement. The optimal layout is the arrangement necessary for customers to have a comfortable time.

[0307] Autonomous movement

[0308] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to the specified position based on instructions from the server. In this way, the optimal layout is physically realized.

[0309] Emotion engine integration

[0310] The server analyzes the user's facial expressions, voice, and movements, and recognizes the user's emotions using an emotion engine. The emotion engine is built using emotion analysis libraries such as OpenCV and SentiStrength. If the user is dissatisfied, that information is fed back to the AI, which then generates the optimal layout again.

[0311] Prompt input with generative AI models

[0312] The server inputs prompts into the generative AI model to generate the optimal layout, which are generated based on the specified environmental conditions and the user's emotional state.

[0313] Specific examples

[0314] For example, in a cafe scenario, sensors detect available tables in real time during busy morning hours and suggest optimal layouts. A robot then moves the tables based on the new layout. If a customer feels uncomfortable, the emotion engine analyzes that information and the server relocates them to an available space, adjusts the lighting, and adjusts the volume.

[0315] Prompt Sentence Examples

[0316] "Please suggest the best table arrangement based on the busyness and customer sentiment of this cafe."

[0317] This will create a system that dynamically improves the customer experience in physical stores.

[0318] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0319] Step 1:

[0320] The terminal collects environmental information. It uses sensors to acquire information on the customer's location in the store, the level of congestion, the volume of sound, the temperature, etc. The acquired data is sent to the server in real time. The input is various data from the sensors, and the output is environmental data sent to the server.

[0321] Step 2:

[0322] The server receives the environmental information and passes the data to the AI ​​means. The AI ​​means generates the optimal layout based on the received environmental information. The input is the collected environmental data, and the output is the generated optimal layout. Specifically, it uses AI libraries such as TensorFlow to analyze location information and congestion levels and calculate the optimal placement of tables and chairs.

[0323] Step 3:

[0324] The server inputs the generated optimal layout into the generative AI model as a prompt. This prompt specifically reflects the specified environmental conditions and the user's emotional state. The input is the optimal layout and environmental data, and the output is the prompt. An example of a prompt is, "Please suggest the optimal table arrangement based on the occupancy level of this cafe and the emotions of customers."

[0325] Step 4:

[0326] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to specified positions based on instructions from the server. In concrete terms, the robot receives instructions to move each piece of furniture and moves it to the target coordinates according to those instructions. The input is the optimal layout, and the output is the new layout with the furniture physically arranged.

[0327] Step 5:

[0328] The terminal also collects the user's emotions and sends them to the server. The emotion engine means analyzes the user's facial expressions, voice, and movements to recognize the user's emotional state. The recognized emotion data is fed back to the server. The input is the user's emotional data, and the output is analyzed emotion information. Specifically, the device uses a camera and microphone to capture the user's facial expressions and voice, and sends the analysis results to the server.

[0329] Step 6:

[0330] The server receives feedback from the emotion engine and re-executes the AI ​​method as necessary. This may result in readjusting the layout based on new environmental and emotional data. The input is feedback from the emotion engine and the latest environmental data, and the output is a regenerated optimal layout. Specifically, if the user is dissatisfied, the server re-examines the location information and congestion level to improve the layout.

[0331] This allows the entire system to work together to provide the optimal environment for maximizing user comfort and efficiency.

[0332] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0333] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0334] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0335] [Second embodiment]

[0336] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0337] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0338] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0339] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0340] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0341] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0342] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0343] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0344] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0345] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0346] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0347] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0348] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities. The specific operation of the system is described below.

[0349] Collection of environmental information

[0350] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. This information is updated regularly to keep it up to date.

[0351] Layout Optimization

[0352] The server provides the collected sensor information to the AI ​​means, which then calculates the optimal table and chair arrangement based on this data. Specifically, it considers seating arrangements that allow participants in a conference room to communicate smoothly with all other participants, and table arrangements that ensure smooth customer flow in a cafe.

[0353] Autonomous movement

[0354] The device autonomously moves tables and chairs to their designated positions based on the optimal layout provided by the server. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," which the device receives and executes. The tables and chairs automatically move to their designated positions and form a new layout.

[0355] Specific examples

[0356] For example, consider a scenario of a business meeting. Before the meeting begins, the device's sensors acquire the location information of the participants, and the device sends environmental information such as the level of congestion and volume to the server. The server passes this data to an AI means, which calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to the designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[0357] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[0358] This system allows users to maximize space utilization and operate the space more efficiently, while real-time optimization allows for quick response to unpredictable situations, enabling flexible operation.

[0359] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[0360] The processing flow will be explained below.

[0361] Step 1:

[0362] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[0363] Step 2:

[0364] The device sends the collected environmental information to a server, including information on people's current location, congestion level, and sound volume.

[0365] Step 3:

[0366] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means. The server inputs the data into the AI ​​in an appropriate data format to handle the data accurately and efficiently.

[0367] Step 4:

[0368] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the layout to avoid crowding, minimize traffic congestion, and optimally distribute sound levels. For example, in a conference room, it determines the layout so that all participants can communicate smoothly.

[0369] Step 5:

[0370] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[0371] Step 6:

[0372] The terminal starts to move based on the optimal layout information received from the server. Specifically, the terminal's movement means autonomously operates the tables and chairs to move them to the predetermined positions.

[0373] Step 7:

[0374] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[0375] Step 8:

[0376] The device collects sensor information again and provides it to the server. The server then uses this new information to further fine-tune the optimal layout, thereby realizing a system that can respond to dynamic environmental changes.

[0377] Through the above steps, the system of the present invention can obtain environmental information in real time, generate an optimal layout based on that information, and move autonomously, thereby maximizing utilization efficiency.

[0378] Example 1

[0379] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0380] Conventional space optimization systems are unable to respond immediately to environmental changes, making it difficult to make effective layout changes. Furthermore, when manual layout changes are required, the time and effort required hinders efficient space utilization. Furthermore, collecting environmental information that relies on human senses results in subjective judgments, making it difficult to provide an optimal layout immediately. As a result, the efficiency of meetings and work can decline, making it difficult to provide a comfortable space.

[0381] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0382] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a transportation means for autonomously moving according to the optimal layout. This enables rapid response to environmental changes and efficient layout changes. The environmental information acquired by the sensor means includes location information, congestion level, and volume, and the server calculates the optimal layout using a generative AI model based on this information. The terminal periodically updates the environmental information and transmits and receives information to the server using a secure communication protocol, achieving real-time optimization. This maximizes the use of space and makes it possible to quickly provide a comfortable environment.

[0383] "Environmental information" refers to data relating to the surrounding state and conditions, such as location information, congestion level, and volume.

[0384] "Sensor means" refers to a device or apparatus for acquiring environmental information. Examples include an infrared sensor for acquiring position information and a microphone for measuring sound volume.

[0385] "Artificial intelligence means" refers to an artificial intelligence system or algorithm for generating an optimal layout based on acquired environmental information.

[0386] "Moving means" refers to a device or mechanism that physically moves tables and chairs to their designated positions according to the optimal layout.

[0387] "Periodic" means repeated at regular intervals.

[0388] A "server" is a computer system that communicates with terminals via a network and processes and manages data.

[0389] "Terminal" refers to a device or equipment for controlling sensor means or mobile means.

[0390] A "generative AI model" is a part of an artificial intelligence tool and is a machine learning model that analyzes prompts based on environmental information and calculates the optimal layout.

[0391] A "prompt sentence" is a sentence of instructions or commands input to a generative AI model.

[0392] "Location information" is data relating to the coordinates or location of a particular object or person.

[0393] "Crowdness" is data about the number of people and objects in a particular area and their density.

[0394] "Volume" is data relating to the loudness of a sound in a particular environment.

[0395] A "secure communication protocol" is a communication rule for safely sending and receiving data.

[0396] The present invention is a system that includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities.

[0397] Collection of environmental information

[0398] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. These sensors include infrared sensors and microphones. The device activates the sensors, periodically updates the environmental information, and keeps the latest information. This makes it possible to acquire data in real time.

[0399] Sending data

[0400] The device periodically sends the collected environmental information to the server, using a secure communication protocol (e.g., HTTPS) to ensure safe data transmission and reception.

[0401] Layout optimization

[0402] The server provides the received sensor data to the artificial intelligence means. The artificial intelligence means analyzes the data using a generative AI model and calculates the optimal table and chair placement. Specifically, the server inputs the following prompt sentence to the generative AI model:

[0403] Please propose the optimal layout based on the current conference room environment information. The people's positions are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)] The ambient volume is 75dB.

[0404] Based on this, the generative AI model calculates the optimal layout and returns the results to the server.

[0405] Sending layout information

[0406] The server sends the optimal layout information calculated by the generative AI model to the device, including specific instructions such as moving table 1 to coordinates (20, 30).

[0407] Execution of autonomous movement

[0408] The terminals autonomously move tables and chairs to their designated positions based on instructions received from the server. Electric motors are used as the means of movement, allowing for quick and accurate physical movement. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," and the terminal receives and executes this instruction.

[0409] Specific examples

[0410] For example, consider a business meeting scenario. Before the meeting begins, the device's sensors acquire the participants' locations, and the device sends environmental information such as congestion level and volume to a server. The server passes this data to a generative AI model, and the AI ​​method calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to their designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[0411] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[0412] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[0413] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0414] Step 1: The device activates sensors and collects environmental information

[0415] Specific operation: The device activates infrared sensors, microphones, etc., and acquires data such as location information, congestion level, and volume within the conference room.

[0416] Input: Surrounding environment data from sensors

[0417] Data processing: The acquired data is converted into a format that includes the date, time, and sensor position, and then organized.

[0418] Output: Formatted environmental information data

[0419] Step 2: The device sends the collected environmental information to the server.

[0420] Specific operation: The device periodically sends collected data to a server using a secure protocol such as HTTPS.

[0421] Input: Formatted environmental information data

[0422] Data processing: Convert data into a sendable format (e.g., JSON format).

[0423] Output: Environment information data sent to the server

[0424] Step 3: The server analyzes the received sensor data

[0425] Specific operation: The server analyzes the received sensor data and extracts information such as people's location, congestion level, and volume.

[0426] Input: Environmental information data sent from the device

[0427] Data processing: Analyze the data and break it down into elements such as location, congestion level, and volume.

[0428] Output: Analysis results (location information, congestion level, volume, etc.)

[0429] Step 4: The server inputs a prompt to the generative AI model.

[0430] Specific operation: The server generates and inputs a prompt to the AI ​​model based on the analysis results. For example, "Please propose the optimal layout based on the current environmental information of the conference room. The positions of the people are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)]. The ambient volume is 75dB."

[0431] Input: Analysis results

[0432] Data processing: Generate a prompt statement.

[0433] Output: prompt statement

[0434] Step 5: Generative AI model calculates optimal layout

[0435] How it works: The generative AI model calculates the optimal table and chair arrangement based on the prompt.

[0436] Input: prompt statement

[0437] Data calculation: The generative AI model analyzes environmental information such as location, congestion level, and volume, and calculates the optimal layout.

[0438] Output: Optimal layout information

[0439] Step 6: The server sends the optimal layout information to the terminal.

[0440] Specific operation: The server sends the optimal layout information received from the generative AI model to the terminal.

[0441] Input: Optimal layout information

[0442] Data processing: Convert data into a sendable format (e.g., JSON format).

[0443] Output: Layout information sent to the device

[0444] Step 7: The device begins autonomous movement based on the optimal layout

[0445] Specific operation: Based on the layout information received, the terminal uses electric motors to move tables and chairs to the designated positions.

[0446] Input: Optimal layout information

[0447] Data calculation: Calculating physical travel routes and methods.

[0448] Output: Tables and chairs are moved into position

[0449] (Application example 1)

[0450] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0451] Current spatial layout management systems do not integrate environmental information collection, layout optimization, and autonomous movement, making it difficult to optimize layouts in real time. Furthermore, there are few ways to visually confirm optimized layout information, making it difficult for on-site staff to properly understand the layout. This results in situations where it is not possible to quickly respond to sudden congestion or environmental changes.

[0452] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0453] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal, thereby enabling real-time optimization of the spatial layout and providing visual information to on-site staff.

[0454] The "sensor means for acquiring environmental information" is a device for collecting data related to the environment, such as location information, congestion level, and volume.

[0455] The "artificial intelligence means for generating an optimal layout based on acquired environmental information" is an artificial intelligence system for analyzing environmental information acquired from the sensor means and calculating the most efficient spatial arrangement based on that information.

[0456] "A means of transportation that moves autonomously according to an optimal layout" is a device that automatically moves furniture such as tables and chairs based on the generated optimal layout.

[0457] "Means for displaying layout information using an application installed on a terminal" refers to a system for visually displaying optimal layout information to a user through an application installed on a terminal such as a smartphone or smart glasses.

[0458] "Location information" is information that indicates the specific coordinate data of a specific object or person in a space.

[0459] "Crowding level" is data that represents the degree of density of people and objects in a space.

[0460] "Volume" is data that measures the loudness of sound in a space.

[0461] An "artificial intelligence means" is a computer system that can analyze data based on knowledge and experience and propose optimal solutions.

[0462] An "autonomous vehicle" is a robot or device that has the ability to automatically move to a specified location.

[0463] "Layout information" is information that instructs the placement of objects in a space.

[0464] A specific system for implementing this invention comprises a sensor means for collecting environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a moving means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal.

[0465] System Configuration

[0466] Hardware Configuration

[0467] 1. Sensor means:

[0468] To obtain environmental information, various sensors (infrared cameras, microphones, distance sensors, etc.) are used to measure location, occupancy, and volume.

[0469] These sensors periodically collect environmental data and send it to a server.

[0470] 2. Transportation:

[0471] Robotic arms and autonomous mobile furniture are used to automatically move furniture such as tables and chairs.

[0472] The mobile means can be moved to a precise position using a control system such as the Robot Operating System (ROS).

[0473] 3. Terminal:

[0474] Portable devices such as smartphones and smart glasses have dedicated applications installed on them, allowing users to visually check optimal layout information.

[0475] Software Configuration

[0476] 1. Artificial Intelligence Means:

[0477] The artificial intelligence model uses a neural network model that analyzes environmental information using TensorFlow and PyTorch and generates the optimal layout.

[0478] The artificial intelligence receives regularly updated sensor information and suggests optimal layouts in real time.

[0479] 2. Application Method:

[0480] The application installed on the device displays layout information that is optimal for the user.

[0481] The application is implemented using mobile development frameworks such as Java or Swift.

[0482] Processing flow

[0483] 1. Environmental information collection:

[0484] The server periodically acquires environmental data such as location information, congestion level, and volume through sensor means.

[0485] 2. Layout optimization:

[0486] The acquired environmental information is transmitted to a server and analyzed by artificial intelligence means.

[0487] Artificial intelligence calculates the optimal table and chair placement based on the collected data.

[0488] 3. Autonomous Movement:

[0489] The moving means autonomously starts moving based on the optimal layout information provided by the server.

[0490] Each table and chair moves to a designated position to form the new layout.

[0491] 4. Display information:

[0492] The application installed on the terminal visually displays the layout information received from the server to the user.

[0493] Users can check the layout status through the application and manually make corrections if necessary.

[0494] Specific examples

[0495] For example, consider a scenario of a business meeting. Before the meeting begins, sensors acquire the location information of participants and send environmental information such as congestion level and volume to a server. The server passes this data to an artificial intelligence means, which calculates the optimal layout. The transportation means then receives instructions from the server and autonomously moves tables and chairs to their designated positions. An application on the device allows the meeting to proceed in a comfortable environment for all participants.

[0496] An example of a prompt might be:

[0497] "Generate the optimal seating arrangement for meeting participants so that they can communicate smoothly with all other participants. Participant location information: [20, 30, 40, 50]"

[0498] Also, in the case of application in a cafe,

[0499] "Improve table placement to ensure smooth customer flow within the cafe. Current location: [20, 10, 30, 25, 15]"

[0500] In this way, the system can optimize the spatial layout and provide visual information in real time.

[0501] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0502] Step 1:

[0503] The sensor means acquires environmental information. The input is location information, occupancy level, and volume within the environment, and the output is these data. Specifically, each sensor (infrared camera, microphone, distance sensor, etc.) collects data at predetermined intervals and sends it to the server. The sensors periodically update the data in real time at their locations.

[0504] Step 2:

[0505] The server receives environmental information acquired from the sensor means and provides it to the artificial intelligence means. The input is location information, congestion level, and volume data acquired from the sensor means, and the output is environmental data provided to the artificial intelligence means. Specifically, the server converts the data into a standard format and passes it to the artificial intelligence means.

[0506] Step 3:

[0507] The artificial intelligence means generates an optimal layout based on environmental information. The input is environmental data from the sensor means, and the output is optimal layout placement information. Specifically, the artificial intelligence means uses a generative AI model to analyze the data and calculate the optimal placement of tables and chairs. This calculation is performed using frameworks such as TensorFlow and PyTorch.

[0508] Step 4:

[0509] The server receives the optimal layout information generated by the artificial intelligence means and provides it to the moving means. The input is the layout arrangement information from the artificial intelligence means, and the output is specific movement instructions provided to the moving means. Specifically, the server converts the generated layout information into specific movement instructions for each piece of furniture and transmits them to the moving means.

[0510] Step 5:

[0511] The mobile device autonomously moves the furniture according to the optimal layout. The input is the movement instructions provided by the server, and the output is the physical environment with the new layout configured. Specifically, the robot arm or autonomous mobile furniture moves accurately to the specified position.

[0512] Step 6:

[0513] An application installed on the device displays optimal layout information to the user. The input is optimal layout information provided by the server, and the output is visual information displayed on the device's display. Specifically, the application is developed in Java or Swift, and the user can check the optimal layout in real time and make corrections as necessary.

[0514] Step 7:

[0515] The user operates the device to check the layout content and manually correct it if necessary. The input is the layout information displayed on the device and the user's operations, and the output is the final layout information. Specifically, the user performs operations such as tapping and swiping through the application to fine-tune the layout.

[0516] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0517] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, a vehicle that moves autonomously according to the optimal layout, and an emotion engine that recognizes the user's emotions. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities. Specific operations and overall system processing are described below.

[0518] Collection of environmental information

[0519] The terminal is equipped with a sensor for acquiring information about the surrounding environment. The sensor acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the terminal's sensor acquires the movements and positions of people in a conference room, the degree of crowding, and the sound levels in the room through the sensor means, and collects this as data.

[0520] Layout Optimization

[0521] The server receives the environmental information sent from the devices and uses AI to generate the optimal layout. Specifically, the AI ​​calculates the placement of tables and chairs to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[0522] Autonomous movement

[0523] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and chairs to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and chairs automatically move to the specified positions, and a new layout is formed.

[0524] Emotion engine integration

[0525] The system incorporates an emotion engine to recognize the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions, voice, and movements. Integrating this with data acquired by sensors, the emotion engine analyzes the user's current emotional state. For example, if the user is feeling dissatisfied, the emotion engine provides that information as feedback to the AI ​​means to readjust the optimal layout.

[0526] Specific examples

[0527] For example, consider a business meeting scenario. As participants enter the conference room, sensors on their devices collect location and environmental information such as volume, and send it to a server. The server uses AI tools to calculate the optimal seating arrangement that allows all participants to see and hear easily. The devices then automatically move tables and chairs based on this arrangement.

[0528] During the meeting, the sensor sends the user's facial expressions and voice to the emotion engine, which recognizes that the user is feeling stressed. The emotion engine then provides this information to the AI, which then adjusts the layout again to make the user feel comfortable, for example by lowering the volume or providing more space for the seats.

[0529] In this way, by integrating an emotion engine, the present invention realizes space creation that takes into consideration not only the optimization of the physical environment but also emotional comfort, thereby maximizing user satisfaction and utilization efficiency.

[0530] Through the above steps, the system of the present invention can obtain environmental information in real time, recognize the user's emotions using an emotion engine, generate an optimal layout based on that, and move autonomously, thereby maximizing utilization efficiency and user experience.

[0531] The processing flow will be explained below.

[0532] Step 1:

[0533] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[0534] Step 2:

[0535] The device sends the collected environmental information to a server, including information such as the current location of people, the level of congestion, and the volume of sound.

[0536] Step 3:

[0537] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means, which then inputs the data into the AI ​​means in an appropriate format.

[0538] Step 4:

[0539] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the placement of tables and chairs, taking into account people's flow, avoiding congestion, and optimally distributing sound levels. For example, it determines the seating arrangement that allows everyone in the conference room to communicate smoothly.

[0540] Step 5:

[0541] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[0542] Step 6:

[0543] The terminal automatically moves the tables and chairs to their designated positions using the movement means based on the optimal layout. Specifically, it executes the instruction "move table 1 to coordinates (20, 30)."

[0544] Step 7:

[0545] The device collects sensor information again to check whether the new layout is appropriate. If there are any changes in the environment information, it sends it to the server again.

[0546] Step 8:

[0547] The server then analyzes the received environmental information and adjusts the layout again using AI as necessary, thereby realizing a system that can respond to dynamic environmental changes.

[0548] Step 9:

[0549] The emotion engine is initialized by the device and recognizes the user's emotions by analyzing their facial expressions, voice, and movements. This information is sent to the emotion engine through sensors.

[0550] Step 10:

[0551] The device transmits the recognized user emotion data to the server. For example, if the user is feeling unhappy, the information is conveyed to the server.

[0552] Step 11:

[0553] The server's AI means analyzes the emotional data provided by the emotion engine and readjusts the layout based on that data, for example by providing more spacious seating to allow users to relax.

[0554] Step 12:

[0555] The terminal receives the new optimum layout instruction from the server and moves the tables and chairs to their predetermined positions again.

[0556] Step 13:

[0557] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[0558] In this way, the system of the present invention can maximize utilization efficiency and user experience by acquiring environmental information and user emotional information in real time, generating an optimal layout based on that information, and moving autonomously.

[0559] Example 2

[0560] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0561] In conventional conference rooms and event spaces, it was difficult to obtain environmental information in real time and change the layout to reflect user emotions, making it impossible to maximize user satisfaction and utilization efficiency. Also, when physical layout changes were made manually, it was labor-intensive and time-consuming.

[0562] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a detection means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously operating according to the optimal layout, and an emotion analysis means for analyzing the user's emotions. This makes it possible to acquire environmental information in real time and generate and execute an optimal layout that reflects the user's emotions.

[0563] "Environmental information" refers to data about the surrounding physical conditions and situations, such as location information, crowding level, and volume.

[0564] The term "detection means" refers to a device including sensors and devices for acquiring environmental information.

[0565] "Artificial intelligence means" refers to algorithms or programs for generating optimal placement based on acquired environmental information.

[0566] A "mobility means" is a device that autonomously moves objects such as tables and seats according to optimal placement.

[0567] The "emotion analysis means" is a system for analyzing the user's facial expressions, voice, and movements to recognize the user's emotional state.

[0568] "Feedback" is the process by which the emotional analysis means provides the artificial intelligence means with the user's emotional state as recognized by the emotion analysis means, and the system then readjusts based on that information.

[0569] The present invention provides a system that includes a detection unit that acquires environmental information, an artificial intelligence unit that generates an optimal layout based on the acquired environmental information, a transportation unit that operates autonomously according to the optimal layout, and an emotion analysis unit that analyzes the emotions of a user. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities.

[0570] Collection of environmental information

[0571] The device is equipped with a detection means for acquiring information about the surrounding environment. The detection means acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the detection means of the device acquires information about people's movements, positions, and crowding levels in a conference room, as well as the sound levels in the room, through sensors, and collects this information as data.

[0572] Layout Optimization

[0573] The server receives the environmental information sent from the terminals and uses artificial intelligence to generate the optimal layout. Specifically, the artificial intelligence calculates the arrangement of tables and seats to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[0574] Autonomous movement

[0575] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and seats to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and seats automatically move to the specified positions, and a new layout is formed.

[0576] Emotion engine integration

[0577] The system incorporates an emotion analysis means for recognizing the user's emotions. The emotion analysis means recognizes emotions by analyzing the user's facial expressions, voice, and movements. The emotion analysis means analyzes the user's current emotional state by integrating the data acquired by the detection means. For example, if the user is feeling dissatisfied, the emotion analysis means provides that information as feedback to the artificial intelligence means, which then readjusts the optimal layout.

[0578] Specific examples

[0579] Consider a business meeting scenario. When participants enter a conference room, the device's detection means collects environmental information, such as location information and volume, and sends it to a server. The server then uses artificial intelligence to calculate the optimal seating arrangement for all participants, ensuring easy visibility and hearing. The device then automatically moves the tables and seats based on this arrangement. During the meeting, the detection means transmits the user's facial expressions and voice to the emotion analysis means, which recognizes that the user is feeling stressed. The emotion analysis means provides this information to the artificial intelligence means, which then adjusts the layout to make the user feel comfortable. For example, it may lower the volume level or provide more space. In this way, by integrating emotion analysis means, the present invention not only optimizes the physical environment but also creates a space that takes emotional comfort into account. This maximizes user satisfaction and utilization efficiency.

[0580] Example prompt sentence:

[0581] Please explain the specific operation of a layout optimization system in a conference room. Please explain the series of processing steps, from collecting environmental information to layout optimization, autonomous movement, and emotion engine integration, along with the specific operations involved in each step.

[0582] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0583] Step 1:

[0584] The device acquires information about the surrounding environment using a detection means. The detection means acquires information about people's locations, the degree of crowding, and the volume of sound as input. This data is stored in temporary storage, and environmental information is obtained as output. Specifically, the device activates sensors installed throughout the room and constantly monitors the movements of people and objects.

[0585] Step 2:

[0586] The device sends the environmental information collected in step 1 to the server. As input, the acquired location information, congestion level, and volume data are sent from the device to the server. As output, the server receives the environmental information. Specifically, the device aggregates the collected data into a data packet and sends it to the server via the network.

[0587] Step 3:

[0588] The server analyzes the received environmental information. The environmental information sent from the device is used as input. The analyzed environmental information is obtained as output. The server uses a database and analytical algorithms to understand people's movements and congestion conditions based on the obtained data. Specifically, the server accesses the database and performs statistical analysis.

[0589] Step 4:

[0590] The server uses artificial intelligence to generate an optimal layout. The analyzed environmental information is input to the artificial intelligence. The optimal table and seating arrangement is obtained as output. Specifically, the artificial intelligence model executes a calculation algorithm to generate a layout pattern that takes into account people's movement, avoiding congestion, and sound distribution.

[0591] Step 5:

[0592] The server sends instructions for the generated optimal layout to the terminal. As input, the server sends data for the optimal layout to the terminal. As output, the terminal receives the new layout information. Specifically, the server converts the generated layout information into a data format and sends it to the terminal via the network.

[0593] Step 6:

[0594] The terminal performs actual movement based on the optimal layout sent from the server. The optimal layout instructions are received as input by the terminal. The output is that the tables and seats are placed in the specified positions. As a specific operation, the terminal operates the means of movement and executes instructions such as "move table 1 to coordinates (20, 30)."

[0595] Step 7:

[0596] The sensors capture the user's facial expressions, voice, and movements. As input, the sensors collect the user's facial and voice data. As output, the sensors obtain the user's emotional data. Specifically, the sensors run facial recognition and voice analysis algorithms to analyze the user's emotional state.

[0597] Step 8:

[0598] The terminal transmits emotional data obtained from the sensor to the emotional analysis means. As input, the terminal transmits data on the user's facial expressions and voice to the emotional analysis means. As output, the emotional analysis means provides the analysis results. As a specific operation, the terminal transmits the collected emotional data for feedback.

[0599] Step 9:

[0600] The emotion analysis means analyzes the user's emotional state and feeds back the results to the server. As input, the emotion analysis means takes in the transmitted user's emotional data. As output, the emotion analysis results are provided to the server. In concrete terms, the emotion analysis means detects the user's stress or dissatisfaction and transmits this information to the server.

[0601] Step 10:

[0602] The server readjusts the layout based on the results of the emotion analysis. The emotion analysis results are input to the artificial intelligence means. The readjusted optimal layout is obtained as the output. Specifically, the server generates a new layout that takes the user's emotions into consideration and sends instructions to the terminal again.

[0603] (Application example 2)

[0604] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0605] Conventional layout optimization systems based on environmental information have the problem of being unable to consider user emotions or real-time changes in traffic flow, making it difficult to improve user satisfaction. Furthermore, these systems can only perform static layout changes, making them unable to respond to dynamically changing situations.

[0606] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, transportation means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into the generation AI model using a prompt sentence. This makes it possible to dynamically generate an optimal layout while taking into account changes in the user's emotions and movement lines, thereby improving user satisfaction and efficiency.

[0607] The "sensor means" is a device for acquiring environmental information, specifically, a device that has the function of acquiring location information, congestion level, volume, and the like.

[0608] "AI means" is an artificial intelligence system that generates an optimal layout based on collected environmental information.

[0609] A "moving means" is a device that autonomously moves objects such as tables and chairs according to the generated optimal layout.

[0610] The "emotion engine means" is a device that can recognize the user's emotions and analyze those emotions.

[0611] "Generative AI Model" refers to an artificial intelligence model used to generate an optimal layout, which receives prompts and generates appropriate output.

[0612] A "prompt" is a textual instruction entered into a generative AI model, which specifically indicates the desired layout and operation.

[0613] A system for implementing this invention includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, movement means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into a generative AI model using a prompt sentence.

[0614] Collection of environmental information

[0615] The server collects environmental information in real time using various sensors (location sensor, microphone, temperature sensor, etc.) installed on the terminal. Specifically, it collects information on the location of customers in the store, the level of congestion, volume, temperature, etc. This allows the current environmental conditions to be accumulated as data.

[0616] Layout optimization

[0617] The server inputs the collected environmental information into the AI ​​means to generate the optimal layout. This AI means is built using artificial intelligence libraries such as TensorFlow. The AI ​​means analyzes the collected location information, congestion level, volume, temperature, etc., and calculates the optimal table and chair placement. The optimal layout is the arrangement necessary for customers to have a comfortable time.

[0618] Autonomous movement

[0619] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to the specified position based on instructions from the server. In this way, the optimal layout is physically realized.

[0620] Emotion engine integration

[0621] The server analyzes the user's facial expressions, voice, and movements, and recognizes the user's emotions using an emotion engine. The emotion engine is built using emotion analysis libraries such as OpenCV and SentiStrength. If the user is dissatisfied, that information is fed back to the AI, which then generates the optimal layout again.

[0622] Prompt input with generative AI models

[0623] The server inputs prompts into the generative AI model to generate the optimal layout, which are generated based on the specified environmental conditions and the user's emotional state.

[0624] Specific examples

[0625] For example, in a cafe scenario, sensors detect available tables in real time during busy morning hours and suggest optimal layouts. A robot then moves the tables based on the new layout. If a customer feels uncomfortable, the emotion engine analyzes that information and the server relocates them to an available space, adjusts the lighting, and adjusts the volume.

[0626] Prompt Sentence Examples

[0627] "Please suggest the best table arrangement based on the busyness and customer sentiment of this cafe."

[0628] This will create a system that dynamically improves the customer experience in physical stores.

[0629] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0630] Step 1:

[0631] The terminal collects environmental information. It uses sensors to acquire information on the customer's location in the store, the level of congestion, the volume of sound, the temperature, etc. The acquired data is sent to the server in real time. The input is various data from the sensors, and the output is environmental data sent to the server.

[0632] Step 2:

[0633] The server receives the environmental information and passes the data to the AI ​​means. The AI ​​means generates the optimal layout based on the received environmental information. The input is the collected environmental data, and the output is the generated optimal layout. Specifically, it uses AI libraries such as TensorFlow to analyze location information and congestion levels and calculate the optimal placement of tables and chairs.

[0634] Step 3:

[0635] The server inputs the generated optimal layout into the generative AI model as a prompt. This prompt specifically reflects the specified environmental conditions and the user's emotional state. The input is the optimal layout and environmental data, and the output is the prompt. An example of a prompt is, "Please suggest the optimal table arrangement based on the occupancy level of this cafe and the emotions of customers."

[0636] Step 4:

[0637] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to specified positions based on instructions from the server. In concrete terms, the robot receives instructions to move each piece of furniture and moves it to the target coordinates according to those instructions. The input is the optimal layout, and the output is the new layout with the furniture physically arranged.

[0638] Step 5:

[0639] The terminal also collects the user's emotions and sends them to the server. The emotion engine means analyzes the user's facial expressions, voice, and movements to recognize the user's emotional state. The recognized emotion data is fed back to the server. The input is the user's emotional data, and the output is analyzed emotion information. Specifically, the device uses a camera and microphone to capture the user's facial expressions and voice, and sends the analysis results to the server.

[0640] Step 6:

[0641] The server receives feedback from the emotion engine and re-executes the AI ​​method as necessary. This may result in readjusting the layout based on new environmental and emotional data. The input is feedback from the emotion engine and the latest environmental data, and the output is a regenerated optimal layout. Specifically, if the user is dissatisfied, the server re-examines the location information and congestion level to improve the layout.

[0642] This allows the entire system to work together to provide the optimal environment for maximizing user comfort and efficiency.

[0643] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0644] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0645] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0646] [Third embodiment]

[0647] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0648] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0649] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0650] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0651] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0652] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0653] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0654] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0655] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0656] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0657] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0658] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0659] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities. The specific operation of the system is described below.

[0660] Collection of environmental information

[0661] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. This information is updated regularly to keep it up to date.

[0662] Layout Optimization

[0663] The server provides the collected sensor information to the AI ​​means, which then calculates the optimal table and chair arrangement based on this data. Specifically, it considers seating arrangements that allow participants in a conference room to communicate smoothly with all other participants, and table arrangements that ensure smooth customer flow in a cafe.

[0664] Autonomous movement

[0665] The device autonomously moves tables and chairs to their designated positions based on the optimal layout provided by the server. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," which the device receives and executes. The tables and chairs automatically move to their designated positions and form a new layout.

[0666] Specific examples

[0667] For example, consider a scenario of a business meeting. Before the meeting begins, the device's sensors acquire the location information of the participants, and the device sends environmental information such as the level of congestion and volume to the server. The server passes this data to an AI means, which calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to the designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[0668] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[0669] This system allows users to maximize space utilization and operate the space more efficiently, while real-time optimization allows for quick response to unpredictable situations, enabling flexible operation.

[0670] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[0671] The processing flow will be explained below.

[0672] Step 1:

[0673] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[0674] Step 2:

[0675] The device sends the collected environmental information to a server, including information on people's current location, congestion level, and sound volume.

[0676] Step 3:

[0677] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means. The server inputs the data into the AI ​​in an appropriate data format to handle the data accurately and efficiently.

[0678] Step 4:

[0679] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the layout to avoid crowding, minimize traffic congestion, and optimally distribute sound levels. For example, in a conference room, it determines the layout so that all participants can communicate smoothly.

[0680] Step 5:

[0681] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[0682] Step 6:

[0683] The terminal starts to move based on the optimal layout information received from the server. Specifically, the terminal's movement means autonomously operates the tables and chairs to move them to the predetermined positions.

[0684] Step 7:

[0685] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[0686] Step 8:

[0687] The device collects sensor information again and provides it to the server. The server then uses this new information to further fine-tune the optimal layout, thereby realizing a system that can respond to dynamic environmental changes.

[0688] Through the above steps, the system of the present invention can obtain environmental information in real time, generate an optimal layout based on that information, and move autonomously, thereby maximizing utilization efficiency.

[0689] Example 1

[0690] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0691] Conventional space optimization systems are unable to respond immediately to environmental changes, making it difficult to make effective layout changes. Furthermore, when manual layout changes are required, the time and effort required hinders efficient space utilization. Furthermore, collecting environmental information that relies on human senses results in subjective judgments, making it difficult to provide an optimal layout immediately. As a result, the efficiency of meetings and work can decline, making it difficult to provide a comfortable space.

[0692] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0693] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a transportation means for autonomously moving according to the optimal layout. This enables rapid response to environmental changes and efficient layout changes. The environmental information acquired by the sensor means includes location information, congestion level, and volume, and the server calculates the optimal layout using a generative AI model based on this information. The terminal periodically updates the environmental information and transmits and receives information to the server using a secure communication protocol, achieving real-time optimization. This maximizes the use of space and makes it possible to quickly provide a comfortable environment.

[0694] "Environmental information" refers to data relating to the surrounding state and conditions, such as location information, congestion level, and volume.

[0695] "Sensor means" refers to a device or apparatus for acquiring environmental information. Examples include an infrared sensor for acquiring position information and a microphone for measuring sound volume.

[0696] "Artificial intelligence means" refers to an artificial intelligence system or algorithm for generating an optimal layout based on acquired environmental information.

[0697] "Moving means" refers to a device or mechanism that physically moves tables and chairs to their designated positions according to the optimal layout.

[0698] "Periodic" means repeated at regular intervals.

[0699] A "server" is a computer system that communicates with terminals via a network and processes and manages data.

[0700] "Terminal" refers to a device or equipment for controlling sensor means or mobile means.

[0701] A "generative AI model" is a part of an artificial intelligence tool and is a machine learning model that analyzes prompts based on environmental information and calculates the optimal layout.

[0702] A "prompt sentence" is a sentence of instructions or commands input to a generative AI model.

[0703] "Location information" is data relating to the coordinates or location of a particular object or person.

[0704] "Crowdness" is data about the number of people and objects in a particular area and their density.

[0705] "Volume" is data relating to the loudness of a sound in a particular environment.

[0706] A "secure communication protocol" is a communication rule for safely sending and receiving data.

[0707] The present invention is a system that includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities.

[0708] Collection of environmental information

[0709] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. These sensors include infrared sensors and microphones. The device activates the sensors, periodically updates the environmental information, and keeps the latest information. This makes it possible to acquire data in real time.

[0710] Sending data

[0711] The device periodically sends the collected environmental information to the server, using a secure communication protocol (e.g., HTTPS) to ensure safe data transmission and reception.

[0712] Layout optimization

[0713] The server provides the received sensor data to the artificial intelligence means. The artificial intelligence means analyzes the data using a generative AI model and calculates the optimal table and chair placement. Specifically, the server inputs the following prompt sentence to the generative AI model:

[0714] Please propose the optimal layout based on the current conference room environment information. The people's positions are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)] The ambient volume is 75dB.

[0715] Based on this, the generative AI model calculates the optimal layout and returns the results to the server.

[0716] Sending layout information

[0717] The server sends the optimal layout information calculated by the generative AI model to the device, including specific instructions such as moving table 1 to coordinates (20, 30).

[0718] Execution of autonomous movement

[0719] The terminals autonomously move tables and chairs to their designated positions based on instructions received from the server. Electric motors are used as the means of movement, allowing for quick and accurate physical movement. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," and the terminal receives and executes this instruction.

[0720] Specific examples

[0721] For example, consider a business meeting scenario. Before the meeting begins, the device's sensors acquire the participants' locations, and the device sends environmental information such as congestion level and volume to a server. The server passes this data to a generative AI model, and the AI ​​method calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to their designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[0722] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[0723] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[0724] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0725] Step 1: The device activates sensors and collects environmental information

[0726] Specific operation: The device activates infrared sensors, microphones, etc., and acquires data such as location information, congestion level, and volume within the conference room.

[0727] Input: Surrounding environment data from sensors

[0728] Data processing: The acquired data is converted into a format that includes the date, time, and sensor position, and then organized.

[0729] Output: Formatted environmental information data

[0730] Step 2: The device sends the collected environmental information to the server.

[0731] Specific operation: The device periodically sends collected data to a server using a secure protocol such as HTTPS.

[0732] Input: Formatted environmental information data

[0733] Data processing: Convert data into a sendable format (e.g., JSON format).

[0734] Output: Environment information data sent to the server

[0735] Step 3: The server analyzes the received sensor data

[0736] Specific operation: The server analyzes the received sensor data and extracts information such as people's location, congestion level, and volume.

[0737] Input: Environmental information data sent from the device

[0738] Data processing: Analyze the data and break it down into elements such as location, congestion level, and volume.

[0739] Output: Analysis results (location information, congestion level, volume, etc.)

[0740] Step 4: The server inputs a prompt to the generative AI model.

[0741] Specific operation: The server generates and inputs a prompt to the AI ​​model based on the analysis results. For example, "Please propose the optimal layout based on the current environmental information of the conference room. The positions of the people are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)]. The ambient volume is 75dB."

[0742] Input: Analysis results

[0743] Data processing: Generate a prompt statement.

[0744] Output: prompt statement

[0745] Step 5: Generative AI model calculates optimal layout

[0746] How it works: The generative AI model calculates the optimal table and chair arrangement based on the prompt.

[0747] Input: prompt statement

[0748] Data calculation: The generative AI model analyzes environmental information such as location, congestion level, and volume, and calculates the optimal layout.

[0749] Output: Optimal layout information

[0750] Step 6: The server sends the optimal layout information to the terminal.

[0751] Specific operation: The server sends the optimal layout information received from the generative AI model to the terminal.

[0752] Input: Optimal layout information

[0753] Data processing: Convert data into a sendable format (e.g., JSON format).

[0754] Output: Layout information sent to the device

[0755] Step 7: The device begins autonomous movement based on the optimal layout

[0756] Specific operation: Based on the layout information received, the terminal uses electric motors to move tables and chairs to the designated positions.

[0757] Input: Optimal layout information

[0758] Data calculation: Calculating physical travel routes and methods.

[0759] Output: Tables and chairs are moved into position

[0760] (Application example 1)

[0761] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0762] Current spatial layout management systems do not integrate environmental information collection, layout optimization, and autonomous movement, making it difficult to optimize layouts in real time. Furthermore, there are few ways to visually confirm optimized layout information, making it difficult for on-site staff to properly understand the layout. This results in situations where it is not possible to quickly respond to sudden congestion or environmental changes.

[0763] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0764] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal, thereby enabling real-time optimization of the spatial layout and providing visual information to on-site staff.

[0765] The "sensor means for acquiring environmental information" is a device for collecting data related to the environment, such as location information, congestion level, and volume.

[0766] The "artificial intelligence means for generating an optimal layout based on acquired environmental information" is an artificial intelligence system for analyzing environmental information acquired from the sensor means and calculating the most efficient spatial arrangement based on that information.

[0767] "A means of transportation that moves autonomously according to an optimal layout" is a device that automatically moves furniture such as tables and chairs based on the generated optimal layout.

[0768] "Means for displaying layout information using an application installed on a terminal" refers to a system for visually displaying optimal layout information to a user through an application installed on a terminal such as a smartphone or smart glasses.

[0769] "Location information" is information that indicates the specific coordinate data of a specific object or person in a space.

[0770] "Crowding level" is data that represents the degree of density of people and objects in a space.

[0771] "Volume" is data that measures the loudness of sound in a space.

[0772] An "artificial intelligence means" is a computer system that can analyze data based on knowledge and experience and propose optimal solutions.

[0773] An "autonomous vehicle" is a robot or device that has the ability to automatically move to a specified location.

[0774] "Layout information" is information that instructs the placement of objects in a space.

[0775] A specific system for implementing this invention comprises a sensor means for collecting environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a moving means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal.

[0776] System Configuration

[0777] Hardware Configuration

[0778] 1. Sensor means:

[0779] To obtain environmental information, various sensors (infrared cameras, microphones, distance sensors, etc.) are used to measure location, occupancy, and volume.

[0780] These sensors periodically collect environmental data and send it to a server.

[0781] 2. Transportation:

[0782] Robotic arms and autonomous mobile furniture are used to automatically move furniture such as tables and chairs.

[0783] The mobile means can be moved to a precise position using a control system such as the Robot Operating System (ROS).

[0784] 3. Terminal:

[0785] Portable devices such as smartphones and smart glasses have dedicated applications installed on them, allowing users to visually check optimal layout information.

[0786] Software Configuration

[0787] 1. Artificial Intelligence Means:

[0788] The artificial intelligence model uses a neural network model that analyzes environmental information using TensorFlow and PyTorch and generates the optimal layout.

[0789] The artificial intelligence receives regularly updated sensor information and suggests optimal layouts in real time.

[0790] 2. Application Method:

[0791] The application installed on the device displays layout information that is optimal for the user.

[0792] The application is implemented using mobile development frameworks such as Java or Swift.

[0793] Processing flow

[0794] 1. Environmental information collection:

[0795] The server periodically acquires environmental data such as location information, congestion level, and volume through sensor means.

[0796] 2. Layout optimization:

[0797] The acquired environmental information is transmitted to a server and analyzed by artificial intelligence means.

[0798] Artificial intelligence calculates the optimal table and chair placement based on the collected data.

[0799] 3. Autonomous Movement:

[0800] The moving means autonomously starts moving based on the optimal layout information provided by the server.

[0801] Each table and chair moves to a designated position to form the new layout.

[0802] 4. Display information:

[0803] The application installed on the terminal visually displays the layout information received from the server to the user.

[0804] Users can check the layout status through the application and manually make corrections if necessary.

[0805] Specific examples

[0806] For example, consider a scenario of a business meeting. Before the meeting begins, sensors acquire the location information of participants and send environmental information such as congestion level and volume to a server. The server passes this data to an artificial intelligence means, which calculates the optimal layout. The transportation means then receives instructions from the server and autonomously moves tables and chairs to their designated positions. An application on the device allows the meeting to proceed in a comfortable environment for all participants.

[0807] An example of a prompt might be:

[0808] "Generate the optimal seating arrangement for meeting participants so that they can communicate smoothly with all other participants. Participant location information: [20, 30, 40, 50]"

[0809] Also, in the case of application in a cafe,

[0810] "Improve table placement to ensure smooth customer flow within the cafe. Current location: [20, 10, 30, 25, 15]"

[0811] In this way, the system can optimize the spatial layout and provide visual information in real time.

[0812] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0813] Step 1:

[0814] The sensor means acquires environmental information. The input is location information, occupancy level, and volume within the environment, and the output is these data. Specifically, each sensor (infrared camera, microphone, distance sensor, etc.) collects data at predetermined intervals and sends it to the server. The sensors periodically update the data in real time at their locations.

[0815] Step 2:

[0816] The server receives environmental information acquired from the sensor means and provides it to the artificial intelligence means. The input is location information, congestion level, and volume data acquired from the sensor means, and the output is environmental data provided to the artificial intelligence means. Specifically, the server converts the data into a standard format and passes it to the artificial intelligence means.

[0817] Step 3:

[0818] The artificial intelligence means generates an optimal layout based on environmental information. The input is environmental data from the sensor means, and the output is optimal layout placement information. Specifically, the artificial intelligence means uses a generative AI model to analyze the data and calculate the optimal placement of tables and chairs. This calculation is performed using frameworks such as TensorFlow and PyTorch.

[0819] Step 4:

[0820] The server receives the optimal layout information generated by the artificial intelligence means and provides it to the moving means. The input is the layout arrangement information from the artificial intelligence means, and the output is specific movement instructions provided to the moving means. Specifically, the server converts the generated layout information into specific movement instructions for each piece of furniture and transmits them to the moving means.

[0821] Step 5:

[0822] The mobile device autonomously moves the furniture according to the optimal layout. The input is the movement instructions provided by the server, and the output is the physical environment with the new layout configured. Specifically, the robot arm or autonomous mobile furniture moves accurately to the specified position.

[0823] Step 6:

[0824] An application installed on the device displays optimal layout information to the user. The input is optimal layout information provided by the server, and the output is visual information displayed on the device's display. Specifically, the application is developed in Java or Swift, and the user can check the optimal layout in real time and make corrections as necessary.

[0825] Step 7:

[0826] The user operates the device to check the layout content and manually correct it if necessary. The input is the layout information displayed on the device and the user's operations, and the output is the final layout information. Specifically, the user performs operations such as tapping and swiping through the application to fine-tune the layout.

[0827] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0828] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, a vehicle that moves autonomously according to the optimal layout, and an emotion engine that recognizes the user's emotions. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities. Specific operations and overall system processing are described below.

[0829] Collection of environmental information

[0830] The terminal is equipped with a sensor for acquiring information about the surrounding environment. The sensor acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the terminal's sensor acquires the movements and positions of people in a conference room, the degree of crowding, and the sound levels in the room through the sensor means, and collects this as data.

[0831] Layout Optimization

[0832] The server receives the environmental information sent from the devices and uses AI to generate the optimal layout. Specifically, the AI ​​calculates the placement of tables and chairs to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[0833] Autonomous movement

[0834] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and chairs to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and chairs automatically move to the specified positions, and a new layout is formed.

[0835] Emotion engine integration

[0836] The system incorporates an emotion engine to recognize the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions, voice, and movements. Integrating this with data acquired by sensors, the emotion engine analyzes the user's current emotional state. For example, if the user is feeling dissatisfied, the emotion engine provides that information as feedback to the AI ​​means to readjust the optimal layout.

[0837] Specific examples

[0838] For example, consider a business meeting scenario. As participants enter the conference room, sensors on their devices collect location and environmental information such as volume, and send it to a server. The server uses AI tools to calculate the optimal seating arrangement that allows all participants to see and hear easily. The devices then automatically move tables and chairs based on this arrangement.

[0839] During the meeting, the sensor sends the user's facial expressions and voice to the emotion engine, which recognizes that the user is feeling stressed. The emotion engine then provides this information to the AI, which then adjusts the layout again to make the user feel comfortable, for example by lowering the volume or providing more space for the seats.

[0840] In this way, by integrating an emotion engine, the present invention realizes space creation that takes into consideration not only the optimization of the physical environment but also emotional comfort, thereby maximizing user satisfaction and utilization efficiency.

[0841] Through the above steps, the system of the present invention can obtain environmental information in real time, recognize the user's emotions using an emotion engine, generate an optimal layout based on that, and move autonomously, thereby maximizing utilization efficiency and user experience.

[0842] The processing flow will be explained below.

[0843] Step 1:

[0844] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[0845] Step 2:

[0846] The device sends the collected environmental information to a server, including information such as the current location of people, the level of congestion, and the volume of sound.

[0847] Step 3:

[0848] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means, which then inputs the data into the AI ​​means in an appropriate format.

[0849] Step 4:

[0850] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the placement of tables and chairs, taking into account people's flow, avoiding congestion, and optimally distributing sound levels. For example, it determines the seating arrangement that allows everyone in the conference room to communicate smoothly.

[0851] Step 5:

[0852] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[0853] Step 6:

[0854] The terminal automatically moves the tables and chairs to their designated positions using the movement means based on the optimal layout. Specifically, it executes the instruction "move table 1 to coordinates (20, 30)."

[0855] Step 7:

[0856] The device collects sensor information again to check whether the new layout is appropriate. If there are any changes in the environment information, it sends it to the server again.

[0857] Step 8:

[0858] The server then analyzes the received environmental information and adjusts the layout again using AI as necessary, thereby realizing a system that can respond to dynamic environmental changes.

[0859] Step 9:

[0860] The emotion engine is initialized by the device and recognizes the user's emotions by analyzing their facial expressions, voice, and movements. This information is sent to the emotion engine through sensors.

[0861] Step 10:

[0862] The device transmits the recognized user emotion data to the server. For example, if the user is feeling unhappy, the information is conveyed to the server.

[0863] Step 11:

[0864] The server's AI means analyzes the emotional data provided by the emotion engine and readjusts the layout based on that data, for example by providing more spacious seating to allow users to relax.

[0865] Step 12:

[0866] The terminal receives the new optimum layout instruction from the server and moves the tables and chairs to their predetermined positions again.

[0867] Step 13:

[0868] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[0869] In this way, the system of the present invention can maximize utilization efficiency and user experience by acquiring environmental information and user emotional information in real time, generating an optimal layout based on that information, and moving autonomously.

[0870] Example 2

[0871] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0872] In conventional conference rooms and event spaces, it was difficult to obtain environmental information in real time and change the layout to reflect user emotions, making it impossible to maximize user satisfaction and utilization efficiency. Also, when physical layout changes were made manually, it was labor-intensive and time-consuming.

[0873] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a detection means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously operating according to the optimal layout, and an emotion analysis means for analyzing the user's emotions. This makes it possible to acquire environmental information in real time and generate and execute an optimal layout that reflects the user's emotions.

[0874] "Environmental information" refers to data about the surrounding physical conditions and situations, such as location information, crowding level, and volume.

[0875] The term "detection means" refers to a device including sensors and devices for acquiring environmental information.

[0876] "Artificial intelligence means" refers to algorithms or programs for generating optimal placement based on acquired environmental information.

[0877] A "mobility means" is a device that autonomously moves objects such as tables and seats according to optimal placement.

[0878] The "emotion analysis means" is a system for analyzing the user's facial expressions, voice, and movements to recognize the user's emotional state.

[0879] "Feedback" is the process by which the emotional analysis means provides the artificial intelligence means with the user's emotional state as recognized by the emotion analysis means, and the system then readjusts based on that information.

[0880] The present invention provides a system that includes a detection unit that acquires environmental information, an artificial intelligence unit that generates an optimal layout based on the acquired environmental information, a transportation unit that operates autonomously according to the optimal layout, and an emotion analysis unit that analyzes the emotions of a user. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities.

[0881] Collection of environmental information

[0882] The device is equipped with a detection means for acquiring information about the surrounding environment. The detection means acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the detection means of the device acquires information about people's movements, positions, and crowding levels in a conference room, as well as the sound levels in the room, through sensors, and collects this information as data.

[0883] Layout Optimization

[0884] The server receives the environmental information sent from the terminals and uses artificial intelligence to generate the optimal layout. Specifically, the artificial intelligence calculates the arrangement of tables and seats to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[0885] Autonomous movement

[0886] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and seats to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and seats automatically move to the specified positions, and a new layout is formed.

[0887] Emotion engine integration

[0888] The system incorporates an emotion analysis means for recognizing the user's emotions. The emotion analysis means recognizes emotions by analyzing the user's facial expressions, voice, and movements. The emotion analysis means analyzes the user's current emotional state by integrating the data acquired by the detection means. For example, if the user is feeling dissatisfied, the emotion analysis means provides that information as feedback to the artificial intelligence means, which then readjusts the optimal layout.

[0889] Specific examples

[0890] Consider a business meeting scenario. When participants enter a conference room, the device's detection means collects environmental information, such as location information and volume, and sends it to a server. The server then uses artificial intelligence to calculate the optimal seating arrangement for all participants, ensuring easy visibility and hearing. The device then automatically moves the tables and seats based on this arrangement. During the meeting, the detection means transmits the user's facial expressions and voice to the emotion analysis means, which recognizes that the user is feeling stressed. The emotion analysis means provides this information to the artificial intelligence means, which then adjusts the layout to make the user feel comfortable. For example, it may lower the volume level or provide more space. In this way, by integrating emotion analysis means, the present invention not only optimizes the physical environment but also creates a space that takes emotional comfort into account. This maximizes user satisfaction and utilization efficiency.

[0891] Example prompt sentence:

[0892] Please explain the specific operation of a layout optimization system in a conference room. Please explain the series of processing steps, from collecting environmental information to layout optimization, autonomous movement, and emotion engine integration, along with the specific operations involved in each step.

[0893] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0894] Step 1:

[0895] The device acquires information about the surrounding environment using a detection means. The detection means acquires information about people's locations, the degree of crowding, and the volume of sound as input. This data is stored in temporary storage, and environmental information is obtained as output. Specifically, the device activates sensors installed throughout the room and constantly monitors the movements of people and objects.

[0896] Step 2:

[0897] The device sends the environmental information collected in step 1 to the server. As input, the acquired location information, congestion level, and volume data are sent from the device to the server. As output, the server receives the environmental information. Specifically, the device aggregates the collected data into a data packet and sends it to the server via the network.

[0898] Step 3:

[0899] The server analyzes the received environmental information. The environmental information sent from the device is used as input. The analyzed environmental information is obtained as output. The server uses a database and analytical algorithms to understand people's movements and congestion conditions based on the obtained data. Specifically, the server accesses the database and performs statistical analysis.

[0900] Step 4:

[0901] The server uses artificial intelligence to generate an optimal layout. The analyzed environmental information is input to the artificial intelligence. The optimal table and seating arrangement is obtained as output. Specifically, the artificial intelligence model executes a calculation algorithm to generate a layout pattern that takes into account people's movement, avoiding congestion, and sound distribution.

[0902] Step 5:

[0903] The server sends instructions for the generated optimal layout to the terminal. As input, the server sends data for the optimal layout to the terminal. As output, the terminal receives the new layout information. Specifically, the server converts the generated layout information into a data format and sends it to the terminal via the network.

[0904] Step 6:

[0905] The terminal performs actual movement based on the optimal layout sent from the server. The optimal layout instructions are received as input by the terminal. The output is that the tables and seats are placed in the specified positions. As a specific operation, the terminal operates the means of movement and executes instructions such as "move table 1 to coordinates (20, 30)."

[0906] Step 7:

[0907] The sensors capture the user's facial expressions, voice, and movements. As input, the sensors collect the user's facial and voice data. As output, the sensors obtain the user's emotional data. Specifically, the sensors run facial recognition and voice analysis algorithms to analyze the user's emotional state.

[0908] Step 8:

[0909] The terminal transmits emotional data obtained from the sensor to the emotional analysis means. As input, the terminal transmits data on the user's facial expressions and voice to the emotional analysis means. As output, the emotional analysis means provides the analysis results. As a specific operation, the terminal transmits the collected emotional data for feedback.

[0910] Step 9:

[0911] The emotion analysis means analyzes the user's emotional state and feeds back the results to the server. As input, the emotion analysis means takes in the transmitted user's emotional data. As output, the emotion analysis results are provided to the server. In concrete terms, the emotion analysis means detects the user's stress or dissatisfaction and transmits this information to the server.

[0912] Step 10:

[0913] The server readjusts the layout based on the results of the emotion analysis. The emotion analysis results are input to the artificial intelligence means. The readjusted optimal layout is obtained as the output. Specifically, the server generates a new layout that takes the user's emotions into consideration and sends instructions to the terminal again.

[0914] (Application example 2)

[0915] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0916] Conventional layout optimization systems based on environmental information have the problem of being unable to consider user emotions or real-time changes in traffic flow, making it difficult to improve user satisfaction. Furthermore, these systems can only perform static layout changes, making them unable to respond to dynamically changing situations.

[0917] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, transportation means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into the generation AI model using a prompt sentence. This makes it possible to dynamically generate an optimal layout while taking into account changes in the user's emotions and movement lines, thereby improving user satisfaction and efficiency.

[0918] The "sensor means" is a device for acquiring environmental information, specifically, a device that has the function of acquiring location information, congestion level, volume, and the like.

[0919] "AI means" is an artificial intelligence system that generates an optimal layout based on collected environmental information.

[0920] A "moving means" is a device that autonomously moves objects such as tables and chairs according to the generated optimal layout.

[0921] The "emotion engine means" is a device that can recognize the user's emotions and analyze those emotions.

[0922] "Generative AI Model" refers to an artificial intelligence model used to generate an optimal layout, which receives prompts and generates appropriate output.

[0923] A "prompt" is a textual instruction entered into a generative AI model, which specifically indicates the desired layout and operation.

[0924] A system for implementing this invention includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, movement means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into a generative AI model using a prompt sentence.

[0925] Collection of environmental information

[0926] The server collects environmental information in real time using various sensors (location sensor, microphone, temperature sensor, etc.) installed on the terminal. Specifically, it collects information on the location of customers in the store, the level of congestion, volume, temperature, etc. This allows the current environmental conditions to be accumulated as data.

[0927] Layout optimization

[0928] The server inputs the collected environmental information into the AI ​​means to generate the optimal layout. This AI means is built using artificial intelligence libraries such as TensorFlow. The AI ​​means analyzes the collected location information, congestion level, volume, temperature, etc., and calculates the optimal table and chair placement. The optimal layout is the arrangement necessary for customers to have a comfortable time.

[0929] Autonomous movement

[0930] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to the specified position based on instructions from the server. In this way, the optimal layout is physically realized.

[0931] Emotion engine integration

[0932] The server analyzes the user's facial expressions, voice, and movements, and recognizes the user's emotions using an emotion engine. The emotion engine is built using emotion analysis libraries such as OpenCV and SentiStrength. If the user is dissatisfied, that information is fed back to the AI, which then generates the optimal layout again.

[0933] Prompt input with generative AI models

[0934] The server inputs prompts into the generative AI model to generate the optimal layout, which are generated based on the specified environmental conditions and the user's emotional state.

[0935] Specific examples

[0936] For example, in a cafe scenario, sensors detect available tables in real time during busy morning hours and suggest optimal layouts. A robot then moves the tables based on the new layout. If a customer feels uncomfortable, the emotion engine analyzes that information and the server relocates them to an available space, adjusts the lighting, and adjusts the volume.

[0937] Prompt Sentence Examples

[0938] "Please suggest the best table arrangement based on the busyness and customer sentiment of this cafe."

[0939] This will create a system that dynamically improves the customer experience in physical stores.

[0940] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0941] Step 1:

[0942] The terminal collects environmental information. It uses sensors to acquire information on the customer's location in the store, the level of congestion, the volume of sound, the temperature, etc. The acquired data is sent to the server in real time. The input is various data from the sensors, and the output is environmental data sent to the server.

[0943] Step 2:

[0944] The server receives the environmental information and passes the data to the AI ​​means. The AI ​​means generates the optimal layout based on the received environmental information. The input is the collected environmental data, and the output is the generated optimal layout. Specifically, it uses AI libraries such as TensorFlow to analyze location information and congestion levels and calculate the optimal placement of tables and chairs.

[0945] Step 3:

[0946] The server inputs the generated optimal layout into the generative AI model as a prompt. This prompt specifically reflects the specified environmental conditions and the user's emotional state. The input is the optimal layout and environmental data, and the output is the prompt. An example of a prompt is, "Please suggest the optimal table arrangement based on the occupancy level of this cafe and the emotions of customers."

[0947] Step 4:

[0948] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to specified positions based on instructions from the server. In concrete terms, the robot receives instructions to move each piece of furniture and moves it to the target coordinates according to those instructions. The input is the optimal layout, and the output is the new layout with the furniture physically arranged.

[0949] Step 5:

[0950] The terminal also collects the user's emotions and sends them to the server. The emotion engine means analyzes the user's facial expressions, voice, and movements to recognize the user's emotional state. The recognized emotion data is fed back to the server. The input is the user's emotional data, and the output is analyzed emotion information. Specifically, the device uses a camera and microphone to capture the user's facial expressions and voice, and sends the analysis results to the server.

[0951] Step 6:

[0952] The server receives feedback from the emotion engine and re-executes the AI ​​method as necessary. This may result in readjusting the layout based on new environmental and emotional data. The input is feedback from the emotion engine and the latest environmental data, and the output is a regenerated optimal layout. Specifically, if the user is dissatisfied, the server re-examines the location information and congestion level to improve the layout.

[0953] This allows the entire system to work together to provide the optimal environment for maximizing user comfort and efficiency.

[0954] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0955] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0956] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[0957] [Fourth embodiment]

[0958] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[0959] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0960] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0961] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[0962] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0963] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0964] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0965] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[0966] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0967] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0968] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0969] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0970] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[0971] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities. The specific operation of the system is described below.

[0972] Collection of environmental information

[0973] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. This information is updated regularly to keep it up to date.

[0974] Layout Optimization

[0975] The server provides the collected sensor information to the AI ​​means, which then calculates the optimal table and chair arrangement based on this data. Specifically, it considers seating arrangements that allow participants in a conference room to communicate smoothly with all other participants, and table arrangements that ensure smooth customer flow in a cafe.

[0976] Autonomous movement

[0977] The device autonomously moves tables and chairs to their designated positions based on the optimal layout provided by the server. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," which the device receives and executes. The tables and chairs automatically move to their designated positions and form a new layout.

[0978] Specific examples

[0979] For example, consider a scenario of a business meeting. Before the meeting begins, the device's sensors acquire the location information of the participants, and the device sends environmental information such as the level of congestion and volume to the server. The server passes this data to an AI means, which calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to the designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[0980] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[0981] This system allows users to maximize space utilization and operate the space more efficiently, while real-time optimization allows for quick response to unpredictable situations, enabling flexible operation.

[0982] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[0983] The processing flow will be explained below.

[0984] Step 1:

[0985] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[0986] Step 2:

[0987] The device sends the collected environmental information to a server, including information on people's current location, congestion level, and sound volume.

[0988] Step 3:

[0989] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means. The server inputs the data into the AI ​​in an appropriate data format to handle the data accurately and efficiently.

[0990] Step 4:

[0991] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the layout to avoid crowding, minimize traffic congestion, and optimally distribute sound levels. For example, in a conference room, it determines the layout so that all participants can communicate smoothly.

[0992] Step 5:

[0993] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[0994] Step 6:

[0995] The terminal starts to move based on the optimal layout information received from the server. Specifically, the terminal's movement means autonomously operates the tables and chairs to move them to the predetermined positions.

[0996] Step 7:

[0997] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[0998] Step 8:

[0999] The device collects sensor information again and provides it to the server. The server then uses this new information to further fine-tune the optimal layout, thereby realizing a system that can respond to dynamic environmental changes.

[1000] Through the above steps, the system of the present invention can obtain environmental information in real time, generate an optimal layout based on that information, and move autonomously, thereby maximizing utilization efficiency.

[1001] Example 1

[1002] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1003] Conventional space optimization systems are unable to respond immediately to environmental changes, making it difficult to make effective layout changes. Furthermore, when manual layout changes are required, the time and effort required hinders efficient space utilization. Furthermore, collecting environmental information that relies on human senses results in subjective judgments, making it difficult to provide an optimal layout immediately. As a result, the efficiency of meetings and work can decline, making it difficult to provide a comfortable space.

[1004] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1005] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a transportation means for autonomously moving according to the optimal layout. This enables rapid response to environmental changes and efficient layout changes. The environmental information acquired by the sensor means includes location information, congestion level, and volume, and the server calculates the optimal layout using a generative AI model based on this information. The terminal periodically updates the environmental information and transmits and receives information to the server using a secure communication protocol, achieving real-time optimization. This maximizes the use of space and makes it possible to quickly provide a comfortable environment.

[1006] "Environmental information" refers to data relating to the surrounding state and conditions, such as location information, congestion level, and volume.

[1007] "Sensor means" refers to a device or apparatus for acquiring environmental information. Examples include an infrared sensor for acquiring position information and a microphone for measuring sound volume.

[1008] "Artificial intelligence means" refers to an artificial intelligence system or algorithm for generating an optimal layout based on acquired environmental information.

[1009] "Moving means" refers to a device or mechanism that physically moves tables and chairs to their designated positions according to the optimal layout.

[1010] "Periodic" means repeated at regular intervals.

[1011] A "server" is a computer system that communicates with terminals via a network and processes and manages data.

[1012] "Terminal" refers to a device or equipment for controlling sensor means or mobile means.

[1013] A "generative AI model" is a part of an artificial intelligence tool and is a machine learning model that analyzes prompts based on environmental information and calculates the optimal layout.

[1014] A "prompt sentence" is a sentence of instructions or commands input to a generative AI model.

[1015] "Location information" is data relating to the coordinates or location of a particular object or person.

[1016] "Crowdness" is data about the number of people and objects in a particular area and their density.

[1017] "Volume" is data relating to the loudness of a sound in a particular environment.

[1018] A "secure communication protocol" is a communication rule for safely sending and receiving data.

[1019] The present invention is a system that includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, and a vehicle that autonomously moves according to the optimal layout. This system is expected to be used in a variety of areas, such as business meeting spaces, event spaces, cafes, restaurants, and educational facilities.

[1020] Collection of environmental information

[1021] The device uses sensors to acquire information about the surrounding environment. This information includes location information, congestion level, volume, etc. For example, the device's sensors measure the location and concentration of people in a conference room, as well as the volume of sound in the room. These sensors include infrared sensors and microphones. The device activates the sensors, periodically updates the environmental information, and keeps the latest information. This makes it possible to acquire data in real time.

[1022] Sending data

[1023] The device periodically sends the collected environmental information to the server, using a secure communication protocol (e.g., HTTPS) to ensure safe data transmission and reception.

[1024] Layout optimization

[1025] The server provides the received sensor data to the artificial intelligence means. The artificial intelligence means analyzes the data using a generative AI model and calculates the optimal table and chair placement. Specifically, the server inputs the following prompt sentence to the generative AI model:

[1026] Please propose the optimal layout based on the current conference room environment information. The people's positions are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)] The ambient volume is 75dB.

[1027] Based on this, the generative AI model calculates the optimal layout and returns the results to the server.

[1028] Sending layout information

[1029] The server sends the optimal layout information calculated by the generative AI model to the device, including specific instructions such as moving table 1 to coordinates (20, 30).

[1030] Execution of autonomous movement

[1031] The terminals autonomously move tables and chairs to their designated positions based on instructions received from the server. Electric motors are used as the means of movement, allowing for quick and accurate physical movement. For example, the server generates a movement instruction such as "move table 1 to coordinates (20, 30)," and the terminal receives and executes this instruction.

[1032] Specific examples

[1033] For example, consider a business meeting scenario. Before the meeting begins, the device's sensors acquire the participants' locations, and the device sends environmental information such as congestion level and volume to a server. The server passes this data to a generative AI model, and the AI ​​method calculates the optimal layout. The device receives instructions from the server and autonomously moves tables and chairs to their designated positions. This allows the meeting to proceed in a comfortable environment for all participants.

[1034] Similarly, in cafes, sensors can monitor customer movements and automatically rearrange tables and chairs when the cafe becomes too crowded, providing a comfortable space for customers.

[1035] As described above, the present invention solves the current problems in space utilization and provides optimal layouts for a variety of scenes.

[1036] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1037] Step 1: The device activates sensors and collects environmental information

[1038] Specific operation: The device activates infrared sensors, microphones, etc., and acquires data such as location information, congestion level, and volume within the conference room.

[1039] Input: Surrounding environment data from sensors

[1040] Data processing: The acquired data is converted into a format that includes the date, time, and sensor position, and then organized.

[1041] Output: Formatted environmental information data

[1042] Step 2: The device sends the collected environmental information to the server.

[1043] Specific operation: The device periodically sends collected data to a server using a secure protocol such as HTTPS.

[1044] Input: Formatted environmental information data

[1045] Data processing: Convert data into a sendable format (e.g., JSON format).

[1046] Output: Environment information data sent to the server

[1047] Step 3: The server analyzes the received sensor data

[1048] Specific operation: The server analyzes the received sensor data and extracts information such as people's location, congestion level, and volume.

[1049] Input: Environmental information data sent from the device

[1050] Data processing: Analyze the data and break it down into elements such as location, congestion level, and volume.

[1051] Output: Analysis results (location information, congestion level, volume, etc.)

[1052] Step 4: The server inputs a prompt to the generative AI model.

[1053] Specific operation: The server generates and inputs a prompt to the AI ​​model based on the analysis results. For example, "Please propose the optimal layout based on the current environmental information of the conference room. The positions of the people are as follows: [Participant A: (10,20), Participant B: (30,40), Participant C: (50,60)]. The ambient volume is 75dB."

[1054] Input: Analysis results

[1055] Data processing: Generate a prompt statement.

[1056] Output: prompt statement

[1057] Step 5: Generative AI model calculates optimal layout

[1058] How it works: The generative AI model calculates the optimal table and chair arrangement based on the prompt.

[1059] Input: prompt statement

[1060] Data calculation: The generative AI model analyzes environmental information such as location, congestion level, and volume, and calculates the optimal layout.

[1061] Output: Optimal layout information

[1062] Step 6: The server sends the optimal layout information to the terminal.

[1063] Specific operation: The server sends the optimal layout information received from the generative AI model to the terminal.

[1064] Input: Optimal layout information

[1065] Data processing: Convert data into a sendable format (e.g., JSON format).

[1066] Output: Layout information sent to the device

[1067] Step 7: The device begins autonomous movement based on the optimal layout

[1068] Specific operation: Based on the layout information received, the terminal uses electric motors to move tables and chairs to the designated positions.

[1069] Input: Optimal layout information

[1070] Data calculation: Calculating physical travel routes and methods.

[1071] Output: Tables and chairs are moved into position

[1072] (Application example 1)

[1073] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1074] Current spatial layout management systems do not integrate environmental information collection, layout optimization, and autonomous movement, making it difficult to optimize layouts in real time. Furthermore, there are few ways to visually confirm optimized layout information, making it difficult for on-site staff to properly understand the layout. This results in situations where it is not possible to quickly respond to sudden congestion or environmental changes.

[1075] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1076] In this invention, the server includes a sensor means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal, thereby enabling real-time optimization of the spatial layout and providing visual information to on-site staff.

[1077] The "sensor means for acquiring environmental information" is a device for collecting data related to the environment, such as location information, congestion level, and volume.

[1078] The "artificial intelligence means for generating an optimal layout based on acquired environmental information" is an artificial intelligence system for analyzing environmental information acquired from the sensor means and calculating the most efficient spatial arrangement based on that information.

[1079] "A means of transportation that moves autonomously according to an optimal layout" is a device that automatically moves furniture such as tables and chairs based on the generated optimal layout.

[1080] "Means for displaying layout information using an application installed on a terminal" refers to a system for visually displaying optimal layout information to a user through an application installed on a terminal such as a smartphone or smart glasses.

[1081] "Location information" is information that indicates the specific coordinate data of a specific object or person in a space.

[1082] "Crowding level" is data that represents the degree of density of people and objects in a space.

[1083] "Volume" is data that measures the loudness of sound in a space.

[1084] An "artificial intelligence means" is a computer system that can analyze data based on knowledge and experience and propose optimal solutions.

[1085] An "autonomous vehicle" is a robot or device that has the ability to automatically move to a specified location.

[1086] "Layout information" is information that instructs the placement of objects in a space.

[1087] A specific system for implementing this invention comprises a sensor means for collecting environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a moving means for autonomously moving according to the optimal layout, and a means for displaying layout information using an application installed on a terminal.

[1088] System Configuration

[1089] Hardware Configuration

[1090] 1. Sensor means:

[1091] To obtain environmental information, various sensors (infrared cameras, microphones, distance sensors, etc.) are used to measure location, occupancy, and volume.

[1092] These sensors periodically collect environmental data and send it to a server.

[1093] 2. Transportation:

[1094] Robotic arms and autonomous mobile furniture are used to automatically move furniture such as tables and chairs.

[1095] The mobile means can be moved to a precise position using a control system such as the Robot Operating System (ROS).

[1096] 3. Terminal:

[1097] Portable devices such as smartphones and smart glasses have dedicated applications installed on them, allowing users to visually check optimal layout information.

[1098] Software Configuration

[1099] 1. Artificial Intelligence Means:

[1100] The artificial intelligence model uses a neural network model that analyzes environmental information using TensorFlow and PyTorch and generates the optimal layout.

[1101] The artificial intelligence receives regularly updated sensor information and suggests optimal layouts in real time.

[1102] 2. Application Method:

[1103] The application installed on the device displays layout information that is optimal for the user.

[1104] The application is implemented using mobile development frameworks such as Java or Swift.

[1105] Processing flow

[1106] 1. Environmental information collection:

[1107] The server periodically acquires environmental data such as location information, congestion level, and volume through sensor means.

[1108] 2. Layout optimization:

[1109] The acquired environmental information is transmitted to a server and analyzed by artificial intelligence means.

[1110] Artificial intelligence calculates the optimal table and chair placement based on the collected data.

[1111] 3. Autonomous Movement:

[1112] The moving means autonomously starts moving based on the optimal layout information provided by the server.

[1113] Each table and chair moves to a designated position to form the new layout.

[1114] 4. Display information:

[1115] The application installed on the terminal visually displays the layout information received from the server to the user.

[1116] Users can check the layout status through the application and manually make corrections if necessary.

[1117] Specific examples

[1118] For example, consider a scenario of a business meeting. Before the meeting begins, sensors acquire the location information of participants and send environmental information such as congestion level and volume to a server. The server passes this data to an artificial intelligence means, which calculates the optimal layout. The transportation means then receives instructions from the server and autonomously moves tables and chairs to their designated positions. An application on the device allows the meeting to proceed in a comfortable environment for all participants.

[1119] An example of a prompt might be:

[1120] "Generate the optimal seating arrangement for meeting participants so that they can communicate smoothly with all other participants. Participant location information: [20, 30, 40, 50]"

[1121] Also, in the case of application in a cafe,

[1122] "Improve table placement to ensure smooth customer flow within the cafe. Current location: [20, 10, 30, 25, 15]"

[1123] In this way, the system can optimize the spatial layout and provide visual information in real time.

[1124] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1125] Step 1:

[1126] The sensor means acquires environmental information. The input is location information, occupancy level, and volume within the environment, and the output is these data. Specifically, each sensor (infrared camera, microphone, distance sensor, etc.) collects data at predetermined intervals and sends it to the server. The sensors periodically update the data in real time at their locations.

[1127] Step 2:

[1128] The server receives environmental information acquired from the sensor means and provides it to the artificial intelligence means. The input is location information, congestion level, and volume data acquired from the sensor means, and the output is environmental data provided to the artificial intelligence means. Specifically, the server converts the data into a standard format and passes it to the artificial intelligence means.

[1129] Step 3:

[1130] The artificial intelligence means generates an optimal layout based on environmental information. The input is environmental data from the sensor means, and the output is optimal layout placement information. Specifically, the artificial intelligence means uses a generative AI model to analyze the data and calculate the optimal placement of tables and chairs. This calculation is performed using frameworks such as TensorFlow and PyTorch.

[1131] Step 4:

[1132] The server receives the optimal layout information generated by the artificial intelligence means and provides it to the moving means. The input is the layout arrangement information from the artificial intelligence means, and the output is specific movement instructions provided to the moving means. Specifically, the server converts the generated layout information into specific movement instructions for each piece of furniture and transmits them to the moving means.

[1133] Step 5:

[1134] The mobile device autonomously moves the furniture according to the optimal layout. The input is the movement instructions provided by the server, and the output is the physical environment with the new layout configured. Specifically, the robot arm or autonomous mobile furniture moves accurately to the specified position.

[1135] Step 6:

[1136] An application installed on the device displays optimal layout information to the user. The input is optimal layout information provided by the server, and the output is visual information displayed on the device's display. Specifically, the application is developed in Java or Swift, and the user can check the optimal layout in real time and make corrections as necessary.

[1137] Step 7:

[1138] The user operates the device to check the layout content and manually correct it if necessary. The input is the layout information displayed on the device and the user's operations, and the output is the final layout information. Specifically, the user performs operations such as tapping and swiping through the application to fine-tune the layout.

[1139] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1140] The present invention is a system that includes a sensor means for acquiring environmental information, an AI means for generating an optimal layout based on the acquired environmental information, a vehicle that moves autonomously according to the optimal layout, and an emotion engine that recognizes the user's emotions. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities. Specific operations and overall system processing are described below.

[1141] Collection of environmental information

[1142] The terminal is equipped with a sensor for acquiring information about the surrounding environment. The sensor acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the terminal's sensor acquires the movements and positions of people in a conference room, the degree of crowding, and the sound levels in the room through the sensor means, and collects this as data.

[1143] Layout Optimization

[1144] The server receives the environmental information sent from the devices and uses AI to generate the optimal layout. Specifically, the AI ​​calculates the placement of tables and chairs to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[1145] Autonomous movement

[1146] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and chairs to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and chairs automatically move to the specified positions, and a new layout is formed.

[1147] Emotion engine integration

[1148] The system incorporates an emotion engine to recognize the user's emotions. The emotion engine recognizes emotions by analyzing the user's facial expressions, voice, and movements. Integrating this with data acquired by sensors, the emotion engine analyzes the user's current emotional state. For example, if the user is feeling dissatisfied, the emotion engine provides that information as feedback to the AI ​​means to readjust the optimal layout.

[1149] Specific examples

[1150] For example, consider a business meeting scenario. As participants enter the conference room, sensors on their devices collect location and environmental information such as volume, and send it to a server. The server uses AI tools to calculate the optimal seating arrangement that allows all participants to see and hear easily. The devices then automatically move tables and chairs based on this arrangement.

[1151] During the meeting, the sensor sends the user's facial expressions and voice to the emotion engine, which recognizes that the user is feeling stressed. The emotion engine then provides this information to the AI, which then adjusts the layout again to make the user feel comfortable, for example by lowering the volume or providing more space for the seats.

[1152] In this way, by integrating an emotion engine, the present invention realizes space creation that takes into consideration not only the optimization of the physical environment but also emotional comfort, thereby maximizing user satisfaction and utilization efficiency.

[1153] Through the above steps, the system of the present invention can obtain environmental information in real time, recognize the user's emotions using an emotion engine, generate an optimal layout based on that, and move autonomously, thereby maximizing utilization efficiency and user experience.

[1154] The processing flow will be explained below.

[1155] Step 1:

[1156] The device initializes the sensors and acquires environmental information. The sensors measure people's locations, congestion levels, and sound volume in spaces such as conference rooms and event spaces, and collect this information as data.

[1157] Step 2:

[1158] The device sends the collected environmental information to a server, including information such as the current location of people, the level of congestion, and the volume of sound.

[1159] Step 3:

[1160] The server analyzes the environmental information received from the terminal and provides it to the AI ​​means, which then inputs the data into the AI ​​means in an appropriate format.

[1161] Step 4:

[1162] The server's AI generates the optimal layout based on the provided environmental information. The AI ​​calculates the placement of tables and chairs, taking into account people's flow, avoiding congestion, and optimally distributing sound levels. For example, it determines the seating arrangement that allows everyone in the conference room to communicate smoothly.

[1163] Step 5:

[1164] The server transmits the generated optimal layout information to the terminal, including the specific position coordinates to which each table and chair should be moved.

[1165] Step 6:

[1166] The terminal automatically moves the tables and chairs to their designated positions using the movement means based on the optimal layout. Specifically, it executes the instruction "move table 1 to coordinates (20, 30)."

[1167] Step 7:

[1168] The device collects sensor information again to check whether the new layout is appropriate. If there are any changes in the environment information, it sends it to the server again.

[1169] Step 8:

[1170] The server then analyzes the received environmental information and adjusts the layout again using AI as necessary, thereby realizing a system that can respond to dynamic environmental changes.

[1171] Step 9:

[1172] The emotion engine is initialized by the device and recognizes the user's emotions by analyzing their facial expressions, voice, and movements. This information is sent to the emotion engine through sensors.

[1173] Step 10:

[1174] The device transmits the recognized user emotion data to the server. For example, if the user is feeling unhappy, the information is conveyed to the server.

[1175] Step 11:

[1176] The server's AI means analyzes the emotional data provided by the emotion engine and readjusts the layout based on that data, for example by providing more spacious seating to allow users to relax.

[1177] Step 12:

[1178] The terminal receives the new optimum layout instruction from the server and moves the tables and chairs to their predetermined positions again.

[1179] Step 13:

[1180] The user reviews the new layout and manually makes small adjustments as needed, although most adjustments are automated, minimizing user intervention.

[1181] In this way, the system of the present invention can maximize utilization efficiency and user experience by acquiring environmental information and user emotional information in real time, generating an optimal layout based on that information, and moving autonomously.

[1182] Example 2

[1183] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1184] In conventional conference rooms and event spaces, it was difficult to obtain environmental information in real time and change the layout to reflect user emotions, making it impossible to maximize user satisfaction and utilization efficiency. Also, when physical layout changes were made manually, it was labor-intensive and time-consuming.

[1185] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a detection means for acquiring environmental information, an artificial intelligence means for generating an optimal layout based on the acquired environmental information, a movement means for autonomously operating according to the optimal layout, and an emotion analysis means for analyzing the user's emotions. This makes it possible to acquire environmental information in real time and generate and execute an optimal layout that reflects the user's emotions.

[1186] "Environmental information" refers to data about the surrounding physical conditions and situations, such as location information, crowding level, and volume.

[1187] The term "detection means" refers to a device including sensors and devices for acquiring environmental information.

[1188] "Artificial intelligence means" refers to algorithms or programs for generating optimal placement based on acquired environmental information.

[1189] A "mobility means" is a device that autonomously moves objects such as tables and seats according to optimal placement.

[1190] The "emotion analysis means" is a system for analyzing the user's facial expressions, voice, and movements to recognize the user's emotional state.

[1191] "Feedback" is the process by which the emotional analysis means provides the artificial intelligence means with the user's emotional state as recognized by the emotion analysis means, and the system then readjusts based on that information.

[1192] The present invention provides a system that includes a detection unit that acquires environmental information, an artificial intelligence unit that generates an optimal layout based on the acquired environmental information, a transportation unit that operates autonomously according to the optimal layout, and an emotion analysis unit that analyzes the emotions of a user. This system can be used in a variety of environments, such as business meeting spaces, event spaces, cafes, and educational facilities.

[1193] Collection of environmental information

[1194] The device is equipped with a detection means for acquiring information about the surrounding environment. The detection means acquires information about people's positions, congestion levels, and sound levels in a conference room, event space, etc. For example, the detection means of the device acquires information about people's movements, positions, and crowding levels in a conference room, as well as the sound levels in the room, through sensors, and collects this information as data.

[1195] Layout Optimization

[1196] The server receives the environmental information sent from the terminals and uses artificial intelligence to generate the optimal layout. Specifically, the artificial intelligence calculates the arrangement of tables and seats to optimize people's movement, avoid congestion, and distribute sound levels optimally. For example, it derives a seating arrangement in a conference room that allows everyone to communicate smoothly.

[1197] Autonomous movement

[1198] The terminal performs the actual movement based on the optimal layout sent from the server. It uses the movement means to automatically move the tables and seats to the specified positions. Specifically, the terminal receives an instruction such as "move table 1 to coordinates (20, 30)" and executes it. The tables and seats automatically move to the specified positions, and a new layout is formed.

[1199] Emotion engine integration

[1200] The system incorporates an emotion analysis means for recognizing the user's emotions. The emotion analysis means recognizes emotions by analyzing the user's facial expressions, voice, and movements. The emotion analysis means analyzes the user's current emotional state by integrating the data acquired by the detection means. For example, if the user is feeling dissatisfied, the emotion analysis means provides that information as feedback to the artificial intelligence means, which then readjusts the optimal layout.

[1201] Specific examples

[1202] Consider a business meeting scenario. When participants enter a conference room, the device's detection means collects environmental information, such as location information and volume, and sends it to a server. The server then uses artificial intelligence to calculate the optimal seating arrangement for all participants, ensuring easy visibility and hearing. The device then automatically moves the tables and seats based on this arrangement. During the meeting, the detection means transmits the user's facial expressions and voice to the emotion analysis means, which recognizes that the user is feeling stressed. The emotion analysis means provides this information to the artificial intelligence means, which then adjusts the layout to make the user feel comfortable. For example, it may lower the volume level or provide more space. In this way, by integrating emotion analysis means, the present invention not only optimizes the physical environment but also creates a space that takes emotional comfort into account. This maximizes user satisfaction and utilization efficiency.

[1203] Example prompt sentence:

[1204] Please explain the specific operation of a layout optimization system in a conference room. Please explain the series of processing steps, from collecting environmental information to layout optimization, autonomous movement, and emotion engine integration, along with the specific operations involved in each step.

[1205] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1206] Step 1:

[1207] The device acquires information about the surrounding environment using a detection means. The detection means acquires information about people's locations, the degree of crowding, and the volume of sound as input. This data is stored in temporary storage, and environmental information is obtained as output. Specifically, the device activates sensors installed throughout the room and constantly monitors the movements of people and objects.

[1208] Step 2:

[1209] The device sends the environmental information collected in step 1 to the server. As input, the acquired location information, congestion level, and volume data are sent from the device to the server. As output, the server receives the environmental information. Specifically, the device aggregates the collected data into a data packet and sends it to the server via the network.

[1210] Step 3:

[1211] The server analyzes the received environmental information. The environmental information sent from the device is used as input. The analyzed environmental information is obtained as output. The server uses a database and analytical algorithms to understand people's movements and congestion conditions based on the obtained data. Specifically, the server accesses the database and performs statistical analysis.

[1212] Step 4:

[1213] The server uses artificial intelligence to generate an optimal layout. The analyzed environmental information is input to the artificial intelligence. The optimal table and seating arrangement is obtained as output. Specifically, the artificial intelligence model executes a calculation algorithm to generate a layout pattern that takes into account people's movement, avoiding congestion, and sound distribution.

[1214] Step 5:

[1215] The server sends instructions for the generated optimal layout to the terminal. As input, the server sends data for the optimal layout to the terminal. As output, the terminal receives the new layout information. Specifically, the server converts the generated layout information into a data format and sends it to the terminal via the network.

[1216] Step 6:

[1217] The terminal performs actual movement based on the optimal layout sent from the server. The optimal layout instructions are received as input by the terminal. The output is that the tables and seats are placed in the specified positions. As a specific operation, the terminal operates the means of movement and executes instructions such as "move table 1 to coordinates (20, 30)."

[1218] Step 7:

[1219] The sensors capture the user's facial expressions, voice, and movements. As input, the sensors collect the user's facial and voice data. As output, the sensors obtain the user's emotional data. Specifically, the sensors run facial recognition and voice analysis algorithms to analyze the user's emotional state.

[1220] Step 8:

[1221] The terminal transmits emotional data obtained from the sensor to the emotional analysis means. As input, the terminal transmits data on the user's facial expressions and voice to the emotional analysis means. As output, the emotional analysis means provides the analysis results. As a specific operation, the terminal transmits the collected emotional data for feedback.

[1222] Step 9:

[1223] The emotion analysis means analyzes the user's emotional state and feeds back the results to the server. As input, the emotion analysis means takes in the transmitted user's emotional data. As output, the emotion analysis results are provided to the server. In concrete terms, the emotion analysis means detects the user's stress or dissatisfaction and transmits this information to the server.

[1224] Step 10:

[1225] The server readjusts the layout based on the results of the emotion analysis. The emotion analysis results are input to the artificial intelligence means. The readjusted optimal layout is obtained as the output. Specifically, the server generates a new layout that takes the user's emotions into consideration and sends instructions to the terminal again.

[1226] (Application example 2)

[1227] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1228] Conventional layout optimization systems based on environmental information have the problem of being unable to consider user emotions or real-time changes in traffic flow, making it difficult to improve user satisfaction. Furthermore, these systems can only perform static layout changes, making them unable to respond to dynamically changing situations.

[1229] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, transportation means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into the generation AI model using a prompt sentence. This makes it possible to dynamically generate an optimal layout while taking into account changes in the user's emotions and movement lines, thereby improving user satisfaction and efficiency.

[1230] The "sensor means" is a device for acquiring environmental information, specifically, a device that has the function of acquiring location information, congestion level, volume, and the like.

[1231] "AI means" is an artificial intelligence system that generates an optimal layout based on collected environmental information.

[1232] A "moving means" is a device that autonomously moves objects such as tables and chairs according to the generated optimal layout.

[1233] The "emotion engine means" is a device that can recognize the user's emotions and analyze those emotions.

[1234] "Generative AI Model" refers to an artificial intelligence model used to generate an optimal layout, which receives prompts and generates appropriate output.

[1235] A "prompt" is a textual instruction entered into a generative AI model, which specifically indicates the desired layout and operation.

[1236] A system for implementing this invention includes sensor means for acquiring environmental information, AI means for generating an optimal layout based on the acquired environmental information, movement means for autonomously moving according to the optimal layout, emotion engine means for recognizing the user's emotions, and means for inputting the optimal layout into a generative AI model using a prompt sentence.

[1237] Collection of environmental information

[1238] The server collects environmental information in real time using various sensors (location sensor, microphone, temperature sensor, etc.) installed on the terminal. Specifically, it collects information on the location of customers in the store, the level of congestion, volume, temperature, etc. This allows the current environmental conditions to be accumulated as data.

[1239] Layout optimization

[1240] The server inputs the collected environmental information into the AI ​​means to generate the optimal layout. This AI means is built using artificial intelligence libraries such as TensorFlow. The AI ​​means analyzes the collected location information, congestion level, volume, temperature, etc., and calculates the optimal table and chair placement. The optimal layout is the arrangement necessary for customers to have a comfortable time.

[1241] Autonomous movement

[1242] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to the specified position based on instructions from the server. In this way, the optimal layout is physically realized.

[1243] Emotion engine integration

[1244] The server analyzes the user's facial expressions, voice, and movements, and recognizes the user's emotions using an emotion engine. The emotion engine is built using emotion analysis libraries such as OpenCV and SentiStrength. If the user is dissatisfied, that information is fed back to the AI, which then generates the optimal layout again.

[1245] Prompt input with generative AI models

[1246] The server inputs prompts into the generative AI model to generate the optimal layout, which are generated based on the specified environmental conditions and the user's emotional state.

[1247] Specific examples

[1248] For example, in a cafe scenario, sensors detect available tables in real time during busy morning hours and suggest optimal layouts. A robot then moves the tables based on the new layout. If a customer feels uncomfortable, the emotion engine analyzes that information and the server relocates them to an available space, adjusts the lighting, and adjusts the volume.

[1249] Prompt Sentence Examples

[1250] "Please suggest the best table arrangement based on the busyness and customer sentiment of this cafe."

[1251] This will create a system that dynamically improves the customer experience in physical stores.

[1252] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1253] Step 1:

[1254] The terminal collects environmental information. It uses sensors to acquire information on the customer's location in the store, the level of congestion, the volume of sound, the temperature, etc. The acquired data is sent to the server in real time. The input is various data from the sensors, and the output is environmental data sent to the server.

[1255] Step 2:

[1256] The server receives the environmental information and passes the data to the AI ​​means. The AI ​​means generates the optimal layout based on the received environmental information. The input is the collected environmental data, and the output is the generated optimal layout. Specifically, it uses AI libraries such as TensorFlow to analyze location information and congestion levels and calculate the optimal placement of tables and chairs.

[1257] Step 3:

[1258] The server inputs the generated optimal layout into the generative AI model as a prompt. This prompt specifically reflects the specified environmental conditions and the user's emotional state. The input is the optimal layout and environmental data, and the output is the prompt. An example of a prompt is, "Please suggest the optimal table arrangement based on the occupancy level of this cafe and the emotions of customers."

[1259] Step 4:

[1260] The terminal autonomously moves tables and chairs based on the optimal layout sent from the server. The means of movement is a robot, which moves furniture to specified positions based on instructions from the server. In concrete terms, the robot receives instructions to move each piece of furniture and moves it to the target coordinates according to those instructions. The input is the optimal layout, and the output is the new layout with the furniture physically arranged.

[1261] Step 5:

[1262] The terminal also collects the user's emotions and sends them to the server. The emotion engine means analyzes the user's facial expressions, voice, and movements to recognize the user's emotional state. The recognized emotion data is fed back to the server. The input is the user's emotional data, and the output is analyzed emotion information. Specifically, the device uses a camera and microphone to capture the user's facial expressions and voice, and sends the analysis results to the server.

[1263] Step 6:

[1264] The server receives feedback from the emotion engine and re-executes the AI ​​method as necessary. This may result in readjusting the layout based on new environmental and emotional data. The input is feedback from the emotion engine and the latest environmental data, and the output is a regenerated optimal layout. Specifically, if the user is dissatisfied, the server re-examines the location information and congestion level to improve the layout.

[1265] This allows the entire system to work together to provide the optimal environment for maximizing user comfort and efficiency.

[1266] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1267] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1268] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1269] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1270] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1271] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1272] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1273] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1274] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1275] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1276] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1277] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1278] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1279] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1280] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1281] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1282] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1283] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1284] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1285] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1286] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1287] The following is further disclosed regarding the above embodiment.

[1288] (Claim 1)

[1289] a sensor means for acquiring environmental information;

[1290] An AI method to generate an optimal layout based on the acquired environmental information;

[1291] A means of transportation that moves autonomously according to the optimal layout;

[1292] A system including:

[1293] (Claim 2)

[1294] 2. The system of claim 1, wherein the sensor means acquires location information, crowding level, and volume.

[1295] (Claim 3)

[1296] The system according to claim 1, wherein the AI ​​means calculates the optimal arrangement of tables and chairs based on the acquired environmental information.

[1297] (Claim 4)

[1298] 10. The system of claim 1, wherein the moving means moves the tables and chairs to predetermined positions based on the generated optimal layout.

[1299] (Claim 5)

[1300] The system of claim 1, wherein the AI ​​means learns from past usage data to predict and improve future layouts.

[1301] (Claim 6)

[1302] 2. The system according to claim 1, wherein the means of transportation monitors the user's movement in real time and dynamically changes its location based on the monitoring.

[1303] "Example 1"

[1304] (Claim 1)

[1305] a sensor means for acquiring environmental information;

[1306] an artificial intelligence means for generating an optimal layout based on the acquired environmental information;

[1307] A means of transportation that moves autonomously according to the optimal layout;

[1308] A system including:

[1309] (Claim 2)

[1310] 2. The system of claim 1, wherein the sensor means acquires location information, crowding level, and volume.

[1311] (Claim 3)

[1312] 2. The system according to claim 1, wherein the artificial intelligence means calculates the optimal arrangement of tables and chairs based on the acquired environmental information.

[1313] (Claim 4)

[1314] 2. The system of claim 1, wherein the terminal periodically updates environmental information using sensors and transmits the information to the server.

[1315] (Claim 5)

[1316] The system of claim 1, wherein the server analyzes the received sensor data and passes prompt sentences to the generative AI model to calculate the optimal layout.

[1317] (Claim 6)

[1318] 2. The system according to claim 1, wherein a terminal receives instructions from a server and autonomously moves tables and chairs to predetermined positions.

[1319] (Claim 7)

[1320] 2. The system according to claim 1, wherein the environment information and layout information are transmitted and received between the server and the terminal using a secure communication protocol.

[1321] "Application Example 1"

[1322] (Claim 1)

[1323] a sensor means for acquiring environmental information;

[1324] an artificial intelligence means for generating an optimal layout based on the acquired environmental information;

[1325] A means of transportation that moves autonomously according to the optimal layout;

[1326] means for displaying layout information by an application installed on the terminal;

[1327] A system including:

[1328] (Claim 2)

[1329] 2. The system of claim 1, wherein the sensor means acquires location information, crowding level, and volume.

[1330] (Claim 3)

[1331] 2. The system of claim 1, wherein the artificial intelligence means calculates optimal table and seating arrangements based on the acquired environmental information.

[1332] (Claim 4)

[1333] 2. The system according to claim 1, wherein optimal layout information is displayed in an application on the terminal and instructions for autonomous movement are issued.

[1334] "Example 2: Combining Emotion Engines"

[1335] (Claim 1)

[1336] a detection means for acquiring environmental information;

[1337] an artificial intelligence means for generating an optimal placement based on the acquired environmental information;

[1338] a means of transportation that operates autonomously according to an optimal layout;

[1339] emotion analysis means for analyzing the emotions of a user;

[1340] A system including:

[1341] (Claim 2)

[1342] 2. The system according to claim 1, wherein the detection means acquires location information, congestion level, and volume.

[1343] (Claim 3)

[1344] 2. The system of claim 1, wherein the artificial intelligence means calculates optimal table and seating arrangements based on the acquired environmental information.

[1345] (Claim 4)

[1346] 2. The system according to claim 1, wherein the emotion analysis means analyzes the user's facial expressions, voice, and actions to recognize the user's emotional state, and provides the recognition result to the artificial intelligence means as feedback.

[1347] "Application example 2 when combining emotion engines"

[1348] (Claim 1)

[1349] a sensor means for acquiring environmental information;

[1350] An AI method to generate an optimal layout based on the acquired environmental information;

[1351] A means of transportation that moves autonomously according to the optimal layout;

[1352] emotion engine means for recognizing the emotion of a user;

[1353] A means to input the optimal layout into the generative AI model using prompt sentences;

[1354] A system including:

[1355] (Claim 2)

[1356] 2. The system of claim 1, wherein the sensor means acquires location information, crowding level, and volume.

[1357] (Claim 3)

[1358] The system according to claim 1, wherein the AI ​​means calculates the optimal arrangement of tables and chairs based on the acquired environmental information. [Explanation of symbols]

[1359] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a sensor means for acquiring environmental information; An AI method to generate an optimal layout based on the acquired environmental information; A means of transportation that moves autonomously according to the optimal layout; A system including:

2. 2. The system of claim 1, wherein the sensor means acquires location information, congestion level, and volume.

3. 2. The system according to claim 1, wherein the AI ​​means calculates the optimal arrangement of tables and chairs based on the acquired environmental information.

4. 2. The system of claim 1, wherein the moving means moves the tables and chairs to predetermined positions based on the generated optimal layout.

5. 10. The system of claim 1, wherein the AI ​​means learns from past usage data to predict and improve future layouts.

6. 2. The system according to claim 1, wherein the transportation means monitors the user's movement line in real time and dynamically changes its location based on the line.

Images