system

Abstract

Provide a system. The system includes: a means for collecting data on a user's lifestyle, health condition, movement patterns, and dietary habits; A means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user; means for transmitting instructions to a service device or system in accordance with the generated service plan; A means for drones to receive instructions and deliver meals to designated locations; A means for the self-driving vehicle to safely navigate the user to their destination; a means for the home medical system to perform a health check on the user and transmit the data to a remote doctor; A way for users to interact with digital family and robots in a virtual space, A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] As the aging of society progresses, issues such as an increase in the number of elderly people living alone and a lack of health management and lifestyle support are becoming apparent. Furthermore, in urban areas, people's lifestyles and needs are becoming more diverse, requiring individualized support. However, conventional systems make it difficult to provide personalized services that meet individual needs, making it difficult to alleviate the loneliness and inconvenience experienced by the elderly. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for collecting data on a user's daily rhythm, health status, travel patterns, and dietary habits, and a means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, thereby providing services tailored to individual needs. It also provides a means for sending instructions according to the generated service plan, and includes a system for delivering meals by drone, assisting users with their travels using self-driving cars, providing health checks using a home medical system, and interacting with digital family members and robots in a virtual space. This system can alleviate the sense of loneliness and inconvenience experienced by the elderly and provide them with the services they need in a timely manner.

[0006] "Life rhythm" refers to the pattern of activity and rest times in the user's daily life.

[0007] "Health Status" refers to data that indicates the current state of a user's physical and mental health.

[0008] "Travel patterns" refers to information such as the route, frequency, and destination of a user's daily travels.

[0009] "Diet" refers to information about the content and nutritional balance of the meals that a user normally takes.

[0010] "Means for collecting data" refers to devices and systems that measure and acquire necessary information from the user's daily life.

[0011] A "generative AI model" is an artificial intelligence that analyzes collected data and generates a service plan that is suitable for the user.

[0012] The "means for generating service plans" refers to a mechanism that utilizes generative AI models to create service schedules and content optimized to the user's needs.

[0013] The "means for sending instructions to a service device or system" refers to a method or apparatus for sending specific operating instructions to a corresponding device or system based on the generated service plan.

[0014] A "drone" is an unmanned aerial vehicle that flies remotely or autonomously and transports designated cargo.

[0015] An "autonomous vehicle" is a vehicle that drives autonomously and transports a user to a specific destination.

[0016] A "home medical system" refers to medical equipment and related services that allow users to conduct health checks in their own homes and remotely transmit the resulting data to a doctor.

[0017] A "virtual space" is a computer-generated three-dimensional environment in which users can interact with digital family members or robots.

[0018] "Digital family" refers to digital avatars or characters created to interact with users in a virtual space.

[0019] A "robot" is a mechanical device with artificial intelligence that exists in physical or virtual form and provides a specific function or service to a user. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0021] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0022] First, the terms used in the following description will be explained.

[0023] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0024] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0025] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0026] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0028] [First embodiment]

[0029] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0030] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0031] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0032] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0033] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0035] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0036] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0037] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0038] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0039] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0040] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0041] overview

[0042] This invention aims to build a smart city that improves users' quality of life by utilizing generative AI models and advanced technologies. Specifically, it collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes them using generative AI models, and provides optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, autonomous vehicle transportation support, home medical care, and virtual interaction between digital families and robots.

[0043] Data collection

[0044] 1. Users

[0045] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[0046] 2. Device (smartphone)

[0047] The transferred data is organized and periodically uploaded to the server.

[0048] Analyzing data and generating service plans

[0049] 3. Server

[0050] The collected data is analyzed using a generative AI model. For example, it analyzes health status and generates nutritionally balanced meal menus for food delivery.

[0051] Analyze user travel patterns and create schedules for self-driving vehicles.

[0052] Book home health care time slots when necessary.

[0053] Service Instruction and Execution

[0054] 4. Server

[0055] Based on the generated service plan, instructions are sent to the devices and systems responsible for carrying out each service, such as sending instructions to a drone to deliver a meal from a designated restaurant to the user's home, or to an autonomous vehicle to transport the user to their destination.

[0056] 5. Drones

[0057] Once instructed, the robot will head to the designated restaurant, pick up the meal, and deliver it to the user's home, where it will drop off the meal at a designated location (e.g., balcony).

[0058] 6. Self-driving cars

[0059] Once instructions are received, the vehicle will pick up the user at the specified time and place and safely drive to the pre-set destination.

[0060] Providing home medical care

[0061] 7. Server

[0062] If the user needs a health check or medical treatment, instructions are sent to the home medical system.

[0063] 8. Terminal (medical robot)

[0064] The system visits the user's home and performs necessary health checks, and the collected data is sent to the server in real time.

[0065] 9. Doctor

[0066] The remotely transmitted data is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[0067] Virtual interaction

[0068] 10. Users

[0069] Access the virtual space using a digital device (e.g., a smartphone or VR device).

[0070] 11. Server

[0071] We create an environment in a virtual space where users can interact with digital family members and support robots.

[0072] 12. Users

[0073] In the virtual space, people can interact and engage in collaborative activities with their digital family or robots, a process that reduces feelings of loneliness and provides psychological support.

[0074] Specific examples

[0075] Specific examples of meal delivery

[0076] When a user makes a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[0077] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[0078] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[0079] Examples of outpatient visits

[0080] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[0081] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[0082] In this way, the present invention aims to effectively provide support services adapted to an aging society and improve the quality of life of users.

[0083] The processing flow will be explained below.

[0084] Step 1:

[0085] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[0086] Step 2:

[0087] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[0088] Step 3:

[0089] The device (smartphone) organizes and saves the transferred data and periodically uploads it to the server.

[0090] Step 4:

[0091] The server aggregates the data received from users and provides it to the generative AI model, which analyzes their health status, lifestyle, travel patterns, diet, and other factors.

[0092] Step 5:

[0093] The server uses the generative AI model to generate a service plan optimized for each user, for example, determining a nutritionally balanced meal menu based on health data.

[0094] Step 6:

[0095] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[0096] Step 7:

[0097] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[0098] Step 8:

[0099] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, picks up the user, and drives safely to the destination (e.g., hospital).

[0100] Step 9:

[0101] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[0102] Step 10:

[0103] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[0104] Step 11:

[0105] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[0106] Step 12:

[0107] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[0108] Step 13:

[0109] Users access the virtual space using digital devices (smartphones or VR devices).

[0110] Step 14:

[0111] The server generates an environment for interaction with digital family and robots in a virtual space.

[0112] Step 15:

[0113] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[0114] Through this series of steps, smart cities will provide cutting-edge systems that support and improve the quality of users' lives.

[0115] Example 1

[0116] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0117] In modern society, with the aging population and diversifying lifestyles, there is a demand for providing optimal services to each individual user. However, existing systems lack the means to centrally collect and analyze data on users' daily rhythms, health conditions, and travel patterns, and to generate service plans tailored to individual needs. Furthermore, there is no system that can comprehensively manage meal delivery, transportation support, home medical care, and virtual space interactions, limiting the quality and efficiency of the services users can receive.

[0118] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0119] In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement patterns, and dietary habits, means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and means for sending instructions to service devices and systems in accordance with the generated service plan, thereby enabling the provision of optimal services tailored to the user's complex needs.

[0120] The "user's life rhythm" refers to the time periods and periodic activity patterns of the user's daily life, such as waking up, going to bed, eating, and exercising.

[0121] "Health status" refers to indicators of a user's physical and mental health, including, for example, heart rate, blood pressure, sleep quality, and stress level.

[0122] "Travel patterns" refers to data such as a user's daily travel routes and frequency, and the history of places visited.

[0123] "Dietary data" refers to information related to the types of food and nutrients a user consumes, as well as meal times and frequency.

[0124] A "generative AI model" refers to an algorithm or system that learns from large amounts of data and performs natural language generation and data analysis like a human.

[0125] "Generated service plan" refers to a specific plan of services to be provided according to the user's needs and condition based on the analysis results of the generating AI model.

[0126] "Service equipment and systems" refers to equipment and systems for performing specific services such as food delivery, autonomous driving, health checks, and virtual interactions.

[0127] "Unmanned aerial vehicle" refers to an aircraft that can fly remotely or autonomously and transport or deliver goods.

[0128] An "autonomous vehicle" refers to a vehicle that can drive autonomously using artificial intelligence and sensor technology.

[0129] A "home medical system" refers to equipment and software used to conduct health checks and medical treatment in a user's home.

[0130] "Virtual space" refers to a computer-generated digital environment that allows users to interact with digital family members and robots.

[0131] "Digital family" refers to digital characters created to interact with users in a virtual space.

[0132] A "wearable device" refers to a small electronic device that can be worn and used by a user on a daily basis.

[0133] MODE FOR CARRYING OUT THE INVENTION

[0134] overview

[0135] This invention relates to a system for building smart cities that utilizes generative AI models and advanced technologies to improve users' quality of life. The system collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes the data using generative AI models, and provides optimal service plans for users. The system also manages a series of integrated services, including food delivery by unmanned aerial vehicles, transportation support by autonomous vehicles, home medical care, and interaction between digital families and robots in a virtual space.

[0136] Data collection

[0137] 1. Users

[0138] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time and transfer it to their smartphones.

[0139] For example, if you wake up at 6am, the smartwatch will automatically record your heart rate and sleep time, and this data will be transferred to your smartphone via Bluetooth.

[0140] Organizing and sending data

[0141] 2. Device (smartphone)

[0142] The device organizes the received data using a dedicated application (e.g., a health care app) and uploads it to a server periodically (e.g., every hour).

[0143] Data is transmitted over Wi-Fi or mobile networks and is encrypted to protect privacy.

[0144] Analyzing data and generating service plans

[0145] 3. Server

[0146] The server receives the collected data in real time and analyzes it using a generative AI model (e.g., GPT-4 (registered trademark)). For example, it evaluates the user's health status and customizes an appropriate meal menu.

[0147] The server analyzes the user's travel patterns and creates a schedule for the self-driving car. For example, it understands that the user travels to a specific location at a certain time each week and sets the schedule for the self-driving car accordingly.

[0148] Prescribing and executing service plans

[0149] 4. Server

[0150] The server transmits instructions to an execution device, such as an unmanned aerial vehicle or an autonomous vehicle, based on the generated service plan.

[0151] Specifically, the drone will be instructed to retrieve a specific meal from a specified restaurant and deliver it to the user's home, while the self-driving car will be instructed to pick up the user from their home at 9:00 and arrive at their destination by 10:00.

[0152] 5. Unmanned aerial vehicle

[0153] When the drone receives instructions from the server, it flies to the specified restaurant and picks up the meal. For example, it delivers a high-protein, low-fat meal to a user who has requested dinner.

[0154] 6. Self-driving cars

[0155] The self-driving car will pick up the user at the designated time and drive safely to the destination, using LIDAR sensors and cameras to understand the surrounding situation.

[0156] Providing home medical care

[0157] 7. Server

[0158] The server sends necessary instructions to the home medical system according to the user's health condition. For example, if a user shows symptoms of high blood pressure, the home medical robot will measure their blood pressure.

[0159] 8. Terminal (medical robot)

[0160] The medical robot performs the prescribed health checks and transmits the acquired data to a server in real time.

[0161] 9. Doctor

[0162] The data sent remotely is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[0163] Virtual interaction

[0164] 10. Users

[0165] Users access the virtual space using digital devices (e.g., smartphones or VR devices) and interact with their digital family and support robots.

[0166] 11. Server

[0167] It creates a virtual space and provides an environment where users can interact with their digital family and support robots. For example, it sets up a birthday party in the user's virtual space and generates a scene in which the digital family hands out presents.

[0168] Specific examples

[0169] Specific examples of meal delivery

[0170] When a user inputs a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[0171] The server sends instructions to the drone to "get food from the specified restaurant and deliver it to the user's balcony."

[0172] The drone will pick up the meal and deliver it to your balcony.

[0173] Specific examples of outpatient visits

[0174] When a user enters a medical appointment into a smartphone application, the server creates and transmits a driving plan for the self-driving car.

[0175] The self-driving car will arrive at the user's home at the specified time and drive safely with the user on board.

[0176] Prompt Sentence Examples

[0177] "When a user makes a dinner request, explain how the server selects the appropriate menu item and how the drone delivers the meal."

[0178] In this way, the system aims to provide a variety of support services suited to an aging society and to improve the overall quality of life of users.

[0179] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0180] Step 1:

[0181] Users use a smartwatch or biometric measurement device to measure data and transfer it to their smartphone.

[0182] Input: Smartwatch data such as heart rate, walking distance, and sleep time

[0183] Data processing: The information measured by the smartwatch is transferred to the smartphone via Bluetooth.

[0184] Output: Biometric data transferred to a smartphone

[0185] How it works: When you wake up at 6am, your heart rate and sleep time will be automatically measured by the smartwatch, and this data will be transferred to your smartphone via Bluetooth.

[0186] Step 2:

[0187] The device (smartphone) organizes the received data and periodically uploads it to the server.

[0188] Input: Biometric data transferred from the smartwatch

[0189] Data processing: Organize and encrypt data using dedicated applications (e.g., health apps)

[0190] Output: Upload the organized data to the server

[0191] What it does: The Health app organizes your data and uploads it to a server every hour over Wi-Fi or your mobile network.

[0192] Step 3:

[0193] The server analyzes the collected data using a generative AI model and generates a service plan.

[0194] Input: Biometric data uploaded to the server

[0195] Data processing: Using generative AI models (e.g., GPT-4) to analyze data and assess health status and mobility patterns

[0196] Output: Optimal service plan based on analysis results

[0197] How it works: The server uses a generative AI model to assess the user's health and determine that they need a high-protein, low-fat menu. It then creates a personalized meal plan.

[0198] Step 4:

[0199] The server transmits instructions to each service device based on the generated service plan.

[0200] Input: Generated service plan

[0201] Data processing: Generate specific instructions, such as food delivery instructions or scheduling an autonomous vehicle

[0202] Output: Instructions sent to unmanned aerial vehicles and autonomous vehicles

[0203] Specific operation: The server sends instructions to the unmanned aerial vehicle to retrieve a specific meal from a specified restaurant and deliver it to the user's home. It also sends instructions to the self-driving car to pick up the user from their home at 9:00 and arrive at their destination at 10:00.

[0204] Step 5:

[0205] The drones will then receive instructions and deliver the meals to designated locations.

[0206] Input: Meal delivery instructions from the server

[0207] Data processing: Use GPS to fly to a designated restaurant and pick up your meal

[0208] Output: Meal delivered to the user's home

[0209] Specific operation: The drone will fly to the designated restaurant, pick up the meal, and deliver it to the user's balcony. After delivery, it will return to the user's home using the coordinates.

[0210] Step 6:

[0211] The self-driving car will pick up the user at a designated time and place and drive them to their destination.

[0212] Input: Operation instructions from the server

[0213] Data processing: Calculate routes using LIDAR sensors and cameras to operate safely

[0214] Output: User arrives at destination

[0215] Specific operation: The self-driving car arrives in front of the user's home at the specified time, safely picks up the user, and drives them to their destination.

[0216] Step 7:

[0217] The server instructs the home medical system to check the user's health.

[0218] Input: User's health data and health check instructions

[0219] Data processing: Evaluate the user's health status and generate instructions for necessary health checks

[0220] Output: Health check instructions sent to medical robot

[0221] Specific operation: For a user showing symptoms of high blood pressure, the server instructs the medical robot to "measure blood pressure and send the data to the server."

[0222] Step 8:

[0223] The terminal (medical robot) performs a health check and sends the acquired data to the server.

[0224] Input: Health check instructions from the server

[0225] Data processing: Measure the user's health data, encrypt it, and send it to the server

[0226] Output: Health data sent to the server

[0227] Specific operation: The medical robot measures the user's blood pressure and transmits the data to a server in real time.

[0228] Step 9:

[0229] The doctor analyzes the transmitted data and sends treatment instructions back to the medical robot.

[0230] Input: Health data sent from the server

[0231] Data processing: Analyze data and create necessary medical instructions

[0232] Output: Treatment instructions sent back to the medical robot

[0233] Specific operation: The doctor remotely checks the data and sends instructions to the medical robot, such as "Administer medication because the patient's blood pressure is high." The robot then administers the medication based on the instructions.

[0234] Step 10:

[0235] Users access the virtual space using digital devices and interact with their digital family and support robots.

[0236] Input: Access request from a digital terminal

[0237] Data processing: Connection to virtual space, user authentication, interaction simulation

[0238] Output: Interactive experience in virtual space

[0239] Specific operation: Users use smartphones or VR devices to access a virtual space, where they can interact with their digital family and collaborate with a support robot.

[0240] Step 11:

[0241] The server generates an environment in which users can interact with their digital family and support robots in a virtual space.

[0242] Input: User's request in the virtual space

[0243] Data processing: Virtual space generation, digital character creation, script execution

[0244] Output: A user-accessible virtual space

[0245] Specific operation: The server generates a virtual space, for example, setting up a virtual birthday party for the user and creating a scene in which the digital family hands over presents.

[0246] Step 12:

[0247] Users can enjoy interacting and collaborating with their digital family and robots in a virtual space.

[0248] Input: Interacting with digital characters in a virtual space

[0249] Output: Psychological support and entertainment experiences

[0250] Specific actions: Users can interact with their digital family in a virtual space, reducing feelings of loneliness. They can also collaborate with a support robot and receive functional support while having fun.

[0251] (Application example 1)

[0252] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0253] In an aging society, there is a demand for detailed support tailored to individual health conditions and lifestyle patterns, but existing systems have difficulty providing this automatically. Another issue is the lack of a system that can collect users' health data in real time and respond immediately in emergencies. Furthermore, there is a lack of a means to notify users of generated health reports in a timely manner. Therefore, a comprehensive system is needed to improve users' quality of life.

[0254] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0255] In this invention, the server includes: means for collecting data on a user's daily rhythm, health status, travel patterns, and dietary habits; means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user; means for transmitting instructions to service devices and systems according to the generated service plan; means for an unmanned aerial vehicle receiving the instructions to deliver meals to a specified location; means for an autonomous vehicle receiving the instructions to safely drive the user to the destination; means for a home medical system to conduct health checks on the user and transmit the data to a remote doctor; means for the user to interact with a digital family or robot in a virtual space; means for collecting the user's health data in real time and communicating with a doctor via a medical robot in an emergency; and means for notifying the user of the generated health report. This enables daily monitoring of the user's health status and prompt and appropriate medical treatment when necessary. It also provides comprehensive support that contributes to improving the user's quality of life.

[0256] "User's daily rhythm" refers to the activity patterns and time management in the user's daily life.

[0257] "Health Status" refers to the overall state of a user's physical and mental health.

[0258] "Travel patterns" refer to a user's usual travel routes, choice of transportation means, travel time, etc.

[0259] "Diet" refers to the types and amounts of food a user consumes on a daily basis, the time of intake, and nutritional balance.

[0260] "Means for collecting data" refers to devices and systems for measuring and recording various activities and health conditions of users.

[0261] A "generative AI model" refers to algorithms or software that uses artificial intelligence to analyze data and generate patterns or optimized results.

[0262] "Means for analyzing and generating optimal service plans for users" refers to systems and algorithms that use collected data to design and propose services that best suit the user's needs.

[0263] The "means for transmitting instructions" refers to a communication system for transmitting operation commands to various terminals and devices based on the generated service plan.

[0264] "Unmanned aerial vehicle" refers to a drone or other flying device designed to fly autonomously and carry goods.

[0265] An "autonomous vehicle" refers to a vehicle that drives itself without human input.

[0266] "Home medical system" refers to a system or device for providing medical services in a user's home.

[0267] "Means for performing health checks and transmitting data to a remote doctor" refers to a system or device for monitoring a user's health status and transmitting that data to a doctor remotely.

[0268] "Virtual space" refers to a digital space constructed using computer technology that can be experienced in a way that is close to reality.

[0269] "Digital family" refers to digitized family avatars or characters that can interact with users in a virtual space.

[0270] A "robot" refers to a mechanical device that autonomously performs programmed actions.

[0271] "Means for notifying users of health reports" refers to systems and methods for communicating analysis results and recommendations to users.

[0272] The present invention relates to a system for providing various services based on a user's health condition and lifestyle patterns. Specific embodiments for carrying out the present invention will be described below.

[0273] System Overview

[0274] Data collection

[0275] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. This data is then transferred to the user's smartphone, which then organizes the data and periodically uploads it to a server.

[0276] Data analysis and service plan generation

[0277] The server receives the uploaded data and analyzes it using generative AI models, for example, analyzing health conditions and generating nutritionally balanced meal plans for food delivery, analyzing the user's travel patterns and creating schedules for autonomous vehicles, and even reserving time slots for home medical care if necessary.

[0278] Service Instruction and Execution

[0279] Based on the generated service plan, the server sends instructions to the devices and systems responsible for executing each service. For example, an unmanned aerial vehicle delivers meals to a specified location, an autonomous vehicle drives a user to their destination, or a home medical system checks the user's health and transmits the acquired data to the server in real time.

[0280] Hardware and software used

[0281] Hardware

[0282] Smartwatches: (e.g., smartwatches, fitness tracking devices)

[0283] Smartphones: (e.g. iOS devices, ANDROID (registered trademark) devices)

[0284] Unmanned aerial vehicles: (e.g., delivery drones)

[0285] Autonomous vehicles: (e.g., self-driving cars, robotaxis)

[0286] Medical robots: (e.g., home medical support robots)

[0287] software

[0288] Generative AI models: (e.g., machine learning models using the scikit-learn library)

[0289] Data transfer API: (e.g. RESTful API)

[0290] Data analysis software: (e.g., Python program)

[0291] Specific use cases

[0292] Health data analysis and reporting

[0293] The server provides appropriate health advice and reports to users based on the collected health data. For example, if the user's heart rate is abnormally high, the server immediately notifies the medical robot and performs a health check on the user.

[0294] Specific prompt examples:

[0295] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[0296] In this way, the present invention enables daily monitoring of the user's health condition, enabling prompt and appropriate medical treatment when necessary, and providing comprehensive support that contributes to improving the user's quality of life.

[0297] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0298] Step 1:

[0299] Data collection

[0300] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. The data is then transferred to a smartphone and collected as input data. The smartphone then organizes the data and periodically uploads it to a server.

[0301] Step 2:

[0302] Data reception

[0303] The server receives data uploaded from the smartphone. This input data includes heart rate, walking distance, sleep duration, etc. The server stores this data in a database and prepares it for analysis.

[0304] Step 3:

[0305] Data analysis

[0306] The server analyzes the received data using a generative AI model. The generative AI model is implemented using the scikit-learn library and analyzes health status and lifestyle patterns based on the input data. For example, it analyzes the user's heart rate and sleep data to evaluate their health status. The output of this analysis process is a health check result and recommended lifestyle improvements.

[0307] Step 4:

[0308] Service plan generation

[0309] The server generates an optimal service plan for the user based on the analysis results, including a nutritionally balanced meal menu, an appropriate exercise plan, and an autonomous vehicle schedule. The generated plan is output as instructions for the next step.

[0310] Step 5:

[0311] Send instructions

[0312] Based on the generated service plan, the server sends instructions to service devices and systems, such as unmanned aerial vehicles, autonomous vehicles, and home healthcare systems. The instructions detail how each device should operate. For example, an unmanned aerial vehicle might receive instructions to deliver meals to a specified location, and an autonomous vehicle might receive instructions to drive a user to their destination.

[0313] Step 6:

[0314] Execution of instructions

[0315] Each device receives instructions from the server and performs a specific operation. For example, an unmanned aerial vehicle will head to a designated restaurant, pick up a meal, and deliver it to the user's home. An autonomous vehicle will pick up the user at the designated place and time and drive them safely to their destination.

[0316] Step 7:

[0317] Providing home medical care

[0318] The home medical system performs health checks on users based on instructions from a server. The acquired health data is sent to the server in real time and analyzed by a doctor in a remote location. The medical robot follows instructions from the server and takes appropriate action according to the user's health condition.

[0319] Step 8:

[0320] Health report generation and notification

[0321] The server periodically generates a health report based on the collected data and analysis results. This report includes the user's past health data, current condition, and future recommendations. The report is sent to the user's smartphone, allowing the user to understand their own health status.

[0322] Specific prompt examples:

[0323] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[0324] In this way, each step works in cooperation with the others, making it possible to monitor the user's health condition and provide optimal services.

[0325] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0326] overview

[0327] This invention aims to build a smart city that improves users' quality of life by utilizing advanced technologies such as generative AI models and emotion engines. Specifically, it collects data on users' daily rhythms, health conditions, travel patterns, and dietary habits, as well as emotional data, and analyzes it using generative AI models to provide optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, transportation support using self-driving cars, home medical care, and virtual interactions between digital families and robots.

[0328] Data collection

[0329] 1. Users

[0330] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[0331] Using a device equipped with an emotion engine, emotional data such as facial expressions, tone of voice, and gestures are measured.

[0332] 2. Device (smartphone)

[0333] The transferred biometric information and emotional data are organized and periodically uploaded to a server.

[0334] Analyzing data and generating service plans

[0335] 3. Server

[0336] The collected biometric and emotional data is analyzed using a generative AI model, which, for example, generates a nutritionally balanced meal menu taking into account the patient's health and emotional state.

[0337] Adjust the schedule of self-driving cars based on user travel patterns and emotional data.

[0338] Book home health care time slots when necessary.

[0339] Service Instruction and Execution

[0340] 4. Server

[0341] Based on the generated service plan, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[0342] 5. Drones

[0343] Once instructed, the robot will head to the designated restaurant to pick up the meal, and then deliver it to the user's designated location (such as a balcony).

[0344] 6. Self-driving cars

[0345] Once instructions are received, the vehicle will arrive at the user's home at the specified time and travel safely to the pre-set destination.

[0346] Providing home medical care

[0347] 7. Server

[0348] If it determines that the user's health needs to be checked, it sends instructions to the home medical system.

[0349] 8. Terminal (medical robot)

[0350] Upon receiving instructions, it visits the user's home, conducts a health check, and sends the results to the server in real time.

[0351] 9. Doctor

[0352] The data transmitted remotely is analyzed and medical instructions are sent to the robot.

[0353] Virtual interaction

[0354] 10. Users

[0355] Access the virtual space using a digital device (smartphone or VR device).

[0356] 11. Server

[0357] We create an environment in which people can interact with digital family and robots in a virtual space.

[0358] 12. Users

[0359] Interacting with digital family and robots in a virtual space reduces feelings of loneliness.

[0360] Support by Emotion Engine

[0361] 13. Terminal (device with emotion engine)

[0362] It recognizes emotions based on data such as the user's facial expressions, tone of voice, and gestures.

[0363] 14. Server

[0364] Emotion data collected from the emotion engine is analyzed to understand the user's current emotional state.

[0365] 15. Server

[0366] The system generates a service plan that takes into account the user's emotional state. If the emotional state is stressful, it will provide relaxing music services and support in a virtual space.

[0367] Specific examples

[0368] A concrete example of emotion-based food delivery

[0369] When a user makes a dinner request, the server selects an appropriate menu based on the user's health and emotional data.

[0370] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[0371] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[0372] Examples of emotionally driven visits

[0373] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[0374] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[0375] Emotion-based support in virtual space

[0376] If the emotion engine detects that the user is feeling stressed, the server generates a relaxing environment in the virtual space and guides the user on how to access it.

[0377] Users can interact with digital family and robots in a virtual space and receive support to reduce stress.

[0378] In this way, the present invention provides an advanced life support system that also takes emotion data into consideration, thereby further improving the quality of life of users.

[0379] The processing flow will be explained below.

[0380] Step 1:

[0381] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[0382] Step 2:

[0383] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[0384] Step 3:

[0385] The device (smartphone) organizes and stores the transferred biometric information and periodically uploads it to the server.

[0386] Step 4:

[0387] The terminal (device equipped with an emotion engine) measures the user's facial expressions, tone of voice, and gestures in real time, generates emotion data, and transfers it to the terminal (smartphone).

[0388] Step 5:

[0389] The device (smartphone) organizes the transferred emotional data and uploads it to the server along with the biometric information.

[0390] Step 6:

[0391] The server collects the received biometric and emotional data and provides it to the generative AI model, which analyzes the user's health, daily rhythm, movement patterns, emotional state, and other factors.

[0392] Step 7:

[0393] The server uses the generative AI model to generate an optimized service plan for each user, for example, determining a nutritionally balanced meal menu based on health and emotional data.

[0394] Step 8:

[0395] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[0396] Step 9:

[0397] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[0398] Step 10:

[0399] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, and drives safely to the pre-set destination.

[0400] Step 11:

[0401] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[0402] Step 12:

[0403] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[0404] Step 13:

[0405] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[0406] Step 14:

[0407] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[0408] Step 15:

[0409] Users access the virtual space using digital devices (smartphones or VR devices).

[0410] Step 16:

[0411] The server generates an environment in a virtual space where people can interact with digital family members and robots.

[0412] Step 17:

[0413] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[0414] Step 18:

[0415] The terminal (device equipped with an emotion engine) again measures the user's facial expressions, tone of voice, and gestures, and updates the emotion data.

[0416] Step 19:

[0417] The server analyzes the updated emotional data and adjusts and optimizes the service plan in real time as needed. If the emotional state is stressful, it provides relaxing music services and support in a virtual space.

[0418] Through this series of steps, a high-dimensional life support system that also takes emotional data into account will improve the quality of the user's life.

[0419] Example 2

[0420] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0421] In modern society, the aging of society and the diversification of lifestyles are driving demand for advanced systems that comprehensively support people's daily rhythms, health conditions, travel patterns, dietary habits, and other aspects of their lives. It is also necessary to provide services that take emotional information into account, but current technology has not yet fully realized this. The present invention aims to solve these problems and improve the quality of life of users.

[0422] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement pattern, and dietary habits, means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user, means for sending instructions to a service device or system according to the generated service plan, means for recognizing emotions and analyzing the emotion data to grasp the user's emotional state, and means for generating optimal relaxation services and support based on the emotional state. This makes it possible to comprehensively support a wide range of needs of users and improve their quality of life.

[0423] "User" refers to a person who uses the system.

[0424] "Life rhythm" refers to data that indicates a user's daily activities and sleep cycles.

[0425] "Health status" refers to data including biometric information such as the user's heart rate, blood pressure, body temperature, and sleep duration.

[0426] "Travel patterns" refers to data indicating a user's regular travel routes and frequency.

[0427] "Diet" refers to data regarding the types of food a user consumes and their nutritional balance.

[0428] "Means of collecting data" refers to devices and software that collect information on users' lifestyles, health conditions, travel patterns, and dietary habits.

[0429] "Generative AI model" refers to an artificial intelligence model that analyzes collected data and generates service plans and proposals suitable for users.

[0430] "Means for analysis" refers to the equipment and software used to analyze the collected data.

[0431] A "service plan" refers to a method of providing optimal support and services based on a user's lifestyle, health condition, travel patterns, diet, emotional state, etc.

[0432] The term "service device or system" refers to a device or system that provides a service to a user based on a generated service plan.

[0433] "Unmanned aerial vehicle" refers to a small aircraft operated by remote control or autonomous pilot for the purpose of delivering goods.

[0434] An "autonomous vehicle" refers to a vehicle that automatically drives a user to their destination.

[0435] A "home medical care system" refers to a system that remotely checks the user's health status and provides necessary medical treatment and advice.

[0436] "Virtual space" refers to a digital environment generated by computer simulation.

[0437] "Digital persona" refers to a computer-generated character that interacts with the user in a virtual space.

[0438] "Automated machine" refers to a robot or other mechanical device that interacts with the user in a virtual space.

[0439] "Means for recognizing emotions" refers to devices or software that sense and recognize a user's emotional state from facial expressions, tone of voice, gestures, etc.

[0440] "Emotional state" refers to the user's emotional and feeling state at any given time.

[0441] "Relaxation services" refer to services such as music and virtual environments that help users reduce stress and relax.

[0442] "Assistance" refers to comprehensive support to improve the user's quality of life.

[0443] MODE FOR CARRYING OUT THE INVENTION

[0444] This invention is a smart system that collects data on a user's daily rhythm, health status, travel patterns, and dietary habits, analyzes the data using a generative AI model, and generates an optimal service plan for the user, thereby improving their quality of life. Specific embodiments of this system are described below.

[0445] Data collection hardware and software

[0446] 1. User data collection

[0447] Hardware: Users use smartwatches and other biometric devices that measure data such as heart rate, walking distance, and sleep duration in real time.

[0448] Software: A dedicated application is installed on the smartwatch, and the measured data is transferred to a smartphone via Bluetooth. The smartphone also has an application installed to organize and store the data and transfer it to a server.

[0449] 2. Collecting Emotional Data

[0450] Hardware: Devices equipped with emotion engines (e.g., emotion-recognizing cameras and microphones) are used. These devices capture data such as the user's facial expressions, tone of voice, and gestures.

[0451] Software: The emotion engine analyzes the data in real time and transmits the emotion data to the smartphone, which organizes it and uploads it to the server.

[0452] Data analysis and service plan generation

[0453] 3. Server Roles

[0454] Hardware: The server has high-performance computing resources and large memory and storage capacity for data management and analysis.

[0455] Software: A generative AI model is installed on the server, which performs analysis based on the collected data.

[0456] 4. Analysis using generative AI models

[0457] The server uses a generative AI model to analyze data collected from users, such as their daily rhythms, health status, and emotional state. This analysis generates an optimal service plan that takes into account the user's health and emotional state.

[0458] Provision of services

[0459] 5. Sending specific service instructions

[0460] Based on the generated service plan, the server sends instructions to various service devices and systems, including unmanned aerial vehicles, autonomous vehicles, and home medical systems.

[0461] 6. Drone meal delivery

[0462] Example: A user requests dinner, and the server sends instructions to an unmanned aerial vehicle to deliver the meal from a specified restaurant to the user's home. The unmanned aerial vehicle picks up the meal and delivers it to the user's balcony.

[0463] 7. Transportation support using autonomous vehicles

[0464] Example: When a user enters a doctor's appointment, the server creates and sends a driving plan for an autonomous vehicle, which arrives at the user's home at the specified time and drives the user safely to their destination.

[0465] 8. Health checks through home medical care systems

[0466] Example: If the server determines that a user needs a health check, it sends instructions to a home medical system, and a medical robot visits the user's home to conduct a health check. The results of the check are sent to the server in real time, and a doctor analyzes them remotely.

[0467] Interaction in virtual space and support using emotion engine

[0468] 9. Interacting with digital people and automata in virtual spaces

[0469] Example: A user interacts with digital people or automata in a virtual space to reduce feelings of loneliness. A server generates digital people or automata in a virtual space and makes them accessible to the user.

[0470] 10. Emotional state analysis and relaxation services

[0471] Example: The server analyzes the emotion data collected by the emotion engine to understand the user's current emotional state. For example, if the user is feeling stressed, it can provide a relaxing music service or a relaxing environment in a virtual space.

[0472] Examples of prompt statements

[0473] "Please give me some healthy eating suggestions for this week."

[0474] "I'm feeling stressed so please recommend some relaxing music."

[0475] Please adjust your hospital visit schedule for next week.

[0476] As described above, the present invention is a system that utilizes advanced technology to provide total support for the user's life and improve the quality of life.

[0477] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0478] Step 1: User puts on the smartwatch

[0479] Input: User wearing a smartwatch

[0480] Specific operation: The user wears a smartwatch and biometric information such as heart rate, walking distance, and sleep time is measured in real time.

[0481] Output: Measured biometric data

[0482] Step 2: Transfer data from your smartwatch to your phone

[0483] Input: Biometric data measured by a smartwatch

[0484] How it works: The smartwatch transmits measurement data via Bluetooth to a smartphone, which temporarily stores and organizes this data.

[0485] Output: Biometric data stored on the smartphone

[0486] Step 3: Emotion data measurement using the emotion engine

[0487] Input: User facial expressions, tone of voice, gestures, etc.

[0488] How it works: The user uses a device equipped with the emotion engine to measure emotion data, which is then analyzed in real time.

[0489] Output: Measured emotion data

[0490] Step 4: Transferring emotional data to your smartphone

[0491] Input: Emotion data from the emotion engine

[0492] How it works: The emotion engine transfers the measured emotion data to the smartphone, which then organizes and stores it.

[0493] Output: Organized emotional data is stored on the smartphone.

[0494] Step 5: Upload data regularly

[0495] Input: Biometric and emotional data stored on a smartphone

[0496] How it works: Your smartphone periodically uploads this data to a server via Wi-Fi or mobile data.

[0497] Output: Biometric and emotional data uploaded to the server

[0498] Step 6: Receiving and storing data

[0499] Input: Data uploaded from your smartphone

[0500] Specific operation: The server receives biometric and emotional data sent from the smartphone and stores the received data in a database.

[0501] Output: Data stored in the server database

[0502] Step 7: Analyze the data with a generative AI model

[0503] Input: Stored biometric and emotional data

[0504] Specific operation: The server analyzes the stored data using a generative AI model. As a result of the analysis, it understands the user's health and emotional state and generates an appropriate service plan.

[0505] Output: Generated service plan

[0506] Step 8: Send instructions for the generated service plan to each device

[0507] Input: Generated service plan

[0508] Specific operations: Based on the generated service plan, the server sends specific instructions to each device or system, such as an unmanned aerial vehicle, an autonomous vehicle, or a home medical system.

[0509] Output: Specific instructions sent to each device or system

[0510] Step 9: Meal pickup and delivery by drone

[0511] Input: Food delivery instructions from the server

[0512] Specific operation: The unmanned aerial vehicle receives instructions from the server, heads to the specified restaurant, picks up the meal, and then delivers the meal to the user's designated location (such as a balcony).

[0513] Output: Meal delivered to user-specified location

[0514] Step 10: Mobility support with autonomous vehicles

[0515] Input: Movement plan instructions from the server

[0516] Specific operation: The autonomous vehicle receives instructions from the server and arrives at the user's home at the specified time. It then safely drives the user to their destination.

[0517] Output: Safe travel to destination

[0518] Step 11: Implementing a home health system

[0519] Input: Home care orders from the server

[0520] Specific operation: If the server determines that a user's health check is necessary, it sends instructions to the home medical system. The medical robot visits the user's home and performs a health check.

[0521] Output: Health checks performed and real-time data sent to the server

[0522] Step 12: Virtual interaction

[0523] Input: User access request and emotion data

[0524] Specific operation: The user accesses the virtual space and interacts with digital people and automated machines. The server generates the virtual space and makes it accessible to the user.

[0525] Output: User interaction experience in virtual space

[0526] Step 13: Understanding emotional states using the emotion engine and providing services

[0527] Input: Emotion data

[0528] Specific operation: The emotion engine analyzes the emotion data and understands the user's current emotional state. The server generates and provides relaxation and support services based on the emotional state.

[0529] Output: Relaxation services and assistance suited to the user

[0530] (Application example 2)

[0531] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0532] Conventional smart city construction technologies have struggled to provide optimal services tailored to individual users' lifestyles, health conditions, travel patterns, dietary habits, and emotional fluctuations. Furthermore, at workplaces, there has been a lack of means to collect and analyze workers' biometric and emotional data in real time and optimize the work environment. This has resulted in reduced worker efficiency and increased health risks. A comprehensive system is needed to solve these problems.

[0533] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0534] In this invention, the server includes a means for collecting data on the user's daily rhythm, health condition, travel patterns, and dietary habits, a means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and a means for sending instructions to service devices and systems according to the generated service plan. This enables the provision of optimal services tailored to the user's individual circumstances. Furthermore, the smart glasses include a means for collecting biometric information and emotional data from the worker, a means for analyzing the collected biometric information and emotional data, and a means for sending instructions to optimize the work environment. The cooperative operation of various devices and systems that execute the service plan enables the optimization of the overall work environment and the safety of the worker.

[0535] A "user" is an individual who receives a service in the present invention.

[0536] "Life rhythm" refers to the temporal behavioral patterns of a user in their daily life.

[0537] "Health status" is information that indicates the degree of the user's physical and mental health.

[0538] "Travel patterns" refer to the route and time zone trends that a user typically follows on a daily basis.

[0539] "Diet" refers to the food content and eating habits of a user on a daily basis.

[0540] The "data collection means" refers to a device or system for collecting biometric information and behavioral data of a user.

[0541] A "generative AI model" is an artificial intelligence technology that analyzes collected data and generates appropriate service plans.

[0542] A "service plan" is a specific service plan or proposal that is provided taking into account the individual circumstances of the user.

[0543] "Service equipment and systems" are physical and software devices for executing generated service plans.

[0544] A "drone" is a device that uses unmanned aerial vehicle technology to deliver goods.

[0545] An "autonomous vehicle" is a vehicle that drives autonomously using artificial intelligence technology.

[0546] A "home medical system" is a device or system for providing medical testing and care in a user's home.

[0547] A "health check" is an examination or monitoring to assess the user's health status.

[0548] A "remote physician" is a physician who is not physically near the user but provides medical services remotely.

[0549] "Virtual reality space" is a pseudo-three-dimensional space generated by computer technology.

[0550] "Digital family members" are digital characters that users can interact with in a virtual reality space.

[0551] A "robot" is a mechanical device that is designed to assist a user autonomously or remotely.

[0552] "Smart glasses" are glasses-type devices worn on the user's eyes that display information and collect biometric and emotional data using sensors.

[0553] "Biometric information" refers to information about the user's physical condition, such as heart rate, body temperature, and respiratory rate.

[0554] "Emotion data" is information about the user's emotional state that is analyzed from facial expressions, tone of voice, and the like.

[0555] "Work environment optimization" means adjusting work conditions to the optimum state based on the user's biometric information and emotional data.

[0556] System Overview

[0557] The system of this invention collects data on a user's lifestyle, health status, travel patterns, and diet, analyzes it using a generative AI model, and generates an optimal service plan for the user. Based on this service plan, the system also comprehensively manages the provision of services via various devices and systems, such as drones, self-driving cars, home medical systems, and smart glasses.

[0558] Hardware and software used

[0559] 1. Hardware:

[0560] Smart Glasses: Devices that collect biometric and emotional data from a user (e.g., Google® Glass® Enterprise Edition).

[0561] Drone: A device that uses unmanned aerial technology to deliver goods.

[0562] Self-driving car: A vehicle that uses artificial intelligence technology to drive itself autonomously.

[0563] Home medical robot: A device that checks the user's health and transmits the data to a doctor in a remote location.

[0564] 2. Software:

[0565] Generative AI model: Analyzes user data and generates optimal service plans (e.g., TENSORFLOW (registered trademark), PyTorch).

[0566] Emotion engine: Analyzes emotion data and understands the user's emotional state (e.g., Emotion API).

[0567] Cloud server: Analyzes data and generates service plans (e.g., AWS (registered trademark)).

[0568] Data processing and calculation

[0569] 1. Data Collection and Transmission:

[0570] The server collects the user's biometric information, such as heart rate, body temperature, and voice tone, as well as emotional data in real time through the smart glasses and transfers it to a cloud server.

[0571] 2. Data Analysis:

[0572] The server analyzes the data uploaded to the cloud server using a generative AI model and emotion engine. This includes assessing the user's health and determining their emotional state. For example, if the user's fatigue level is high, it generates a service plan that recommends taking a break.

[0573] 3. Create and run the service plan:

[0574] Based on the service plan, it sends instructions to various devices and systems, such as instructing a drone to deliver a meal or an autonomous vehicle to move the user.

[0575] Specific examples

[0576] For example, if a user is working for a long time and is becoming increasingly fatigued based on data collected from the smart glasses, the cloud server will use the generative AI model to generate instructions recommending "taking a break," while simultaneously instructing a drone to deliver a relaxing lunch to the user's workspace and adjusting lighting and temperature to a comfortable level for the user.

[0577] Prompt Sentence Examples

[0578] Based on the data collected from the emotion engine, the system analyzes the health and emotional state of workers, and if the fatigue level is above 80 or the stress level is above 70, it sends a command to the cloud server to "recommend taking a break." It also sends a command to dim the factory lights and start playing relaxing music.

[0579] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0580] Step 1:

[0581] The user wears smart glasses. The smart glasses collect the user's biometric information (heart rate, body temperature, respiratory rate) and emotional data (facial expression, tone of voice, etc.) in real time. These data are the original input. The smart glasses collect this data and transfer it to a smartphone or directly to a cloud server.

[0582] Step 2:

[0583] The server receives the collected biometric and emotional data from the cloud server. The received data is stored in an internal database. The stored data is then analyzed by the generative AI model and emotion engine.

[0584] Step 3:

[0585] The server uses the generative AI model and emotion engine to analyze the received biometric and emotional data. During the analysis, the server extracts, for example, the user's fatigue level and stress level. The output of this analysis is an assessment of the user's health and emotional state.

[0586] Step 4:

[0587] Based on the analysis results obtained by the server, the server generates an optimal service plan for the user. Specifically, it creates a plan that recommends rest if fatigue is high, or a plan that suggests nutritionally balanced meals if the diet is inappropriate. This service plan is the generated output.

[0588] Step 5:

[0589] The server sends instructions to various devices (drones, self-driving cars, smart glasses, etc.) based on the generated service plan. For example, it instructs a drone to deliver a meal, an autonomous car to navigate from the user's home to a specific destination, or smart glasses to remind the user to take a break.

[0590] Step 6:

[0591] The drone starts operating according to instructions from the server. It picks up the meal from the specified restaurant and then delivers it to the user's specified location (for example, the user's workplace). This is the specific operation of the drone.

[0592] Step 7:

[0593] The self-driving car starts operating according to instructions from the server. It arrives at the user's home at the specified time and safely drives the user to their destination. After completing the drive, the self-driving car waits for the next instruction.

[0594] Step 8:

[0595] The smart glasses notify the user of the server's instructions. For example, they can display a message saying "Please take a break" and simultaneously play relaxing music. The user is expected to take a break in accordance with this message.

[0596] Step 9:

[0597] The user receives the meal or uses the self-driving car and takes the necessary action. When the user receives the meal, they can also send feedback about the meal (satisfaction, problems, etc.) to the server via smart glasses or a smartphone.

[0598] Step 10:

[0599] The server receives feedback from users and uses it to improve future service plans, which is expected to result in a continuous improvement in the quality of service.

[0600] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0601] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0602] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0603] [Second embodiment]

[0604] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0605] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0606] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0607] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0608] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0609] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0610] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0611] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0612] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0613] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0614] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0615] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0616] overview

[0617] This invention aims to build a smart city that improves users' quality of life by utilizing generative AI models and advanced technologies. Specifically, it collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes them using generative AI models, and provides optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, autonomous vehicle transportation support, home medical care, and virtual interaction between digital families and robots.

[0618] Data collection

[0619] 1. Users

[0620] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[0621] 2. Device (smartphone)

[0622] The transferred data is organized and periodically uploaded to the server.

[0623] Analyzing data and generating service plans

[0624] 3. Server

[0625] The collected data is analyzed using a generative AI model. For example, it analyzes health status and generates nutritionally balanced meal menus for food delivery.

[0626] Analyze user travel patterns and create schedules for self-driving vehicles.

[0627] Book home health care time slots when necessary.

[0628] Service Instruction and Execution

[0629] 4. Server

[0630] Based on the generated service plan, instructions are sent to the devices and systems responsible for carrying out each service, such as sending instructions to a drone to deliver a meal from a designated restaurant to the user's home, or to an autonomous vehicle to transport the user to their destination.

[0631] 5. Drones

[0632] Once instructed, the robot will head to the designated restaurant, pick up the meal, and deliver it to the user's home, where it will drop off the meal at a designated location (e.g., balcony).

[0633] 6. Self-driving cars

[0634] Once instructions are received, the vehicle will pick up the user at the specified time and place and safely drive to the pre-set destination.

[0635] Providing home medical care

[0636] 7. Server

[0637] If the user needs a health check or medical treatment, instructions are sent to the home medical system.

[0638] 8. Terminal (medical robot)

[0639] The system visits the user's home and performs necessary health checks, and the collected data is sent to the server in real time.

[0640] 9. Doctor

[0641] The remotely transmitted data is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[0642] Virtual interaction

[0643] 10. Users

[0644] Access the virtual space using a digital device (e.g., a smartphone or VR device).

[0645] 11. Server

[0646] We create an environment in a virtual space where users can interact with digital family members and support robots.

[0647] 12. Users

[0648] In the virtual space, people can interact and engage in collaborative activities with their digital family or robots, a process that reduces feelings of loneliness and provides psychological support.

[0649] Specific examples

[0650] Specific examples of meal delivery

[0651] When a user makes a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[0652] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[0653] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[0654] Examples of outpatient visits

[0655] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[0656] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[0657] In this way, the present invention aims to effectively provide support services adapted to an aging society and improve the quality of life of users.

[0658] The processing flow will be explained below.

[0659] Step 1:

[0660] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[0661] Step 2:

[0662] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[0663] Step 3:

[0664] The device (smartphone) organizes and saves the transferred data and periodically uploads it to the server.

[0665] Step 4:

[0666] The server aggregates the data received from users and provides it to the generative AI model, which analyzes their health status, lifestyle, travel patterns, diet, and other factors.

[0667] Step 5:

[0668] The server uses the generative AI model to generate a service plan optimized for each user, for example, determining a nutritionally balanced meal menu based on health data.

[0669] Step 6:

[0670] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[0671] Step 7:

[0672] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[0673] Step 8:

[0674] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, picks up the user, and drives safely to the destination (e.g., hospital).

[0675] Step 9:

[0676] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[0677] Step 10:

[0678] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[0679] Step 11:

[0680] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[0681] Step 12:

[0682] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[0683] Step 13:

[0684] Users access the virtual space using digital devices (smartphones or VR devices).

[0685] Step 14:

[0686] The server generates an environment for interaction with digital family and robots in a virtual space.

[0687] Step 15:

[0688] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[0689] Through this series of steps, smart cities will provide cutting-edge systems that support and improve the quality of users' lives.

[0690] Example 1

[0691] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0692] In modern society, with the aging population and diversifying lifestyles, there is a demand for providing optimal services to each individual user. However, existing systems lack the means to centrally collect and analyze data on users' daily rhythms, health conditions, and travel patterns, and to generate service plans tailored to individual needs. Furthermore, there is no system that can comprehensively manage meal delivery, transportation support, home medical care, and virtual space interactions, limiting the quality and efficiency of the services users can receive.

[0693] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0694] In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement patterns, and dietary habits, means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and means for sending instructions to service devices and systems in accordance with the generated service plan, thereby enabling the provision of optimal services tailored to the user's complex needs.

[0695] The "user's life rhythm" refers to the time periods and periodic activity patterns of the user's daily life, such as waking up, going to bed, eating, and exercising.

[0696] "Health status" refers to indicators of a user's physical and mental health, including, for example, heart rate, blood pressure, sleep quality, and stress level.

[0697] "Travel patterns" refers to data such as a user's daily travel routes and frequency, and the history of places visited.

[0698] "Dietary data" refers to information related to the types of food and nutrients a user consumes, as well as meal times and frequency.

[0699] A "generative AI model" refers to an algorithm or system that learns from large amounts of data and performs natural language generation and data analysis like a human.

[0700] "Generated service plan" refers to a specific plan of services to be provided according to the user's needs and condition based on the analysis results of the generating AI model.

[0701] "Service equipment and systems" refers to equipment and systems for performing specific services such as food delivery, autonomous driving, health checks, and virtual interactions.

[0702] "Unmanned aerial vehicle" refers to an aircraft that can fly remotely or autonomously and transport or deliver goods.

[0703] An "autonomous vehicle" refers to a vehicle that can drive autonomously using artificial intelligence and sensor technology.

[0704] A "home medical system" refers to equipment and software used to conduct health checks and medical treatment in a user's home.

[0705] "Virtual space" refers to a computer-generated digital environment that allows users to interact with digital family members and robots.

[0706] "Digital family" refers to digital characters created to interact with users in a virtual space.

[0707] A "wearable device" refers to a small electronic device that can be worn and used by a user on a daily basis.

[0708] MODE FOR CARRYING OUT THE INVENTION

[0709] overview

[0710] This invention relates to a system for building smart cities that utilizes generative AI models and advanced technologies to improve users' quality of life. The system collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes the data using generative AI models, and provides optimal service plans for users. The system also manages a series of integrated services, including food delivery by unmanned aerial vehicles, transportation support by autonomous vehicles, home medical care, and interaction between digital families and robots in a virtual space.

[0711] Data collection

[0712] 1. Users

[0713] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time and transfer it to their smartphones.

[0714] For example, if you wake up at 6am, the smartwatch will automatically record your heart rate and sleep time, and this data will be transferred to your smartphone via Bluetooth.

[0715] Organizing and sending data

[0716] 2. Device (smartphone)

[0717] The device organizes the received data using a dedicated application (e.g., a health care app) and uploads it to a server periodically (e.g., every hour).

[0718] Data is transmitted over Wi-Fi or mobile networks and is encrypted to protect privacy.

[0719] Analyzing data and generating service plans

[0720] 3. Server

[0721] The server receives the collected data in real time and analyzes it with a generative AI model (e.g., GPT-4), for example, to evaluate the user's health status and customize an appropriate meal menu.

[0722] The server analyzes the user's travel patterns and creates a schedule for the self-driving car. For example, it understands that the user travels to a specific location at a certain time each week and sets the schedule for the self-driving car accordingly.

[0723] Prescribing and executing service plans

[0724] 4. Server

[0725] The server transmits instructions to an execution device, such as an unmanned aerial vehicle or an autonomous vehicle, based on the generated service plan.

[0726] Specifically, the drone will be instructed to retrieve a specific meal from a specified restaurant and deliver it to the user's home, while the self-driving car will be instructed to pick up the user from their home at 9:00 and arrive at their destination by 10:00.

[0727] 5. Unmanned aerial vehicle

[0728] When the drone receives instructions from the server, it flies to the specified restaurant and picks up the meal. For example, it delivers a high-protein, low-fat meal to a user who has requested dinner.

[0729] 6. Self-driving cars

[0730] The self-driving car will pick up the user at the designated time and drive safely to the destination, using LIDAR sensors and cameras to understand the surrounding situation.

[0731] Providing home medical care

[0732] 7. Server

[0733] The server sends necessary instructions to the home medical system according to the user's health condition. For example, if a user shows symptoms of high blood pressure, the home medical robot will measure their blood pressure.

[0734] 8. Terminal (medical robot)

[0735] The medical robot performs the prescribed health checks and transmits the acquired data to a server in real time.

[0736] 9. Doctor

[0737] The data sent remotely is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[0738] Virtual interaction

[0739] 10. Users

[0740] Users access the virtual space using digital devices (e.g., smartphones or VR devices) and interact with their digital family and support robots.

[0741] 11. Server

[0742] It creates a virtual space and provides an environment where users can interact with their digital family and support robots. For example, it sets up a birthday party in the user's virtual space and generates a scene in which the digital family hands out presents.

[0743] Specific examples

[0744] Specific examples of meal delivery

[0745] When a user inputs a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[0746] The server sends instructions to the drone to "get food from the specified restaurant and deliver it to the user's balcony."

[0747] The drone will pick up the meal and deliver it to your balcony.

[0748] Specific examples of outpatient visits

[0749] When a user enters a medical appointment into a smartphone application, the server creates and transmits a driving plan for the self-driving car.

[0750] The self-driving car will arrive at the user's home at the specified time and drive safely with the user on board.

[0751] Prompt Sentence Examples

[0752] "When a user makes a dinner request, explain how the server selects the appropriate menu item and how the drone delivers the meal."

[0753] In this way, the system aims to provide a variety of support services suited to an aging society and to improve the overall quality of life of users.

[0754] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0755] Step 1:

[0756] Users use a smartwatch or biometric measurement device to measure data and transfer it to their smartphone.

[0757] Input: Smartwatch data such as heart rate, walking distance, and sleep time

[0758] Data processing: The information measured by the smartwatch is transferred to the smartphone via Bluetooth.

[0759] Output: Biometric data transferred to a smartphone

[0760] How it works: When you wake up at 6am, your heart rate and sleep time will be automatically measured by the smartwatch, and this data will be transferred to your smartphone via Bluetooth.

[0761] Step 2:

[0762] The device (smartphone) organizes the received data and periodically uploads it to the server.

[0763] Input: Biometric data transferred from the smartwatch

[0764] Data processing: Organize and encrypt data using dedicated applications (e.g., health apps)

[0765] Output: Upload the organized data to the server

[0766] What it does: The Health app organizes your data and uploads it to a server every hour over Wi-Fi or your mobile network.

[0767] Step 3:

[0768] The server analyzes the collected data using a generative AI model and generates a service plan.

[0769] Input: Biometric data uploaded to the server

[0770] Data processing: Using generative AI models (e.g., GPT-4) to analyze data and assess health status and mobility patterns

[0771] Output: Optimal service plan based on analysis results

[0772] How it works: The server uses a generative AI model to assess the user's health and determine that they need a high-protein, low-fat menu. It then creates a personalized meal plan.

[0773] Step 4:

[0774] The server transmits instructions to each service device based on the generated service plan.

[0775] Input: Generated service plan

[0776] Data processing: Generate specific instructions, such as food delivery instructions or scheduling an autonomous vehicle

[0777] Output: Instructions sent to unmanned aerial vehicles and autonomous vehicles

[0778] Specific operation: The server sends instructions to the unmanned aerial vehicle to retrieve a specific meal from a specified restaurant and deliver it to the user's home. It also sends instructions to the self-driving car to pick up the user from their home at 9:00 and arrive at their destination at 10:00.

[0779] Step 5:

[0780] The drones will then receive instructions and deliver the meals to designated locations.

[0781] Input: Meal delivery instructions from the server

[0782] Data processing: Use GPS to fly to a designated restaurant and pick up your meal

[0783] Output: Meal delivered to the user's home

[0784] Specific operation: The drone will fly to the designated restaurant, pick up the meal, and deliver it to the user's balcony. After delivery, it will return to the user's home using the coordinates.

[0785] Step 6:

[0786] The self-driving car will pick up the user at a designated time and place and drive them to their destination.

[0787] Input: Operation instructions from the server

[0788] Data processing: Calculate routes using LIDAR sensors and cameras to operate safely

[0789] Output: User arrives at destination

[0790] Specific operation: The self-driving car arrives in front of the user's home at the specified time, safely picks up the user, and drives them to their destination.

[0791] Step 7:

[0792] The server instructs the home medical system to check the user's health.

[0793] Input: User's health data and health check instructions

[0794] Data processing: Evaluate the user's health status and generate instructions for necessary health checks

[0795] Output: Health check instructions sent to medical robot

[0796] Specific operation: For a user showing symptoms of high blood pressure, the server instructs the medical robot to "measure blood pressure and send the data to the server."

[0797] Step 8:

[0798] The terminal (medical robot) performs a health check and sends the acquired data to the server.

[0799] Input: Health check instructions from the server

[0800] Data processing: Measure the user's health data, encrypt it, and send it to the server

[0801] Output: Health data sent to the server

[0802] Specific operation: The medical robot measures the user's blood pressure and transmits the data to a server in real time.

[0803] Step 9:

[0804] The doctor analyzes the transmitted data and sends treatment instructions back to the medical robot.

[0805] Input: Health data sent from the server

[0806] Data processing: Analyze data and create necessary medical instructions

[0807] Output: Treatment instructions sent back to the medical robot

[0808] Specific operation: The doctor remotely checks the data and sends instructions to the medical robot, such as "Administer medication because the patient's blood pressure is high." The robot then administers the medication based on the instructions.

[0809] Step 10:

[0810] Users access the virtual space using digital devices and interact with their digital family and support robots.

[0811] Input: Access request from a digital terminal

[0812] Data processing: Connection to virtual space, user authentication, interaction simulation

[0813] Output: Interactive experience in virtual space

[0814] Specific operation: Users use smartphones or VR devices to access a virtual space, where they can interact with their digital family and collaborate with a support robot.

[0815] Step 11:

[0816] The server generates an environment in which users can interact with their digital family and support robots in a virtual space.

[0817] Input: User's request in the virtual space

[0818] Data processing: Virtual space generation, digital character creation, script execution

[0819] Output: A user-accessible virtual space

[0820] Specific operation: The server generates a virtual space, for example, setting up a virtual birthday party for the user and creating a scene in which the digital family hands over presents.

[0821] Step 12:

[0822] Users can enjoy interacting and collaborating with their digital family and robots in a virtual space.

[0823] Input: Interacting with digital characters in a virtual space

[0824] Output: Psychological support and entertainment experiences

[0825] Specific actions: Users can interact with their digital family in a virtual space, reducing feelings of loneliness. They can also collaborate with a support robot and receive functional support while having fun.

[0826] (Application example 1)

[0827] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0828] In an aging society, there is a demand for detailed support tailored to individual health conditions and lifestyle patterns, but existing systems have difficulty providing this automatically. Another issue is the lack of a system that can collect users' health data in real time and respond immediately in emergencies. Furthermore, there is a lack of a means to notify users of generated health reports in a timely manner. Therefore, a comprehensive system is needed to improve users' quality of life.

[0829] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0830] In this invention, the server includes: means for collecting data on a user's daily rhythm, health status, travel patterns, and dietary habits; means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user; means for transmitting instructions to service devices and systems according to the generated service plan; means for an unmanned aerial vehicle receiving the instructions to deliver meals to a specified location; means for an autonomous vehicle receiving the instructions to safely drive the user to the destination; means for a home medical system to conduct health checks on the user and transmit the data to a remote doctor; means for the user to interact with a digital family or robot in a virtual space; means for collecting the user's health data in real time and communicating with a doctor via a medical robot in an emergency; and means for notifying the user of the generated health report. This enables daily monitoring of the user's health status and prompt and appropriate medical treatment when necessary. It also provides comprehensive support that contributes to improving the user's quality of life.

[0831] "User's daily rhythm" refers to the activity patterns and time management in the user's daily life.

[0832] "Health Status" refers to the overall state of a user's physical and mental health.

[0833] "Travel patterns" refer to a user's usual travel routes, choice of transportation means, travel time, etc.

[0834] "Diet" refers to the types and amounts of food a user consumes on a daily basis, the time of intake, and nutritional balance.

[0835] "Means for collecting data" refers to devices and systems for measuring and recording various activities and health conditions of users.

[0836] A "generative AI model" refers to algorithms or software that uses artificial intelligence to analyze data and generate patterns or optimized results.

[0837] "Means for analyzing and generating optimal service plans for users" refers to systems and algorithms that use collected data to design and propose services that best suit the user's needs.

[0838] The "means for transmitting instructions" refers to a communication system for transmitting operation commands to various terminals and devices based on the generated service plan.

[0839] "Unmanned aerial vehicle" refers to a drone or other flying device designed to fly autonomously and carry goods.

[0840] An "autonomous vehicle" refers to a vehicle that drives itself without human input.

[0841] "Home medical system" refers to a system or device for providing medical services in a user's home.

[0842] "Means for performing health checks and transmitting data to a remote doctor" refers to a system or device for monitoring a user's health status and transmitting that data to a doctor remotely.

[0843] "Virtual space" refers to a digital space constructed using computer technology that can be experienced in a way that is close to reality.

[0844] "Digital family" refers to digitized family avatars or characters that can interact with users in a virtual space.

[0845] A "robot" refers to a mechanical device that autonomously performs programmed actions.

[0846] "Means for notifying users of health reports" refers to systems and methods for communicating analysis results and recommendations to users.

[0847] The present invention relates to a system for providing various services based on a user's health condition and lifestyle patterns. Specific embodiments for carrying out the present invention will be described below.

[0848] System Overview

[0849] Data collection

[0850] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. This data is then transferred to the user's smartphone, which then organizes the data and periodically uploads it to a server.

[0851] Data analysis and service plan generation

[0852] The server receives the uploaded data and analyzes it using generative AI models, for example, analyzing health conditions and generating nutritionally balanced meal plans for food delivery, analyzing the user's travel patterns and creating schedules for autonomous vehicles, and even reserving time slots for home medical care if necessary.

[0853] Service Instruction and Execution

[0854] Based on the generated service plan, the server sends instructions to the devices and systems responsible for executing each service. For example, an unmanned aerial vehicle delivers meals to a specified location, an autonomous vehicle drives a user to their destination, or a home medical system checks the user's health and transmits the acquired data to the server in real time.

[0855] Hardware and software used

[0856] Hardware

[0857] Smartwatches: (e.g., smartwatches, fitness tracking devices)

[0858] Smartphones: (e.g. iOS devices, Android devices)

[0859] Unmanned aerial vehicles: (e.g., delivery drones)

[0860] Autonomous vehicles: (e.g., self-driving cars, robotaxis)

[0861] Medical robots: (e.g., home medical support robots)

[0862] software

[0863] Generative AI models: (e.g., machine learning models using the scikit-learn library)

[0864] Data transfer API: (e.g. RESTful API)

[0865] Data analysis software: (e.g., Python program)

[0866] Specific use cases

[0867] Health data analysis and reporting

[0868] The server provides appropriate health advice and reports to users based on the collected health data. For example, if the user's heart rate is abnormally high, the server immediately notifies the medical robot and performs a health check on the user.

[0869] Specific prompt examples:

[0870] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[0871] In this way, the present invention enables daily monitoring of the user's health condition, enabling prompt and appropriate medical treatment when necessary, and providing comprehensive support that contributes to improving the user's quality of life.

[0872] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0873] Step 1:

[0874] Data collection

[0875] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. The data is then transferred to a smartphone and collected as input data. The smartphone then organizes the data and periodically uploads it to a server.

[0876] Step 2:

[0877] Data reception

[0878] The server receives data uploaded from the smartphone. This input data includes heart rate, walking distance, sleep duration, etc. The server stores this data in a database and prepares it for analysis.

[0879] Step 3:

[0880] Data analysis

[0881] The server analyzes the received data using a generative AI model. The generative AI model is implemented using the scikit-learn library and analyzes health status and lifestyle patterns based on the input data. For example, it analyzes the user's heart rate and sleep data to evaluate their health status. The output of this analysis process is a health check result and recommended lifestyle improvements.

[0882] Step 4:

[0883] Service plan generation

[0884] The server generates an optimal service plan for the user based on the analysis results, including a nutritionally balanced meal menu, an appropriate exercise plan, and an autonomous vehicle schedule. The generated plan is output as instructions for the next step.

[0885] Step 5:

[0886] Send instructions

[0887] Based on the generated service plan, the server sends instructions to service devices and systems, such as unmanned aerial vehicles, autonomous vehicles, and home healthcare systems. The instructions detail how each device should operate. For example, an unmanned aerial vehicle might receive instructions to deliver meals to a specified location, and an autonomous vehicle might receive instructions to drive a user to their destination.

[0888] Step 6:

[0889] Execution of instructions

[0890] Each device receives instructions from the server and performs a specific operation. For example, an unmanned aerial vehicle will head to a designated restaurant, pick up a meal, and deliver it to the user's home. An autonomous vehicle will pick up the user at the designated place and time and drive them safely to their destination.

[0891] Step 7:

[0892] Providing home medical care

[0893] The home medical system performs health checks on users based on instructions from a server. The acquired health data is sent to the server in real time and analyzed by a doctor in a remote location. The medical robot follows instructions from the server and takes appropriate action according to the user's health condition.

[0894] Step 8:

[0895] Health report generation and notification

[0896] The server periodically generates a health report based on the collected data and analysis results. This report includes the user's past health data, current condition, and future recommendations. The report is sent to the user's smartphone, allowing the user to understand their own health status.

[0897] Specific prompt examples:

[0898] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[0899] In this way, each step works in cooperation with the others, making it possible to monitor the user's health condition and provide optimal services.

[0900] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0901] overview

[0902] This invention aims to build a smart city that improves users' quality of life by utilizing advanced technologies such as generative AI models and emotion engines. Specifically, it collects data on users' daily rhythms, health conditions, travel patterns, and dietary habits, as well as emotional data, and analyzes it using generative AI models to provide optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, transportation support using self-driving cars, home medical care, and virtual interactions between digital families and robots.

[0903] Data collection

[0904] 1. Users

[0905] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[0906] Using a device equipped with an emotion engine, emotional data such as facial expressions, tone of voice, and gestures are measured.

[0907] 2. Device (smartphone)

[0908] The transferred biometric information and emotional data are organized and periodically uploaded to a server.

[0909] Analyzing data and generating service plans

[0910] 3. Server

[0911] The collected biometric and emotional data is analyzed using a generative AI model, which, for example, generates a nutritionally balanced meal menu taking into account the patient's health and emotional state.

[0912] Adjust the schedule of self-driving cars based on user travel patterns and emotional data.

[0913] Book home health care time slots when necessary.

[0914] Service Instruction and Execution

[0915] 4. Server

[0916] Based on the generated service plan, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[0917] 5. Drones

[0918] Once instructed, the robot will head to the designated restaurant to pick up the meal, and then deliver it to the user's designated location (such as a balcony).

[0919] 6. Self-driving cars

[0920] Once instructions are received, the vehicle will arrive at the user's home at the specified time and travel safely to the pre-set destination.

[0921] Providing home medical care

[0922] 7. Server

[0923] If it determines that the user's health needs to be checked, it sends instructions to the home medical system.

[0924] 8. Terminal (medical robot)

[0925] Upon receiving instructions, it visits the user's home, conducts a health check, and sends the results to the server in real time.

[0926] 9. Doctor

[0927] The data transmitted remotely is analyzed and medical instructions are sent to the robot.

[0928] Virtual interaction

[0929] 10. Users

[0930] Access the virtual space using a digital device (smartphone or VR device).

[0931] 11. Server

[0932] We create an environment in which people can interact with digital family and robots in a virtual space.

[0933] 12. Users

[0934] Interacting with digital family and robots in a virtual space reduces feelings of loneliness.

[0935] Support by Emotion Engine

[0936] 13. Terminal (device with emotion engine)

[0937] It recognizes emotions based on data such as the user's facial expressions, tone of voice, and gestures.

[0938] 14. Server

[0939] Emotion data collected from the emotion engine is analyzed to understand the user's current emotional state.

[0940] 15. Server

[0941] The system generates a service plan that takes into account the user's emotional state. If the emotional state is stressful, it will provide relaxing music services and support in a virtual space.

[0942] Specific examples

[0943] A concrete example of emotion-based food delivery

[0944] When a user makes a dinner request, the server selects an appropriate menu based on the user's health and emotional data.

[0945] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[0946] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[0947] Examples of emotionally driven visits

[0948] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[0949] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[0950] Emotion-based support in virtual space

[0951] If the emotion engine detects that the user is feeling stressed, the server generates a relaxing environment in the virtual space and guides the user on how to access it.

[0952] Users can interact with digital family and robots in a virtual space and receive support to reduce stress.

[0953] In this way, the present invention provides an advanced life support system that also takes emotion data into consideration, thereby further improving the quality of life of users.

[0954] The processing flow will be explained below.

[0955] Step 1:

[0956] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[0957] Step 2:

[0958] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[0959] Step 3:

[0960] The device (smartphone) organizes and stores the transferred biometric information and periodically uploads it to the server.

[0961] Step 4:

[0962] The terminal (device equipped with an emotion engine) measures the user's facial expressions, tone of voice, and gestures in real time, generates emotion data, and transfers it to the terminal (smartphone).

[0963] Step 5:

[0964] The device (smartphone) organizes the transferred emotional data and uploads it to the server along with the biometric information.

[0965] Step 6:

[0966] The server collects the received biometric and emotional data and provides it to the generative AI model, which analyzes the user's health, daily rhythm, movement patterns, emotional state, and other factors.

[0967] Step 7:

[0968] The server uses the generative AI model to generate an optimized service plan for each user, for example, determining a nutritionally balanced meal menu based on health and emotional data.

[0969] Step 8:

[0970] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[0971] Step 9:

[0972] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[0973] Step 10:

[0974] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, and drives safely to the pre-set destination.

[0975] Step 11:

[0976] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[0977] Step 12:

[0978] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[0979] Step 13:

[0980] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[0981] Step 14:

[0982] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[0983] Step 15:

[0984] Users access the virtual space using digital devices (smartphones or VR devices).

[0985] Step 16:

[0986] The server generates an environment in a virtual space where people can interact with digital family members and robots.

[0987] Step 17:

[0988] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[0989] Step 18:

[0990] The terminal (device equipped with an emotion engine) again measures the user's facial expressions, tone of voice, and gestures, and updates the emotion data.

[0991] Step 19:

[0992] The server analyzes the updated emotional data and adjusts and optimizes the service plan in real time as needed. If the emotional state is stressful, it provides relaxing music services and support in a virtual space.

[0993] Through this series of steps, a high-dimensional life support system that also takes emotional data into account will improve the quality of the user's life.

[0994] Example 2

[0995] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0996] In modern society, the aging of society and the diversification of lifestyles are driving demand for advanced systems that comprehensively support people's daily rhythms, health conditions, travel patterns, dietary habits, and other aspects of their lives. It is also necessary to provide services that take emotional information into account, but current technology has not yet fully realized this. The present invention aims to solve these problems and improve the quality of life of users.

[0997] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement pattern, and dietary habits, means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user, means for sending instructions to a service device or system according to the generated service plan, means for recognizing emotions and analyzing the emotion data to grasp the user's emotional state, and means for generating optimal relaxation services and support based on the emotional state. This makes it possible to comprehensively support a wide range of needs of users and improve their quality of life.

[0998] "User" refers to a person who uses the system.

[0999] "Life rhythm" refers to data that indicates a user's daily activities and sleep cycles.

[1000] "Health status" refers to data including biometric information such as the user's heart rate, blood pressure, body temperature, and sleep duration.

[1001] "Travel patterns" refers to data indicating a user's regular travel routes and frequency.

[1002] "Diet" refers to data regarding the types of food a user consumes and their nutritional balance.

[1003] "Means of collecting data" refers to devices and software that collect information on users' lifestyles, health conditions, travel patterns, and dietary habits.

[1004] "Generative AI model" refers to an artificial intelligence model that analyzes collected data and generates service plans and proposals suitable for users.

[1005] "Means for analysis" refers to the equipment and software used to analyze the collected data.

[1006] A "service plan" refers to a method of providing optimal support and services based on a user's lifestyle, health condition, travel patterns, diet, emotional state, etc.

[1007] The term "service device or system" refers to a device or system that provides a service to a user based on a generated service plan.

[1008] "Unmanned aerial vehicle" refers to a small aircraft operated by remote control or autonomous pilot for the purpose of delivering goods.

[1009] An "autonomous vehicle" refers to a vehicle that automatically drives a user to their destination.

[1010] A "home medical care system" refers to a system that remotely checks the user's health status and provides necessary medical treatment and advice.

[1011] "Virtual space" refers to a digital environment generated by computer simulation.

[1012] "Digital persona" refers to a computer-generated character that interacts with the user in a virtual space.

[1013] "Automated machine" refers to a robot or other mechanical device that interacts with the user in a virtual space.

[1014] "Means for recognizing emotions" refers to devices or software that sense and recognize a user's emotional state from facial expressions, tone of voice, gestures, etc.

[1015] "Emotional state" refers to the user's emotional and feeling state at any given time.

[1016] "Relaxation services" refer to services such as music and virtual environments that help users reduce stress and relax.

[1017] "Assistance" refers to comprehensive support to improve the user's quality of life.

[1018] MODE FOR CARRYING OUT THE INVENTION

[1019] This invention is a smart system that collects data on a user's daily rhythm, health status, travel patterns, and dietary habits, analyzes the data using a generative AI model, and generates an optimal service plan for the user, thereby improving their quality of life. Specific embodiments of this system are described below.

[1020] Data collection hardware and software

[1021] 1. User data collection

[1022] Hardware: Users use smartwatches and other biometric devices that measure data such as heart rate, walking distance, and sleep duration in real time.

[1023] Software: A dedicated application is installed on the smartwatch, and the measured data is transferred to a smartphone via Bluetooth. The smartphone also has an application installed to organize and store the data and transfer it to a server.

[1024] 2. Collecting Emotional Data

[1025] Hardware: Devices equipped with emotion engines (e.g., emotion-recognizing cameras and microphones) are used. These devices capture data such as the user's facial expressions, tone of voice, and gestures.

[1026] Software: The emotion engine analyzes the data in real time and transmits the emotion data to the smartphone, which organizes it and uploads it to the server.

[1027] Data analysis and service plan generation

[1028] 3. Server Roles

[1029] Hardware: The server has high-performance computing resources and large memory and storage capacity for data management and analysis.

[1030] Software: A generative AI model is installed on the server, which performs analysis based on the collected data.

[1031] 4. Analysis using generative AI models

[1032] The server uses a generative AI model to analyze data collected from users, such as their daily rhythms, health status, and emotional state. This analysis generates an optimal service plan that takes into account the user's health and emotional state.

[1033] Provision of services

[1034] 5. Sending specific service instructions

[1035] Based on the generated service plan, the server sends instructions to various service devices and systems, including unmanned aerial vehicles, autonomous vehicles, and home medical systems.

[1036] 6. Drone meal delivery

[1037] Example: A user requests dinner, and the server sends instructions to an unmanned aerial vehicle to deliver the meal from a specified restaurant to the user's home. The unmanned aerial vehicle picks up the meal and delivers it to the user's balcony.

[1038] 7. Transportation support using autonomous vehicles

[1039] Example: When a user enters a doctor's appointment, the server creates and sends a driving plan for an autonomous vehicle, which arrives at the user's home at the specified time and drives the user safely to their destination.

[1040] 8. Health checks through home medical care systems

[1041] Example: If the server determines that a user needs a health check, it sends instructions to a home medical system, and a medical robot visits the user's home to conduct a health check. The results of the check are sent to the server in real time, and a doctor analyzes them remotely.

[1042] Interaction in virtual space and support using emotion engine

[1043] 9. Interacting with digital people and automata in virtual spaces

[1044] Example: A user interacts with digital people or automata in a virtual space to reduce feelings of loneliness. A server generates digital people or automata in a virtual space and makes them accessible to the user.

[1045] 10. Emotional state analysis and relaxation services

[1046] Example: The server analyzes the emotion data collected by the emotion engine to understand the user's current emotional state. For example, if the user is feeling stressed, it can provide a relaxing music service or a relaxing environment in a virtual space.

[1047] Examples of prompt statements

[1048] "Please give me some healthy eating suggestions for this week."

[1049] "I'm feeling stressed so please recommend some relaxing music."

[1050] Please adjust your hospital visit schedule for next week.

[1051] As described above, the present invention is a system that utilizes advanced technology to provide total support for the user's life and improve the quality of life.

[1052] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1053] Step 1: User puts on the smartwatch

[1054] Input: User wearing a smartwatch

[1055] Specific operation: The user wears a smartwatch and biometric information such as heart rate, walking distance, and sleep time is measured in real time.

[1056] Output: Measured biometric data

[1057] Step 2: Transfer data from your smartwatch to your phone

[1058] Input: Biometric data measured by a smartwatch

[1059] How it works: The smartwatch transmits measurement data via Bluetooth to a smartphone, which temporarily stores and organizes this data.

[1060] Output: Biometric data stored on the smartphone

[1061] Step 3: Emotion data measurement using the emotion engine

[1062] Input: User facial expressions, tone of voice, gestures, etc.

[1063] How it works: The user uses a device equipped with the emotion engine to measure emotion data, which is then analyzed in real time.

[1064] Output: Measured emotion data

[1065] Step 4: Transferring emotional data to your smartphone

[1066] Input: Emotion data from the emotion engine

[1067] How it works: The emotion engine transfers the measured emotion data to the smartphone, which then organizes and stores it.

[1068] Output: Organized emotional data is stored on the smartphone.

[1069] Step 5: Upload data regularly

[1070] Input: Biometric and emotional data stored on a smartphone

[1071] How it works: Your smartphone periodically uploads this data to a server via Wi-Fi or mobile data.

[1072] Output: Biometric and emotional data uploaded to the server

[1073] Step 6: Receiving and storing data

[1074] Input: Data uploaded from your smartphone

[1075] Specific operation: The server receives biometric and emotional data sent from the smartphone and stores the received data in a database.

[1076] Output: Data stored in the server database

[1077] Step 7: Analyze the data with a generative AI model

[1078] Input: Stored biometric and emotional data

[1079] Specific operation: The server analyzes the stored data using a generative AI model. As a result of the analysis, it understands the user's health and emotional state and generates an appropriate service plan.

[1080] Output: Generated service plan

[1081] Step 8: Send instructions for the generated service plan to each device

[1082] Input: Generated service plan

[1083] Specific operations: Based on the generated service plan, the server sends specific instructions to each device or system, such as an unmanned aerial vehicle, an autonomous vehicle, or a home medical system.

[1084] Output: Specific instructions sent to each device or system

[1085] Step 9: Meal pickup and delivery by drone

[1086] Input: Food delivery instructions from the server

[1087] Specific operation: The unmanned aerial vehicle receives instructions from the server, heads to the specified restaurant, picks up the meal, and then delivers the meal to the user's designated location (such as a balcony).

[1088] Output: Meal delivered to user-specified location

[1089] Step 10: Mobility support with autonomous vehicles

[1090] Input: Movement plan instructions from the server

[1091] Specific operation: The autonomous vehicle receives instructions from the server and arrives at the user's home at the specified time. It then safely drives the user to their destination.

[1092] Output: Safe travel to destination

[1093] Step 11: Implementing a home health system

[1094] Input: Home care orders from the server

[1095] Specific operation: If the server determines that a user's health check is necessary, it sends instructions to the home medical system. The medical robot visits the user's home and performs a health check.

[1096] Output: Health checks performed and real-time data sent to the server

[1097] Step 12: Virtual interaction

[1098] Input: User access request and emotion data

[1099] Specific operation: The user accesses the virtual space and interacts with digital people and automated machines. The server generates the virtual space and makes it accessible to the user.

[1100] Output: User interaction experience in virtual space

[1101] Step 13: Understanding emotional states using the emotion engine and providing services

[1102] Input: Emotion data

[1103] Specific operation: The emotion engine analyzes the emotion data and understands the user's current emotional state. The server generates and provides relaxation and support services based on the emotional state.

[1104] Output: Relaxation services and assistance suited to the user

[1105] (Application example 2)

[1106] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1107] Conventional smart city construction technologies have struggled to provide optimal services tailored to individual users' lifestyles, health conditions, travel patterns, dietary habits, and emotional fluctuations. Furthermore, at workplaces, there has been a lack of means to collect and analyze workers' biometric and emotional data in real time and optimize the work environment. This has resulted in reduced worker efficiency and increased health risks. A comprehensive system is needed to solve these problems.

[1108] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1109] In this invention, the server includes a means for collecting data on the user's daily rhythm, health condition, travel patterns, and dietary habits, a means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and a means for sending instructions to service devices and systems according to the generated service plan. This enables the provision of optimal services tailored to the user's individual circumstances. Furthermore, the smart glasses include a means for collecting biometric information and emotional data from the worker, a means for analyzing the collected biometric information and emotional data, and a means for sending instructions to optimize the work environment. The cooperative operation of various devices and systems that execute the service plan enables the optimization of the overall work environment and the safety of the worker.

[1110] A "user" is an individual who receives a service in the present invention.

[1111] "Life rhythm" refers to the temporal behavioral patterns of a user in their daily life.

[1112] "Health status" is information that indicates the degree of the user's physical and mental health.

[1113] "Travel patterns" refer to the route and time zone trends that a user typically follows on a daily basis.

[1114] "Diet" refers to the food content and eating habits of a user on a daily basis.

[1115] The "data collection means" refers to a device or system for collecting biometric information and behavioral data of a user.

[1116] A "generative AI model" is an artificial intelligence technology that analyzes collected data and generates appropriate service plans.

[1117] A "service plan" is a specific service plan or proposal that is provided taking into account the individual circumstances of the user.

[1118] "Service equipment and systems" are physical and software devices for executing generated service plans.

[1119] A "drone" is a device that uses unmanned aerial vehicle technology to deliver goods.

[1120] An "autonomous vehicle" is a vehicle that drives autonomously using artificial intelligence technology.

[1121] A "home medical system" is a device or system for providing medical testing and care in a user's home.

[1122] A "health check" is an examination or monitoring to assess the user's health status.

[1123] A "remote physician" is a physician who is not physically near the user but provides medical services remotely.

[1124] "Virtual reality space" is a pseudo-three-dimensional space generated by computer technology.

[1125] "Digital family members" are digital characters that users can interact with in a virtual reality space.

[1126] A "robot" is a mechanical device that is designed to assist a user autonomously or remotely.

[1127] "Smart glasses" are glasses-type devices worn on the user's eyes that display information and collect biometric and emotional data using sensors.

[1128] "Biometric information" refers to information about the user's physical condition, such as heart rate, body temperature, and respiratory rate.

[1129] "Emotion data" is information about the user's emotional state that is analyzed from facial expressions, tone of voice, and the like.

[1130] "Work environment optimization" means adjusting work conditions to the optimum state based on the user's biometric information and emotional data.

[1131] System Overview

[1132] The system of this invention collects data on a user's lifestyle, health status, travel patterns, and diet, analyzes it using a generative AI model, and generates an optimal service plan for the user. Based on this service plan, the system also comprehensively manages the provision of services via various devices and systems, such as drones, self-driving cars, home medical systems, and smart glasses.

[1133] Hardware and software used

[1134] 1. Hardware:

[1135] Smart glasses: Devices that collect biometric and emotional data from users (e.g., Google Glass Enterprise Edition).

[1136] Drone: A device that uses unmanned aerial technology to deliver goods.

[1137] Self-driving car: A vehicle that uses artificial intelligence technology to drive itself autonomously.

[1138] Home medical robot: A device that checks the user's health and transmits the data to a doctor in a remote location.

[1139] 2. Software:

[1140] Generative AI model: Analyzes user data and generates optimal service plans (e.g., TensorFlow, PyTorch).

[1141] Emotion engine: Analyzes emotion data and understands the user's emotional state (e.g., Emotion API).

[1142] Cloud server: Analyzes data and generates service plans (e.g., AWS).

[1143] Data processing and calculation

[1144] 1. Data Collection and Transmission:

[1145] The server collects the user's biometric information, such as heart rate, body temperature, and voice tone, as well as emotional data in real time through the smart glasses and transfers it to a cloud server.

[1146] 2. Data Analysis:

[1147] The server analyzes the data uploaded to the cloud server using a generative AI model and emotion engine. This includes assessing the user's health and determining their emotional state. For example, if the user's fatigue level is high, it generates a service plan that recommends taking a break.

[1148] 3. Create and run the service plan:

[1149] Based on the service plan, it sends instructions to various devices and systems, such as instructing a drone to deliver a meal or an autonomous vehicle to move the user.

[1150] Specific examples

[1151] For example, if a user is working for a long time and is becoming increasingly fatigued based on data collected from the smart glasses, the cloud server will use the generative AI model to generate instructions recommending "taking a break," while simultaneously instructing a drone to deliver a relaxing lunch to the user's workspace and adjusting lighting and temperature to a comfortable level for the user.

[1152] Prompt Sentence Examples

[1153] Based on the data collected from the emotion engine, the system analyzes the health and emotional state of workers, and if the fatigue level is above 80 or the stress level is above 70, it sends a command to the cloud server to "recommend taking a break." It also sends a command to dim the factory lights and start playing relaxing music.

[1154] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1155] Step 1:

[1156] The user wears smart glasses. The smart glasses collect the user's biometric information (heart rate, body temperature, respiratory rate) and emotional data (facial expression, tone of voice, etc.) in real time. These data are the original input. The smart glasses collect this data and transfer it to a smartphone or directly to a cloud server.

[1157] Step 2:

[1158] The server receives the collected biometric and emotional data from the cloud server. The received data is stored in an internal database. The stored data is then analyzed by the generative AI model and emotion engine.

[1159] Step 3:

[1160] The server uses the generative AI model and emotion engine to analyze the received biometric and emotional data. During the analysis, the server extracts, for example, the user's fatigue level and stress level. The output of this analysis is an assessment of the user's health and emotional state.

[1161] Step 4:

[1162] Based on the analysis results obtained by the server, the server generates an optimal service plan for the user. Specifically, it creates a plan that recommends rest if fatigue is high, or a plan that suggests nutritionally balanced meals if the diet is inappropriate. This service plan is the generated output.

[1163] Step 5:

[1164] The server sends instructions to various devices (drones, self-driving cars, smart glasses, etc.) based on the generated service plan. For example, it instructs a drone to deliver a meal, an autonomous car to navigate from the user's home to a specific destination, or smart glasses to remind the user to take a break.

[1165] Step 6:

[1166] The drone starts operating according to instructions from the server. It picks up the meal from the specified restaurant and then delivers it to the user's specified location (for example, the user's workplace). This is the specific operation of the drone.

[1167] Step 7:

[1168] The self-driving car starts operating according to instructions from the server. It arrives at the user's home at the specified time and safely drives the user to their destination. After completing the drive, the self-driving car waits for the next instruction.

[1169] Step 8:

[1170] The smart glasses notify the user of the server's instructions. For example, they can display a message saying "Please take a break" and simultaneously play relaxing music. The user is expected to take a break in accordance with this message.

[1171] Step 9:

[1172] The user receives the meal or uses the self-driving car and takes the necessary action. When the user receives the meal, they can also send feedback about the meal (satisfaction, problems, etc.) to the server via smart glasses or a smartphone.

[1173] Step 10:

[1174] The server receives feedback from users and uses it to improve future service plans, which is expected to result in a continuous improvement in the quality of service.

[1175] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1176] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1177] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1178] [Third embodiment]

[1179] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1180] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1181] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1182] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1183] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1184] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1185] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1186] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1187] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1188] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1189] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1190] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1191] overview

[1192] This invention aims to build a smart city that improves users' quality of life by utilizing generative AI models and advanced technologies. Specifically, it collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes them using generative AI models, and provides optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, autonomous vehicle transportation support, home medical care, and virtual interaction between digital families and robots.

[1193] Data collection

[1194] 1. Users

[1195] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[1196] 2. Device (smartphone)

[1197] The transferred data is organized and periodically uploaded to the server.

[1198] Analyzing data and generating service plans

[1199] 3. Server

[1200] The collected data is analyzed using a generative AI model. For example, it analyzes health status and generates nutritionally balanced meal menus for food delivery.

[1201] Analyze user travel patterns and create schedules for self-driving vehicles.

[1202] Book home health care time slots when necessary.

[1203] Service Instruction and Execution

[1204] 4. Server

[1205] Based on the generated service plan, instructions are sent to the devices and systems responsible for carrying out each service, such as sending instructions to a drone to deliver a meal from a designated restaurant to the user's home, or to an autonomous vehicle to transport the user to their destination.

[1206] 5. Drones

[1207] Once instructed, the robot will head to the designated restaurant, pick up the meal, and deliver it to the user's home, where it will drop off the meal at a designated location (e.g., balcony).

[1208] 6. Self-driving cars

[1209] Once instructions are received, the vehicle will pick up the user at the specified time and place and safely drive to the pre-set destination.

[1210] Providing home medical care

[1211] 7. Server

[1212] If the user needs a health check or medical treatment, instructions are sent to the home medical system.

[1213] 8. Terminal (medical robot)

[1214] The system visits the user's home and performs necessary health checks, and the collected data is sent to the server in real time.

[1215] 9. Doctor

[1216] The remotely transmitted data is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[1217] Virtual interaction

[1218] 10. Users

[1219] Access the virtual space using a digital device (e.g., a smartphone or VR device).

[1220] 11. Server

[1221] We create an environment in a virtual space where users can interact with digital family members and support robots.

[1222] 12. Users

[1223] In the virtual space, people can interact and engage in collaborative activities with their digital family or robots, a process that reduces feelings of loneliness and provides psychological support.

[1224] Specific examples

[1225] Specific examples of meal delivery

[1226] When a user makes a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[1227] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[1228] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[1229] Examples of outpatient visits

[1230] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[1231] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[1232] In this way, the present invention aims to effectively provide support services adapted to an aging society and improve the quality of life of users.

[1233] The processing flow will be explained below.

[1234] Step 1:

[1235] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[1236] Step 2:

[1237] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[1238] Step 3:

[1239] The device (smartphone) organizes and saves the transferred data and periodically uploads it to the server.

[1240] Step 4:

[1241] The server aggregates the data received from users and provides it to the generative AI model, which analyzes their health status, lifestyle, travel patterns, diet, and other factors.

[1242] Step 5:

[1243] The server uses the generative AI model to generate a service plan optimized for each user, for example, determining a nutritionally balanced meal menu based on health data.

[1244] Step 6:

[1245] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[1246] Step 7:

[1247] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[1248] Step 8:

[1249] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, picks up the user, and drives safely to the destination (e.g., hospital).

[1250] Step 9:

[1251] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[1252] Step 10:

[1253] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[1254] Step 11:

[1255] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[1256] Step 12:

[1257] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[1258] Step 13:

[1259] Users access the virtual space using digital devices (smartphones or VR devices).

[1260] Step 14:

[1261] The server generates an environment for interaction with digital family and robots in a virtual space.

[1262] Step 15:

[1263] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[1264] Through this series of steps, smart cities will provide cutting-edge systems that support and improve the quality of users' lives.

[1265] Example 1

[1266] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1267] In modern society, with the aging population and diversifying lifestyles, there is a demand for providing optimal services to each individual user. However, existing systems lack the means to centrally collect and analyze data on users' daily rhythms, health conditions, and travel patterns, and to generate service plans tailored to individual needs. Furthermore, there is no system that can comprehensively manage meal delivery, transportation support, home medical care, and virtual space interactions, limiting the quality and efficiency of the services users can receive.

[1268] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1269] In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement patterns, and dietary habits, means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and means for sending instructions to service devices and systems in accordance with the generated service plan, thereby enabling the provision of optimal services tailored to the user's complex needs.

[1270] The "user's life rhythm" refers to the time periods and periodic activity patterns of the user's daily life, such as waking up, going to bed, eating, and exercising.

[1271] "Health status" refers to indicators of a user's physical and mental health, including, for example, heart rate, blood pressure, sleep quality, and stress level.

[1272] "Travel patterns" refers to data such as a user's daily travel routes and frequency, and the history of places visited.

[1273] "Dietary data" refers to information related to the types of food and nutrients a user consumes, as well as meal times and frequency.

[1274] A "generative AI model" refers to an algorithm or system that learns from large amounts of data and performs natural language generation and data analysis like a human.

[1275] "Generated service plan" refers to a specific plan of services to be provided according to the user's needs and condition based on the analysis results of the generating AI model.

[1276] "Service equipment and systems" refers to equipment and systems for performing specific services such as food delivery, autonomous driving, health checks, and virtual interactions.

[1277] "Unmanned aerial vehicle" refers to an aircraft that can fly remotely or autonomously and transport or deliver goods.

[1278] An "autonomous vehicle" refers to a vehicle that can drive autonomously using artificial intelligence and sensor technology.

[1279] A "home medical system" refers to equipment and software used to conduct health checks and medical treatment in a user's home.

[1280] "Virtual space" refers to a computer-generated digital environment that allows users to interact with digital family members and robots.

[1281] "Digital family" refers to digital characters created to interact with users in a virtual space.

[1282] A "wearable device" refers to a small electronic device that can be worn and used by a user on a daily basis.

[1283] MODE FOR CARRYING OUT THE INVENTION

[1284] overview

[1285] This invention relates to a system for building smart cities that utilizes generative AI models and advanced technologies to improve users' quality of life. The system collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes the data using generative AI models, and provides optimal service plans for users. The system also manages a series of integrated services, including food delivery by unmanned aerial vehicles, transportation support by autonomous vehicles, home medical care, and interaction between digital families and robots in a virtual space.

[1286] Data collection

[1287] 1. Users

[1288] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time and transfer it to their smartphones.

[1289] For example, if you wake up at 6am, the smartwatch will automatically record your heart rate and sleep time, and this data will be transferred to your smartphone via Bluetooth.

[1290] Organizing and sending data

[1291] 2. Device (smartphone)

[1292] The device organizes the received data using a dedicated application (e.g., a health care app) and uploads it to a server periodically (e.g., every hour).

[1293] Data is transmitted over Wi-Fi or mobile networks and is encrypted to protect privacy.

[1294] Analyzing data and generating service plans

[1295] 3. Server

[1296] The server receives the collected data in real time and analyzes it with a generative AI model (e.g., GPT-4), for example, to evaluate the user's health status and customize an appropriate meal menu.

[1297] The server analyzes the user's travel patterns and creates a schedule for the self-driving car. For example, it understands that the user travels to a specific location at a certain time each week and sets the schedule for the self-driving car accordingly.

[1298] Prescribing and executing service plans

[1299] 4. Server

[1300] The server transmits instructions to an execution device, such as an unmanned aerial vehicle or an autonomous vehicle, based on the generated service plan.

[1301] Specifically, the drone will be instructed to retrieve a specific meal from a specified restaurant and deliver it to the user's home, while the self-driving car will be instructed to pick up the user from their home at 9:00 and arrive at their destination by 10:00.

[1302] 5. Unmanned aerial vehicle

[1303] When the drone receives instructions from the server, it flies to the specified restaurant and picks up the meal. For example, it delivers a high-protein, low-fat meal to a user who has requested dinner.

[1304] 6. Self-driving cars

[1305] The self-driving car will pick up the user at the designated time and drive safely to the destination, using LIDAR sensors and cameras to understand the surrounding situation.

[1306] Providing home medical care

[1307] 7. Server

[1308] The server sends necessary instructions to the home medical system according to the user's health condition. For example, if a user shows symptoms of high blood pressure, the home medical robot will measure their blood pressure.

[1309] 8. Terminal (medical robot)

[1310] The medical robot performs the prescribed health checks and transmits the acquired data to a server in real time.

[1311] 9. Doctor

[1312] The data sent remotely is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[1313] Virtual interaction

[1314] 10. Users

[1315] Users access the virtual space using digital devices (e.g., smartphones or VR devices) and interact with their digital family and support robots.

[1316] 11. Server

[1317] It creates a virtual space and provides an environment where users can interact with their digital family and support robots. For example, it sets up a birthday party in the user's virtual space and generates a scene in which the digital family hands out presents.

[1318] Specific examples

[1319] Specific examples of meal delivery

[1320] When a user inputs a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[1321] The server sends instructions to the drone to "get food from the specified restaurant and deliver it to the user's balcony."

[1322] The drone will pick up the meal and deliver it to your balcony.

[1323] Specific examples of outpatient visits

[1324] When a user enters a medical appointment into a smartphone application, the server creates and transmits a driving plan for the self-driving car.

[1325] The self-driving car will arrive at the user's home at the specified time and drive safely with the user on board.

[1326] Prompt Sentence Examples

[1327] "When a user makes a dinner request, explain how the server selects the appropriate menu item and how the drone delivers the meal."

[1328] In this way, the system aims to provide a variety of support services suited to an aging society and to improve the overall quality of life of users.

[1329] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1330] Step 1:

[1331] Users use a smartwatch or biometric measurement device to measure data and transfer it to their smartphone.

[1332] Input: Smartwatch data such as heart rate, walking distance, and sleep time

[1333] Data processing: The information measured by the smartwatch is transferred to the smartphone via Bluetooth.

[1334] Output: Biometric data transferred to a smartphone

[1335] How it works: When you wake up at 6am, your heart rate and sleep time will be automatically measured by the smartwatch, and this data will be transferred to your smartphone via Bluetooth.

[1336] Step 2:

[1337] The device (smartphone) organizes the received data and periodically uploads it to the server.

[1338] Input: Biometric data transferred from the smartwatch

[1339] Data processing: Organize and encrypt data using dedicated applications (e.g., health apps)

[1340] Output: Upload the organized data to the server

[1341] What it does: The Health app organizes your data and uploads it to a server every hour over Wi-Fi or your mobile network.

[1342] Step 3:

[1343] The server analyzes the collected data using a generative AI model and generates a service plan.

[1344] Input: Biometric data uploaded to the server

[1345] Data processing: Using generative AI models (e.g., GPT-4) to analyze data and assess health status and mobility patterns

[1346] Output: Optimal service plan based on analysis results

[1347] How it works: The server uses a generative AI model to assess the user's health and determine that they need a high-protein, low-fat menu. It then creates a personalized meal plan.

[1348] Step 4:

[1349] The server transmits instructions to each service device based on the generated service plan.

[1350] Input: Generated service plan

[1351] Data processing: Generate specific instructions, such as food delivery instructions or scheduling an autonomous vehicle

[1352] Output: Instructions sent to unmanned aerial vehicles and autonomous vehicles

[1353] Specific operation: The server sends instructions to the unmanned aerial vehicle to retrieve a specific meal from a specified restaurant and deliver it to the user's home. It also sends instructions to the self-driving car to pick up the user from their home at 9:00 and arrive at their destination at 10:00.

[1354] Step 5:

[1355] The drones will then receive instructions and deliver the meals to designated locations.

[1356] Input: Meal delivery instructions from the server

[1357] Data processing: Use GPS to fly to a designated restaurant and pick up your meal

[1358] Output: Meal delivered to the user's home

[1359] Specific operation: The drone will fly to the designated restaurant, pick up the meal, and deliver it to the user's balcony. After delivery, it will return to the user's home using the coordinates.

[1360] Step 6:

[1361] The self-driving car will pick up the user at a designated time and place and drive them to their destination.

[1362] Input: Operation instructions from the server

[1363] Data processing: Calculate routes using LIDAR sensors and cameras to operate safely

[1364] Output: User arrives at destination

[1365] Specific operation: The self-driving car arrives in front of the user's home at the specified time, safely picks up the user, and drives them to their destination.

[1366] Step 7:

[1367] The server instructs the home medical system to check the user's health.

[1368] Input: User's health data and health check instructions

[1369] Data processing: Evaluate the user's health status and generate instructions for necessary health checks

[1370] Output: Health check instructions sent to medical robot

[1371] Specific operation: For a user showing symptoms of high blood pressure, the server instructs the medical robot to "measure blood pressure and send the data to the server."

[1372] Step 8:

[1373] The terminal (medical robot) performs a health check and sends the acquired data to the server.

[1374] Input: Health check instructions from the server

[1375] Data processing: Measure the user's health data, encrypt it, and send it to the server

[1376] Output: Health data sent to the server

[1377] Specific operation: The medical robot measures the user's blood pressure and transmits the data to a server in real time.

[1378] Step 9:

[1379] The doctor analyzes the transmitted data and sends treatment instructions back to the medical robot.

[1380] Input: Health data sent from the server

[1381] Data processing: Analyze data and create necessary medical instructions

[1382] Output: Treatment instructions sent back to the medical robot

[1383] Specific operation: The doctor remotely checks the data and sends instructions to the medical robot, such as "Administer medication because the patient's blood pressure is high." The robot then administers the medication based on the instructions.

[1384] Step 10:

[1385] Users access the virtual space using digital devices and interact with their digital family and support robots.

[1386] Input: Access request from a digital terminal

[1387] Data processing: Connection to virtual space, user authentication, interaction simulation

[1388] Output: Interactive experience in virtual space

[1389] Specific operation: Users use smartphones or VR devices to access a virtual space, where they can interact with their digital family and collaborate with a support robot.

[1390] Step 11:

[1391] The server generates an environment in which users can interact with their digital family and support robots in a virtual space.

[1392] Input: User's request in the virtual space

[1393] Data processing: Virtual space generation, digital character creation, script execution

[1394] Output: A user-accessible virtual space

[1395] Specific operation: The server generates a virtual space, for example, setting up a virtual birthday party for the user and creating a scene in which the digital family hands over presents.

[1396] Step 12:

[1397] Users can enjoy interacting and collaborating with their digital family and robots in a virtual space.

[1398] Input: Interacting with digital characters in a virtual space

[1399] Output: Psychological support and entertainment experiences

[1400] Specific actions: Users can interact with their digital family in a virtual space, reducing feelings of loneliness. They can also collaborate with a support robot and receive functional support while having fun.

[1401] (Application example 1)

[1402] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1403] In an aging society, there is a demand for detailed support tailored to individual health conditions and lifestyle patterns, but existing systems have difficulty providing this automatically. Another issue is the lack of a system that can collect users' health data in real time and respond immediately in emergencies. Furthermore, there is a lack of a means to notify users of generated health reports in a timely manner. Therefore, a comprehensive system is needed to improve users' quality of life.

[1404] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1405] In this invention, the server includes: means for collecting data on a user's daily rhythm, health status, travel patterns, and dietary habits; means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user; means for transmitting instructions to service devices and systems according to the generated service plan; means for an unmanned aerial vehicle receiving the instructions to deliver meals to a specified location; means for an autonomous vehicle receiving the instructions to safely drive the user to the destination; means for a home medical system to conduct health checks on the user and transmit the data to a remote doctor; means for the user to interact with a digital family or robot in a virtual space; means for collecting the user's health data in real time and communicating with a doctor via a medical robot in an emergency; and means for notifying the user of the generated health report. This enables daily monitoring of the user's health status and prompt and appropriate medical treatment when necessary. It also provides comprehensive support that contributes to improving the user's quality of life.

[1406] "User's daily rhythm" refers to the activity patterns and time management in the user's daily life.

[1407] "Health Status" refers to the overall state of a user's physical and mental health.

[1408] "Travel patterns" refer to a user's usual travel routes, choice of transportation means, travel time, etc.

[1409] "Diet" refers to the types and amounts of food a user consumes on a daily basis, the time of intake, and nutritional balance.

[1410] "Means for collecting data" refers to devices and systems for measuring and recording various activities and health conditions of users.

[1411] A "generative AI model" refers to algorithms or software that uses artificial intelligence to analyze data and generate patterns or optimized results.

[1412] "Means for analyzing and generating optimal service plans for users" refers to systems and algorithms that use collected data to design and propose services that best suit the user's needs.

[1413] The "means for transmitting instructions" refers to a communication system for transmitting operation commands to various terminals and devices based on the generated service plan.

[1414] "Unmanned aerial vehicle" refers to a drone or other flying device designed to fly autonomously and carry goods.

[1415] An "autonomous vehicle" refers to a vehicle that drives itself without human input.

[1416] "Home medical system" refers to a system or device for providing medical services in a user's home.

[1417] "Means for performing health checks and transmitting data to a remote doctor" refers to a system or device for monitoring a user's health status and transmitting that data to a doctor remotely.

[1418] "Virtual space" refers to a digital space constructed using computer technology that can be experienced in a way that is close to reality.

[1419] "Digital family" refers to digitized family avatars or characters that can interact with users in a virtual space.

[1420] A "robot" refers to a mechanical device that autonomously performs programmed actions.

[1421] "Means for notifying users of health reports" refers to systems and methods for communicating analysis results and recommendations to users.

[1422] The present invention relates to a system for providing various services based on a user's health condition and lifestyle patterns. Specific embodiments for carrying out the present invention will be described below.

[1423] System Overview

[1424] Data collection

[1425] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. This data is then transferred to the user's smartphone, which then organizes the data and periodically uploads it to a server.

[1426] Data analysis and service plan generation

[1427] The server receives the uploaded data and analyzes it using generative AI models, for example, analyzing health conditions and generating nutritionally balanced meal plans for food delivery, analyzing the user's travel patterns and creating schedules for autonomous vehicles, and even reserving time slots for home medical care if necessary.

[1428] Service Instruction and Execution

[1429] Based on the generated service plan, the server sends instructions to the devices and systems responsible for executing each service. For example, an unmanned aerial vehicle delivers meals to a specified location, an autonomous vehicle drives a user to their destination, or a home medical system checks the user's health and transmits the acquired data to the server in real time.

[1430] Hardware and software used

[1431] Hardware

[1432] Smartwatches: (e.g., smartwatches, fitness tracking devices)

[1433] Smartphones: (e.g. iOS devices, Android devices)

[1434] Unmanned aerial vehicles: (e.g., delivery drones)

[1435] Autonomous vehicles: (e.g., self-driving cars, robotaxis)

[1436] Medical robots: (e.g., home medical support robots)

[1437] software

[1438] Generative AI models: (e.g., machine learning models using the scikit-learn library)

[1439] Data transfer API: (e.g. RESTful API)

[1440] Data analysis software: (e.g., Python program)

[1441] Specific use cases

[1442] Health data analysis and reporting

[1443] The server provides appropriate health advice and reports to users based on the collected health data. For example, if the user's heart rate is abnormally high, the server immediately notifies the medical robot and performs a health check on the user.

[1444] Specific prompt examples:

[1445] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[1446] In this way, the present invention enables daily monitoring of the user's health condition, enabling prompt and appropriate medical treatment when necessary, and providing comprehensive support that contributes to improving the user's quality of life.

[1447] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1448] Step 1:

[1449] Data collection

[1450] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. The data is then transferred to a smartphone and collected as input data. The smartphone then organizes the data and periodically uploads it to a server.

[1451] Step 2:

[1452] Data reception

[1453] The server receives data uploaded from the smartphone. This input data includes heart rate, walking distance, sleep duration, etc. The server stores this data in a database and prepares it for analysis.

[1454] Step 3:

[1455] Data analysis

[1456] The server analyzes the received data using a generative AI model. The generative AI model is implemented using the scikit-learn library and analyzes health status and lifestyle patterns based on the input data. For example, it analyzes the user's heart rate and sleep data to evaluate their health status. The output of this analysis process is a health check result and recommended lifestyle improvements.

[1457] Step 4:

[1458] Service plan generation

[1459] The server generates an optimal service plan for the user based on the analysis results, including a nutritionally balanced meal menu, an appropriate exercise plan, and an autonomous vehicle schedule. The generated plan is output as instructions for the next step.

[1460] Step 5:

[1461] Send instructions

[1462] Based on the generated service plan, the server sends instructions to service devices and systems, such as unmanned aerial vehicles, autonomous vehicles, and home healthcare systems. The instructions detail how each device should operate. For example, an unmanned aerial vehicle might receive instructions to deliver meals to a specified location, and an autonomous vehicle might receive instructions to drive a user to their destination.

[1463] Step 6:

[1464] Execution of instructions

[1465] Each device receives instructions from the server and performs a specific operation. For example, an unmanned aerial vehicle will head to a designated restaurant, pick up a meal, and deliver it to the user's home. An autonomous vehicle will pick up the user at the designated place and time and drive them safely to their destination.

[1466] Step 7:

[1467] Providing home medical care

[1468] The home medical system performs health checks on users based on instructions from a server. The acquired health data is sent to the server in real time and analyzed by a doctor in a remote location. The medical robot follows instructions from the server and takes appropriate action according to the user's health condition.

[1469] Step 8:

[1470] Health report generation and notification

[1471] The server periodically generates a health report based on the collected data and analysis results. This report includes the user's past health data, current condition, and future recommendations. The report is sent to the user's smartphone, allowing the user to understand their own health status.

[1472] Specific prompt examples:

[1473] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[1474] In this way, each step works in cooperation with the others, making it possible to monitor the user's health condition and provide optimal services.

[1475] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1476] overview

[1477] This invention aims to build a smart city that improves users' quality of life by utilizing advanced technologies such as generative AI models and emotion engines. Specifically, it collects data on users' daily rhythms, health conditions, travel patterns, and dietary habits, as well as emotional data, and analyzes it using generative AI models to provide optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, transportation support using self-driving cars, home medical care, and virtual interactions between digital families and robots.

[1478] Data collection

[1479] 1. Users

[1480] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[1481] Using a device equipped with an emotion engine, emotional data such as facial expressions, tone of voice, and gestures are measured.

[1482] 2. Device (smartphone)

[1483] The transferred biometric information and emotional data are organized and periodically uploaded to a server.

[1484] Analyzing data and generating service plans

[1485] 3. Server

[1486] The collected biometric and emotional data is analyzed using a generative AI model, which, for example, generates a nutritionally balanced meal menu taking into account the patient's health and emotional state.

[1487] Adjust the schedule of self-driving cars based on user travel patterns and emotional data.

[1488] Book home health care time slots when necessary.

[1489] Service Instruction and Execution

[1490] 4. Server

[1491] Based on the generated service plan, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[1492] 5. Drones

[1493] Once instructed, the robot will head to the designated restaurant to pick up the meal, and then deliver it to the user's designated location (such as a balcony).

[1494] 6. Self-driving cars

[1495] Once instructions are received, the vehicle will arrive at the user's home at the specified time and travel safely to the pre-set destination.

[1496] Providing home medical care

[1497] 7. Server

[1498] If it determines that the user's health needs to be checked, it sends instructions to the home medical system.

[1499] 8. Terminal (medical robot)

[1500] Upon receiving instructions, it visits the user's home, conducts a health check, and sends the results to the server in real time.

[1501] 9. Doctor

[1502] The data transmitted remotely is analyzed and medical instructions are sent to the robot.

[1503] Virtual interaction

[1504] 10. Users

[1505] Access the virtual space using a digital device (smartphone or VR device).

[1506] 11. Server

[1507] We create an environment in which people can interact with digital family and robots in a virtual space.

[1508] 12. Users

[1509] Interacting with digital family and robots in a virtual space reduces feelings of loneliness.

[1510] Support by Emotion Engine

[1511] 13. Terminal (device with emotion engine)

[1512] It recognizes emotions based on data such as the user's facial expressions, tone of voice, and gestures.

[1513] 14. Server

[1514] Emotion data collected from the emotion engine is analyzed to understand the user's current emotional state.

[1515] 15. Server

[1516] The system generates a service plan that takes into account the user's emotional state. If the emotional state is stressful, it will provide relaxing music services and support in a virtual space.

[1517] Specific examples

[1518] A concrete example of emotion-based food delivery

[1519] When a user makes a dinner request, the server selects an appropriate menu based on the user's health and emotional data.

[1520] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[1521] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[1522] Examples of emotionally driven visits

[1523] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[1524] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[1525] Emotion-based support in virtual space

[1526] If the emotion engine detects that the user is feeling stressed, the server generates a relaxing environment in the virtual space and guides the user on how to access it.

[1527] Users can interact with digital family and robots in a virtual space and receive support to reduce stress.

[1528] In this way, the present invention provides an advanced life support system that also takes emotion data into consideration, thereby further improving the quality of life of users.

[1529] The processing flow will be explained below.

[1530] Step 1:

[1531] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[1532] Step 2:

[1533] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[1534] Step 3:

[1535] The device (smartphone) organizes and stores the transferred biometric information and periodically uploads it to the server.

[1536] Step 4:

[1537] The terminal (device equipped with an emotion engine) measures the user's facial expressions, tone of voice, and gestures in real time, generates emotion data, and transfers it to the terminal (smartphone).

[1538] Step 5:

[1539] The device (smartphone) organizes the transferred emotional data and uploads it to the server along with the biometric information.

[1540] Step 6:

[1541] The server collects the received biometric and emotional data and provides it to the generative AI model, which analyzes the user's health, daily rhythm, movement patterns, emotional state, and other factors.

[1542] Step 7:

[1543] The server uses the generative AI model to generate an optimized service plan for each user, for example, determining a nutritionally balanced meal menu based on health and emotional data.

[1544] Step 8:

[1545] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[1546] Step 9:

[1547] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[1548] Step 10:

[1549] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, and drives safely to the pre-set destination.

[1550] Step 11:

[1551] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[1552] Step 12:

[1553] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[1554] Step 13:

[1555] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[1556] Step 14:

[1557] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[1558] Step 15:

[1559] Users access the virtual space using digital devices (smartphones or VR devices).

[1560] Step 16:

[1561] The server generates an environment in a virtual space where people can interact with digital family members and robots.

[1562] Step 17:

[1563] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[1564] Step 18:

[1565] The terminal (device equipped with an emotion engine) again measures the user's facial expressions, tone of voice, and gestures, and updates the emotion data.

[1566] Step 19:

[1567] The server analyzes the updated emotional data and adjusts and optimizes the service plan in real time as needed. If the emotional state is stressful, it provides relaxing music services and support in a virtual space.

[1568] Through this series of steps, a high-dimensional life support system that also takes emotional data into account will improve the quality of the user's life.

[1569] Example 2

[1570] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1571] In modern society, the aging of society and the diversification of lifestyles are driving demand for advanced systems that comprehensively support people's daily rhythms, health conditions, travel patterns, dietary habits, and other aspects of their lives. It is also necessary to provide services that take emotional information into account, but current technology has not yet fully realized this. The present invention aims to solve these problems and improve the quality of life of users.

[1572] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement pattern, and dietary habits, means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user, means for sending instructions to a service device or system according to the generated service plan, means for recognizing emotions and analyzing the emotion data to grasp the user's emotional state, and means for generating optimal relaxation services and support based on the emotional state. This makes it possible to comprehensively support a wide range of needs of users and improve their quality of life.

[1573] "User" refers to a person who uses the system.

[1574] "Life rhythm" refers to data that indicates a user's daily activities and sleep cycles.

[1575] "Health status" refers to data including biometric information such as the user's heart rate, blood pressure, body temperature, and sleep duration.

[1576] "Travel patterns" refers to data indicating a user's regular travel routes and frequency.

[1577] "Diet" refers to data regarding the types of food a user consumes and their nutritional balance.

[1578] "Means of collecting data" refers to devices and software that collect information on users' lifestyles, health conditions, travel patterns, and dietary habits.

[1579] "Generative AI model" refers to an artificial intelligence model that analyzes collected data and generates service plans and proposals suitable for users.

[1580] "Means for analysis" refers to the equipment and software used to analyze the collected data.

[1581] A "service plan" refers to a method of providing optimal support and services based on a user's lifestyle, health condition, travel patterns, diet, emotional state, etc.

[1582] The term "service device or system" refers to a device or system that provides a service to a user based on a generated service plan.

[1583] "Unmanned aerial vehicle" refers to a small aircraft operated by remote control or autonomous pilot for the purpose of delivering goods.

[1584] An "autonomous vehicle" refers to a vehicle that automatically drives a user to their destination.

[1585] A "home medical care system" refers to a system that remotely checks the user's health status and provides necessary medical treatment and advice.

[1586] "Virtual space" refers to a digital environment generated by computer simulation.

[1587] "Digital persona" refers to a computer-generated character that interacts with the user in a virtual space.

[1588] "Automated machine" refers to a robot or other mechanical device that interacts with the user in a virtual space.

[1589] "Means for recognizing emotions" refers to devices or software that sense and recognize a user's emotional state from facial expressions, tone of voice, gestures, etc.

[1590] "Emotional state" refers to the user's emotional and feeling state at any given time.

[1591] "Relaxation services" refer to services such as music and virtual environments that help users reduce stress and relax.

[1592] "Assistance" refers to comprehensive support to improve the user's quality of life.

[1593] MODE FOR CARRYING OUT THE INVENTION

[1594] This invention is a smart system that collects data on a user's daily rhythm, health status, travel patterns, and dietary habits, analyzes the data using a generative AI model, and generates an optimal service plan for the user, thereby improving their quality of life. Specific embodiments of this system are described below.

[1595] Data collection hardware and software

[1596] 1. User data collection

[1597] Hardware: Users use smartwatches and other biometric devices that measure data such as heart rate, walking distance, and sleep duration in real time.

[1598] Software: A dedicated application is installed on the smartwatch, and the measured data is transferred to a smartphone via Bluetooth. The smartphone also has an application installed to organize and store the data and transfer it to a server.

[1599] 2. Collecting Emotional Data

[1600] Hardware: Devices equipped with emotion engines (e.g., emotion-recognizing cameras and microphones) are used. These devices capture data such as the user's facial expressions, tone of voice, and gestures.

[1601] Software: The emotion engine analyzes the data in real time and transmits the emotion data to the smartphone, which organizes it and uploads it to the server.

[1602] Data analysis and service plan generation

[1603] 3. Server Roles

[1604] Hardware: The server has high-performance computing resources and large memory and storage capacity for data management and analysis.

[1605] Software: A generative AI model is installed on the server, which performs analysis based on the collected data.

[1606] 4. Analysis using generative AI models

[1607] The server uses a generative AI model to analyze data collected from users, such as their daily rhythms, health status, and emotional state. This analysis generates an optimal service plan that takes into account the user's health and emotional state.

[1608] Provision of services

[1609] 5. Sending specific service instructions

[1610] Based on the generated service plan, the server sends instructions to various service devices and systems, including unmanned aerial vehicles, autonomous vehicles, and home medical systems.

[1611] 6. Drone meal delivery

[1612] Example: A user requests dinner, and the server sends instructions to an unmanned aerial vehicle to deliver the meal from a specified restaurant to the user's home. The unmanned aerial vehicle picks up the meal and delivers it to the user's balcony.

[1613] 7. Transportation support using autonomous vehicles

[1614] Example: When a user enters a doctor's appointment, the server creates and sends a driving plan for an autonomous vehicle, which arrives at the user's home at the specified time and drives the user safely to their destination.

[1615] 8. Health checks through home medical care systems

[1616] Example: If the server determines that a user needs a health check, it sends instructions to a home medical system, and a medical robot visits the user's home to conduct a health check. The results of the check are sent to the server in real time, and a doctor analyzes them remotely.

[1617] Interaction in virtual space and support using emotion engine

[1618] 9. Interacting with digital people and automata in virtual spaces

[1619] Example: A user interacts with digital people or automata in a virtual space to reduce feelings of loneliness. A server generates digital people or automata in a virtual space and makes them accessible to the user.

[1620] 10. Emotional state analysis and relaxation services

[1621] Example: The server analyzes the emotion data collected by the emotion engine to understand the user's current emotional state. For example, if the user is feeling stressed, it can provide a relaxing music service or a relaxing environment in a virtual space.

[1622] Examples of prompt statements

[1623] "Please give me some healthy eating suggestions for this week."

[1624] "I'm feeling stressed so please recommend some relaxing music."

[1625] Please adjust your hospital visit schedule for next week.

[1626] As described above, the present invention is a system that utilizes advanced technology to provide total support for the user's life and improve the quality of life.

[1627] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1628] Step 1: User puts on the smartwatch

[1629] Input: User wearing a smartwatch

[1630] Specific operation: The user wears a smartwatch and biometric information such as heart rate, walking distance, and sleep time is measured in real time.

[1631] Output: Measured biometric data

[1632] Step 2: Transfer data from your smartwatch to your phone

[1633] Input: Biometric data measured by a smartwatch

[1634] How it works: The smartwatch transmits measurement data via Bluetooth to a smartphone, which temporarily stores and organizes this data.

[1635] Output: Biometric data stored on the smartphone

[1636] Step 3: Emotion data measurement using the emotion engine

[1637] Input: User facial expressions, tone of voice, gestures, etc.

[1638] How it works: The user uses a device equipped with the emotion engine to measure emotion data, which is then analyzed in real time.

[1639] Output: Measured emotion data

[1640] Step 4: Transferring emotional data to your smartphone

[1641] Input: Emotion data from the emotion engine

[1642] How it works: The emotion engine transfers the measured emotion data to the smartphone, which then organizes and stores it.

[1643] Output: Organized emotional data is stored on the smartphone.

[1644] Step 5: Upload data regularly

[1645] Input: Biometric and emotional data stored on a smartphone

[1646] How it works: Your smartphone periodically uploads this data to a server via Wi-Fi or mobile data.

[1647] Output: Biometric and emotional data uploaded to the server

[1648] Step 6: Receiving and storing data

[1649] Input: Data uploaded from your smartphone

[1650] Specific operation: The server receives biometric and emotional data sent from the smartphone and stores the received data in a database.

[1651] Output: Data stored in the server database

[1652] Step 7: Analyze the data with a generative AI model

[1653] Input: Stored biometric and emotional data

[1654] Specific operation: The server analyzes the stored data using a generative AI model. As a result of the analysis, it understands the user's health and emotional state and generates an appropriate service plan.

[1655] Output: Generated service plan

[1656] Step 8: Send instructions for the generated service plan to each device

[1657] Input: Generated service plan

[1658] Specific operations: Based on the generated service plan, the server sends specific instructions to each device or system, such as an unmanned aerial vehicle, an autonomous vehicle, or a home medical system.

[1659] Output: Specific instructions sent to each device or system

[1660] Step 9: Meal pickup and delivery by drone

[1661] Input: Food delivery instructions from the server

[1662] Specific operation: The unmanned aerial vehicle receives instructions from the server, heads to the specified restaurant, picks up the meal, and then delivers the meal to the user's designated location (such as a balcony).

[1663] Output: Meal delivered to user-specified location

[1664] Step 10: Mobility support with autonomous vehicles

[1665] Input: Movement plan instructions from the server

[1666] Specific operation: The autonomous vehicle receives instructions from the server and arrives at the user's home at the specified time. It then safely drives the user to their destination.

[1667] Output: Safe travel to destination

[1668] Step 11: Implementing a home health system

[1669] Input: Home care orders from the server

[1670] Specific operation: If the server determines that a user's health check is necessary, it sends instructions to the home medical system. The medical robot visits the user's home and performs a health check.

[1671] Output: Health checks performed and real-time data sent to the server

[1672] Step 12: Virtual interaction

[1673] Input: User access request and emotion data

[1674] Specific operation: The user accesses the virtual space and interacts with digital people and automated machines. The server generates the virtual space and makes it accessible to the user.

[1675] Output: User interaction experience in virtual space

[1676] Step 13: Understanding emotional states using the emotion engine and providing services

[1677] Input: Emotion data

[1678] Specific operation: The emotion engine analyzes the emotion data and understands the user's current emotional state. The server generates and provides relaxation and support services based on the emotional state.

[1679] Output: Relaxation services and assistance suited to the user

[1680] (Application example 2)

[1681] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1682] Conventional smart city construction technologies have struggled to provide optimal services tailored to individual users' lifestyles, health conditions, travel patterns, dietary habits, and emotional fluctuations. Furthermore, at workplaces, there has been a lack of means to collect and analyze workers' biometric and emotional data in real time and optimize the work environment. This has resulted in reduced worker efficiency and increased health risks. A comprehensive system is needed to solve these problems.

[1683] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1684] In this invention, the server includes a means for collecting data on the user's daily rhythm, health condition, travel patterns, and dietary habits, a means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and a means for sending instructions to service devices and systems according to the generated service plan. This enables the provision of optimal services tailored to the user's individual circumstances. Furthermore, the smart glasses include a means for collecting biometric information and emotional data from the worker, a means for analyzing the collected biometric information and emotional data, and a means for sending instructions to optimize the work environment. The cooperative operation of various devices and systems that execute the service plan enables the optimization of the overall work environment and the safety of the worker.

[1685] A "user" is an individual who receives a service in the present invention.

[1686] "Life rhythm" refers to the temporal behavioral patterns of a user in their daily life.

[1687] "Health status" is information that indicates the degree of the user's physical and mental health.

[1688] "Travel patterns" refer to the route and time zone trends that a user typically follows on a daily basis.

[1689] "Diet" refers to the food content and eating habits of a user on a daily basis.

[1690] The "data collection means" refers to a device or system for collecting biometric information and behavioral data of a user.

[1691] A "generative AI model" is an artificial intelligence technology that analyzes collected data and generates appropriate service plans.

[1692] A "service plan" is a specific service plan or proposal that is provided taking into account the individual circumstances of the user.

[1693] "Service equipment and systems" are physical and software devices for executing generated service plans.

[1694] A "drone" is a device that uses unmanned aerial vehicle technology to deliver goods.

[1695] An "autonomous vehicle" is a vehicle that drives autonomously using artificial intelligence technology.

[1696] A "home medical system" is a device or system for providing medical testing and care in a user's home.

[1697] A "health check" is an examination or monitoring to assess the user's health status.

[1698] A "remote physician" is a physician who is not physically near the user but provides medical services remotely.

[1699] "Virtual reality space" is a pseudo-three-dimensional space generated by computer technology.

[1700] "Digital family members" are digital characters that users can interact with in a virtual reality space.

[1701] A "robot" is a mechanical device that is designed to assist a user autonomously or remotely.

[1702] "Smart glasses" are glasses-type devices worn on the user's eyes that display information and collect biometric and emotional data using sensors.

[1703] "Biometric information" refers to information about the user's physical condition, such as heart rate, body temperature, and respiratory rate.

[1704] "Emotion data" is information about the user's emotional state that is analyzed from facial expressions, tone of voice, and the like.

[1705] "Work environment optimization" means adjusting work conditions to the optimum state based on the user's biometric information and emotional data.

[1706] System Overview

[1707] The system of this invention collects data on a user's lifestyle, health status, travel patterns, and diet, analyzes it using a generative AI model, and generates an optimal service plan for the user. Based on this service plan, the system also comprehensively manages the provision of services via various devices and systems, such as drones, self-driving cars, home medical systems, and smart glasses.

[1708] Hardware and software used

[1709] 1. Hardware:

[1710] Smart glasses: Devices that collect biometric and emotional data from users (e.g., Google Glass Enterprise Edition).

[1711] Drone: A device that uses unmanned aerial technology to deliver goods.

[1712] Self-driving car: A vehicle that uses artificial intelligence technology to drive itself autonomously.

[1713] Home medical robot: A device that checks the user's health and transmits the data to a doctor in a remote location.

[1714] 2. Software:

[1715] Generative AI model: Analyzes user data and generates optimal service plans (e.g., TensorFlow, PyTorch).

[1716] Emotion engine: Analyzes emotion data and understands the user's emotional state (e.g., Emotion API).

[1717] Cloud server: Analyzes data and generates service plans (e.g., AWS).

[1718] Data processing and calculation

[1719] 1. Data Collection and Transmission:

[1720] The server collects the user's biometric information, such as heart rate, body temperature, and voice tone, as well as emotional data in real time through the smart glasses and transfers it to a cloud server.

[1721] 2. Data Analysis:

[1722] The server analyzes the data uploaded to the cloud server using a generative AI model and emotion engine. This includes assessing the user's health and determining their emotional state. For example, if the user's fatigue level is high, it generates a service plan that recommends taking a break.

[1723] 3. Create and run the service plan:

[1724] Based on the service plan, it sends instructions to various devices and systems, such as instructing a drone to deliver a meal or an autonomous vehicle to move the user.

[1725] Specific examples

[1726] For example, if a user is working for a long time and is becoming increasingly fatigued based on data collected from the smart glasses, the cloud server will use the generative AI model to generate instructions recommending "taking a break," while simultaneously instructing a drone to deliver a relaxing lunch to the user's workspace and adjusting lighting and temperature to a comfortable level for the user.

[1727] Prompt Sentence Examples

[1728] Based on the data collected from the emotion engine, the system analyzes the health and emotional state of workers, and if the fatigue level is above 80 or the stress level is above 70, it sends a command to the cloud server to "recommend taking a break." It also sends a command to dim the factory lights and start playing relaxing music.

[1729] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1730] Step 1:

[1731] The user wears smart glasses. The smart glasses collect the user's biometric information (heart rate, body temperature, respiratory rate) and emotional data (facial expression, tone of voice, etc.) in real time. These data are the original input. The smart glasses collect this data and transfer it to a smartphone or directly to a cloud server.

[1732] Step 2:

[1733] The server receives the collected biometric and emotional data from the cloud server. The received data is stored in an internal database. The stored data is then analyzed by the generative AI model and emotion engine.

[1734] Step 3:

[1735] The server uses the generative AI model and emotion engine to analyze the received biometric and emotional data. During the analysis, the server extracts, for example, the user's fatigue level and stress level. The output of this analysis is an assessment of the user's health and emotional state.

[1736] Step 4:

[1737] Based on the analysis results obtained by the server, the server generates an optimal service plan for the user. Specifically, it creates a plan that recommends rest if fatigue is high, or a plan that suggests nutritionally balanced meals if the diet is inappropriate. This service plan is the generated output.

[1738] Step 5:

[1739] The server sends instructions to various devices (drones, self-driving cars, smart glasses, etc.) based on the generated service plan. For example, it instructs a drone to deliver a meal, an autonomous car to navigate from the user's home to a specific destination, or smart glasses to remind the user to take a break.

[1740] Step 6:

[1741] The drone starts operating according to instructions from the server. It picks up the meal from the specified restaurant and then delivers it to the user's specified location (for example, the user's workplace). This is the specific operation of the drone.

[1742] Step 7:

[1743] The self-driving car starts operating according to instructions from the server. It arrives at the user's home at the specified time and safely drives the user to their destination. After completing the drive, the self-driving car waits for the next instruction.

[1744] Step 8:

[1745] The smart glasses notify the user of the server's instructions. For example, they can display a message saying "Please take a break" and simultaneously play relaxing music. The user is expected to take a break in accordance with this message.

[1746] Step 9:

[1747] The user receives the meal or uses the self-driving car and takes the necessary action. When the user receives the meal, they can also send feedback about the meal (satisfaction, problems, etc.) to the server via smart glasses or a smartphone.

[1748] Step 10:

[1749] The server receives feedback from users and uses it to improve future service plans, which is expected to result in a continuous improvement in the quality of service.

[1750] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1751] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1752] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1753] [Fourth embodiment]

[1754] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1755] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1756] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1757] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1758] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1759] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1760] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1761] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1762] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1763] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1764] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1765] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1766] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1767] overview

[1768] This invention aims to build a smart city that improves users' quality of life by utilizing generative AI models and advanced technologies. Specifically, it collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes them using generative AI models, and provides optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, autonomous vehicle transportation support, home medical care, and virtual interaction between digital families and robots.

[1769] Data collection

[1770] 1. Users

[1771] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[1772] 2. Device (smartphone)

[1773] The transferred data is organized and periodically uploaded to the server.

[1774] Analyzing data and generating service plans

[1775] 3. Server

[1776] The collected data is analyzed using a generative AI model. For example, it analyzes health status and generates nutritionally balanced meal menus for food delivery.

[1777] Analyze user travel patterns and create schedules for self-driving vehicles.

[1778] Book home health care time slots when necessary.

[1779] Service Instruction and Execution

[1780] 4. Server

[1781] Based on the generated service plan, instructions are sent to the devices and systems responsible for carrying out each service, such as sending instructions to a drone to deliver a meal from a designated restaurant to the user's home, or to an autonomous vehicle to transport the user to their destination.

[1782] 5. Drones

[1783] Once instructed, the robot will head to the designated restaurant, pick up the meal, and deliver it to the user's home, where it will drop off the meal at a designated location (e.g., balcony).

[1784] 6. Self-driving cars

[1785] Once instructions are received, the vehicle will pick up the user at the specified time and place and safely drive to the pre-set destination.

[1786] Providing home medical care

[1787] 7. Server

[1788] If the user needs a health check or medical treatment, instructions are sent to the home medical system.

[1789] 8. Terminal (medical robot)

[1790] The system visits the user's home and performs necessary health checks, and the collected data is sent to the server in real time.

[1791] 9. Doctor

[1792] The remotely transmitted data is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[1793] Virtual interaction

[1794] 10. Users

[1795] Access the virtual space using a digital device (e.g., a smartphone or VR device).

[1796] 11. Server

[1797] We create an environment in a virtual space where users can interact with digital family members and support robots.

[1798] 12. Users

[1799] In the virtual space, people can interact and engage in collaborative activities with their digital family or robots, a process that reduces feelings of loneliness and provides psychological support.

[1800] Specific examples

[1801] Specific examples of meal delivery

[1802] When a user makes a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[1803] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[1804] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[1805] Examples of outpatient visits

[1806] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[1807] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[1808] In this way, the present invention aims to effectively provide support services adapted to an aging society and improve the quality of life of users.

[1809] The processing flow will be explained below.

[1810] Step 1:

[1811] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[1812] Step 2:

[1813] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[1814] Step 3:

[1815] The device (smartphone) organizes and saves the transferred data and periodically uploads it to the server.

[1816] Step 4:

[1817] The server aggregates the data received from users and provides it to the generative AI model, which analyzes their health status, lifestyle, travel patterns, diet, and other factors.

[1818] Step 5:

[1819] The server uses the generative AI model to generate a service plan optimized for each user, for example, determining a nutritionally balanced meal menu based on health data.

[1820] Step 6:

[1821] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[1822] Step 7:

[1823] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[1824] Step 8:

[1825] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, picks up the user, and drives safely to the destination (e.g., hospital).

[1826] Step 9:

[1827] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[1828] Step 10:

[1829] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[1830] Step 11:

[1831] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[1832] Step 12:

[1833] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[1834] Step 13:

[1835] Users access the virtual space using digital devices (smartphones or VR devices).

[1836] Step 14:

[1837] The server generates an environment for interaction with digital family and robots in a virtual space.

[1838] Step 15:

[1839] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[1840] Through this series of steps, smart cities will provide cutting-edge systems that support and improve the quality of users' lives.

[1841] Example 1

[1842] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1843] In modern society, with the aging population and diversifying lifestyles, there is a demand for providing optimal services to each individual user. However, existing systems lack the means to centrally collect and analyze data on users' daily rhythms, health conditions, and travel patterns, and to generate service plans tailored to individual needs. Furthermore, there is no system that can comprehensively manage meal delivery, transportation support, home medical care, and virtual space interactions, limiting the quality and efficiency of the services users can receive.

[1844] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1845] In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement patterns, and dietary habits, means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and means for sending instructions to service devices and systems in accordance with the generated service plan, thereby enabling the provision of optimal services tailored to the user's complex needs.

[1846] The "user's life rhythm" refers to the time periods and periodic activity patterns of the user's daily life, such as waking up, going to bed, eating, and exercising.

[1847] "Health status" refers to indicators of a user's physical and mental health, including, for example, heart rate, blood pressure, sleep quality, and stress level.

[1848] "Travel patterns" refers to data such as a user's daily travel routes and frequency, and the history of places visited.

[1849] "Dietary data" refers to information related to the types of food and nutrients a user consumes, as well as meal times and frequency.

[1850] A "generative AI model" refers to an algorithm or system that learns from large amounts of data and performs natural language generation and data analysis like a human.

[1851] "Generated service plan" refers to a specific plan of services to be provided according to the user's needs and condition based on the analysis results of the generating AI model.

[1852] "Service equipment and systems" refers to equipment and systems for performing specific services such as food delivery, autonomous driving, health checks, and virtual interactions.

[1853] "Unmanned aerial vehicle" refers to an aircraft that can fly remotely or autonomously and transport or deliver goods.

[1854] An "autonomous vehicle" refers to a vehicle that can drive autonomously using artificial intelligence and sensor technology.

[1855] A "home medical system" refers to equipment and software used to conduct health checks and medical treatment in a user's home.

[1856] "Virtual space" refers to a computer-generated digital environment that allows users to interact with digital family members and robots.

[1857] "Digital family" refers to digital characters created to interact with users in a virtual space.

[1858] A "wearable device" refers to a small electronic device that can be worn and used by a user on a daily basis.

[1859] MODE FOR CARRYING OUT THE INVENTION

[1860] overview

[1861] This invention relates to a system for building smart cities that utilizes generative AI models and advanced technologies to improve users' quality of life. The system collects data on users' lifestyles, health conditions, travel patterns, and dietary habits, analyzes the data using generative AI models, and provides optimal service plans for users. The system also manages a series of integrated services, including food delivery by unmanned aerial vehicles, transportation support by autonomous vehicles, home medical care, and interaction between digital families and robots in a virtual space.

[1862] Data collection

[1863] 1. Users

[1864] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time and transfer it to their smartphones.

[1865] For example, if you wake up at 6am, the smartwatch will automatically record your heart rate and sleep time, and this data will be transferred to your smartphone via Bluetooth.

[1866] Organizing and sending data

[1867] 2. Device (smartphone)

[1868] The device organizes the received data using a dedicated application (e.g., a health care app) and uploads it to a server periodically (e.g., every hour).

[1869] Data is transmitted over Wi-Fi or mobile networks and is encrypted to protect privacy.

[1870] Analyzing data and generating service plans

[1871] 3. Server

[1872] The server receives the collected data in real time and analyzes it with a generative AI model (e.g., GPT-4), for example, to evaluate the user's health status and customize an appropriate meal menu.

[1873] The server analyzes the user's travel patterns and creates a schedule for the self-driving car. For example, it understands that the user travels to a specific location at a certain time each week and sets the schedule for the self-driving car accordingly.

[1874] Prescribing and executing service plans

[1875] 4. Server

[1876] The server transmits instructions to an execution device, such as an unmanned aerial vehicle or an autonomous vehicle, based on the generated service plan.

[1877] Specifically, the drone will be instructed to retrieve a specific meal from a specified restaurant and deliver it to the user's home, while the self-driving car will be instructed to pick up the user from their home at 9:00 and arrive at their destination by 10:00.

[1878] 5. Unmanned aerial vehicle

[1879] When the drone receives instructions from the server, it flies to the specified restaurant and picks up the meal. For example, it delivers a high-protein, low-fat meal to a user who has requested dinner.

[1880] 6. Self-driving cars

[1881] The self-driving car will pick up the user at the designated time and drive safely to the destination, using LIDAR sensors and cameras to understand the surrounding situation.

[1882] Providing home medical care

[1883] 7. Server

[1884] The server sends necessary instructions to the home medical system according to the user's health condition. For example, if a user shows symptoms of high blood pressure, the home medical robot will measure their blood pressure.

[1885] 8. Terminal (medical robot)

[1886] The medical robot performs the prescribed health checks and transmits the acquired data to a server in real time.

[1887] 9. Doctor

[1888] The data sent remotely is analyzed and medical instructions are sent back to the medical robot, which then responds based on those instructions.

[1889] Virtual interaction

[1890] 10. Users

[1891] Users access the virtual space using digital devices (e.g., smartphones or VR devices) and interact with their digital family and support robots.

[1892] 11. Server

[1893] It creates a virtual space and provides an environment where users can interact with their digital family and support robots. For example, it sets up a birthday party in the user's virtual space and generates a scene in which the digital family hands out presents.

[1894] Specific examples

[1895] Specific examples of meal delivery

[1896] When a user inputs a dinner request, the server selects an appropriate menu based on the user's health data and preference patterns.

[1897] The server sends instructions to the drone to "get food from the specified restaurant and deliver it to the user's balcony."

[1898] The drone will pick up the meal and deliver it to your balcony.

[1899] Specific examples of outpatient visits

[1900] When a user enters a medical appointment into a smartphone application, the server creates and transmits a driving plan for the self-driving car.

[1901] The self-driving car will arrive at the user's home at the specified time and drive safely with the user on board.

[1902] Prompt Sentence Examples

[1903] "When a user makes a dinner request, explain how the server selects the appropriate menu item and how the drone delivers the meal."

[1904] In this way, the system aims to provide a variety of support services suited to an aging society and to improve the overall quality of life of users.

[1905] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1906] Step 1:

[1907] Users use a smartwatch or biometric measurement device to measure data and transfer it to their smartphone.

[1908] Input: Smartwatch data such as heart rate, walking distance, and sleep time

[1909] Data processing: The information measured by the smartwatch is transferred to the smartphone via Bluetooth.

[1910] Output: Biometric data transferred to a smartphone

[1911] How it works: When you wake up at 6am, your heart rate and sleep time will be automatically measured by the smartwatch, and this data will be transferred to your smartphone via Bluetooth.

[1912] Step 2:

[1913] The device (smartphone) organizes the received data and periodically uploads it to the server.

[1914] Input: Biometric data transferred from the smartwatch

[1915] Data processing: Organize and encrypt data using dedicated applications (e.g., health apps)

[1916] Output: Upload the organized data to the server

[1917] What it does: The Health app organizes your data and uploads it to a server every hour over Wi-Fi or your mobile network.

[1918] Step 3:

[1919] The server analyzes the collected data using a generative AI model and generates a service plan.

[1920] Input: Biometric data uploaded to the server

[1921] Data processing: Using generative AI models (e.g., GPT-4) to analyze data and assess health status and mobility patterns

[1922] Output: Optimal service plan based on analysis results

[1923] How it works: The server uses a generative AI model to assess the user's health and determine that they need a high-protein, low-fat menu. It then creates a personalized meal plan.

[1924] Step 4:

[1925] The server transmits instructions to each service device based on the generated service plan.

[1926] Input: Generated service plan

[1927] Data processing: Generate specific instructions, such as food delivery instructions or scheduling an autonomous vehicle

[1928] Output: Instructions sent to unmanned aerial vehicles and autonomous vehicles

[1929] Specific operation: The server sends instructions to the unmanned aerial vehicle to retrieve a specific meal from a specified restaurant and deliver it to the user's home. It also sends instructions to the self-driving car to pick up the user from their home at 9:00 and arrive at their destination at 10:00.

[1930] Step 5:

[1931] The drones will then receive instructions and deliver the meals to designated locations.

[1932] Input: Meal delivery instructions from the server

[1933] Data processing: Use GPS to fly to a designated restaurant and pick up your meal

[1934] Output: Meal delivered to the user's home

[1935] Specific operation: The drone will fly to the designated restaurant, pick up the meal, and deliver it to the user's balcony. After delivery, it will return to the user's home using the coordinates.

[1936] Step 6:

[1937] The self-driving car will pick up the user at a designated time and place and drive them to their destination.

[1938] Input: Operation instructions from the server

[1939] Data processing: Calculate routes using LIDAR sensors and cameras to operate safely

[1940] Output: User arrives at destination

[1941] Specific operation: The self-driving car arrives in front of the user's home at the specified time, safely picks up the user, and drives them to their destination.

[1942] Step 7:

[1943] The server instructs the home medical system to check the user's health.

[1944] Input: User's health data and health check instructions

[1945] Data processing: Evaluate the user's health status and generate instructions for necessary health checks

[1946] Output: Health check instructions sent to medical robot

[1947] Specific operation: For a user showing symptoms of high blood pressure, the server instructs the medical robot to "measure blood pressure and send the data to the server."

[1948] Step 8:

[1949] The terminal (medical robot) performs a health check and sends the acquired data to the server.

[1950] Input: Health check instructions from the server

[1951] Data processing: Measure the user's health data, encrypt it, and send it to the server

[1952] Output: Health data sent to the server

[1953] Specific operation: The medical robot measures the user's blood pressure and transmits the data to a server in real time.

[1954] Step 9:

[1955] The doctor analyzes the transmitted data and sends treatment instructions back to the medical robot.

[1956] Input: Health data sent from the server

[1957] Data processing: Analyze data and create necessary medical instructions

[1958] Output: Treatment instructions sent back to the medical robot

[1959] Specific operation: The doctor remotely checks the data and sends instructions to the medical robot, such as "Administer medication because the patient's blood pressure is high." The robot then administers the medication based on the instructions.

[1960] Step 10:

[1961] Users access the virtual space using digital devices and interact with their digital family and support robots.

[1962] Input: Access request from a digital terminal

[1963] Data processing: Connection to virtual space, user authentication, interaction simulation

[1964] Output: Interactive experience in virtual space

[1965] Specific operation: Users use smartphones or VR devices to access a virtual space, where they can interact with their digital family and collaborate with a support robot.

[1966] Step 11:

[1967] The server generates an environment in which users can interact with their digital family and support robots in a virtual space.

[1968] Input: User's request in the virtual space

[1969] Data processing: Virtual space generation, digital character creation, script execution

[1970] Output: A user-accessible virtual space

[1971] Specific operation: The server generates a virtual space, for example, setting up a virtual birthday party for the user and creating a scene in which the digital family hands over presents.

[1972] Step 12:

[1973] Users can enjoy interacting and collaborating with their digital family and robots in a virtual space.

[1974] Input: Interacting with digital characters in a virtual space

[1975] Output: Psychological support and entertainment experiences

[1976] Specific actions: Users can interact with their digital family in a virtual space, reducing feelings of loneliness. They can also collaborate with a support robot and receive functional support while having fun.

[1977] (Application example 1)

[1978] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1979] In an aging society, there is a demand for detailed support tailored to individual health conditions and lifestyle patterns, but existing systems have difficulty providing this automatically. Another issue is the lack of a system that can collect users' health data in real time and respond immediately in emergencies. Furthermore, there is a lack of a means to notify users of generated health reports in a timely manner. Therefore, a comprehensive system is needed to improve users' quality of life.

[1980] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1981] In this invention, the server includes: means for collecting data on a user's daily rhythm, health status, travel patterns, and dietary habits; means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user; means for transmitting instructions to service devices and systems according to the generated service plan; means for an unmanned aerial vehicle receiving the instructions to deliver meals to a specified location; means for an autonomous vehicle receiving the instructions to safely drive the user to the destination; means for a home medical system to conduct health checks on the user and transmit the data to a remote doctor; means for the user to interact with a digital family or robot in a virtual space; means for collecting the user's health data in real time and communicating with a doctor via a medical robot in an emergency; and means for notifying the user of the generated health report. This enables daily monitoring of the user's health status and prompt and appropriate medical treatment when necessary. It also provides comprehensive support that contributes to improving the user's quality of life.

[1982] "User's daily rhythm" refers to the activity patterns and time management in the user's daily life.

[1983] "Health Status" refers to the overall state of a user's physical and mental health.

[1984] "Travel patterns" refer to a user's usual travel routes, choice of transportation means, travel time, etc.

[1985] "Diet" refers to the types and amounts of food a user consumes on a daily basis, the time of intake, and nutritional balance.

[1986] "Means for collecting data" refers to devices and systems for measuring and recording various activities and health conditions of users.

[1987] A "generative AI model" refers to algorithms or software that uses artificial intelligence to analyze data and generate patterns or optimized results.

[1988] "Means for analyzing and generating optimal service plans for users" refers to systems and algorithms that use collected data to design and propose services that best suit the user's needs.

[1989] The "means for transmitting instructions" refers to a communication system for transmitting operation commands to various terminals and devices based on the generated service plan.

[1990] "Unmanned aerial vehicle" refers to a drone or other flying device designed to fly autonomously and carry goods.

[1991] An "autonomous vehicle" refers to a vehicle that drives itself without human input.

[1992] "Home medical system" refers to a system or device for providing medical services in a user's home.

[1993] "Means for performing health checks and transmitting data to a remote doctor" refers to a system or device for monitoring a user's health status and transmitting that data to a doctor remotely.

[1994] "Virtual space" refers to a digital space constructed using computer technology that can be experienced in a way that is close to reality.

[1995] "Digital family" refers to digitized family avatars or characters that can interact with users in a virtual space.

[1996] A "robot" refers to a mechanical device that autonomously performs programmed actions.

[1997] "Means for notifying users of health reports" refers to systems and methods for communicating analysis results and recommendations to users.

[1998] The present invention relates to a system for providing various services based on a user's health condition and lifestyle patterns. Specific embodiments for carrying out the present invention will be described below.

[1999] System Overview

[2000] Data collection

[2001] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. This data is then transferred to the user's smartphone, which then organizes the data and periodically uploads it to a server.

[2002] Data analysis and service plan generation

[2003] The server receives the uploaded data and analyzes it using generative AI models, for example, analyzing health conditions and generating nutritionally balanced meal plans for food delivery, analyzing the user's travel patterns and creating schedules for autonomous vehicles, and even reserving time slots for home medical care if necessary.

[2004] Service Instruction and Execution

[2005] Based on the generated service plan, the server sends instructions to the devices and systems responsible for executing each service. For example, an unmanned aerial vehicle delivers meals to a specified location, an autonomous vehicle drives a user to their destination, or a home medical system checks the user's health and transmits the acquired data to the server in real time.

[2006] Hardware and software used

[2007] Hardware

[2008] Smartwatches: (e.g., smartwatches, fitness tracking devices)

[2009] Smartphones: (e.g. iOS devices, Android devices)

[2010] Unmanned aerial vehicles: (e.g., delivery drones)

[2011] Autonomous vehicles: (e.g., self-driving cars, robotaxis)

[2012] Medical robots: (e.g., home medical support robots)

[2013] software

[2014] Generative AI models: (e.g., machine learning models using the scikit-learn library)

[2015] Data transfer API: (e.g. RESTful API)

[2016] Data analysis software: (e.g., Python program)

[2017] Specific use cases

[2018] Health data analysis and reporting

[2019] The server provides appropriate health advice and reports to users based on the collected health data. For example, if the user's heart rate is abnormally high, the server immediately notifies the medical robot and performs a health check on the user.

[2020] Specific prompt examples:

[2021] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[2022] In this way, the present invention enables daily monitoring of the user's health condition, enabling prompt and appropriate medical treatment when necessary, and providing comprehensive support that contributes to improving the user's quality of life.

[2023] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2024] Step 1:

[2025] Data collection

[2026] Users use smartwatches and other biometric devices to measure daily data such as heart rate, walking distance, and sleep time in real time. The data is then transferred to a smartphone and collected as input data. The smartphone then organizes the data and periodically uploads it to a server.

[2027] Step 2:

[2028] Data reception

[2029] The server receives data uploaded from the smartphone. This input data includes heart rate, walking distance, sleep duration, etc. The server stores this data in a database and prepares it for analysis.

[2030] Step 3:

[2031] Data analysis

[2032] The server analyzes the received data using a generative AI model. The generative AI model is implemented using the scikit-learn library and analyzes health status and lifestyle patterns based on the input data. For example, it analyzes the user's heart rate and sleep data to evaluate their health status. The output of this analysis process is a health check result and recommended lifestyle improvements.

[2033] Step 4:

[2034] Service plan generation

[2035] The server generates an optimal service plan for the user based on the analysis results, including a nutritionally balanced meal menu, an appropriate exercise plan, and an autonomous vehicle schedule. The generated plan is output as instructions for the next step.

[2036] Step 5:

[2037] Send instructions

[2038] Based on the generated service plan, the server sends instructions to service devices and systems, such as unmanned aerial vehicles, autonomous vehicles, and home healthcare systems. The instructions detail how each device should operate. For example, an unmanned aerial vehicle might receive instructions to deliver meals to a specified location, and an autonomous vehicle might receive instructions to drive a user to their destination.

[2039] Step 6:

[2040] Execution of instructions

[2041] Each device receives instructions from the server and performs a specific operation. For example, an unmanned aerial vehicle will head to a designated restaurant, pick up a meal, and deliver it to the user's home. An autonomous vehicle will pick up the user at the designated place and time and drive them safely to their destination.

[2042] Step 7:

[2043] Providing home medical care

[2044] The home medical system performs health checks on users based on instructions from a server. The acquired health data is sent to the server in real time and analyzed by a doctor in a remote location. The medical robot follows instructions from the server and takes appropriate action according to the user's health condition.

[2045] Step 8:

[2046] Health report generation and notification

[2047] The server periodically generates a health report based on the collected data and analysis results. This report includes the user's past health data, current condition, and future recommendations. The report is sent to the user's smartphone, allowing the user to understand their own health status.

[2048] Specific prompt examples:

[2049] "Evaluate the health status of user ID 'user123' based on their heart rate, steps, and sleep time over the past week, and trigger emergency protocols if necessary."

[2050] In this way, each step works in cooperation with the others, making it possible to monitor the user's health condition and provide optimal services.

[2051] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2052] overview

[2053] This invention aims to build a smart city that improves users' quality of life by utilizing advanced technologies such as generative AI models and emotion engines. Specifically, it collects data on users' daily rhythms, health conditions, travel patterns, and dietary habits, as well as emotional data, and analyzes it using generative AI models to provide optimal service plans for users. It also integrates and manages a series of services, including drone meal delivery, transportation support using self-driving cars, home medical care, and virtual interactions between digital families and robots.

[2054] Data collection

[2055] 1. Users

[2056] Using smartwatches and other biometric devices, data such as daily heart rate, walking distance, and sleep time are measured in real time and transmitted to a smartphone.

[2057] Using a device equipped with an emotion engine, emotional data such as facial expressions, tone of voice, and gestures are measured.

[2058] 2. Device (smartphone)

[2059] The transferred biometric information and emotional data are organized and periodically uploaded to a server.

[2060] Analyzing data and generating service plans

[2061] 3. Server

[2062] The collected biometric and emotional data is analyzed using a generative AI model, which, for example, generates a nutritionally balanced meal menu taking into account the patient's health and emotional state.

[2063] Adjust the schedule of self-driving cars based on user travel patterns and emotional data.

[2064] Book home health care time slots when necessary.

[2065] Service Instruction and Execution

[2066] 4. Server

[2067] Based on the generated service plan, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[2068] 5. Drones

[2069] Once instructed, the robot will head to the designated restaurant to pick up the meal, and then deliver it to the user's designated location (such as a balcony).

[2070] 6. Self-driving cars

[2071] Once instructions are received, the vehicle will arrive at the user's home at the specified time and travel safely to the pre-set destination.

[2072] Providing home medical care

[2073] 7. Server

[2074] If it determines that the user's health needs to be checked, it sends instructions to the home medical system.

[2075] 8. Terminal (medical robot)

[2076] Upon receiving instructions, it visits the user's home, conducts a health check, and sends the results to the server in real time.

[2077] 9. Doctor

[2078] The data transmitted remotely is analyzed and medical instructions are sent to the robot.

[2079] Virtual interaction

[2080] 10. Users

[2081] Access the virtual space using a digital device (smartphone or VR device).

[2082] 11. Server

[2083] We create an environment in which people can interact with digital family and robots in a virtual space.

[2084] 12. Users

[2085] Interacting with digital family and robots in a virtual space reduces feelings of loneliness.

[2086] Support by Emotion Engine

[2087] 13. Terminal (device with emotion engine)

[2088] It recognizes emotions based on data such as the user's facial expressions, tone of voice, and gestures.

[2089] 14. Server

[2090] Emotion data collected from the emotion engine is analyzed to understand the user's current emotional state.

[2091] 15. Server

[2092] The system generates a service plan that takes into account the user's emotional state. If the emotional state is stressful, it will provide relaxing music services and support in a virtual space.

[2093] Specific examples

[2094] A concrete example of emotion-based food delivery

[2095] When a user makes a dinner request, the server selects an appropriate menu based on the user's health and emotional data.

[2096] The server sends instructions to the drone to deliver a meal from a designated restaurant to the user's home.

[2097] The drone picks up the meal, delivers it to the user's balcony, and then returns.

[2098] Examples of emotionally driven visits

[2099] When a user enters a medical appointment, the server creates and sends a driving plan for the self-driving car.

[2100] The self-driving car will arrive at the user's home at the specified time and safely drive the user to their destination.

[2101] Emotion-based support in virtual space

[2102] If the emotion engine detects that the user is feeling stressed, the server generates a relaxing environment in the virtual space and guides the user on how to access it.

[2103] Users can interact with digital family and robots in a virtual space and receive support to reduce stress.

[2104] In this way, the present invention provides an advanced life support system that also takes emotion data into consideration, thereby further improving the quality of life of users.

[2105] The processing flow will be explained below.

[2106] Step 1:

[2107] Users wear smartwatches or other biometric devices that collect real-time data such as heart rate, walking distance, and sleep duration throughout their daily activities.

[2108] Step 2:

[2109] The data measured by the device (smartwatch) is transferred to the device (smartphone) in real time via Bluetooth.

[2110] Step 3:

[2111] The device (smartphone) organizes and stores the transferred biometric information and periodically uploads it to the server.

[2112] Step 4:

[2113] The terminal (device equipped with an emotion engine) measures the user's facial expressions, tone of voice, and gestures in real time, generates emotion data, and transfers it to the terminal (smartphone).

[2114] Step 5:

[2115] The device (smartphone) organizes the transferred emotional data and uploads it to the server along with the biometric information.

[2116] Step 6:

[2117] The server collects the received biometric and emotional data and provides it to the generative AI model, which analyzes the user's health, daily rhythm, movement patterns, emotional state, and other factors.

[2118] Step 7:

[2119] The server uses the generative AI model to generate an optimized service plan for each user, for example, determining a nutritionally balanced meal menu based on health and emotional data.

[2120] Step 8:

[2121] Based on the service plan generated by the server, specific instructions are sent to the devices and systems responsible for each service, such as sending meal delivery instructions to a drone service or a user's travel plan to an autonomous vehicle.

[2122] Step 9:

[2123] The drone receives instructions from the server, heads to the designated restaurant, picks up the meal, and then delivers it to the user's designated location (such as a balcony).

[2124] Step 10:

[2125] The self-driving car receives instructions from the server, arrives at the user's home at the specified time, and drives safely to the pre-set destination.

[2126] Step 11:

[2127] Users input appointments for medical visits and travel through their devices (smartphones), and this information is sent to the server.

[2128] Step 12:

[2129] The server sends instructions to the home medical system to prepare the necessary medical kits and health checks.

[2130] Step 13:

[2131] The terminal (medical robot) receives instructions from the server, visits the user's home, performs a health check, and sends the results to the server in real time.

[2132] Step 14:

[2133] The server transfers the health check data sent from the medical robot to a doctor, who then remotely analyzes the data and sends necessary treatment instructions to the medical robot.

[2134] Step 15:

[2135] Users access the virtual space using digital devices (smartphones or VR devices).

[2136] Step 16:

[2137] The server generates an environment in a virtual space where people can interact with digital family members and robots.

[2138] Step 17:

[2139] Users can interact with digital family and robots in a virtual space, reducing feelings of loneliness.

[2140] Step 18:

[2141] The terminal (device equipped with an emotion engine) again measures the user's facial expressions, tone of voice, and gestures, and updates the emotion data.

[2142] Step 19:

[2143] The server analyzes the updated emotional data and adjusts and optimizes the service plan in real time as needed. If the emotional state is stressful, it provides relaxing music services and support in a virtual space.

[2144] Through this series of steps, a high-dimensional life support system that also takes emotional data into account will improve the quality of the user's life.

[2145] Example 2

[2146] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2147] In modern society, the aging of society and the diversification of lifestyles are driving demand for advanced systems that comprehensively support people's daily rhythms, health conditions, travel patterns, dietary habits, and other aspects of their lives. It is also necessary to provide services that take emotional information into account, but current technology has not yet fully realized this. The present invention aims to solve these problems and improve the quality of life of users.

[2148] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting data on the user's lifestyle, health condition, movement pattern, and dietary habits, means for analyzing the collected data using a generative AI model and generating an optimal service plan for the user, means for sending instructions to a service device or system according to the generated service plan, means for recognizing emotions and analyzing the emotion data to grasp the user's emotional state, and means for generating optimal relaxation services and support based on the emotional state. This makes it possible to comprehensively support a wide range of needs of users and improve their quality of life.

[2149] "User" refers to a person who uses the system.

[2150] "Life rhythm" refers to data that indicates a user's daily activities and sleep cycles.

[2151] "Health status" refers to data including biometric information such as the user's heart rate, blood pressure, body temperature, and sleep duration.

[2152] "Travel patterns" refers to data indicating a user's regular travel routes and frequency.

[2153] "Diet" refers to data regarding the types of food a user consumes and their nutritional balance.

[2154] "Means of collecting data" refers to devices and software that collect information on users' lifestyles, health conditions, travel patterns, and dietary habits.

[2155] "Generative AI model" refers to an artificial intelligence model that analyzes collected data and generates service plans and proposals suitable for users.

[2156] "Means for analysis" refers to the equipment and software used to analyze the collected data.

[2157] A "service plan" refers to a method of providing optimal support and services based on a user's lifestyle, health condition, travel patterns, diet, emotional state, etc.

[2158] The term "service device or system" refers to a device or system that provides a service to a user based on a generated service plan.

[2159] "Unmanned aerial vehicle" refers to a small aircraft operated by remote control or autonomous pilot for the purpose of delivering goods.

[2160] An "autonomous vehicle" refers to a vehicle that automatically drives a user to their destination.

[2161] A "home medical care system" refers to a system that remotely checks the user's health status and provides necessary medical treatment and advice.

[2162] "Virtual space" refers to a digital environment generated by computer simulation.

[2163] "Digital persona" refers to a computer-generated character that interacts with the user in a virtual space.

[2164] "Automated machine" refers to a robot or other mechanical device that interacts with the user in a virtual space.

[2165] "Means for recognizing emotions" refers to devices or software that sense and recognize a user's emotional state from facial expressions, tone of voice, gestures, etc.

[2166] "Emotional state" refers to the user's emotional and feeling state at any given time.

[2167] "Relaxation services" refer to services such as music and virtual environments that help users reduce stress and relax.

[2168] "Assistance" refers to comprehensive support to improve the user's quality of life.

[2169] MODE FOR CARRYING OUT THE INVENTION

[2170] This invention is a smart system that collects data on a user's daily rhythm, health status, travel patterns, and dietary habits, analyzes the data using a generative AI model, and generates an optimal service plan for the user, thereby improving their quality of life. Specific embodiments of this system are described below.

[2171] Data collection hardware and software

[2172] 1. User data collection

[2173] Hardware: Users use smartwatches and other biometric devices that measure data such as heart rate, walking distance, and sleep duration in real time.

[2174] Software: A dedicated application is installed on the smartwatch, and the measured data is transferred to a smartphone via Bluetooth. The smartphone also has an application installed to organize and store the data and transfer it to a server.

[2175] 2. Collecting Emotional Data

[2176] Hardware: Devices equipped with emotion engines (e.g., emotion-recognizing cameras and microphones) are used. These devices capture data such as the user's facial expressions, tone of voice, and gestures.

[2177] Software: The emotion engine analyzes the data in real time and transmits the emotion data to the smartphone, which organizes it and uploads it to the server.

[2178] Data analysis and service plan generation

[2179] 3. Server Roles

[2180] Hardware: The server has high-performance computing resources and large memory and storage capacity for data management and analysis.

[2181] Software: A generative AI model is installed on the server, which performs analysis based on the collected data.

[2182] 4. Analysis using generative AI models

[2183] The server uses a generative AI model to analyze data collected from users, such as their daily rhythms, health status, and emotional state. This analysis generates an optimal service plan that takes into account the user's health and emotional state.

[2184] Provision of services

[2185] 5. Sending specific service instructions

[2186] Based on the generated service plan, the server sends instructions to various service devices and systems, including unmanned aerial vehicles, autonomous vehicles, and home medical systems.

[2187] 6. Drone meal delivery

[2188] Example: A user requests dinner, and the server sends instructions to an unmanned aerial vehicle to deliver the meal from a specified restaurant to the user's home. The unmanned aerial vehicle picks up the meal and delivers it to the user's balcony.

[2189] 7. Transportation support using autonomous vehicles

[2190] Example: When a user enters a doctor's appointment, the server creates and sends a driving plan for an autonomous vehicle, which arrives at the user's home at the specified time and drives the user safely to their destination.

[2191] 8. Health checks through home medical care systems

[2192] Example: If the server determines that a user needs a health check, it sends instructions to a home medical system, and a medical robot visits the user's home to conduct a health check. The results of the check are sent to the server in real time, and a doctor analyzes them remotely.

[2193] Interaction in virtual space and support using emotion engine

[2194] 9. Interacting with digital people and automata in virtual spaces

[2195] Example: A user interacts with digital people or automata in a virtual space to reduce feelings of loneliness. A server generates digital people or automata in a virtual space and makes them accessible to the user.

[2196] 10. Emotional state analysis and relaxation services

[2197] Example: The server analyzes the emotion data collected by the emotion engine to understand the user's current emotional state. For example, if the user is feeling stressed, it can provide a relaxing music service or a relaxing environment in a virtual space.

[2198] Examples of prompt statements

[2199] "Please give me some healthy eating suggestions for this week."

[2200] "I'm feeling stressed so please recommend some relaxing music."

[2201] Please adjust your hospital visit schedule for next week.

[2202] As described above, the present invention is a system that utilizes advanced technology to provide total support for the user's life and improve the quality of life.

[2203] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2204] Step 1: User puts on the smartwatch

[2205] Input: User wearing a smartwatch

[2206] Specific operation: The user wears a smartwatch and biometric information such as heart rate, walking distance, and sleep time is measured in real time.

[2207] Output: Measured biometric data

[2208] Step 2: Transfer data from your smartwatch to your phone

[2209] Input: Biometric data measured by a smartwatch

[2210] How it works: The smartwatch transmits measurement data via Bluetooth to a smartphone, which temporarily stores and organizes this data.

[2211] Output: Biometric data stored on the smartphone

[2212] Step 3: Emotion data measurement using the emotion engine

[2213] Input: User facial expressions, tone of voice, gestures, etc.

[2214] How it works: The user uses a device equipped with the emotion engine to measure emotion data, which is then analyzed in real time.

[2215] Output: Measured emotion data

[2216] Step 4: Transferring emotional data to your smartphone

[2217] Input: Emotion data from the emotion engine

[2218] How it works: The emotion engine transfers the measured emotion data to the smartphone, which then organizes and stores it.

[2219] Output: Organized emotional data is stored on the smartphone.

[2220] Step 5: Upload data regularly

[2221] Input: Biometric and emotional data stored on a smartphone

[2222] How it works: Your smartphone periodically uploads this data to a server via Wi-Fi or mobile data.

[2223] Output: Biometric and emotional data uploaded to the server

[2224] Step 6: Receiving and storing data

[2225] Input: Data uploaded from your smartphone

[2226] Specific operation: The server receives biometric and emotional data sent from the smartphone and stores the received data in a database.

[2227] Output: Data stored in the server database

[2228] Step 7: Analyze the data with a generative AI model

[2229] Input: Stored biometric and emotional data

[2230] Specific operation: The server analyzes the stored data using a generative AI model. As a result of the analysis, it understands the user's health and emotional state and generates an appropriate service plan.

[2231] Output: Generated service plan

[2232] Step 8: Send instructions for the generated service plan to each device

[2233] Input: Generated service plan

[2234] Specific operations: Based on the generated service plan, the server sends specific instructions to each device or system, such as an unmanned aerial vehicle, an autonomous vehicle, or a home medical system.

[2235] Output: Specific instructions sent to each device or system

[2236] Step 9: Meal pickup and delivery by drone

[2237] Input: Food delivery instructions from the server

[2238] Specific operation: The unmanned aerial vehicle receives instructions from the server, heads to the specified restaurant, picks up the meal, and then delivers the meal to the user's designated location (such as a balcony).

[2239] Output: Meal delivered to user-specified location

[2240] Step 10: Mobility support with autonomous vehicles

[2241] Input: Movement plan instructions from the server

[2242] Specific operation: The autonomous vehicle receives instructions from the server and arrives at the user's home at the specified time. It then safely drives the user to their destination.

[2243] Output: Safe travel to destination

[2244] Step 11: Implementing a home health system

[2245] Input: Home care orders from the server

[2246] Specific operation: If the server determines that a user's health check is necessary, it sends instructions to the home medical system. The medical robot visits the user's home and performs a health check.

[2247] Output: Health checks performed and real-time data sent to the server

[2248] Step 12: Virtual interaction

[2249] Input: User access request and emotion data

[2250] Specific operation: The user accesses the virtual space and interacts with digital people and automated machines. The server generates the virtual space and makes it accessible to the user.

[2251] Output: User interaction experience in virtual space

[2252] Step 13: Understanding emotional states using the emotion engine and providing services

[2253] Input: Emotion data

[2254] Specific operation: The emotion engine analyzes the emotion data and understands the user's current emotional state. The server generates and provides relaxation and support services based on the emotional state.

[2255] Output: Relaxation services and assistance suited to the user

[2256] (Application example 2)

[2257] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2258] Conventional smart city construction technologies have struggled to provide optimal services tailored to individual users' lifestyles, health conditions, travel patterns, dietary habits, and emotional fluctuations. Furthermore, at workplaces, there has been a lack of means to collect and analyze workers' biometric and emotional data in real time and optimize the work environment. This has resulted in reduced worker efficiency and increased health risks. A comprehensive system is needed to solve these problems.

[2259] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2260] In this invention, the server includes a means for collecting data on the user's daily rhythm, health condition, travel patterns, and dietary habits, a means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user, and a means for sending instructions to service devices and systems according to the generated service plan. This enables the provision of optimal services tailored to the user's individual circumstances. Furthermore, the smart glasses include a means for collecting biometric information and emotional data from the worker, a means for analyzing the collected biometric information and emotional data, and a means for sending instructions to optimize the work environment. The cooperative operation of various devices and systems that execute the service plan enables the optimization of the overall work environment and the safety of the worker.

[2261] A "user" is an individual who receives a service in the present invention.

[2262] "Life rhythm" refers to the temporal behavioral patterns of a user in their daily life.

[2263] "Health status" is information that indicates the degree of the user's physical and mental health.

[2264] "Travel patterns" refer to the route and time zone trends that a user typically follows on a daily basis.

[2265] "Diet" refers to the food content and eating habits of a user on a daily basis.

[2266] The "data collection means" refers to a device or system for collecting biometric information and behavioral data of a user.

[2267] A "generative AI model" is an artificial intelligence technology that analyzes collected data and generates appropriate service plans.

[2268] A "service plan" is a specific service plan or proposal that is provided taking into account the individual circumstances of the user.

[2269] "Service equipment and systems" are physical and software devices for executing generated service plans.

[2270] A "drone" is a device that uses unmanned aerial vehicle technology to deliver goods.

[2271] An "autonomous vehicle" is a vehicle that drives autonomously using artificial intelligence technology.

[2272] A "home medical system" is a device or system for providing medical testing and care in a user's home.

[2273] A "health check" is an examination or monitoring to assess the user's health status.

[2274] A "remote physician" is a physician who is not physically near the user but provides medical services remotely.

[2275] "Virtual reality space" is a pseudo-three-dimensional space generated by computer technology.

[2276] "Digital family members" are digital characters that users can interact with in a virtual reality space.

[2277] A "robot" is a mechanical device that is designed to assist a user autonomously or remotely.

[2278] "Smart glasses" are glasses-type devices worn on the user's eyes that display information and collect biometric and emotional data using sensors.

[2279] "Biometric information" refers to information about the user's physical condition, such as heart rate, body temperature, and respiratory rate.

[2280] "Emotion data" is information about the user's emotional state that is analyzed from facial expressions, tone of voice, and the like.

[2281] "Work environment optimization" means adjusting work conditions to the optimum state based on the user's biometric information and emotional data.

[2282] System Overview

[2283] The system of this invention collects data on a user's lifestyle, health status, travel patterns, and diet, analyzes it using a generative AI model, and generates an optimal service plan for the user. Based on this service plan, the system also comprehensively manages the provision of services via various devices and systems, such as drones, self-driving cars, home medical systems, and smart glasses.

[2284] Hardware and software used

[2285] 1. Hardware:

[2286] Smart glasses: Devices that collect biometric and emotional data from users (e.g., Google Glass Enterprise Edition).

[2287] Drone: A device that uses unmanned aerial technology to deliver goods.

[2288] Self-driving car: A vehicle that uses artificial intelligence technology to drive itself autonomously.

[2289] Home medical robot: A device that checks the user's health and transmits the data to a doctor in a remote location.

[2290] 2. Software:

[2291] Generative AI model: Analyzes user data and generates optimal service plans (e.g., TensorFlow, PyTorch).

[2292] Emotion engine: Analyzes emotion data and understands the user's emotional state (e.g., Emotion API).

[2293] Cloud server: Analyzes data and generates service plans (e.g., AWS).

[2294] Data processing and calculation

[2295] 1. Data Collection and Transmission:

[2296] The server collects the user's biometric information, such as heart rate, body temperature, and voice tone, as well as emotional data in real time through the smart glasses and transfers it to a cloud server.

[2297] 2. Data Analysis:

[2298] The server analyzes the data uploaded to the cloud server using a generative AI model and emotion engine. This includes assessing the user's health and determining their emotional state. For example, if the user's fatigue level is high, it generates a service plan that recommends taking a break.

[2299] 3. Create and run the service plan:

[2300] Based on the service plan, it sends instructions to various devices and systems, such as instructing a drone to deliver a meal or an autonomous vehicle to move the user.

[2301] Specific examples

[2302] For example, if a user is working for a long time and is becoming increasingly fatigued based on data collected from the smart glasses, the cloud server will use the generative AI model to generate instructions recommending "taking a break," while simultaneously instructing a drone to deliver a relaxing lunch to the user's workspace and adjusting lighting and temperature to a comfortable level for the user.

[2303] Prompt Sentence Examples

[2304] Based on the data collected from the emotion engine, the system analyzes the health and emotional state of workers, and if the fatigue level is above 80 or the stress level is above 70, it sends a command to the cloud server to "recommend taking a break." It also sends a command to dim the factory ligh...

Claims

1. A means for collecting data on the user's daily rhythm, health condition, movement pattern and dietary habits; A means for analyzing the collected data using a generative AI model to generate an optimal service plan for the user; means for transmitting instructions to a service device or system in accordance with the generated service plan; A means for drones to receive instructions and deliver meals to designated locations; A means for the self-driving vehicle to safely navigate the user to their destination; a means for the home medical system to perform a health check on the user and transmit the data to a remote doctor; A way for users to interact with digital family and robots in a virtual space, A system including:

2. The virtual space further includes a means for generating a digital family or robot with which the user interacts. The system of claim 1 .

3. The health check provided by the home medical system is based on data from the user's smartwatch or other biometric measuring device. The system of claim 1 .

Images