System
The system addresses childcare labor shortages by automating child activities based on parent-specified schedules and profiles, ensuring quality care and parental time management.
Patent Information
- Application Number
- JP2024141554
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-22
- Publication Date
- 2026-03-06
AI Technical Summary
Modern childcare is facing a labor shortage due to changes in parents' working styles and lifestyles, particularly in dual-income and single-parent households, leading to a lack of quality time with children and increased parental guilt.
A system that registers parent account information, generates a child profile, synchronizes it with a remote terminal, and executes daily activity schedules, allowing real-time monitoring and adjustment to ensure high-quality care while freeing up parental time.
Enables parents to provide high-quality care for their children while having time for themselves by automating activities based on the child's preferences and schedule, with real-time notification and adjustment capabilities.
Smart Images

Figure 2026038219000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Childcare in modern families is facing a serious labor shortage due to changes in parents' working styles and lifestyles. In particular, in dual-income households and single-parent households, the increased burden of raising children on parents makes it difficult to ensure sufficient time for interaction with their children. As a result, parents are forced to sacrifice their own time, which tends to result in a lack of time with their children. Furthermore, parents often feel guilty about not being able to spend time with their children. Therefore, there is a need for a system that allows parents to secure their own time with peace of mind while still providing high-quality care for their children. [Means for solving the problem]
[0005] In order to solve the above-mentioned problems, the present invention provides the following means. The system includes a means for registering parent account information and a means for generating a child profile based on the information. It also includes a means for synchronizing the generated child profile with a remote terminal and issuing activity instructions. It also includes a means for transmitting a daily activity schedule set by a parent user to the remote terminal and a means for the remote terminal to execute activities in real time based on the set schedule. It also includes a means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions. This allows parents to entrust the time they spend with their children to the remote terminal, while still having time for themselves. Furthermore, the remote terminal automatically selects appropriate activities based on the child's preferences and schedule, making it possible to provide high-quality care for the child.
[0006] A "parent account" is a system that registers information about a parent user and includes authentication information for accessing the parenting physical twin.
[0007] A "child profile" is a data set that includes information about a child's age, interests, preferences, etc., used to determine activities and how to respond to a child.
[0008] A "remote terminal" is a device that functions as a parenting physical twin and carries out interactions and activities with a child based on the parent user's settings.
[0009] "Activity instructions" is information for instructing the remote terminal on specific activities that the child should do.
[0010] The "daily activity schedule" is a timetable set by a parent user that indicates what activities the child will do at what time of day.
[0011] "Performing an activity in real time" means that the remote terminal immediately starts and carries out an activity with the child based on a set schedule.
[0012] The "means for notifying the activity status" is a means for the remote terminal to transmit the progress status of the current activity to the parent user as information.
[0013] The "means for receiving confirmation and adjustment instructions" is a means for the parent user to confirm the activity status of the remote terminal and give new instructions or adjustments. [Brief explanation of the drawings]
[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0016] First, the terms used in the following description will be explained.
[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0022] [First embodiment]
[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0035] Basic system configuration
[0036] The system of the present invention registers information about a parent's account and generates a child's profile based on that information. Once the child's profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the parent user is constantly notified of the activity status of the remote device, allowing the parent user to check and issue adjustment instructions based on this information.
[0037] Parent Account Settings
[0038] Creating a Parent Account
[0039] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[0040] Registration and submission of information
[0041] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[0042] Parenting Physical Twins
[0043] Receiving information and creating a profile
[0044] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[0045] Profile Sync
[0046] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[0047] Setting up an activity schedule
[0048] Entering a schedule
[0049] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[0050] Sending a Schedule
[0051] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[0052] Real-time interaction with children
[0053] Start of activities
[0054] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[0055] Activity status notification
[0056] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[0057] Parental confirmation and coordination
[0058] Activity monitoring
[0059] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[0060] Adjustment instructions
[0061] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[0062] Specific examples
[0063] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[0064] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[0065] At 4:00 PM, the remote device starts playing with a dinosaur toy, and the server notifies the device that "The physical twin is currently playing dinosaur with a child." If it is 6:00 PM and the user wants to have dinner, the device sends the command "Dinner time begins." The server then relays the command to the physical twin, and the remote device begins preparing dinner.
[0066] This system allows parent users to provide high-quality care for their children while still having time for themselves.
[0067] The processing flow will be explained below.
[0068] Step 1:
[0069] Creating a Parent Account
[0070] The user launches the dedicated app on their device and accesses the account creation screen.
[0071] The user enters their information (e.g., name, email address).
[0072] The user enters the child's information (name, age, interests, etc.).
[0073] Step 2:
[0074] Submitting information and registering
[0075] The terminal transmits the entered user and child information to the server.
[0076] The server stores the received information in a database.
[0077] The server generates a child's profile and stores it in a database.
[0078] Step 3:
[0079] Profile Sync
[0080] The server synchronizes the generated child profile to the remote device.
[0081] The remote device receives and stores the synchronized profile.
[0082] Step 4:
[0083] Setting up an activity schedule
[0084] The user enters their child's activity schedule through an app on their device.
[0085] The schedule includes specific times and activities that will occur during those times (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV).
[0086] The terminal transmits the input schedule to the server.
[0087] Step 5:
[0088] Schedule management and preparation
[0089] The server transmits the received schedule to the remote terminal, which prepares the activity.
[0090] The remote terminal makes preparations based on the received schedule.
[0091] Step 6:
[0092] Start of activities
[0093] The server sends an instruction to start an activity to the remote terminal based on the set schedule.
[0094] The remote device initiates an activity with the child.
[0095] For example, at 4:00 PM, the remote device will start playing with a dinosaur toy.
[0096] Step 7:
[0097] Real-time notifications
[0098] The remote terminal reports its current activity to the server.
[0099] The server notifies the terminal of the progress of the activity.
[0100] The device displays the current activity status to the parent user in real time.
[0101] Step 8:
[0102] Monitoring and coordinating activities
[0103] The user monitors the activity of the remote terminal through the terminal.
[0104] The user sends instructions to change or adjust activities as needed from the terminal.
[0105] The server receives the user's instructions and sends change instructions to the remote terminal.
[0106] The remote terminal receives instructions, coordinates and executes activities.
[0107] For example, if a user feels like "I want to have dinner at 18:00," the user sends a command from the terminal to "start dinner time." The server receives the command and transmits it to the remote terminal, which then starts preparing dinner.
[0108] In this way, the system allows parent users to provide high-quality care for their children while still having time for themselves.
[0109] Example 1
[0110] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0111] In traditional child-rearing, parents have had to spend a lot of time and effort planning and managing their children's activities, making it difficult to provide appropriate activities that meet individual needs.In addition, there was a lack of efficient means for parents to monitor their children's activities in real time and make necessary adjustments, making it difficult to respond flexibly.
[0112] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0113] In this invention, the server includes a means for registering parent account information, a means for generating a child profile based on the registered information, a means for synchronizing the child profile with a remote terminal and issuing activity instructions, and a means for transmitting a daily activity schedule set by a parent user to the remote terminal, thereby enabling parents to efficiently plan and manage their children's activities, provide activities according to individual needs, and enable real-time monitoring and flexible adjustment.
[0114] "Parent Account" means an account through which a User creates and manages a Child Profile.
[0115] A "child profile" is a database entry that holds information about a registered child (such as age, interests, activity preferences, etc.).
[0116] A "remote device" is a device (such as a smartphone, tablet, or dedicated device) that communicates with the server and performs and manages activities with a child.
[0117] An "activity schedule" is a timetable set by a parent user that lists what activities a child will do during a specific time period.
[0118] The "server" is a central device that stores parent accounts, child profiles, and activity schedules in a database and communicates with remote devices.
[0119] "Synchronization" is the process of matching data between a server and a remote terminal, and refers to sharing the latest data between them.
[0120] An "activity instruction" is an instruction from a server or a remote terminal to a child to perform a specific activity at a specific time.
[0121] "Notification" refers to the transmission of information to inform the parent user of the activity status of the remote terminal in real time.
[0122] An "adjustment instruction" is an instruction from a parent user to a remote terminal to change the activity content as needed.
[0123] The present invention is a system for efficiently managing and coordinating parental activities and improving the quality of parental time. This system registers parent account information, generates a child profile based on that information, and provides activity instructions on a remote terminal. A specific embodiment of the system is described below.
[0124] This system uses the following main hardware and software:
[0125] Remote devices: smartphones, tablets, dedicated devices, etc.
[0126] Server: A central device that manages parent accounts, child profiles, and activity schedules.
[0127] Dedicated application: An application installed on the device
[0128] Database: MySQL (registered trademark), etc.
[0129] First, the parent user creates a parent account using a dedicated application. On the account creation screen, the parent enters information such as the parent's name, email address, child's name, age, and interests. For example, the parent user might enter "Name: Jiro Sato," "Email address: jiro@example.com," "Child's name: Ichiro," "Age: 6," and "Interests: Cars."
[0130] The device sends the entered information to the server, which receives it and stores it in a database. Based on this stored information, the server generates a child profile. For example, profile information such as "Name: Ichiro," "Age: 6 years old," and "Interests: Cars" is generated.
[0131] The server then synchronizes the generated child profile information with the remote device, which can then provide activity instructions based on the child's age, interests, and activity preferences.
[0132] Parents use a dedicated application to input their child's activity schedule, such as "15:00 - Play with toys," "17:00 - Draw pictures," and "19:00 - Watch TV." This input schedule is sent from the device to the server, which then sends the information to the remote device.
[0133] The remote device starts its activities according to the schedule sent from the server. At 3:00 PM, the remote device starts the "Play with toys" activity and acts automatically while interacting with the child. For example, the remote device instructs the child on how to choose a toy and how to play with it.
[0134] The server notifies the parent user of the activity status of the remote device in real time. For example, a notification such as "The remote device is currently playing with toys with Ichiro" is sent to the parent user's device. This allows the parent user to understand the current activity status.
[0135] If necessary, the parent user can send an instruction to change the activity from the terminal to the remote terminal via the server. For example, if the parent user sends an instruction to "change to drawing time," the remote terminal will move on to the next activity according to the instruction.
[0136] This allows parent users to efficiently manage and coordinate their children's activities while still having time for themselves. This system allows for flexible responses to the needs of parents and children, and supports child-rearing using the latest technology.
[0137] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0138] System program processing steps
[0139] Step 1:
[0140] Creating a Parent Account
[0141] Processing content: The user launches the dedicated application and enters the required information on the account creation screen.
[0142] Input: Name, email address, child's name, age, interests, etc.
[0143] Data processing: The application converts the input information into JSON format.
[0144] Output: Parent account and child information in JSON format.
[0145] Specific actions: For example, a user enters the following information into the app: "Name: Yamada Taro", "Email address: taro@example.com", "Child's name: Jiro", "Age: 4 years old", "Interests: Space".
[0146] Step 2:
[0147] Registration and submission of information
[0148] Processing content: The terminal sends the entered information to the server.
[0149] Input: Parent account and child information in JSON format.
[0150] Data calculation: The terminal sends the input information to the server as an HTTP request.
[0151] Output: Parent account and child information sent to the server.
[0152] Specific operation: The device sends the following information to the server: "parent_info: {name: 'Yamada Taro', email: 'taro@example.com', child_info: {name: 'Jiro', age: 4, interest: 'Space'}}".
[0153] Step 3:
[0154] Receiving information and storing it in the database
[0155] Processing: The server stores the received information in a database.
[0156] Input: Parent account and child information sent from the device.
[0157] Data processing: The server converts the received information into a format that can be written to the database.
[0158] Output: Information stored in a database.
[0159] Specific operation: The server adds a record to the "parent_info" table with the following information: "Name: Yamada Taro", "Email address: taro@example.com", and "Child information: [Name: Jiro, Age: 4, Interests: Space]".
[0160] Step 4:
[0161] Child profile generation
[0162] What happens: The server generates a profile for the child based on the information in the database.
[0163] Input: Parent account and child information stored in the database.
[0164] Data calculation: The server applies a profile generation algorithm to create the child's profile data.
[0165] Output: Child profile data.
[0166] Specific operation: The server generates data for "Profile: {Name: Jiro, Age: 4, Interests: Space}".
[0167] Step 5:
[0168] Profile Sync
[0169] Processing: The server synchronizes the created child profile to the remote device.
[0170] Input: Child profile data.
[0171] Data processing: Serializing profile data for transmission to remote devices.
[0172] Output: Child profile data sent to the remote device.
[0173] Specific operation: The server sends the data "sync_profile: {Name: Jiro, Age: 4, Interests: Space}" to the remote device.
[0174] Step 6:
[0175] Entering an activity schedule
[0176] What happens: The user enters a child's activity schedule in the application.
[0177] Input: Activity schedule (time and content).
[0178] Data processing: Convert the input schedule into schedule data format.
[0179] Output: Activity schedule data.
[0180] Specific actions: The user inputs "15:00 - play with toys", "17:00 - draw a picture", and "19:00 - watch TV".
[0181] Step 7:
[0182] Sending a Schedule
[0183] Processing content: The terminal sends the input schedule to the server.
[0184] Input: Activity schedule data.
[0185] Data calculation: The terminal sends the input schedule to the server as an HTTP request.
[0186] Output: The activity schedule sent to the server.
[0187] Specific operation: The device sends the following data to the server: "schedule: [{time: '15:00', activity: 'play with toys'}, {time: '17:00', activity: 'draw a picture'}, {time: '19:00', activity: 'watch TV'}]".
[0188] Step 8:
[0189] Start of activities
[0190] Processing details: The server instructs the remote terminal to start its activities according to the set schedule.
[0191] Input: Activity schedule data.
[0192] Data processing: The server processes the schedule data to send it to the remote terminal.
[0193] Output: Action instructions sent to the remote device.
[0194] Specific operation: At 15:00, the server sends "activity_start: 15:00 in the morning, content: play with toys" to the remote device.
[0195] Step 9:
[0196] Activity status notification
[0197] What it does: The server notifies the parent user's device of ongoing activities on the remote device in real time.
[0198] Input: Activity data from a remote terminal.
[0199] Data calculation: The server processes the activity status data to send it to the parent user's terminal.
[0200] Output: Activity notification sent to parent user's device.
[0201] Specific operation: When the remote device starts an activity, the server sends a notification to the parent user saying, "Notification: Jiro is currently playing with toys at 15:00."
[0202] Step 10:
[0203] Monitoring and coordinating activities
[0204] Processing details: The user monitors the activity status of the remote terminal and issues instructions to change the activity as necessary.
[0205] Input: Adjustment instructions from parent user.
[0206] Data calculation: The terminal sends adjustment instructions to the server, and the server forwards the instructions to the remote terminal.
[0207] Output: Adjustment instructions sent to the remote device.
[0208] Specific operation: When the parent user presses a button, for example, "Dinner time starts at 17:30," the device sends "activity_change: 17:30 - Dinner time starts" to the remote device via the server.
[0209] The above processing steps realize a system that allows parent users to efficiently plan, manage, and safely coordinate their children's activities.
[0210] (Application example 1)
[0211] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0212] It is difficult for parents to safely and efficiently manage and monitor their children's activities in brick-and-mortar stores in real time. This creates a significant burden on parents, especially when managing multiple activities simultaneously. Traditional methods make it difficult to select appropriate activities based on a child's interests and preferences, and require parents to directly monitor and adjust their children's activities, which consumes a significant amount of parents' time.
[0213] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0214] In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, means for inputting the child's activity schedule at a physical store, and means for monitoring the child's activities at the physical store in real time and notifying the parent user, thereby enabling parents to efficiently and safely manage their child's activities and adjust them flexibly and in real time.
[0215] A "parent account" is an account that allows parents to register information about themselves and their children and manage their children's activities.
[0216] A "child profile" is a set of information that includes a child's personal data, preferences, and activity records, generated based on information from the parent account.
[0217] "Remote Device" means an electronic device or device used to manage and conduct a child's activities.
[0218] An "activity instruction" is an instruction on the content of an activity to be performed by the remote terminal based on the child's profile.
[0219] An "activity schedule" is a time period set by the parent and a schedule of activities to be carried out during that time period.
[0220] "Executing an activity in real time" means that the remote terminal immediately starts and progresses the activity based on a set schedule.
[0221] "Activity Status Notification" refers to informing the parent of the status of ongoing activities on the remote terminal.
[0222] A "children's activity schedule at a physical store" is a schedule of activities that children will participate in at a physical store or facility.
[0223] "Monitoring" means using a remote device or system to monitor the progress of an activity.
[0224] This invention is a system that registers information on a parent account, generates a child profile based on that information, and synchronizes with a remote terminal to provide activity instructions. A specific embodiment of this system will be described below.
[0225] Basic system configuration
[0226] The system consists of a smartphone or tablet device, a server, and a remote device. Parents can use the smartphone application to create an account, generate a child profile, and set an activity schedule.
[0227] Parent Account Settings
[0228] Parents enter their information to create a profile for their child. Parent information includes name, email address, etc. Child information includes name, age, interests, etc. This information is sent to a server and stored in a database.
[0229] Child profile generation
[0230] The server generates a child profile based on the parent and child information it receives, including the child's age, interests, and preferences for specific activities. The server then synchronizes this profile with the remote device, which then adjusts its activities based on the profile.
[0231] Setting up an activity schedule
[0232] Parents use a smartphone application to input their child's activity schedule, which is then sent to a server and transferred from the server to a remote device, which then executes the activities based on the schedule, allowing parents to view and adjust the progress in real time.
[0233] In-store activity management
[0234] Parents can input their children's activity schedules at physical stores (e.g., activity centers and amusement parks). The remote device monitors the activities at the physical stores and facilities in real time and notifies parents of their progress, allowing parents to efficiently and safely manage their children's activities.
[0235] Program processing
[0236] The server uses the Django framework to manage parent account information, child profiles, and activity schedules. The smartphone application also works with Django, exchanging information in JSON format. It also runs periodic tasks to monitor activities in real time and sends necessary notifications to parents.
[0237] Specific examples
[0238] For example, a parent might enter "Name: Parent A," "Email address: abc@example.com," "Child's name: Child B," "Age: 8 years old," and "Interests: Sports." This information is sent to the server, which generates a profile for the child. The parent then sets a schedule, such as "10:00 - Soccer" and "13:00 - Art," and sends it to the server. The server then sends the schedule information to the remote device, which then starts its activities in real time.
[0239] Example prompt for a generative AI model:
[0240] Parent Account Information:
[0241] Name: Parent A
[0242] Email address: abc@example.com
[0243] Child's name: Child B
[0244] Age: 8
[0245] Interests: Sports
[0246] schedule:
[0247] 10:00 - Soccer
[0248] 13:00 - Drawing
[0249] Notification message:
[0250] The physical twins started playing football.
[0251] The physical twin has begun drawing.
[0252] Such a system allows parents to efficiently manage, monitor and regulate their children's activities while still having time for themselves.
[0253] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0254] Step 1:
[0255] Registering a Parent Account
[0256] The user launches the smartphone application and enters information about themselves and their child (such as name, email address, age, interests, etc.). The information is sent in JSON format to the server, which stores it in a database and creates a parent account.
[0257] Input: Parent and child information such as name, email address, age, and interests
[0258] Output: New parent account information and child profile added to the database
[0259] Step 2:
[0260] Child profile generation
[0261] Based on the received information, the server generates a profile of the child, including the child's age, interests, and preferences for specific activities, and transmits this profile to the remote device, which can then tailor its activities accordingly.
[0262] Input: Child information stored in database
[0263] Output: Child profile synced to remote device
[0264] Step 3:
[0265] Setting up an activity schedule
[0266] The user inputs the child's activity schedule using a smartphone application. This schedule is sent to the server in JSON format, and the server stores it in a database. The remote device starts activities based on this schedule information.
[0267] Input: Activity schedule entered (e.g. 10:00 - Soccer, 13:00 - Drawing)
[0268] Output: Activity schedule synced to remote device
[0269] Step 4:
[0270] Real-time action execution
[0271] The remote terminal starts the activity at the set time based on the received schedule information. For example, if a soccer game starts at 10:00, the remote terminal monitors and executes the activity and sends its progress to the server.
[0272] Input: Synced Activity Schedule
[0273] Output: Information about the real-time activities performed and monitored by the child
[0274] Step 5:
[0275] Activity status notification
[0276] The server notifies the parent user of the progress based on the activity status received from the remote terminal. For example, if a soccer game has started, a notification message saying "Soccer has now started" is sent.
[0277] Input: Activity information sent from the remote device
[0278] Output: Activity notification message sent to parent user
[0279] Step 6:
[0280] In-store activity management
[0281] Users input their activities at the physical store and send them to a remote device, which then monitors the activities at the physical store based on this information. For example, the remote device notifies parents in real time about the progress of soccer or art activities at the activity center.
[0282] Input: Children's activity schedule at a brick-and-mortar store
[0283] Output: Real-time activity progress notification
[0284] Step 7:
[0285] Review and adjust activities
[0286] The parent user uses a smartphone application to check the current activity status and, if necessary, send an instruction to adjust the activity to the server. The server then transmits this instruction to the remote terminal, which then adjusts the activity.
[0287] Input: Parent user confirms activity status and gives instructions for adjustment
[0288] Output: Adjusted activity schedule and ongoing activities
[0289] In this way, parents can effectively manage their children's activities and make appropriate adjustments as needed.
[0290] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0291] Basic system configuration
[0292] The system of the present invention registers information about a parent's account and generates a child profile based on that information. Once the child profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the activity status of the remote device is constantly notified to the parent user, who can check and issue adjustment instructions based on this information. The system of the present invention is also equipped with an emotion engine, which can recognize the parent user's emotions and adjust the activity content based on them.
[0293] Parent Account Settings
[0294] Creating a Parent Account
[0295] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[0296] Registration and submission of information
[0297] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[0298] Parenting Physical Twins
[0299] Receiving information and creating a profile
[0300] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[0301] Profile Sync
[0302] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[0303] Setting up an activity schedule
[0304] Entering a schedule
[0305] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[0306] Sending a Schedule
[0307] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[0308] Real-time interaction with children
[0309] Start of activities
[0310] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[0311] Activity status notification
[0312] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[0313] Parental confirmation and coordination
[0314] Activity monitoring
[0315] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[0316] Adjustment instructions
[0317] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[0318] Emotion Engine Settings
[0319] Emotion Engine Settings
[0320] The server is equipped with an emotion engine and analyzes sensor information (e.g., voice data and image data) to recognize the parent user's emotions.
[0321] Recognizing and transmitting emotions
[0322] The emotion engine recognizes the user's emotions and sends that information to the server, which then issues instructions to adjust the activities of the remote device based on the emotion information.
[0323] Specific examples
[0324] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[0325] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[0326] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[0327] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[0328] The processing flow will be explained below.
[0329] Step 1:
[0330] Creating a Parent Account
[0331] The user launches the dedicated app on their device and accesses the account creation screen. The user enters their own information (e.g., name, email address). The user enters their child's information (e.g., name, age, interests).
[0332] Step 2:
[0333] Submitting information and registering
[0334] The device sends the entered user and child information to the server. The server stores the received information in a database. The server creates a child profile and stores it in the database.
[0335] Step 3:
[0336] Profile Sync
[0337] The server synchronizes the created child profile to the remote device, which receives and stores the synchronized profile.
[0338] Step 4:
[0339] Setting up an activity schedule
[0340] The user inputs the child's activity schedule through the device app. The schedule includes specific time periods and activities to be performed during those periods (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV). The device then sends the input schedule to the server.
[0341] Step 5:
[0342] Schedule management and preparation
[0343] The server sends the received schedule to the remote terminal and prepares for the activity. The remote terminal proceeds with preparations based on the received schedule.
[0344] Step 6:
[0345] Start of activities
[0346] The server sends an instruction to start an activity to the remote device based on the set schedule. The remote device starts the activity with the child. For example, at 4:00 p.m., the remote device starts playing with a dinosaur toy.
[0347] Step 7:
[0348] Real-time notifications
[0349] The remote device reports the current activity status to the server. The server notifies the device of the progress of the activity status. The device displays the current activity status to the parent user in real time.
[0350] Step 8:
[0351] Monitoring and coordinating activities
[0352] The user monitors the activity status of the remote terminal through the terminal. The user sends instructions from the terminal to change or adjust the activity as needed. The server receives the user's instructions and sends change instructions to the remote terminal. The remote terminal receives the instructions, adjusts and executes the activity.
[0353] Step 9:
[0354] Emotion engine configuration and emotion recognition
[0355] The server has an emotion engine and receives emotion data (e.g., voice and image data) from the user, which the emotion engine analyzes and recognizes the user's emotion.
[0356] Step 10:
[0357] Emotional information transmission and activity regulation
[0358] The server sends instructions to the remote device to adjust its activities based on the recognized emotion information. The remote device receives the emotion data and adjusts its activities accordingly.
[0359] As a concrete example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5 years old," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it with the remote device.
[0360] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[0361] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[0362] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[0363] Example 2
[0364] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0365] Previous systems offered limited flexibility in managing children's activities based on schedules set by parents, and failed to take into account parents' emotional states, which could result in stress for both parents and children.
[0366] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for registering information about a parent account, means for generating a child's profile based on the registered information, means for synchronizing the child's profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to perform activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, and means for recognizing the parent user's emotions using an emotion engine and adjusting the activity content of the remote terminal based on the information. This allows for more flexible management of children's activities and enables adjustments to be made in accordance with the parent's emotional state.
[0367] A "parent account" is an account created by a parent using the system based on their own information.
[0368] A "child profile" is data generated based on a parent account and includes demographic information such as the child's age and interests.
[0369] "Remote Device" means a remotely controlled device or equipment used to manage and conduct a Child's activities.
[0370] The "activity schedule" is a timetable set by a parent user that shows the child's daily activity schedule.
[0371] The "emotion engine" is a program that recognizes and analyzes the parent user's emotions from voice data and image data.
[0372] The "means for executing an activity in real time" is a function that enables the remote terminal to immediately execute the child's activity according to a set schedule.
[0373] "Notification of activity status" is a function for notifying the parent user of the ongoing activity of the remote terminal in real time.
[0374] The "means for receiving adjustment instructions" is a function that allows the parent user to send instructions to the remote terminal to change the activity content as needed, and for the remote terminal to accept these instructions.
[0375] A "database" is an information system for storing and managing information such as parent accounts and child profiles.
[0376] A "server" is a computer that handles the central data processing and information transmission of a system.
[0377] The present invention is a system that registers information on a parent account, generates a child's profile based on that information, and synchronizes with a remote terminal to instruct activities.
[0378] Basic system configuration
[0379] Parent Account Settings
[0380] The user (parent) launches a dedicated application on their device. They access the account creation screen and enter their own information (e.g., name, email address) and their child's information (e.g., age, name, interests). The device sends the entered information to the server, which then stores the received information in a database. This creates a parent account and a child profile.
[0381] Parenting Physical Twins
[0382] The server receives the information sent from the device and stores it in a database. The server then generates a child profile, which includes information such as age and interests. The generated child profile is synchronized with the remote device, and activity instructions are sent. This allows the remote device to adjust its activities based on the profile.
[0383] Setting up an activity schedule
[0384] The user uses the terminal application to input the child's activity schedule. This is a timetable showing what activities will be performed at what time. The terminal sends the input schedule information to the server, and the server sends the schedule to the remote terminal. The remote terminal can then carry out the activities based on this information.
[0385] Real-time interaction with children
[0386] The server starts activities according to the schedule set on the remote device. The remote device automatically carries out conversations and activities with the child according to the schedule. The server notifies the device of the progress of the remote device's activities in real time, and the parent user can receive these notifications and check the current activity status.
[0387] Parental confirmation and coordination
[0388] Users can monitor the activities of the remote device through their device, which allows them to check whether the current activity is proceeding according to schedule. When necessary, the parent user can send an instruction to change the activity from their device to the remote device via the server, allowing them to flexibly respond to unexpected situations.
[0389] Emotion Engine Settings
[0390] The server is equipped with an emotion engine that analyzes sensor information (e.g., voice data, image data) to recognize the parent user's emotions. The emotion engine recognizes the user's emotions and sends that information to the server. The server issues instructions to adjust the activities of the remote device based on this emotion information.
[0391] Specific examples
[0392] For example, if a user enters "Name: Tanaka Taro", "Email address: taro@example.com", "Child's name: Hanako", "Age: 5", and "Interests: Dinosaurs", the device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[0393] Next, the user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends the information to the server, which then sends the schedule to the remote device, which then begins its activities based on this schedule.
[0394] Furthermore, if the emotion engine recognizes that the parent user is feeling "tired," the remote terminal adjusts the activity content so that the parent user spends more time reading picture books.
[0395] Prompt Sentence Examples
[0396] A possible prompt might be, "Suggest an activity schedule for a 5-year-old child interested in dinosaurs from 10:00 AM to 6:00 PM."
[0397] This system allows parent users to provide care for their children tailored to their own condition while still having time for themselves.
[0398] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0399] Step 1:
[0400] The user (parent) launches a dedicated application on their device and accesses the account creation screen. The user enters their own information (name, email address, etc.) and their child's information (age, name, interests, etc.).
[0401] Input: Parent information, Child information
[0402] Output: Confirmation screen displayed on the device
[0403] Step 2:
[0404] The device sends the information entered by the user to the server, which then registers the received information in a database and creates a parent account and a child profile.
[0405] Input: Parent information, Child information
[0406] Data processing: Creation of parent accounts and child profiles
[0407] Output: Parent account and child profile stored in database
[0408] Step 3:
[0409] The server synchronizes the created child profile to the remote device, which then configures itself based on the received profile information.
[0410] Input: Generated child profile
[0411] Output: Profile information synced to the remote device
[0412] Step 4:
[0413] The user uses the device application to input the child's activity schedule, for example, "16:00 - Play," "18:00 - Dinner," "19:00 - TV," etc.
[0414] Input: Activity schedule information
[0415] Output: Schedule information entered on the terminal
[0416] Step 5:
[0417] The terminal transmits the input schedule information to the server, which then transmits the schedule information to the remote terminal.
[0418] Input: Activity schedule information
[0419] Output: Schedule information sent to the remote device
[0420] Step 6:
[0421] The server starts the activity according to the schedule set in the remote terminal, and the remote terminal automatically performs the activity according to the specified time.
[0422] Input: Schedule information synchronized to the remote device
[0423] Output: Each activity started
[0424] Step 7:
[0425] The server notifies the remote device of the progress of its activities in real time, which the user can then view through the application.
[0426] Input: Remote terminal activity progress
[0427] Output: Notifications displayed on the device
[0428] Step 8:
[0429] The user monitors the activities of the remote terminal through the terminal, and checks whether the activities are proceeding according to schedule.
[0430] Input: Notified activity progress
[0431] Output: Monitoring information that can be viewed by the user
[0432] Step 9:
[0433] When the parent user feels it is necessary, the terminal sends an instruction to change the activity to the remote terminal via the server. The remote terminal changes the activity based on the received instruction.
[0434] Input: Change instruction information from parent user
[0435] Output: Change orders sent to the remote device
[0436] Step 10:
[0437] The server collects and analyzes voice and image data to recognize the parent user's emotions using an emotion engine, and sends the recognized emotion information to the remote device, which then adjusts its activities accordingly.
[0438] Input: Parent user's voice data, image data
[0439] Data processing: Recognition and analysis of emotional information
[0440] Output: Instructions for adjusting activities
[0441] (Application example 2)
[0442] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0443] In recent years, with the increase in dual-income households, the burden of transporting children to and from school has become a major social issue. A reliable transportation method is needed, especially when parents are away from home due to work or other reasons. There is also a need for a system that can manage flexible schedules that take into account the emotional state of parents while ensuring the safety of children. Traditional manual management places a significant burden on both time and mental health, and new technologies are needed to address this.
[0444] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with the remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute child pick-up and drop-off activities in real time in the autonomously driven vehicle based on the set schedule, and means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions. This enables the autonomously driven vehicle to safely pick up and drop off the child based on the schedule set by the parent and notify the parent of the activity status in real time. In addition, flexible adjustments can be made taking into account the parent's emotional state, reducing stress and realizing efficient transportation management.
[0445] A "parent account" is an account in which a parent's personal information is registered to manage their child's activities.
[0446] A "child profile" is an individual profile that includes information about a child's age, interests, and preferences for certain activities.
[0447] The "remote terminal" is a remotely operable device that carries out activities for picking up and dropping off children based on a schedule set by the parents and notifies the parents of the activity status.
[0448] An "activity instruction" is an instruction indicating the specific activity content to be carried out by the remote terminal based on the child's profile and schedule.
[0449] The "daily activity schedule" is a timetable set by parents that lists the timetable and content of their child's daily activities.
[0450] An "autonomous vehicle" is a vehicle that has the ability to automatically carry out child pick-up and drop-off activities according to a programmed schedule.
[0451] "Performing an activity in real time" means performing a child's activity in real time according to a set schedule.
[0452] "Notifying parent user of activity status" means informing the parent in real time of the progress of the activity being executed by the remote terminal.
[0453] "Confirmation and adjustment instructions" means that the parent checks the progress of the activity via the remote terminal and gives instructions for changes as necessary.
[0454] The program of the system that embodies this invention manages everything from registering information in a parent account to picking up and dropping off a child. The system generates a child profile based on the information in the parent account, synchronizes it with a remote terminal, and performs regular pick-up and drop-off using an autonomous vehicle.
[0455] System implementation configuration
[0456] 1. Register parent account information and create a profile
[0457] The user (parent) creates a parent account using a dedicated smartphone application. After entering the parent's information (name, email address) and the child's information (age, name, interests), this information is sent to the server and stored in a database. The child's profile is then generated and synchronized to the remote device.
[0458] 2. Schedule your daily activities
[0459] Through the application, users can set up a daily activity schedule for their children, which is entered by the parent and sent to the server, where it is then sent to the remote device as a timetable.
[0460] 3. Transportation using self-driving vehicles
[0461] The remote terminal will use the autonomous vehicle to pick up and drop off the child in real time based on the set schedule, and the autonomous vehicle will notify the parent of its current location and planned route in real time.
[0462] 4. Notification of activity status and adjustment instructions
[0463] The remote device sends the progress of the transportation activity to the server in real time and notifies the parent's smartphone. The parent can check the current situation through the application and send instructions to the remote device to adjust the activity content as necessary.
[0464] 5. Use of Emotion Engine
[0465] The emotion engine analyzes the parent's emotional state in real time and adjusts the pick-up route and time accordingly. For example, if the parent is tired, the system will automatically adjust the pick-up time to a little earlier.
[0466] Program processing
[0467] The server generates a parent account and a child profile and synchronizes them with the remote device, which then operates the autonomous vehicle based on a set schedule, performs real-time pickup and drop-off activities, and reports the activity status to the server, providing an interface for parents to view the status and issue adjustment instructions.
[0468] Specific examples
[0469] For example, a parent may set a schedule to pick up their child from school at 4:00 PM and return home at 5:00 PM. If the parent's emotion engine recognizes that they are tired, the autonomous vehicle will begin picking them up at 3:45 PM. The system will notify the parent in real time of their location and activity status, allowing them to wait at home with peace of mind.
[0470] Prompt Sentence Examples
[0471] My child's name is Hanako, she's 5 years old, and she's interested in dinosaurs. I want to pick her up from school at 4:00 PM and take her home at 5:00 PM. Her emotional state is calm. Please send the pickup instructions to the autonomous vehicle.
[0472] The above is an embodiment of the present system.
[0473] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0474] Step 1:
[0475] To register information for a parent account, a user opens a smartphone application and enters the parent's name, email address, child's name, age, interests, etc. The entered information is converted to JSON format by the device and sent to the server, which receives the information and stores it in a database.
[0476] Input: Parent's personal information, Child's profile information
[0477] Output: Parent account and child profile information stored in the database.
[0478] Step 2:
[0479] The server uses the information stored in the database to create a profile for the child, including the child's age, name, interests, and preferences for specific activities, and then synchronizes this profile with the remote device.
[0480] Input: Parent account information in the database, child profile information
[0481] Output: Synced child profile
[0482] Step 3:
[0483] A user uses a smartphone application to input a child's daily activity schedule. The schedule includes activities by time period. This schedule information is sent from the device to a server. The server links the schedule information to the child's profile and sends it to the remote device as a timetable.
[0484] Input: Parent-entered activity schedule
[0485] Output: Schedule sent to remote device
[0486] Step 4:
[0487] The remote terminal sends instructions to the autonomous vehicle based on a set schedule. The autonomous vehicle follows the instructions and carries out child pick-up and drop-off activities in real time. The vehicle's current location and planned route are sent to the server via the remote terminal.
[0488] Input: Schedule information from the server
[0489] Output: Pick-up instructions sent to the autonomous vehicle, pick-up activity execution
[0490] Step 5:
[0491] While the remote device is performing the pick-up and drop-off activity, it sends the activity status to the server in real time. The server receives this information and notifies the user's smartphone application. Parents can check the current status through the application and send change instructions to the remote device as necessary.
[0492] Input: Activity from remote terminal
[0493] Output: Activity status notified to parent's smartphone, adjustment instructions from parent
[0494] Step 6:
[0495] The server uses an emotion engine to analyze the parent's emotional state. For example, if it detects that the parent is tired, it will adjust the pickup time of the self-driving vehicle accordingly. This information is then transmitted to a remote device, which can then adjust the schedule flexibly.
[0496] Input: Parent emotion data
[0497] Output: Schedule adjustment instructions based on emotion analysis results
[0498] The above are the specific processing steps of this system, and clearly show what inputs are received at each step, how the data is processed, and how the final output is obtained.
[0499] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0500] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0501] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0502] [Second embodiment]
[0503] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0504] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0505] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0506] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0507] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0508] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0509] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0510] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0511] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0512] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0513] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0514] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0515] Basic system configuration
[0516] The system of the present invention registers information about a parent's account and generates a child's profile based on that information. Once the child's profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the parent user is constantly notified of the activity status of the remote device, allowing the parent user to check and issue adjustment instructions based on this information.
[0517] Parent Account Settings
[0518] Creating a Parent Account
[0519] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[0520] Registration and submission of information
[0521] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[0522] Parenting Physical Twins
[0523] Receiving information and creating a profile
[0524] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[0525] Profile Sync
[0526] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[0527] Setting up an activity schedule
[0528] Entering a schedule
[0529] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[0530] Sending a Schedule
[0531] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[0532] Real-time interaction with children
[0533] Start of activities
[0534] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[0535] Activity status notification
[0536] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[0537] Parental confirmation and coordination
[0538] Activity monitoring
[0539] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[0540] Adjustment instructions
[0541] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[0542] Specific examples
[0543] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[0544] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[0545] At 4:00 PM, the remote device starts playing with a dinosaur toy, and the server notifies the device that "The physical twin is currently playing dinosaur with a child." If it is 6:00 PM and the user wants to have dinner, the device sends the command "Dinner time begins." The server then relays the command to the physical twin, and the remote device begins preparing dinner.
[0546] This system allows parent users to provide high-quality care for their children while still having time for themselves.
[0547] The processing flow will be explained below.
[0548] Step 1:
[0549] Creating a Parent Account
[0550] The user launches the dedicated app on their device and accesses the account creation screen.
[0551] The user enters their information (e.g., name, email address).
[0552] The user enters the child's information (name, age, interests, etc.).
[0553] Step 2:
[0554] Submitting information and registering
[0555] The terminal transmits the entered user and child information to the server.
[0556] The server stores the received information in a database.
[0557] The server generates a child's profile and stores it in a database.
[0558] Step 3:
[0559] Profile Sync
[0560] The server synchronizes the generated child profile to the remote device.
[0561] The remote device receives and stores the synchronized profile.
[0562] Step 4:
[0563] Setting up an activity schedule
[0564] The user enters their child's activity schedule through an app on their device.
[0565] The schedule includes specific times and activities that will occur during those times (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV).
[0566] The terminal transmits the input schedule to the server.
[0567] Step 5:
[0568] Schedule management and preparation
[0569] The server transmits the received schedule to the remote terminal, which prepares the activity.
[0570] The remote terminal makes preparations based on the received schedule.
[0571] Step 6:
[0572] Start of activities
[0573] The server sends an instruction to start an activity to the remote terminal based on the set schedule.
[0574] The remote device initiates an activity with the child.
[0575] For example, at 4:00 PM, the remote device will start playing with a dinosaur toy.
[0576] Step 7:
[0577] Real-time notifications
[0578] The remote terminal reports its current activity to the server.
[0579] The server notifies the terminal of the progress of the activity.
[0580] The device displays the current activity status to the parent user in real time.
[0581] Step 8:
[0582] Monitoring and coordinating activities
[0583] The user monitors the activity of the remote terminal through the terminal.
[0584] The user sends instructions to change or adjust activities as needed from the terminal.
[0585] The server receives the user's instructions and sends change instructions to the remote terminal.
[0586] The remote terminal receives instructions, coordinates and executes activities.
[0587] For example, if a user feels like "I want to have dinner at 18:00," the user sends a command from the terminal to "start dinner time." The server receives the command and transmits it to the remote terminal, which then starts preparing dinner.
[0588] In this way, the system allows parent users to provide high-quality care for their children while still having time for themselves.
[0589] Example 1
[0590] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0591] In traditional child-rearing, parents have had to spend a lot of time and effort planning and managing their children's activities, making it difficult to provide appropriate activities that meet individual needs.In addition, there was a lack of efficient means for parents to monitor their children's activities in real time and make necessary adjustments, making it difficult to respond flexibly.
[0592] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0593] In this invention, the server includes a means for registering parent account information, a means for generating a child profile based on the registered information, a means for synchronizing the child profile with a remote terminal and issuing activity instructions, and a means for transmitting a daily activity schedule set by a parent user to the remote terminal, thereby enabling parents to efficiently plan and manage their children's activities, provide activities according to individual needs, and enable real-time monitoring and flexible adjustment.
[0594] "Parent Account" means an account through which a User creates and manages a Child Profile.
[0595] A "child profile" is a database entry that holds information about a registered child (such as age, interests, activity preferences, etc.).
[0596] A "remote device" is a device (such as a smartphone, tablet, or dedicated device) that communicates with the server and performs and manages activities with a child.
[0597] An "activity schedule" is a timetable set by a parent user that lists what activities a child will do during a specific time period.
[0598] The "server" is a central device that stores parent accounts, child profiles, and activity schedules in a database and communicates with remote devices.
[0599] "Synchronization" is the process of matching data between a server and a remote terminal, and refers to sharing the latest data between them.
[0600] An "activity instruction" is an instruction from a server or a remote terminal to a child to perform a specific activity at a specific time.
[0601] "Notification" refers to the transmission of information to inform the parent user of the activity status of the remote terminal in real time.
[0602] An "adjustment instruction" is an instruction from a parent user to a remote terminal to change the activity content as needed.
[0603] The present invention is a system for efficiently managing and coordinating parental activities and improving the quality of parental time. This system registers parent account information, generates a child profile based on that information, and provides activity instructions on a remote terminal. A specific embodiment of the system is described below.
[0604] This system uses the following main hardware and software:
[0605] Remote devices: smartphones, tablets, dedicated devices, etc.
[0606] Server: A central device that manages parent accounts, child profiles, and activity schedules.
[0607] Dedicated application: An application installed on the device
[0608] Database: MySQL, etc.
[0609] First, the parent user creates a parent account using a dedicated application. On the account creation screen, the parent enters information such as the parent's name, email address, child's name, age, and interests. For example, the parent user might enter "Name: Jiro Sato," "Email address: jiro@example.com," "Child's name: Ichiro," "Age: 6," and "Interests: Cars."
[0610] The device sends the entered information to the server, which receives it and stores it in a database. Based on this stored information, the server generates a child profile. For example, profile information such as "Name: Ichiro," "Age: 6 years old," and "Interests: Cars" is generated.
[0611] The server then synchronizes the generated child profile information with the remote device, which can then provide activity instructions based on the child's age, interests, and activity preferences.
[0612] Parents use a dedicated application to input their child's activity schedule, such as "15:00 - Play with toys," "17:00 - Draw pictures," and "19:00 - Watch TV." This input schedule is sent from the device to the server, which then sends the information to the remote device.
[0613] The remote device starts its activities according to the schedule sent from the server. At 3:00 PM, the remote device starts the "Play with toys" activity and acts automatically while interacting with the child. For example, the remote device instructs the child on how to choose a toy and how to play with it.
[0614] The server notifies the parent user of the activity status of the remote device in real time. For example, a notification such as "The remote device is currently playing with toys with Ichiro" is sent to the parent user's device. This allows the parent user to understand the current activity status.
[0615] If necessary, the parent user can send an instruction to change the activity from the terminal to the remote terminal via the server. For example, if the parent user sends an instruction to "change to drawing time," the remote terminal will move on to the next activity according to the instruction.
[0616] This allows parent users to efficiently manage and coordinate their children's activities while still having time for themselves. This system allows for flexible responses to the needs of parents and children, and supports child-rearing using the latest technology.
[0617] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0618] System program processing steps
[0619] Step 1:
[0620] Creating a Parent Account
[0621] Processing content: The user launches the dedicated application and enters the required information on the account creation screen.
[0622] Input: Name, email address, child's name, age, interests, etc.
[0623] Data processing: The application converts the input information into JSON format.
[0624] Output: Parent account and child information in JSON format.
[0625] Specific actions: For example, a user enters the following information into the app: "Name: Yamada Taro", "Email address: taro@example.com", "Child's name: Jiro", "Age: 4 years old", "Interests: Space".
[0626] Step 2:
[0627] Registration and submission of information
[0628] Processing content: The terminal sends the entered information to the server.
[0629] Input: Parent account and child information in JSON format.
[0630] Data calculation: The terminal sends the input information to the server as an HTTP request.
[0631] Output: Parent account and child information sent to the server.
[0632] Specific operation: The device sends the following information to the server: "parent_info: {name: 'Yamada Taro', email: 'taro@example.com', child_info: {name: 'Jiro', age: 4, interest: 'Space'}}".
[0633] Step 3:
[0634] Receiving information and storing it in the database
[0635] Processing: The server stores the received information in a database.
[0636] Input: Parent account and child information sent from the device.
[0637] Data processing: The server converts the received information into a format that can be written to the database.
[0638] Output: Information stored in a database.
[0639] Specific operation: The server adds a record to the "parent_info" table with the following information: "Name: Yamada Taro", "Email address: taro@example.com", and "Child information: [Name: Jiro, Age: 4, Interests: Space]".
[0640] Step 4:
[0641] Child profile generation
[0642] What happens: The server generates a profile for the child based on the information in the database.
[0643] Input: Parent account and child information stored in the database.
[0644] Data calculation: The server applies a profile generation algorithm to create the child's profile data.
[0645] Output: Child profile data.
[0646] Specific operation: The server generates data for "Profile: {Name: Jiro, Age: 4, Interests: Space}".
[0647] Step 5:
[0648] Profile Sync
[0649] Processing: The server synchronizes the created child profile to the remote device.
[0650] Input: Child profile data.
[0651] Data processing: Serializing profile data for transmission to remote devices.
[0652] Output: Child profile data sent to the remote device.
[0653] Specific operation: The server sends the data "sync_profile: {Name: Jiro, Age: 4, Interests: Space}" to the remote device.
[0654] Step 6:
[0655] Entering an activity schedule
[0656] What happens: The user enters a child's activity schedule in the application.
[0657] Input: Activity schedule (time and content).
[0658] Data processing: Convert the input schedule into schedule data format.
[0659] Output: Activity schedule data.
[0660] Specific actions: The user inputs "15:00 - play with toys", "17:00 - draw a picture", and "19:00 - watch TV".
[0661] Step 7:
[0662] Sending a Schedule
[0663] Processing content: The terminal sends the input schedule to the server.
[0664] Input: Activity schedule data.
[0665] Data calculation: The terminal sends the input schedule to the server as an HTTP request.
[0666] Output: The activity schedule sent to the server.
[0667] Specific operation: The device sends the following data to the server: "schedule: [{time: '15:00', activity: 'play with toys'}, {time: '17:00', activity: 'draw a picture'}, {time: '19:00', activity: 'watch TV'}]".
[0668] Step 8:
[0669] Start of activities
[0670] Processing details: The server instructs the remote terminal to start its activities according to the set schedule.
[0671] Input: Activity schedule data.
[0672] Data processing: The server processes the schedule data to send it to the remote terminal.
[0673] Output: Action instructions sent to the remote device.
[0674] Specific operation: At 15:00, the server sends "activity_start: 15:00 in the morning, content: play with toys" to the remote device.
[0675] Step 9:
[0676] Activity status notification
[0677] What it does: The server notifies the parent user's device of ongoing activities on the remote device in real time.
[0678] Input: Activity data from a remote terminal.
[0679] Data calculation: The server processes the activity status data to send it to the parent user's terminal.
[0680] Output: Activity notification sent to parent user's device.
[0681] Specific operation: When the remote device starts an activity, the server sends a notification to the parent user saying, "Notification: Jiro is currently playing with toys at 15:00."
[0682] Step 10:
[0683] Monitoring and coordinating activities
[0684] Processing details: The user monitors the activity status of the remote terminal and issues instructions to change the activity as necessary.
[0685] Input: Adjustment instructions from parent user.
[0686] Data calculation: The terminal sends adjustment instructions to the server, and the server forwards the instructions to the remote terminal.
[0687] Output: Adjustment instructions sent to the remote device.
[0688] Specific operation: When the parent user presses a button, for example, "Dinner time starts at 17:30," the device sends "activity_change: 17:30 - Dinner time starts" to the remote device via the server.
[0689] The above processing steps realize a system that allows parent users to efficiently plan, manage, and safely coordinate their children's activities.
[0690] (Application example 1)
[0691] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0692] It is difficult for parents to safely and efficiently manage and monitor their children's activities in brick-and-mortar stores in real time. This creates a significant burden on parents, especially when managing multiple activities simultaneously. Traditional methods make it difficult to select appropriate activities based on a child's interests and preferences, and require parents to directly monitor and adjust their children's activities, which consumes a significant amount of parents' time.
[0693] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0694] In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, means for inputting the child's activity schedule at a physical store, and means for monitoring the child's activities at the physical store in real time and notifying the parent user, thereby enabling parents to efficiently and safely manage their child's activities and adjust them flexibly and in real time.
[0695] A "parent account" is an account that allows parents to register information about themselves and their children and manage their children's activities.
[0696] A "child profile" is a set of information that includes a child's personal data, preferences, and activity records, generated based on information from the parent account.
[0697] "Remote Device" means an electronic device or device used to manage and conduct a child's activities.
[0698] An "activity instruction" is an instruction on the content of an activity to be performed by the remote terminal based on the child's profile.
[0699] An "activity schedule" is a time period set by the parent and a schedule of activities to be carried out during that time period.
[0700] "Executing an activity in real time" means that the remote terminal immediately starts and progresses the activity based on a set schedule.
[0701] "Activity Status Notification" refers to informing the parent of the status of ongoing activities on the remote terminal.
[0702] A "children's activity schedule at a physical store" is a schedule of activities that children will participate in at a physical store or facility.
[0703] "Monitoring" means using a remote device or system to monitor the progress of an activity.
[0704] This invention is a system that registers information on a parent account, generates a child profile based on that information, and synchronizes with a remote terminal to provide activity instructions. A specific embodiment of this system will be described below.
[0705] Basic system configuration
[0706] The system consists of a smartphone or tablet device, a server, and a remote device. Parents can use the smartphone application to create an account, generate a child profile, and set an activity schedule.
[0707] Parent Account Settings
[0708] Parents enter their information to create a profile for their child. Parent information includes name, email address, etc. Child information includes name, age, interests, etc. This information is sent to a server and stored in a database.
[0709] Child profile generation
[0710] The server generates a child profile based on the parent and child information it receives, including the child's age, interests, and preferences for specific activities. The server then synchronizes this profile with the remote device, which then adjusts its activities based on the profile.
[0711] Setting up an activity schedule
[0712] Parents use a smartphone application to input their child's activity schedule, which is then sent to a server and transferred from the server to a remote device, which then executes the activities based on the schedule, allowing parents to view and adjust the progress in real time.
[0713] In-store activity management
[0714] Parents can input their children's activity schedules at physical stores (e.g., activity centers and amusement parks). The remote device monitors the activities at the physical stores and facilities in real time and notifies parents of their progress, allowing parents to efficiently and safely manage their children's activities.
[0715] Program processing
[0716] The server uses the Django framework to manage parent account information, child profiles, and activity schedules. The smartphone application also works with Django, exchanging information in JSON format. It also runs periodic tasks to monitor activities in real time and sends necessary notifications to parents.
[0717] Specific examples
[0718] For example, a parent might enter "Name: Parent A," "Email address: abc@example.com," "Child's name: Child B," "Age: 8 years old," and "Interests: Sports." This information is sent to the server, which generates a profile for the child. The parent then sets a schedule, such as "10:00 - Soccer" and "13:00 - Art," and sends it to the server. The server then sends the schedule information to the remote device, which then starts its activities in real time.
[0719] Example prompt for a generative AI model:
[0720] Parent Account Information:
[0721] Name: Parent A
[0722] Email address: abc@example.com
[0723] Child's name: Child B
[0724] Age: 8
[0725] Interests: Sports
[0726] schedule:
[0727] 10:00 - Soccer
[0728] 13:00 - Drawing
[0729] Notification message:
[0730] The physical twins started playing football.
[0731] The physical twin has begun drawing.
[0732] Such a system allows parents to efficiently manage, monitor and regulate their children's activities while still having time for themselves.
[0733] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0734] Step 1:
[0735] Registering a Parent Account
[0736] The user launches the smartphone application and enters information about themselves and their child (such as name, email address, age, interests, etc.). The information is sent in JSON format to the server, which stores it in a database and creates a parent account.
[0737] Input: Parent and child information such as name, email address, age, and interests
[0738] Output: New parent account information and child profile added to the database
[0739] Step 2:
[0740] Child profile generation
[0741] Based on the received information, the server generates a profile of the child, including the child's age, interests, and preferences for specific activities, and transmits this profile to the remote device, which can then tailor its activities accordingly.
[0742] Input: Child information stored in database
[0743] Output: Child profile synced to remote device
[0744] Step 3:
[0745] Setting up an activity schedule
[0746] The user inputs the child's activity schedule using a smartphone application. This schedule is sent to the server in JSON format, and the server stores it in a database. The remote device starts activities based on this schedule information.
[0747] Input: Activity schedule entered (e.g. 10:00 - Soccer, 13:00 - Drawing)
[0748] Output: Activity schedule synced to remote device
[0749] Step 4:
[0750] Real-time action execution
[0751] The remote terminal starts the activity at the set time based on the received schedule information. For example, if a soccer game starts at 10:00, the remote terminal monitors and executes the activity and sends its progress to the server.
[0752] Input: Synced Activity Schedule
[0753] Output: Information about the real-time activities performed and monitored by the child
[0754] Step 5:
[0755] Activity status notification
[0756] The server notifies the parent user of the progress based on the activity status received from the remote terminal. For example, if a soccer game has started, a notification message saying "Soccer has now started" is sent.
[0757] Input: Activity information sent from the remote device
[0758] Output: Activity notification message sent to parent user
[0759] Step 6:
[0760] In-store activity management
[0761] Users input their activities at the physical store and send them to a remote device, which then monitors the activities at the physical store based on this information. For example, the remote device notifies parents in real time about the progress of soccer or art activities at the activity center.
[0762] Input: Children's activity schedule at a brick-and-mortar store
[0763] Output: Real-time activity progress notification
[0764] Step 7:
[0765] Review and adjust activities
[0766] The parent user uses a smartphone application to check the current activity status and, if necessary, send an instruction to adjust the activity to the server. The server then transmits this instruction to the remote terminal, which then adjusts the activity.
[0767] Input: Parent user confirms activity status and gives instructions for adjustment
[0768] Output: Adjusted activity schedule and ongoing activities
[0769] In this way, parents can effectively manage their children's activities and make appropriate adjustments as needed.
[0770] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0771] Basic system configuration
[0772] The system of the present invention registers information about a parent's account and generates a child profile based on that information. Once the child profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the activity status of the remote device is constantly notified to the parent user, who can check and issue adjustment instructions based on this information. The system of the present invention is also equipped with an emotion engine, which can recognize the parent user's emotions and adjust the activity content based on them.
[0773] Parent Account Settings
[0774] Creating a Parent Account
[0775] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[0776] Registration and submission of information
[0777] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[0778] Parenting Physical Twins
[0779] Receiving information and creating a profile
[0780] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[0781] Profile Sync
[0782] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[0783] Setting up an activity schedule
[0784] Entering a schedule
[0785] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[0786] Sending a Schedule
[0787] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[0788] Real-time interaction with children
[0789] Start of activities
[0790] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[0791] Activity status notification
[0792] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[0793] Parental confirmation and coordination
[0794] Activity monitoring
[0795] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[0796] Adjustment instructions
[0797] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[0798] Emotion Engine Settings
[0799] Emotion Engine Settings
[0800] The server is equipped with an emotion engine and analyzes sensor information (e.g., voice data and image data) to recognize the parent user's emotions.
[0801] Recognizing and transmitting emotions
[0802] The emotion engine recognizes the user's emotions and sends that information to the server, which then issues instructions to adjust the activities of the remote device based on the emotion information.
[0803] Specific examples
[0804] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[0805] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[0806] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[0807] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[0808] The processing flow will be explained below.
[0809] Step 1:
[0810] Creating a Parent Account
[0811] The user launches the dedicated app on their device and accesses the account creation screen. The user enters their own information (e.g., name, email address). The user enters their child's information (e.g., name, age, interests).
[0812] Step 2:
[0813] Submitting information and registering
[0814] The device sends the entered user and child information to the server. The server stores the received information in a database. The server creates a child profile and stores it in the database.
[0815] Step 3:
[0816] Profile Sync
[0817] The server synchronizes the created child profile to the remote device, which receives and stores the synchronized profile.
[0818] Step 4:
[0819] Setting up an activity schedule
[0820] The user inputs the child's activity schedule through the device app. The schedule includes specific time periods and activities to be performed during those periods (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV). The device then sends the input schedule to the server.
[0821] Step 5:
[0822] Schedule management and preparation
[0823] The server sends the received schedule to the remote terminal and prepares for the activity. The remote terminal proceeds with preparations based on the received schedule.
[0824] Step 6:
[0825] Start of activities
[0826] The server sends an instruction to start an activity to the remote device based on the set schedule. The remote device starts the activity with the child. For example, at 4:00 p.m., the remote device starts playing with a dinosaur toy.
[0827] Step 7:
[0828] Real-time notifications
[0829] The remote device reports the current activity status to the server. The server notifies the device of the progress of the activity status. The device displays the current activity status to the parent user in real time.
[0830] Step 8:
[0831] Monitoring and coordinating activities
[0832] The user monitors the activity status of the remote terminal through the terminal. The user sends instructions from the terminal to change or adjust the activity as needed. The server receives the user's instructions and sends change instructions to the remote terminal. The remote terminal receives the instructions, adjusts and executes the activity.
[0833] Step 9:
[0834] Emotion engine configuration and emotion recognition
[0835] The server has an emotion engine and receives emotion data (e.g., voice and image data) from the user, which the emotion engine analyzes and recognizes the user's emotion.
[0836] Step 10:
[0837] Emotional information transmission and activity regulation
[0838] The server sends instructions to the remote device to adjust its activities based on the recognized emotion information. The remote device receives the emotion data and adjusts its activities accordingly.
[0839] As a concrete example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5 years old," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it with the remote device.
[0840] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[0841] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[0842] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[0843] Example 2
[0844] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0845] Previous systems offered limited flexibility in managing children's activities based on schedules set by parents, and failed to take into account parents' emotional states, which could result in stress for both parents and children.
[0846] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for registering information about a parent account, means for generating a child's profile based on the registered information, means for synchronizing the child's profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to perform activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, and means for recognizing the parent user's emotions using an emotion engine and adjusting the activity content of the remote terminal based on the information. This allows for more flexible management of children's activities and enables adjustments to be made in accordance with the parent's emotional state.
[0847] A "parent account" is an account created by a parent using the system based on their own information.
[0848] A "child profile" is data generated based on a parent account and includes demographic information such as the child's age and interests.
[0849] "Remote Device" means a remotely controlled device or equipment used to manage and conduct a Child's activities.
[0850] The "activity schedule" is a timetable set by a parent user that shows the child's daily activity schedule.
[0851] The "emotion engine" is a program that recognizes and analyzes the parent user's emotions from voice data and image data.
[0852] The "means for executing an activity in real time" is a function that enables the remote terminal to immediately execute the child's activity according to a set schedule.
[0853] "Notification of activity status" is a function for notifying the parent user of the ongoing activity of the remote terminal in real time.
[0854] The "means for receiving adjustment instructions" is a function that allows the parent user to send instructions to the remote terminal to change the activity content as needed, and for the remote terminal to accept these instructions.
[0855] A "database" is an information system for storing and managing information such as parent accounts and child profiles.
[0856] A "server" is a computer that handles the central data processing and information transmission of a system.
[0857] The present invention is a system that registers information on a parent account, generates a child's profile based on that information, and synchronizes with a remote terminal to instruct activities.
[0858] Basic system configuration
[0859] Parent Account Settings
[0860] The user (parent) launches a dedicated application on their device. They access the account creation screen and enter their own information (e.g., name, email address) and their child's information (e.g., age, name, interests). The device sends the entered information to the server, which then stores the received information in a database. This creates a parent account and a child profile.
[0861] Parenting Physical Twins
[0862] The server receives the information sent from the device and stores it in a database. The server then generates a child profile, which includes information such as age and interests. The generated child profile is synchronized with the remote device, and activity instructions are sent. This allows the remote device to adjust its activities based on the profile.
[0863] Setting up an activity schedule
[0864] The user uses the terminal application to input the child's activity schedule. This is a timetable showing what activities will be performed at what time. The terminal sends the input schedule information to the server, and the server sends the schedule to the remote terminal. The remote terminal can then carry out the activities based on this information.
[0865] Real-time interaction with children
[0866] The server starts activities according to the schedule set on the remote device. The remote device automatically carries out conversations and activities with the child according to the schedule. The server notifies the device of the progress of the remote device's activities in real time, and the parent user can receive these notifications and check the current activity status.
[0867] Parental confirmation and coordination
[0868] Users can monitor the activities of the remote device through their device, which allows them to check whether the current activity is proceeding according to schedule. When necessary, the parent user can send an instruction to change the activity from their device to the remote device via the server, allowing them to flexibly respond to unexpected situations.
[0869] Emotion Engine Settings
[0870] The server is equipped with an emotion engine that analyzes sensor information (e.g., voice data, image data) to recognize the parent user's emotions. The emotion engine recognizes the user's emotions and sends that information to the server. The server issues instructions to adjust the activities of the remote device based on this emotion information.
[0871] Specific examples
[0872] For example, if a user enters "Name: Tanaka Taro", "Email address: taro@example.com", "Child's name: Hanako", "Age: 5", and "Interests: Dinosaurs", the device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[0873] Next, the user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends the information to the server, which then sends the schedule to the remote device, which then begins its activities based on this schedule.
[0874] Furthermore, if the emotion engine recognizes that the parent user is feeling "tired," the remote terminal adjusts the activity content so that the parent user spends more time reading picture books.
[0875] Prompt Sentence Examples
[0876] A possible prompt might be, "Suggest an activity schedule for a 5-year-old child interested in dinosaurs from 10:00 AM to 6:00 PM."
[0877] This system allows parent users to provide care for their children tailored to their own condition while still having time for themselves.
[0878] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0879] Step 1:
[0880] The user (parent) launches a dedicated application on their device and accesses the account creation screen. The user enters their own information (name, email address, etc.) and their child's information (age, name, interests, etc.).
[0881] Input: Parent information, Child information
[0882] Output: Confirmation screen displayed on the device
[0883] Step 2:
[0884] The device sends the information entered by the user to the server, which then registers the received information in a database and creates a parent account and a child profile.
[0885] Input: Parent information, Child information
[0886] Data processing: Creation of parent accounts and child profiles
[0887] Output: Parent account and child profile stored in database
[0888] Step 3:
[0889] The server synchronizes the created child profile to the remote device, which then configures itself based on the received profile information.
[0890] Input: Generated child profile
[0891] Output: Profile information synced to the remote device
[0892] Step 4:
[0893] The user uses the device application to input the child's activity schedule, for example, "16:00 - Play," "18:00 - Dinner," "19:00 - TV," etc.
[0894] Input: Activity schedule information
[0895] Output: Schedule information entered on the terminal
[0896] Step 5:
[0897] The terminal transmits the input schedule information to the server, which then transmits the schedule information to the remote terminal.
[0898] Input: Activity schedule information
[0899] Output: Schedule information sent to the remote device
[0900] Step 6:
[0901] The server starts the activity according to the schedule set in the remote terminal, and the remote terminal automatically performs the activity according to the specified time.
[0902] Input: Schedule information synchronized to the remote device
[0903] Output: Each activity started
[0904] Step 7:
[0905] The server notifies the remote device of the progress of its activities in real time, which the user can then view through the application.
[0906] Input: Remote terminal activity progress
[0907] Output: Notifications displayed on the device
[0908] Step 8:
[0909] The user monitors the activities of the remote terminal through the terminal, and checks whether the activities are proceeding according to schedule.
[0910] Input: Notified activity progress
[0911] Output: Monitoring information that can be viewed by the user
[0912] Step 9:
[0913] When the parent user feels it is necessary, the terminal sends an instruction to change the activity to the remote terminal via the server. The remote terminal changes the activity based on the received instruction.
[0914] Input: Change instruction information from parent user
[0915] Output: Change orders sent to the remote device
[0916] Step 10:
[0917] The server collects and analyzes voice and image data to recognize the parent user's emotions using an emotion engine, and sends the recognized emotion information to the remote device, which then adjusts its activities accordingly.
[0918] Input: Parent user's voice data, image data
[0919] Data processing: Recognition and analysis of emotional information
[0920] Output: Instructions for adjusting activities
[0921] (Application example 2)
[0922] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0923] In recent years, with the increase in dual-income households, the burden of transporting children to and from school has become a major social issue. A reliable transportation method is needed, especially when parents are away from home due to work or other reasons. There is also a need for a system that can manage flexible schedules that take into account the emotional state of parents while ensuring the safety of children. Traditional manual management places a significant burden on both time and mental health, and new technologies are needed to address this.
[0924] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with the remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute child pick-up and drop-off activities in real time in the autonomously driven vehicle based on the set schedule, and means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions. This enables the autonomously driven vehicle to safely pick up and drop off the child based on the schedule set by the parent and notify the parent of the activity status in real time. In addition, flexible adjustments can be made taking into account the parent's emotional state, reducing stress and realizing efficient transportation management.
[0925] A "parent account" is an account in which a parent's personal information is registered to manage their child's activities.
[0926] A "child profile" is an individual profile that includes information about a child's age, interests, and preferences for certain activities.
[0927] The "remote terminal" is a remotely operable device that carries out activities for picking up and dropping off children based on a schedule set by the parents and notifies the parents of the activity status.
[0928] An "activity instruction" is an instruction indicating the specific activity content to be carried out by the remote terminal based on the child's profile and schedule.
[0929] The "daily activity schedule" is a timetable set by parents that lists the timetable and content of their child's daily activities.
[0930] An "autonomous vehicle" is a vehicle that has the ability to automatically carry out child pick-up and drop-off activities according to a programmed schedule.
[0931] "Performing an activity in real time" means performing a child's activity in real time according to a set schedule.
[0932] "Notifying parent user of activity status" means informing the parent in real time of the progress of the activity being executed by the remote terminal.
[0933] "Confirmation and adjustment instructions" means that the parent checks the progress of the activity via the remote terminal and gives instructions for changes as necessary.
[0934] The program of the system that embodies this invention manages everything from registering information in a parent account to picking up and dropping off a child. The system generates a child profile based on the information in the parent account, synchronizes it with a remote terminal, and performs regular pick-up and drop-off using an autonomous vehicle.
[0935] System implementation configuration
[0936] 1. Register parent account information and create a profile
[0937] The user (parent) creates a parent account using a dedicated smartphone application. After entering the parent's information (name, email address) and the child's information (age, name, interests), this information is sent to the server and stored in a database. The child's profile is then generated and synchronized to the remote device.
[0938] 2. Schedule your daily activities
[0939] Through the application, users can set up a daily activity schedule for their children, which is entered by the parent and sent to the server, where it is then sent to the remote device as a timetable.
[0940] 3. Transportation using self-driving vehicles
[0941] The remote terminal will use the autonomous vehicle to pick up and drop off the child in real time based on the set schedule, and the autonomous vehicle will notify the parent of its current location and planned route in real time.
[0942] 4. Notification of activity status and adjustment instructions
[0943] The remote device sends the progress of the transportation activity to the server in real time and notifies the parent's smartphone. The parent can check the current situation through the application and send instructions to the remote device to adjust the activity content as necessary.
[0944] 5. Use of Emotion Engine
[0945] The emotion engine analyzes the parent's emotional state in real time and adjusts the pick-up route and time accordingly. For example, if the parent is tired, the system will automatically adjust the pick-up time to a little earlier.
[0946] Program processing
[0947] The server generates a parent account and a child profile and synchronizes them with the remote device, which then operates the autonomous vehicle based on a set schedule, performs real-time pickup and drop-off activities, and reports the activity status to the server, providing an interface for parents to view the status and issue adjustment instructions.
[0948] Specific examples
[0949] For example, a parent may set a schedule to pick up their child from school at 4:00 PM and return home at 5:00 PM. If the parent's emotion engine recognizes that they are tired, the autonomous vehicle will begin picking them up at 3:45 PM. The system will notify the parent in real time of their location and activity status, allowing them to wait at home with peace of mind.
[0950] Prompt Sentence Examples
[0951] My child's name is Hanako, she's 5 years old, and she's interested in dinosaurs. I want to pick her up from school at 4:00 PM and take her home at 5:00 PM. Her emotional state is calm. Please send the pickup instructions to the autonomous vehicle.
[0952] The above is an embodiment of the present system.
[0953] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0954] Step 1:
[0955] To register information for a parent account, a user opens a smartphone application and enters the parent's name, email address, child's name, age, interests, etc. The entered information is converted to JSON format by the device and sent to the server, which receives the information and stores it in a database.
[0956] Input: Parent's personal information, Child's profile information
[0957] Output: Parent account and child profile information stored in the database.
[0958] Step 2:
[0959] The server uses the information stored in the database to create a profile for the child, including the child's age, name, interests, and preferences for specific activities, and then synchronizes this profile with the remote device.
[0960] Input: Parent account information in the database, child profile information
[0961] Output: Synced child profile
[0962] Step 3:
[0963] A user uses a smartphone application to input a child's daily activity schedule. The schedule includes activities by time period. This schedule information is sent from the device to a server. The server links the schedule information to the child's profile and sends it to the remote device as a timetable.
[0964] Input: Parent-entered activity schedule
[0965] Output: Schedule sent to remote device
[0966] Step 4:
[0967] The remote terminal sends instructions to the autonomous vehicle based on a set schedule. The autonomous vehicle follows the instructions and carries out child pick-up and drop-off activities in real time. The vehicle's current location and planned route are sent to the server via the remote terminal.
[0968] Input: Schedule information from the server
[0969] Output: Pick-up instructions sent to the autonomous vehicle, pick-up activity execution
[0970] Step 5:
[0971] While the remote device is performing the pick-up and drop-off activity, it sends the activity status to the server in real time. The server receives this information and notifies the user's smartphone application. Parents can check the current status through the application and send change instructions to the remote device as necessary.
[0972] Input: Activity from remote terminal
[0973] Output: Activity status notified to parent's smartphone, adjustment instructions from parent
[0974] Step 6:
[0975] The server uses an emotion engine to analyze the parent's emotional state. For example, if it detects that the parent is tired, it will adjust the pickup time of the self-driving vehicle accordingly. This information is then transmitted to a remote device, which can then adjust the schedule flexibly.
[0976] Input: Parent emotion data
[0977] Output: Schedule adjustment instructions based on emotion analysis results
[0978] The above are the specific processing steps of this system, and clearly show what inputs are received at each step, how the data is processed, and how the final output is obtained.
[0979] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0980] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0981] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0982] [Third embodiment]
[0983] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0984] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0985] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0986] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0987] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0988] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0989] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0990] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0991] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0992] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0993] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0994] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0995] Basic system configuration
[0996] The system of the present invention registers information about a parent's account and generates a child's profile based on that information. Once the child's profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the parent user is constantly notified of the activity status of the remote device, allowing the parent user to check and issue adjustment instructions based on this information.
[0997] Parent Account Settings
[0998] Creating a Parent Account
[0999] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[1000] Registration and submission of information
[1001] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[1002] Parenting Physical Twins
[1003] Receiving information and creating a profile
[1004] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[1005] Profile Sync
[1006] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[1007] Setting up an activity schedule
[1008] Entering a schedule
[1009] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[1010] Sending a Schedule
[1011] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[1012] Real-time interaction with children
[1013] Start of activities
[1014] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[1015] Activity status notification
[1016] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[1017] Parental confirmation and coordination
[1018] Activity monitoring
[1019] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[1020] Adjustment instructions
[1021] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[1022] Specific examples
[1023] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[1024] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[1025] At 4:00 PM, the remote device starts playing with a dinosaur toy, and the server notifies the device that "The physical twin is currently playing dinosaur with a child." If it is 6:00 PM and the user wants to have dinner, the device sends the command "Dinner time begins." The server then relays the command to the physical twin, and the remote device begins preparing dinner.
[1026] This system allows parent users to provide high-quality care for their children while still having time for themselves.
[1027] The processing flow will be explained below.
[1028] Step 1:
[1029] Creating a Parent Account
[1030] The user launches the dedicated app on their device and accesses the account creation screen.
[1031] The user enters their information (e.g., name, email address).
[1032] The user enters the child's information (name, age, interests, etc.).
[1033] Step 2:
[1034] Submitting information and registering
[1035] The terminal transmits the entered user and child information to the server.
[1036] The server stores the received information in a database.
[1037] The server generates a child's profile and stores it in a database.
[1038] Step 3:
[1039] Profile Sync
[1040] The server synchronizes the generated child profile to the remote device.
[1041] The remote device receives and stores the synchronized profile.
[1042] Step 4:
[1043] Setting up an activity schedule
[1044] The user enters their child's activity schedule through an app on their device.
[1045] The schedule includes specific times and activities that will occur during those times (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV).
[1046] The terminal transmits the input schedule to the server.
[1047] Step 5:
[1048] Schedule management and preparation
[1049] The server transmits the received schedule to the remote terminal, which prepares the activity.
[1050] The remote terminal makes preparations based on the received schedule.
[1051] Step 6:
[1052] Start of activities
[1053] The server sends an instruction to start an activity to the remote terminal based on the set schedule.
[1054] The remote device initiates an activity with the child.
[1055] For example, at 4:00 PM, the remote device will start playing with a dinosaur toy.
[1056] Step 7:
[1057] Real-time notifications
[1058] The remote terminal reports its current activity to the server.
[1059] The server notifies the terminal of the progress of the activity.
[1060] The device displays the current activity status to the parent user in real time.
[1061] Step 8:
[1062] Monitoring and coordinating activities
[1063] The user monitors the activity of the remote terminal through the terminal.
[1064] The user sends instructions to change or adjust activities as needed from the terminal.
[1065] The server receives the user's instructions and sends change instructions to the remote terminal.
[1066] The remote terminal receives instructions, coordinates and executes activities.
[1067] For example, if a user feels like "I want to have dinner at 18:00," the user sends a command from the terminal to "start dinner time." The server receives the command and transmits it to the remote terminal, which then starts preparing dinner.
[1068] In this way, the system allows parent users to provide high-quality care for their children while still having time for themselves.
[1069] Example 1
[1070] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1071] In traditional child-rearing, parents have had to spend a lot of time and effort planning and managing their children's activities, making it difficult to provide appropriate activities that meet individual needs.In addition, there was a lack of efficient means for parents to monitor their children's activities in real time and make necessary adjustments, making it difficult to respond flexibly.
[1072] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1073] In this invention, the server includes a means for registering parent account information, a means for generating a child profile based on the registered information, a means for synchronizing the child profile with a remote terminal and issuing activity instructions, and a means for transmitting a daily activity schedule set by a parent user to the remote terminal, thereby enabling parents to efficiently plan and manage their children's activities, provide activities according to individual needs, and enable real-time monitoring and flexible adjustment.
[1074] "Parent Account" means an account through which a User creates and manages a Child Profile.
[1075] A "child profile" is a database entry that holds information about a registered child (such as age, interests, activity preferences, etc.).
[1076] A "remote device" is a device (such as a smartphone, tablet, or dedicated device) that communicates with the server and performs and manages activities with a child.
[1077] An "activity schedule" is a timetable set by a parent user that lists what activities a child will do during a specific time period.
[1078] The "server" is a central device that stores parent accounts, child profiles, and activity schedules in a database and communicates with remote devices.
[1079] "Synchronization" is the process of matching data between a server and a remote terminal, and refers to sharing the latest data between them.
[1080] An "activity instruction" is an instruction from a server or a remote terminal to a child to perform a specific activity at a specific time.
[1081] "Notification" refers to the transmission of information to inform the parent user of the activity status of the remote terminal in real time.
[1082] An "adjustment instruction" is an instruction from a parent user to a remote terminal to change the activity content as needed.
[1083] The present invention is a system for efficiently managing and coordinating parental activities and improving the quality of parental time. This system registers parent account information, generates a child profile based on that information, and provides activity instructions on a remote terminal. A specific embodiment of the system is described below.
[1084] This system uses the following main hardware and software:
[1085] Remote devices: smartphones, tablets, dedicated devices, etc.
[1086] Server: A central device that manages parent accounts, child profiles, and activity schedules.
[1087] Dedicated application: An application installed on the device
[1088] Database: MySQL, etc.
[1089] First, the parent user creates a parent account using a dedicated application. On the account creation screen, the parent enters information such as the parent's name, email address, child's name, age, and interests. For example, the parent user might enter "Name: Jiro Sato," "Email address: jiro@example.com," "Child's name: Ichiro," "Age: 6," and "Interests: Cars."
[1090] The device sends the entered information to the server, which receives it and stores it in a database. Based on this stored information, the server generates a child profile. For example, profile information such as "Name: Ichiro," "Age: 6 years old," and "Interests: Cars" is generated.
[1091] The server then synchronizes the generated child profile information with the remote device, which can then provide activity instructions based on the child's age, interests, and activity preferences.
[1092] Parents use a dedicated application to input their child's activity schedule, such as "15:00 - Play with toys," "17:00 - Draw pictures," and "19:00 - Watch TV." This input schedule is sent from the device to the server, which then sends the information to the remote device.
[1093] The remote device starts its activities according to the schedule sent from the server. At 3:00 PM, the remote device starts the "Play with toys" activity and acts automatically while interacting with the child. For example, the remote device instructs the child on how to choose a toy and how to play with it.
[1094] The server notifies the parent user of the activity status of the remote device in real time. For example, a notification such as "The remote device is currently playing with toys with Ichiro" is sent to the parent user's device. This allows the parent user to understand the current activity status.
[1095] If necessary, the parent user can send an instruction to change the activity from the terminal to the remote terminal via the server. For example, if the parent user sends an instruction to "change to drawing time," the remote terminal will move on to the next activity according to the instruction.
[1096] This allows parent users to efficiently manage and coordinate their children's activities while still having time for themselves. This system allows for flexible responses to the needs of parents and children, and supports child-rearing using the latest technology.
[1097] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1098] System program processing steps
[1099] Step 1:
[1100] Creating a Parent Account
[1101] Processing content: The user launches the dedicated application and enters the required information on the account creation screen.
[1102] Input: Name, email address, child's name, age, interests, etc.
[1103] Data processing: The application converts the input information into JSON format.
[1104] Output: Parent account and child information in JSON format.
[1105] Specific actions: For example, a user enters the following information into the app: "Name: Yamada Taro", "Email address: taro@example.com", "Child's name: Jiro", "Age: 4 years old", "Interests: Space".
[1106] Step 2:
[1107] Registration and submission of information
[1108] Processing content: The terminal sends the entered information to the server.
[1109] Input: Parent account and child information in JSON format.
[1110] Data calculation: The terminal sends the input information to the server as an HTTP request.
[1111] Output: Parent account and child information sent to the server.
[1112] Specific operation: The device sends the following information to the server: "parent_info: {name: 'Yamada Taro', email: 'taro@example.com', child_info: {name: 'Jiro', age: 4, interest: 'Space'}}".
[1113] Step 3:
[1114] Receiving information and storing it in the database
[1115] Processing: The server stores the received information in a database.
[1116] Input: Parent account and child information sent from the device.
[1117] Data processing: The server converts the received information into a format that can be written to the database.
[1118] Output: Information stored in a database.
[1119] Specific operation: The server adds a record to the "parent_info" table with the following information: "Name: Yamada Taro", "Email address: taro@example.com", and "Child information: [Name: Jiro, Age: 4, Interests: Space]".
[1120] Step 4:
[1121] Child profile generation
[1122] What happens: The server generates a profile for the child based on the information in the database.
[1123] Input: Parent account and child information stored in the database.
[1124] Data calculation: The server applies a profile generation algorithm to create the child's profile data.
[1125] Output: Child profile data.
[1126] Specific operation: The server generates data for "Profile: {Name: Jiro, Age: 4, Interests: Space}".
[1127] Step 5:
[1128] Profile Sync
[1129] Processing: The server synchronizes the created child profile to the remote device.
[1130] Input: Child profile data.
[1131] Data processing: Serializing profile data for transmission to remote devices.
[1132] Output: Child profile data sent to the remote device.
[1133] Specific operation: The server sends the data "sync_profile: {Name: Jiro, Age: 4, Interests: Space}" to the remote device.
[1134] Step 6:
[1135] Entering an activity schedule
[1136] What happens: The user enters a child's activity schedule in the application.
[1137] Input: Activity schedule (time and content).
[1138] Data processing: Convert the input schedule into schedule data format.
[1139] Output: Activity schedule data.
[1140] Specific actions: The user inputs "15:00 - play with toys", "17:00 - draw a picture", and "19:00 - watch TV".
[1141] Step 7:
[1142] Sending a Schedule
[1143] Processing content: The terminal sends the input schedule to the server.
[1144] Input: Activity schedule data.
[1145] Data calculation: The terminal sends the input schedule to the server as an HTTP request.
[1146] Output: The activity schedule sent to the server.
[1147] Specific operation: The device sends the following data to the server: "schedule: [{time: '15:00', activity: 'play with toys'}, {time: '17:00', activity: 'draw a picture'}, {time: '19:00', activity: 'watch TV'}]".
[1148] Step 8:
[1149] Start of activities
[1150] Processing details: The server instructs the remote terminal to start its activities according to the set schedule.
[1151] Input: Activity schedule data.
[1152] Data processing: The server processes the schedule data to send it to the remote terminal.
[1153] Output: Action instructions sent to the remote device.
[1154] Specific operation: At 15:00, the server sends "activity_start: 15:00 in the morning, content: play with toys" to the remote device.
[1155] Step 9:
[1156] Activity status notification
[1157] What it does: The server notifies the parent user's device of ongoing activities on the remote device in real time.
[1158] Input: Activity data from a remote terminal.
[1159] Data calculation: The server processes the activity status data to send it to the parent user's terminal.
[1160] Output: Activity notification sent to parent user's device.
[1161] Specific operation: When the remote device starts an activity, the server sends a notification to the parent user saying, "Notification: Jiro is currently playing with toys at 15:00."
[1162] Step 10:
[1163] Monitoring and coordinating activities
[1164] Processing details: The user monitors the activity status of the remote terminal and issues instructions to change the activity as necessary.
[1165] Input: Adjustment instructions from parent user.
[1166] Data calculation: The terminal sends adjustment instructions to the server, and the server forwards the instructions to the remote terminal.
[1167] Output: Adjustment instructions sent to the remote device.
[1168] Specific operation: When the parent user presses a button, for example, "Dinner time starts at 17:30," the device sends "activity_change: 17:30 - Dinner time starts" to the remote device via the server.
[1169] The above processing steps realize a system that allows parent users to efficiently plan, manage, and safely coordinate their children's activities.
[1170] (Application example 1)
[1171] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1172] It is difficult for parents to safely and efficiently manage and monitor their children's activities in brick-and-mortar stores in real time. This creates a significant burden on parents, especially when managing multiple activities simultaneously. Traditional methods make it difficult to select appropriate activities based on a child's interests and preferences, and require parents to directly monitor and adjust their children's activities, which consumes a significant amount of parents' time.
[1173] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1174] In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, means for inputting the child's activity schedule at a physical store, and means for monitoring the child's activities at the physical store in real time and notifying the parent user, thereby enabling parents to efficiently and safely manage their child's activities and adjust them flexibly and in real time.
[1175] A "parent account" is an account that allows parents to register information about themselves and their children and manage their children's activities.
[1176] A "child profile" is a set of information that includes a child's personal data, preferences, and activity records, generated based on information from the parent account.
[1177] "Remote Device" means an electronic device or device used to manage and conduct a child's activities.
[1178] An "activity instruction" is an instruction on the content of an activity to be performed by the remote terminal based on the child's profile.
[1179] An "activity schedule" is a time period set by the parent and a schedule of activities to be carried out during that time period.
[1180] "Executing an activity in real time" means that the remote terminal immediately starts and progresses the activity based on a set schedule.
[1181] "Activity Status Notification" refers to informing the parent of the status of ongoing activities on the remote terminal.
[1182] A "children's activity schedule at a physical store" is a schedule of activities that children will participate in at a physical store or facility.
[1183] "Monitoring" means using a remote device or system to monitor the progress of an activity.
[1184] This invention is a system that registers information on a parent account, generates a child profile based on that information, and synchronizes with a remote terminal to provide activity instructions. A specific embodiment of this system will be described below.
[1185] Basic system configuration
[1186] The system consists of a smartphone or tablet device, a server, and a remote device. Parents can use the smartphone application to create an account, generate a child profile, and set an activity schedule.
[1187] Parent Account Settings
[1188] Parents enter their information to create a profile for their child. Parent information includes name, email address, etc. Child information includes name, age, interests, etc. This information is sent to a server and stored in a database.
[1189] Child profile generation
[1190] The server generates a child profile based on the parent and child information it receives, including the child's age, interests, and preferences for specific activities. The server then synchronizes this profile with the remote device, which then adjusts its activities based on the profile.
[1191] Setting up an activity schedule
[1192] Parents use a smartphone application to input their child's activity schedule, which is then sent to a server and transferred from the server to a remote device, which then executes the activities based on the schedule, allowing parents to view and adjust the progress in real time.
[1193] In-store activity management
[1194] Parents can input their children's activity schedules at physical stores (e.g., activity centers and amusement parks). The remote device monitors the activities at the physical stores and facilities in real time and notifies parents of their progress, allowing parents to efficiently and safely manage their children's activities.
[1195] Program processing
[1196] The server uses the Django framework to manage parent account information, child profiles, and activity schedules. The smartphone application also works with Django, exchanging information in JSON format. It also runs periodic tasks to monitor activities in real time and sends necessary notifications to parents.
[1197] Specific examples
[1198] For example, a parent might enter "Name: Parent A," "Email address: abc@example.com," "Child's name: Child B," "Age: 8 years old," and "Interests: Sports." This information is sent to the server, which generates a profile for the child. The parent then sets a schedule, such as "10:00 - Soccer" and "13:00 - Art," and sends it to the server. The server then sends the schedule information to the remote device, which then starts its activities in real time.
[1199] Example prompt for a generative AI model:
[1200] Parent Account Information:
[1201] Name: Parent A
[1202] Email address: abc@example.com
[1203] Child's name: Child B
[1204] Age: 8
[1205] Interests: Sports
[1206] schedule:
[1207] 10:00 - Soccer
[1208] 13:00 - Drawing
[1209] Notification message:
[1210] The physical twins started playing football.
[1211] The physical twin has begun drawing.
[1212] Such a system allows parents to efficiently manage, monitor and regulate their children's activities while still having time for themselves.
[1213] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1214] Step 1:
[1215] Registering a Parent Account
[1216] The user launches the smartphone application and enters information about themselves and their child (such as name, email address, age, interests, etc.). The information is sent in JSON format to the server, which stores it in a database and creates a parent account.
[1217] Input: Parent and child information such as name, email address, age, and interests
[1218] Output: New parent account information and child profile added to the database
[1219] Step 2:
[1220] Child profile generation
[1221] Based on the received information, the server generates a profile of the child, including the child's age, interests, and preferences for specific activities, and transmits this profile to the remote device, which can then tailor its activities accordingly.
[1222] Input: Child information stored in database
[1223] Output: Child profile synced to remote device
[1224] Step 3:
[1225] Setting up an activity schedule
[1226] The user inputs the child's activity schedule using a smartphone application. This schedule is sent to the server in JSON format, and the server stores it in a database. The remote device starts activities based on this schedule information.
[1227] Input: Activity schedule entered (e.g. 10:00 - Soccer, 13:00 - Drawing)
[1228] Output: Activity schedule synced to remote device
[1229] Step 4:
[1230] Real-time action execution
[1231] The remote terminal starts the activity at the set time based on the received schedule information. For example, if a soccer game starts at 10:00, the remote terminal monitors and executes the activity and sends its progress to the server.
[1232] Input: Synced Activity Schedule
[1233] Output: Information about the real-time activities performed and monitored by the child
[1234] Step 5:
[1235] Activity status notification
[1236] The server notifies the parent user of the progress based on the activity status received from the remote terminal. For example, if a soccer game has started, a notification message saying "Soccer has now started" is sent.
[1237] Input: Activity information sent from the remote device
[1238] Output: Activity notification message sent to parent user
[1239] Step 6:
[1240] In-store activity management
[1241] Users input their activities at the physical store and send them to a remote device, which then monitors the activities at the physical store based on this information. For example, the remote device notifies parents in real time about the progress of soccer or art activities at the activity center.
[1242] Input: Children's activity schedule at a brick-and-mortar store
[1243] Output: Real-time activity progress notification
[1244] Step 7:
[1245] Review and adjust activities
[1246] The parent user uses a smartphone application to check the current activity status and, if necessary, send an instruction to adjust the activity to the server. The server then transmits this instruction to the remote terminal, which then adjusts the activity.
[1247] Input: Parent user confirms activity status and gives instructions for adjustment
[1248] Output: Adjusted activity schedule and ongoing activities
[1249] In this way, parents can effectively manage their children's activities and make appropriate adjustments as needed.
[1250] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1251] Basic system configuration
[1252] The system of the present invention registers information about a parent's account and generates a child profile based on that information. Once the child profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the activity status of the remote device is constantly notified to the parent user, who can check and issue adjustment instructions based on this information. The system of the present invention is also equipped with an emotion engine, which can recognize the parent user's emotions and adjust the activity content based on them.
[1253] Parent Account Settings
[1254] Creating a Parent Account
[1255] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[1256] Registration and submission of information
[1257] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[1258] Parenting Physical Twins
[1259] Receiving information and creating a profile
[1260] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[1261] Profile Sync
[1262] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[1263] Setting up an activity schedule
[1264] Entering a schedule
[1265] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[1266] Sending a Schedule
[1267] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[1268] Real-time interaction with children
[1269] Start of activities
[1270] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[1271] Activity status notification
[1272] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[1273] Parental confirmation and coordination
[1274] Activity monitoring
[1275] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[1276] Adjustment instructions
[1277] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[1278] Emotion Engine Settings
[1279] Emotion Engine Settings
[1280] The server is equipped with an emotion engine and analyzes sensor information (e.g., voice data and image data) to recognize the parent user's emotions.
[1281] Recognizing and transmitting emotions
[1282] The emotion engine recognizes the user's emotions and sends that information to the server, which then issues instructions to adjust the activities of the remote device based on the emotion information.
[1283] Specific examples
[1284] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[1285] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[1286] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[1287] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[1288] The processing flow will be explained below.
[1289] Step 1:
[1290] Creating a Parent Account
[1291] The user launches the dedicated app on their device and accesses the account creation screen. The user enters their own information (e.g., name, email address). The user enters their child's information (e.g., name, age, interests).
[1292] Step 2:
[1293] Submitting information and registering
[1294] The device sends the entered user and child information to the server. The server stores the received information in a database. The server creates a child profile and stores it in the database.
[1295] Step 3:
[1296] Profile Sync
[1297] The server synchronizes the created child profile to the remote device, which receives and stores the synchronized profile.
[1298] Step 4:
[1299] Setting up an activity schedule
[1300] The user inputs the child's activity schedule through the device app. The schedule includes specific time periods and activities to be performed during those periods (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV). The device then sends the input schedule to the server.
[1301] Step 5:
[1302] Schedule management and preparation
[1303] The server sends the received schedule to the remote terminal and prepares for the activity. The remote terminal proceeds with preparations based on the received schedule.
[1304] Step 6:
[1305] Start of activities
[1306] The server sends an instruction to start an activity to the remote device based on the set schedule. The remote device starts the activity with the child. For example, at 4:00 p.m., the remote device starts playing with a dinosaur toy.
[1307] Step 7:
[1308] Real-time notifications
[1309] The remote device reports the current activity status to the server. The server notifies the device of the progress of the activity status. The device displays the current activity status to the parent user in real time.
[1310] Step 8:
[1311] Monitoring and coordinating activities
[1312] The user monitors the activity status of the remote terminal through the terminal. The user sends instructions from the terminal to change or adjust the activity as needed. The server receives the user's instructions and sends change instructions to the remote terminal. The remote terminal receives the instructions, adjusts and executes the activity.
[1313] Step 9:
[1314] Emotion engine configuration and emotion recognition
[1315] The server has an emotion engine and receives emotion data (e.g., voice and image data) from the user, which the emotion engine analyzes and recognizes the user's emotion.
[1316] Step 10:
[1317] Emotional information transmission and activity regulation
[1318] The server sends instructions to the remote device to adjust its activities based on the recognized emotion information. The remote device receives the emotion data and adjusts its activities accordingly.
[1319] As a concrete example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5 years old," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it with the remote device.
[1320] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[1321] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[1322] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[1323] Example 2
[1324] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1325] Previous systems offered limited flexibility in managing children's activities based on schedules set by parents, and failed to take into account parents' emotional states, which could result in stress for both parents and children.
[1326] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for registering information about a parent account, means for generating a child's profile based on the registered information, means for synchronizing the child's profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to perform activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, and means for recognizing the parent user's emotions using an emotion engine and adjusting the activity content of the remote terminal based on the information. This allows for more flexible management of children's activities and enables adjustments to be made in accordance with the parent's emotional state.
[1327] A "parent account" is an account created by a parent using the system based on their own information.
[1328] A "child profile" is data generated based on a parent account and includes demographic information such as the child's age and interests.
[1329] "Remote Device" means a remotely controlled device or equipment used to manage and conduct a Child's activities.
[1330] The "activity schedule" is a timetable set by a parent user that shows the child's daily activity schedule.
[1331] The "emotion engine" is a program that recognizes and analyzes the parent user's emotions from voice data and image data.
[1332] The "means for executing an activity in real time" is a function that enables the remote terminal to immediately execute the child's activity according to a set schedule.
[1333] "Notification of activity status" is a function for notifying the parent user of the ongoing activity of the remote terminal in real time.
[1334] The "means for receiving adjustment instructions" is a function that allows the parent user to send instructions to the remote terminal to change the activity content as needed, and for the remote terminal to accept these instructions.
[1335] A "database" is an information system for storing and managing information such as parent accounts and child profiles.
[1336] A "server" is a computer that handles the central data processing and information transmission of a system.
[1337] The present invention is a system that registers information on a parent account, generates a child's profile based on that information, and synchronizes with a remote terminal to instruct activities.
[1338] Basic system configuration
[1339] Parent Account Settings
[1340] The user (parent) launches a dedicated application on their device. They access the account creation screen and enter their own information (e.g., name, email address) and their child's information (e.g., age, name, interests). The device sends the entered information to the server, which then stores the received information in a database. This creates a parent account and a child profile.
[1341] Parenting Physical Twins
[1342] The server receives the information sent from the device and stores it in a database. The server then generates a child profile, which includes information such as age and interests. The generated child profile is synchronized with the remote device, and activity instructions are sent. This allows the remote device to adjust its activities based on the profile.
[1343] Setting up an activity schedule
[1344] The user uses the terminal application to input the child's activity schedule. This is a timetable showing what activities will be performed at what time. The terminal sends the input schedule information to the server, and the server sends the schedule to the remote terminal. The remote terminal can then carry out the activities based on this information.
[1345] Real-time interaction with children
[1346] The server starts activities according to the schedule set on the remote device. The remote device automatically carries out conversations and activities with the child according to the schedule. The server notifies the device of the progress of the remote device's activities in real time, and the parent user can receive these notifications and check the current activity status.
[1347] Parental confirmation and coordination
[1348] Users can monitor the activities of the remote device through their device, which allows them to check whether the current activity is proceeding according to schedule. When necessary, the parent user can send an instruction to change the activity from their device to the remote device via the server, allowing them to flexibly respond to unexpected situations.
[1349] Emotion Engine Settings
[1350] The server is equipped with an emotion engine that analyzes sensor information (e.g., voice data, image data) to recognize the parent user's emotions. The emotion engine recognizes the user's emotions and sends that information to the server. The server issues instructions to adjust the activities of the remote device based on this emotion information.
[1351] Specific examples
[1352] For example, if a user enters "Name: Tanaka Taro", "Email address: taro@example.com", "Child's name: Hanako", "Age: 5", and "Interests: Dinosaurs", the device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[1353] Next, the user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends the information to the server, which then sends the schedule to the remote device, which then begins its activities based on this schedule.
[1354] Furthermore, if the emotion engine recognizes that the parent user is feeling "tired," the remote terminal adjusts the activity content so that the parent user spends more time reading picture books.
[1355] Prompt Sentence Examples
[1356] A possible prompt might be, "Suggest an activity schedule for a 5-year-old child interested in dinosaurs from 10:00 AM to 6:00 PM."
[1357] This system allows parent users to provide care for their children tailored to their own condition while still having time for themselves.
[1358] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1359] Step 1:
[1360] The user (parent) launches a dedicated application on their device and accesses the account creation screen. The user enters their own information (name, email address, etc.) and their child's information (age, name, interests, etc.).
[1361] Input: Parent information, Child information
[1362] Output: Confirmation screen displayed on the device
[1363] Step 2:
[1364] The device sends the information entered by the user to the server, which then registers the received information in a database and creates a parent account and a child profile.
[1365] Input: Parent information, Child information
[1366] Data processing: Creation of parent accounts and child profiles
[1367] Output: Parent account and child profile stored in database
[1368] Step 3:
[1369] The server synchronizes the created child profile to the remote device, which then configures itself based on the received profile information.
[1370] Input: Generated child profile
[1371] Output: Profile information synced to the remote device
[1372] Step 4:
[1373] The user uses the device application to input the child's activity schedule, for example, "16:00 - Play," "18:00 - Dinner," "19:00 - TV," etc.
[1374] Input: Activity schedule information
[1375] Output: Schedule information entered on the terminal
[1376] Step 5:
[1377] The terminal transmits the input schedule information to the server, which then transmits the schedule information to the remote terminal.
[1378] Input: Activity schedule information
[1379] Output: Schedule information sent to the remote device
[1380] Step 6:
[1381] The server starts the activity according to the schedule set in the remote terminal, and the remote terminal automatically performs the activity according to the specified time.
[1382] Input: Schedule information synchronized to the remote device
[1383] Output: Each activity started
[1384] Step 7:
[1385] The server notifies the remote device of the progress of its activities in real time, which the user can then view through the application.
[1386] Input: Remote terminal activity progress
[1387] Output: Notifications displayed on the device
[1388] Step 8:
[1389] The user monitors the activities of the remote terminal through the terminal, and checks whether the activities are proceeding according to schedule.
[1390] Input: Notified activity progress
[1391] Output: Monitoring information that can be viewed by the user
[1392] Step 9:
[1393] When the parent user feels it is necessary, the terminal sends an instruction to change the activity to the remote terminal via the server. The remote terminal changes the activity based on the received instruction.
[1394] Input: Change instruction information from parent user
[1395] Output: Change orders sent to the remote device
[1396] Step 10:
[1397] The server collects and analyzes voice and image data to recognize the parent user's emotions using an emotion engine, and sends the recognized emotion information to the remote device, which then adjusts its activities accordingly.
[1398] Input: Parent user's voice data, image data
[1399] Data processing: Recognition and analysis of emotional information
[1400] Output: Instructions for adjusting activities
[1401] (Application example 2)
[1402] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1403] In recent years, with the increase in dual-income households, the burden of transporting children to and from school has become a major social issue. A reliable transportation method is needed, especially when parents are away from home due to work or other reasons. There is also a need for a system that can manage flexible schedules that take into account the emotional state of parents while ensuring the safety of children. Traditional manual management places a significant burden on both time and mental health, and new technologies are needed to address this.
[1404] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with the remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute child pick-up and drop-off activities in real time in the autonomously driven vehicle based on the set schedule, and means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions. This enables the autonomously driven vehicle to safely pick up and drop off the child based on the schedule set by the parent and notify the parent of the activity status in real time. In addition, flexible adjustments can be made taking into account the parent's emotional state, reducing stress and realizing efficient transportation management.
[1405] A "parent account" is an account in which a parent's personal information is registered to manage their child's activities.
[1406] A "child profile" is an individual profile that includes information about a child's age, interests, and preferences for certain activities.
[1407] The "remote terminal" is a remotely operable device that carries out activities for picking up and dropping off children based on a schedule set by the parents and notifies the parents of the activity status.
[1408] An "activity instruction" is an instruction indicating the specific activity content to be carried out by the remote terminal based on the child's profile and schedule.
[1409] The "daily activity schedule" is a timetable set by parents that lists the timetable and content of their child's daily activities.
[1410] An "autonomous vehicle" is a vehicle that has the ability to automatically carry out child pick-up and drop-off activities according to a programmed schedule.
[1411] "Performing an activity in real time" means performing a child's activity in real time according to a set schedule.
[1412] "Notifying parent user of activity status" means informing the parent in real time of the progress of the activity being executed by the remote terminal.
[1413] "Confirmation and adjustment instructions" means that the parent checks the progress of the activity via the remote terminal and gives instructions for changes as necessary.
[1414] The program of the system that embodies this invention manages everything from registering information in a parent account to picking up and dropping off a child. The system generates a child profile based on the information in the parent account, synchronizes it with a remote terminal, and performs regular pick-up and drop-off using an autonomous vehicle.
[1415] System implementation configuration
[1416] 1. Register parent account information and create a profile
[1417] The user (parent) creates a parent account using a dedicated smartphone application. After entering the parent's information (name, email address) and the child's information (age, name, interests), this information is sent to the server and stored in a database. The child's profile is then generated and synchronized to the remote device.
[1418] 2. Schedule your daily activities
[1419] Through the application, users can set up a daily activity schedule for their children, which is entered by the parent and sent to the server, where it is then sent to the remote device as a timetable.
[1420] 3. Transportation using self-driving vehicles
[1421] The remote terminal will use the autonomous vehicle to pick up and drop off the child in real time based on the set schedule, and the autonomous vehicle will notify the parent of its current location and planned route in real time.
[1422] 4. Notification of activity status and adjustment instructions
[1423] The remote device sends the progress of the transportation activity to the server in real time and notifies the parent's smartphone. The parent can check the current situation through the application and send instructions to the remote device to adjust the activity content as necessary.
[1424] 5. Use of Emotion Engine
[1425] The emotion engine analyzes the parent's emotional state in real time and adjusts the pick-up route and time accordingly. For example, if the parent is tired, the system will automatically adjust the pick-up time to a little earlier.
[1426] Program processing
[1427] The server generates a parent account and a child profile and synchronizes them with the remote device, which then operates the autonomous vehicle based on a set schedule, performs real-time pickup and drop-off activities, and reports the activity status to the server, providing an interface for parents to view the status and issue adjustment instructions.
[1428] Specific examples
[1429] For example, a parent may set a schedule to pick up their child from school at 4:00 PM and return home at 5:00 PM. If the parent's emotion engine recognizes that they are tired, the autonomous vehicle will begin picking them up at 3:45 PM. The system will notify the parent in real time of their location and activity status, allowing them to wait at home with peace of mind.
[1430] Prompt Sentence Examples
[1431] My child's name is Hanako, she's 5 years old, and she's interested in dinosaurs. I want to pick her up from school at 4:00 PM and take her home at 5:00 PM. Her emotional state is calm. Please send the pickup instructions to the autonomous vehicle.
[1432] The above is an embodiment of the present system.
[1433] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1434] Step 1:
[1435] To register information for a parent account, a user opens a smartphone application and enters the parent's name, email address, child's name, age, interests, etc. The entered information is converted to JSON format by the device and sent to the server, which receives the information and stores it in a database.
[1436] Input: Parent's personal information, Child's profile information
[1437] Output: Parent account and child profile information stored in the database.
[1438] Step 2:
[1439] The server uses the information stored in the database to create a profile for the child, including the child's age, name, interests, and preferences for specific activities, and then synchronizes this profile with the remote device.
[1440] Input: Parent account information in the database, child profile information
[1441] Output: Synced child profile
[1442] Step 3:
[1443] A user uses a smartphone application to input a child's daily activity schedule. The schedule includes activities by time period. This schedule information is sent from the device to a server. The server links the schedule information to the child's profile and sends it to the remote device as a timetable.
[1444] Input: Parent-entered activity schedule
[1445] Output: Schedule sent to remote device
[1446] Step 4:
[1447] The remote terminal sends instructions to the autonomous vehicle based on a set schedule. The autonomous vehicle follows the instructions and carries out child pick-up and drop-off activities in real time. The vehicle's current location and planned route are sent to the server via the remote terminal.
[1448] Input: Schedule information from the server
[1449] Output: Pick-up instructions sent to the autonomous vehicle, pick-up activity execution
[1450] Step 5:
[1451] While the remote device is performing the pick-up and drop-off activity, it sends the activity status to the server in real time. The server receives this information and notifies the user's smartphone application. Parents can check the current status through the application and send change instructions to the remote device as necessary.
[1452] Input: Activity from remote terminal
[1453] Output: Activity status notified to parent's smartphone, adjustment instructions from parent
[1454] Step 6:
[1455] The server uses an emotion engine to analyze the parent's emotional state. For example, if it detects that the parent is tired, it will adjust the pickup time of the self-driving vehicle accordingly. This information is then transmitted to a remote device, which can then adjust the schedule flexibly.
[1456] Input: Parent emotion data
[1457] Output: Schedule adjustment instructions based on emotion analysis results
[1458] The above are the specific processing steps of this system, and clearly show what inputs are received at each step, how the data is processed, and how the final output is obtained.
[1459] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1460] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1461] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1462] [Fourth embodiment]
[1463] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1464] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1465] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1466] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1467] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1468] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1469] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1470] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1471] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1472] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1473] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1474] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1475] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1476] Basic system configuration
[1477] The system of the present invention registers information about a parent's account and generates a child's profile based on that information. Once the child's profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the parent user is constantly notified of the activity status of the remote device, allowing the parent user to check and issue adjustment instructions based on this information.
[1478] Parent Account Settings
[1479] Creating a Parent Account
[1480] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[1481] Registration and submission of information
[1482] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[1483] Parenting Physical Twins
[1484] Receiving information and creating a profile
[1485] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[1486] Profile Sync
[1487] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[1488] Setting up an activity schedule
[1489] Entering a schedule
[1490] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[1491] Sending a Schedule
[1492] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[1493] Real-time interaction with children
[1494] Start of activities
[1495] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[1496] Activity status notification
[1497] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[1498] Parental confirmation and coordination
[1499] Activity monitoring
[1500] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[1501] Adjustment instructions
[1502] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[1503] Specific examples
[1504] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[1505] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[1506] At 4:00 PM, the remote device starts playing with a dinosaur toy, and the server notifies the device that "The physical twin is currently playing dinosaur with a child." If it is 6:00 PM and the user wants to have dinner, the device sends the command "Dinner time begins." The server then relays the command to the physical twin, and the remote device begins preparing dinner.
[1507] This system allows parent users to provide high-quality care for their children while still having time for themselves.
[1508] The processing flow will be explained below.
[1509] Step 1:
[1510] Creating a Parent Account
[1511] The user launches the dedicated app on their device and accesses the account creation screen.
[1512] The user enters their information (e.g., name, email address).
[1513] The user enters the child's information (name, age, interests, etc.).
[1514] Step 2:
[1515] Submitting information and registering
[1516] The terminal transmits the entered user and child information to the server.
[1517] The server stores the received information in a database.
[1518] The server generates a child's profile and stores it in a database.
[1519] Step 3:
[1520] Profile Sync
[1521] The server synchronizes the generated child profile to the remote device.
[1522] The remote device receives and stores the synchronized profile.
[1523] Step 4:
[1524] Setting up an activity schedule
[1525] The user enters their child's activity schedule through an app on their device.
[1526] The schedule includes specific times and activities that will occur during those times (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV).
[1527] The terminal transmits the input schedule to the server.
[1528] Step 5:
[1529] Schedule management and preparation
[1530] The server transmits the received schedule to the remote terminal, which prepares the activity.
[1531] The remote terminal makes preparations based on the received schedule.
[1532] Step 6:
[1533] Start of activities
[1534] The server sends an instruction to start an activity to the remote terminal based on the set schedule.
[1535] The remote device initiates an activity with the child.
[1536] For example, at 4:00 PM, the remote device will start playing with a dinosaur toy.
[1537] Step 7:
[1538] Real-time notifications
[1539] The remote terminal reports its current activity to the server.
[1540] The server notifies the terminal of the progress of the activity.
[1541] The device displays the current activity status to the parent user in real time.
[1542] Step 8:
[1543] Monitoring and coordinating activities
[1544] The user monitors the activity of the remote terminal through the terminal.
[1545] The user sends instructions to change or adjust activities as needed from the terminal.
[1546] The server receives the user's instructions and sends change instructions to the remote terminal.
[1547] The remote terminal receives instructions, coordinates and executes activities.
[1548] For example, if a user feels like "I want to have dinner at 18:00," the user sends a command from the terminal to "start dinner time." The server receives the command and transmits it to the remote terminal, which then starts preparing dinner.
[1549] In this way, the system allows parent users to provide high-quality care for their children while still having time for themselves.
[1550] Example 1
[1551] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1552] In traditional child-rearing, parents have had to spend a lot of time and effort planning and managing their children's activities, making it difficult to provide appropriate activities that meet individual needs.In addition, there was a lack of efficient means for parents to monitor their children's activities in real time and make necessary adjustments, making it difficult to respond flexibly.
[1553] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1554] In this invention, the server includes a means for registering parent account information, a means for generating a child profile based on the registered information, a means for synchronizing the child profile with a remote terminal and issuing activity instructions, and a means for transmitting a daily activity schedule set by a parent user to the remote terminal, thereby enabling parents to efficiently plan and manage their children's activities, provide activities according to individual needs, and enable real-time monitoring and flexible adjustment.
[1555] "Parent Account" means an account through which a User creates and manages a Child Profile.
[1556] A "child profile" is a database entry that holds information about a registered child (such as age, interests, activity preferences, etc.).
[1557] A "remote device" is a device (such as a smartphone, tablet, or dedicated device) that communicates with the server and performs and manages activities with a child.
[1558] An "activity schedule" is a timetable set by a parent user that lists what activities a child will do during a specific time period.
[1559] The "server" is a central device that stores parent accounts, child profiles, and activity schedules in a database and communicates with remote devices.
[1560] "Synchronization" is the process of matching data between a server and a remote terminal, and refers to sharing the latest data between them.
[1561] An "activity instruction" is an instruction from a server or a remote terminal to a child to perform a specific activity at a specific time.
[1562] "Notification" refers to the transmission of information to inform the parent user of the activity status of the remote terminal in real time.
[1563] An "adjustment instruction" is an instruction from a parent user to a remote terminal to change the activity content as needed.
[1564] The present invention is a system for efficiently managing and coordinating parental activities and improving the quality of parental time. This system registers parent account information, generates a child profile based on that information, and provides activity instructions on a remote terminal. A specific embodiment of the system is described below.
[1565] This system uses the following main hardware and software:
[1566] Remote devices: smartphones, tablets, dedicated devices, etc.
[1567] Server: A central device that manages parent accounts, child profiles, and activity schedules.
[1568] Dedicated application: An application installed on the device
[1569] Database: MySQL, etc.
[1570] First, the parent user creates a parent account using a dedicated application. On the account creation screen, the parent enters information such as the parent's name, email address, child's name, age, and interests. For example, the parent user might enter "Name: Jiro Sato," "Email address: jiro@example.com," "Child's name: Ichiro," "Age: 6," and "Interests: Cars."
[1571] The device sends the entered information to the server, which receives it and stores it in a database. Based on this stored information, the server generates a child profile. For example, profile information such as "Name: Ichiro," "Age: 6 years old," and "Interests: Cars" is generated.
[1572] The server then synchronizes the generated child profile information with the remote device, which can then provide activity instructions based on the child's age, interests, and activity preferences.
[1573] Parents use a dedicated application to input their child's activity schedule, such as "15:00 - Play with toys," "17:00 - Draw pictures," and "19:00 - Watch TV." This input schedule is sent from the device to the server, which then sends the information to the remote device.
[1574] The remote device starts its activities according to the schedule sent from the server. At 3:00 PM, the remote device starts the "Play with toys" activity and acts automatically while interacting with the child. For example, the remote device instructs the child on how to choose a toy and how to play with it.
[1575] The server notifies the parent user of the activity status of the remote device in real time. For example, a notification such as "The remote device is currently playing with toys with Ichiro" is sent to the parent user's device. This allows the parent user to understand the current activity status.
[1576] If necessary, the parent user can send an instruction to change the activity from the terminal to the remote terminal via the server. For example, if the parent user sends an instruction to "change to drawing time," the remote terminal will move on to the next activity according to the instruction.
[1577] This allows parent users to efficiently manage and coordinate their children's activities while still having time for themselves. This system allows for flexible responses to the needs of parents and children, and supports child-rearing using the latest technology.
[1578] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1579] System program processing steps
[1580] Step 1:
[1581] Creating a Parent Account
[1582] Processing content: The user launches the dedicated application and enters the required information on the account creation screen.
[1583] Input: Name, email address, child's name, age, interests, etc.
[1584] Data processing: The application converts the input information into JSON format.
[1585] Output: Parent account and child information in JSON format.
[1586] Specific actions: For example, a user enters the following information into the app: "Name: Yamada Taro", "Email address: taro@example.com", "Child's name: Jiro", "Age: 4 years old", "Interests: Space".
[1587] Step 2:
[1588] Registration and submission of information
[1589] Processing content: The terminal sends the entered information to the server.
[1590] Input: Parent account and child information in JSON format.
[1591] Data calculation: The terminal sends the input information to the server as an HTTP request.
[1592] Output: Parent account and child information sent to the server.
[1593] Specific operation: The device sends the following information to the server: "parent_info: {name: 'Yamada Taro', email: 'taro@example.com', child_info: {name: 'Jiro', age: 4, interest: 'Space'}}".
[1594] Step 3:
[1595] Receiving information and storing it in the database
[1596] Processing: The server stores the received information in a database.
[1597] Input: Parent account and child information sent from the device.
[1598] Data processing: The server converts the received information into a format that can be written to the database.
[1599] Output: Information stored in a database.
[1600] Specific operation: The server adds a record to the "parent_info" table with the following information: "Name: Yamada Taro", "Email address: taro@example.com", and "Child information: [Name: Jiro, Age: 4, Interests: Space]".
[1601] Step 4:
[1602] Child profile generation
[1603] What happens: The server generates a profile for the child based on the information in the database.
[1604] Input: Parent account and child information stored in the database.
[1605] Data calculation: The server applies a profile generation algorithm to create the child's profile data.
[1606] Output: Child profile data.
[1607] Specific operation: The server generates data for "Profile: {Name: Jiro, Age: 4, Interests: Space}".
[1608] Step 5:
[1609] Profile Sync
[1610] Processing: The server synchronizes the created child profile to the remote device.
[1611] Input: Child profile data.
[1612] Data processing: Serializing profile data for transmission to remote devices.
[1613] Output: Child profile data sent to the remote device.
[1614] Specific operation: The server sends the data "sync_profile: {Name: Jiro, Age: 4, Interests: Space}" to the remote device.
[1615] Step 6:
[1616] Entering an activity schedule
[1617] What happens: The user enters a child's activity schedule in the application.
[1618] Input: Activity schedule (time and content).
[1619] Data processing: Convert the input schedule into schedule data format.
[1620] Output: Activity schedule data.
[1621] Specific actions: The user inputs "15:00 - play with toys", "17:00 - draw a picture", and "19:00 - watch TV".
[1622] Step 7:
[1623] Sending a Schedule
[1624] Processing content: The terminal sends the input schedule to the server.
[1625] Input: Activity schedule data.
[1626] Data calculation: The terminal sends the input schedule to the server as an HTTP request.
[1627] Output: The activity schedule sent to the server.
[1628] Specific operation: The device sends the following data to the server: "schedule: [{time: '15:00', activity: 'play with toys'}, {time: '17:00', activity: 'draw a picture'}, {time: '19:00', activity: 'watch TV'}]".
[1629] Step 8:
[1630] Start of activities
[1631] Processing details: The server instructs the remote terminal to start its activities according to the set schedule.
[1632] Input: Activity schedule data.
[1633] Data processing: The server processes the schedule data to send it to the remote terminal.
[1634] Output: Action instructions sent to the remote device.
[1635] Specific operation: At 15:00, the server sends "activity_start: 15:00 in the morning, content: play with toys" to the remote device.
[1636] Step 9:
[1637] Activity status notification
[1638] What it does: The server notifies the parent user's device of ongoing activities on the remote device in real time.
[1639] Input: Activity data from a remote terminal.
[1640] Data calculation: The server processes the activity status data to send it to the parent user's terminal.
[1641] Output: Activity notification sent to parent user's device.
[1642] Specific operation: When the remote device starts an activity, the server sends a notification to the parent user saying, "Notification: Jiro is currently playing with toys at 15:00."
[1643] Step 10:
[1644] Monitoring and coordinating activities
[1645] Processing details: The user monitors the activity status of the remote terminal and issues instructions to change the activity as necessary.
[1646] Input: Adjustment instructions from parent user.
[1647] Data calculation: The terminal sends adjustment instructions to the server, and the server forwards the instructions to the remote terminal.
[1648] Output: Adjustment instructions sent to the remote device.
[1649] Specific operation: When the parent user presses a button, for example, "Dinner time starts at 17:30," the device sends "activity_change: 17:30 - Dinner time starts" to the remote device via the server.
[1650] The above processing steps realize a system that allows parent users to efficiently plan, manage, and safely coordinate their children's activities.
[1651] (Application example 1)
[1652] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1653] It is difficult for parents to safely and efficiently manage and monitor their children's activities in brick-and-mortar stores in real time. This creates a significant burden on parents, especially when managing multiple activities simultaneously. Traditional methods make it difficult to select appropriate activities based on a child's interests and preferences, and require parents to directly monitor and adjust their children's activities, which consumes a significant amount of parents' time.
[1654] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1655] In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, means for inputting the child's activity schedule at a physical store, and means for monitoring the child's activities at the physical store in real time and notifying the parent user, thereby enabling parents to efficiently and safely manage their child's activities and adjust them flexibly and in real time.
[1656] A "parent account" is an account that allows parents to register information about themselves and their children and manage their children's activities.
[1657] A "child profile" is a set of information that includes a child's personal data, preferences, and activity records, generated based on information from the parent account.
[1658] "Remote Device" means an electronic device or device used to manage and conduct a child's activities.
[1659] An "activity instruction" is an instruction on the content of an activity to be performed by the remote terminal based on the child's profile.
[1660] An "activity schedule" is a time period set by the parent and a schedule of activities to be carried out during that time period.
[1661] "Executing an activity in real time" means that the remote terminal immediately starts and progresses the activity based on a set schedule.
[1662] "Activity Status Notification" refers to informing the parent of the status of ongoing activities on the remote terminal.
[1663] A "children's activity schedule at a physical store" is a schedule of activities that children will participate in at a physical store or facility.
[1664] "Monitoring" means using a remote device or system to monitor the progress of an activity.
[1665] This invention is a system that registers information on a parent account, generates a child profile based on that information, and synchronizes with a remote terminal to provide activity instructions. A specific embodiment of this system will be described below.
[1666] Basic system configuration
[1667] The system consists of a smartphone or tablet device, a server, and a remote device. Parents can use the smartphone application to create an account, generate a child profile, and set an activity schedule.
[1668] Parent Account Settings
[1669] Parents enter their information to create a profile for their child. Parent information includes name, email address, etc. Child information includes name, age, interests, etc. This information is sent to a server and stored in a database.
[1670] Child profile generation
[1671] The server generates a child profile based on the parent and child information it receives, including the child's age, interests, and preferences for specific activities. The server then synchronizes this profile with the remote device, which then adjusts its activities based on the profile.
[1672] Setting up an activity schedule
[1673] Parents use a smartphone application to input their child's activity schedule, which is then sent to a server and transferred from the server to a remote device, which then executes the activities based on the schedule, allowing parents to view and adjust the progress in real time.
[1674] In-store activity management
[1675] Parents can input their children's activity schedules at physical stores (e.g., activity centers and amusement parks). The remote device monitors the activities at the physical stores and facilities in real time and notifies parents of their progress, allowing parents to efficiently and safely manage their children's activities.
[1676] Program processing
[1677] The server uses the Django framework to manage parent account information, child profiles, and activity schedules. The smartphone application also works with Django, exchanging information in JSON format. It also runs periodic tasks to monitor activities in real time and sends necessary notifications to parents.
[1678] Specific examples
[1679] For example, a parent might enter "Name: Parent A," "Email address: abc@example.com," "Child's name: Child B," "Age: 8 years old," and "Interests: Sports." This information is sent to the server, which generates a profile for the child. The parent then sets a schedule, such as "10:00 - Soccer" and "13:00 - Art," and sends it to the server. The server then sends the schedule information to the remote device, which then starts its activities in real time.
[1680] Example prompt for a generative AI model:
[1681] Parent Account Information:
[1682] Name: Parent A
[1683] Email address: abc@example.com
[1684] Child's name: Child B
[1685] Age: 8
[1686] Interests: Sports
[1687] schedule:
[1688] 10:00 - Soccer
[1689] 13:00 - Drawing
[1690] Notification message:
[1691] The physical twins started playing football.
[1692] The physical twin has begun drawing.
[1693] Such a system allows parents to efficiently manage, monitor and regulate their children's activities while still having time for themselves.
[1694] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1695] Step 1:
[1696] Registering a Parent Account
[1697] The user launches the smartphone application and enters information about themselves and their child (such as name, email address, age, interests, etc.). The information is sent in JSON format to the server, which stores it in a database and creates a parent account.
[1698] Input: Parent and child information such as name, email address, age, and interests
[1699] Output: New parent account information and child profile added to the database
[1700] Step 2:
[1701] Child profile generation
[1702] Based on the received information, the server generates a profile of the child, including the child's age, interests, and preferences for specific activities, and transmits this profile to the remote device, which can then tailor its activities accordingly.
[1703] Input: Child information stored in database
[1704] Output: Child profile synced to remote device
[1705] Step 3:
[1706] Setting up an activity schedule
[1707] The user inputs the child's activity schedule using a smartphone application. This schedule is sent to the server in JSON format, and the server stores it in a database. The remote device starts activities based on this schedule information.
[1708] Input: Activity schedule entered (e.g. 10:00 - Soccer, 13:00 - Drawing)
[1709] Output: Activity schedule synced to remote device
[1710] Step 4:
[1711] Real-time action execution
[1712] The remote terminal starts the activity at the set time based on the received schedule information. For example, if a soccer game starts at 10:00, the remote terminal monitors and executes the activity and sends its progress to the server.
[1713] Input: Synced Activity Schedule
[1714] Output: Information about the real-time activities performed and monitored by the child
[1715] Step 5:
[1716] Activity status notification
[1717] The server notifies the parent user of the progress based on the activity status received from the remote terminal. For example, if a soccer game has started, a notification message saying "Soccer has now started" is sent.
[1718] Input: Activity information sent from the remote device
[1719] Output: Activity notification message sent to parent user
[1720] Step 6:
[1721] In-store activity management
[1722] Users input their activities at the physical store and send them to a remote device, which then monitors the activities at the physical store based on this information. For example, the remote device notifies parents in real time about the progress of soccer or art activities at the activity center.
[1723] Input: Children's activity schedule at a brick-and-mortar store
[1724] Output: Real-time activity progress notification
[1725] Step 7:
[1726] Review and adjust activities
[1727] The parent user uses a smartphone application to check the current activity status and, if necessary, send an instruction to adjust the activity to the server. The server then transmits this instruction to the remote terminal, which then adjusts the activity.
[1728] Input: Parent user confirms activity status and gives instructions for adjustment
[1729] Output: Adjusted activity schedule and ongoing activities
[1730] In this way, parents can effectively manage their children's activities and make appropriate adjustments as needed.
[1731] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1732] Basic system configuration
[1733] The system of the present invention registers information about a parent's account and generates a child profile based on that information. Once the child profile is created, it is synchronized with a remote device and activity instructions are issued. The system transmits a daily activity schedule set by the parent user to the remote device, and the remote device executes activities in real time based on that schedule. Furthermore, the activity status of the remote device is constantly notified to the parent user, who can check and issue adjustment instructions based on this information. The system of the present invention is also equipped with an emotion engine, which can recognize the parent user's emotions and adjust the activity content based on them.
[1734] Parent Account Settings
[1735] Creating a Parent Account
[1736] The user (parent) starts a dedicated application on their device, accesses the account creation screen, and enters their own information (e.g., name, email address, etc.) and their child's information (e.g., age, name, interests, etc.).
[1737] Registration and submission of information
[1738] The device sends the entered information to a server, which stores it in a database, creating a parent account and a child profile.
[1739] Parenting Physical Twins
[1740] Receiving information and creating a profile
[1741] The server receives the user and child information sent from the device, stores it in a database, and generates a child profile, which includes information such as the child's age, interests, and preferences for specific activities.
[1742] Profile Sync
[1743] The server synchronizes the generated child profile with the remote device and provides activity instructions, allowing the remote device to adjust its activities based on the profile.
[1744] Setting up an activity schedule
[1745] Entering a schedule
[1746] The user uses an application on the device to input the child's activity schedule, which is a timetable showing what activities will be performed at what times.
[1747] Sending a Schedule
[1748] The terminal sends the input schedule information to the server, which then sends the schedule to the remote terminal as a timetable of activities.
[1749] Real-time interaction with children
[1750] Start of activities
[1751] The server starts activities according to a schedule set in the remote terminal, and the remote terminal automatically carries out conversations and activities with the child according to the schedule.
[1752] Activity status notification
[1753] The server notifies the device of the progress of the remote device's activities in real time, allowing the parent user to check the current activity status.
[1754] Parental confirmation and coordination
[1755] Activity monitoring
[1756] The user can monitor the activities of the remote terminal through the terminal, thereby checking whether the current activity is proceeding according to schedule.
[1757] Adjustment instructions
[1758] When the parent user feels it is necessary, they can send an instruction to change the activity from the terminal to the remote terminal via the server, which allows for flexible response to unexpected situations.
[1759] Emotion Engine Settings
[1760] Emotion Engine Settings
[1761] The server is equipped with an emotion engine and analyzes sensor information (e.g., voice data and image data) to recognize the parent user's emotions.
[1762] Recognizing and transmitting emotions
[1763] The emotion engine recognizes the user's emotions and sends that information to the server, which then issues instructions to adjust the activities of the remote device based on the emotion information.
[1764] Specific examples
[1765] For example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[1766] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[1767] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[1768] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[1769] The processing flow will be explained below.
[1770] Step 1:
[1771] Creating a Parent Account
[1772] The user launches the dedicated app on their device and accesses the account creation screen. The user enters their own information (e.g., name, email address). The user enters their child's information (e.g., name, age, interests).
[1773] Step 2:
[1774] Submitting information and registering
[1775] The device sends the entered user and child information to the server. The server stores the received information in a database. The server creates a child profile and stores it in the database.
[1776] Step 3:
[1777] Profile Sync
[1778] The server synchronizes the created child profile to the remote device, which receives and stores the synchronized profile.
[1779] Step 4:
[1780] Setting up an activity schedule
[1781] The user inputs the child's activity schedule through the device app. The schedule includes specific time periods and activities to be performed during those periods (e.g., 4:00 PM - play, 6:00 PM - dinner, 7:00 PM - TV). The device then sends the input schedule to the server.
[1782] Step 5:
[1783] Schedule management and preparation
[1784] The server sends the received schedule to the remote terminal and prepares for the activity. The remote terminal proceeds with preparations based on the received schedule.
[1785] Step 6:
[1786] Start of activities
[1787] The server sends an instruction to start an activity to the remote device based on the set schedule. The remote device starts the activity with the child. For example, at 4:00 p.m., the remote device starts playing with a dinosaur toy.
[1788] Step 7:
[1789] Real-time notifications
[1790] The remote device reports the current activity status to the server. The server notifies the device of the progress of the activity status. The device displays the current activity status to the parent user in real time.
[1791] Step 8:
[1792] Monitoring and coordinating activities
[1793] The user monitors the activity status of the remote terminal through the terminal. The user sends instructions from the terminal to change or adjust the activity as needed. The server receives the user's instructions and sends change instructions to the remote terminal. The remote terminal receives the instructions, adjusts and executes the activity.
[1794] Step 9:
[1795] Emotion engine configuration and emotion recognition
[1796] The server has an emotion engine and receives emotion data (e.g., voice and image data) from the user, which the emotion engine analyzes and recognizes the user's emotion.
[1797] Step 10:
[1798] Emotional information transmission and activity regulation
[1799] The server sends instructions to the remote device to adjust its activities based on the recognized emotion information. The remote device receives the emotion data and adjusts its activities accordingly.
[1800] As a concrete example, suppose a user enters "Name: Taro Tanaka," "Email address: taro@example.com," "Child's name: Hanako," "Age: 5 years old," and "Interests: Dinosaurs." The device sends this information to the server, which then generates a profile for the child and synchronizes it with the remote device.
[1801] The user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends it to the server. The server then sends this schedule to the remote device, which then starts its activities based on the time.
[1802] If the emotion engine recognizes that the parent user's emotion is "tired," the remote terminal adjusts the activity content to increase quieter activities (for example, reading picture books).
[1803] This system allows parent users to provide care to their children that is tailored to their own condition while still having time for themselves.
[1804] Example 2
[1805] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1806] Previous systems offered limited flexibility in managing children's activities based on schedules set by parents, and failed to take into account parents' emotional states, which could result in stress for both parents and children.
[1807] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for registering information about a parent account, means for generating a child's profile based on the registered information, means for synchronizing the child's profile with a remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to perform activities in real time based on the set schedule, means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions, and means for recognizing the parent user's emotions using an emotion engine and adjusting the activity content of the remote terminal based on the information. This allows for more flexible management of children's activities and enables adjustments to be made in accordance with the parent's emotional state.
[1808] A "parent account" is an account created by a parent using the system based on their own information.
[1809] A "child profile" is data generated based on a parent account and includes demographic information such as the child's age and interests.
[1810] "Remote Device" means a remotely controlled device or equipment used to manage and conduct a Child's activities.
[1811] The "activity schedule" is a timetable set by a parent user that shows the child's daily activity schedule.
[1812] The "emotion engine" is a program that recognizes and analyzes the parent user's emotions from voice data and image data.
[1813] The "means for executing an activity in real time" is a function that enables the remote terminal to immediately execute the child's activity according to a set schedule.
[1814] "Notification of activity status" is a function for notifying the parent user of the ongoing activity of the remote terminal in real time.
[1815] The "means for receiving adjustment instructions" is a function that allows the parent user to send instructions to the remote terminal to change the activity content as needed, and for the remote terminal to accept these instructions.
[1816] A "database" is an information system for storing and managing information such as parent accounts and child profiles.
[1817] A "server" is a computer that handles the central data processing and information transmission of a system.
[1818] The present invention is a system that registers information on a parent account, generates a child's profile based on that information, and synchronizes with a remote terminal to instruct activities.
[1819] Basic system configuration
[1820] Parent Account Settings
[1821] The user (parent) launches a dedicated application on their device. They access the account creation screen and enter their own information (e.g., name, email address) and their child's information (e.g., age, name, interests). The device sends the entered information to the server, which then stores the received information in a database. This creates a parent account and a child profile.
[1822] Parenting Physical Twins
[1823] The server receives the information sent from the device and stores it in a database. The server then generates a child profile, which includes information such as age and interests. The generated child profile is synchronized with the remote device, and activity instructions are sent. This allows the remote device to adjust its activities based on the profile.
[1824] Setting up an activity schedule
[1825] The user uses the terminal application to input the child's activity schedule. This is a timetable showing what activities will be performed at what time. The terminal sends the input schedule information to the server, and the server sends the schedule to the remote terminal. The remote terminal can then carry out the activities based on this information.
[1826] Real-time interaction with children
[1827] The server starts activities according to the schedule set on the remote device. The remote device automatically carries out conversations and activities with the child according to the schedule. The server notifies the device of the progress of the remote device's activities in real time, and the parent user can receive these notifications and check the current activity status.
[1828] Parental confirmation and coordination
[1829] Users can monitor the activities of the remote device through their device, which allows them to check whether the current activity is proceeding according to schedule. When necessary, the parent user can send an instruction to change the activity from their device to the remote device via the server, allowing them to flexibly respond to unexpected situations.
[1830] Emotion Engine Settings
[1831] The server is equipped with an emotion engine that analyzes sensor information (e.g., voice data, image data) to recognize the parent user's emotions. The emotion engine recognizes the user's emotions and sends that information to the server. The server issues instructions to adjust the activities of the remote device based on this emotion information.
[1832] Specific examples
[1833] For example, if a user enters "Name: Tanaka Taro", "Email address: taro@example.com", "Child's name: Hanako", "Age: 5", and "Interests: Dinosaurs", the device sends this information to the server, which then generates a profile for the child and synchronizes it to the remote device.
[1834] Next, the user sets a schedule such as "16:00 - Play," "18:00 - Dinner," and "19:00 - TV," and the device sends the information to the server, which then sends the schedule to the remote device, which then begins its activities based on this schedule.
[1835] Furthermore, if the emotion engine recognizes that the parent user is feeling "tired," the remote terminal adjusts the activity content so that the parent user spends more time reading picture books.
[1836] Prompt Sentence Examples
[1837] A possible prompt might be, "Suggest an activity schedule for a 5-year-old child interested in dinosaurs from 10:00 AM to 6:00 PM."
[1838] This system allows parent users to provide care for their children tailored to their own condition while still having time for themselves.
[1839] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1840] Step 1:
[1841] The user (parent) launches a dedicated application on their device and accesses the account creation screen. The user enters their own information (name, email address, etc.) and their child's information (age, name, interests, etc.).
[1842] Input: Parent information, Child information
[1843] Output: Confirmation screen displayed on the device
[1844] Step 2:
[1845] The device sends the information entered by the user to the server, which then registers the received information in a database and creates a parent account and a child profile.
[1846] Input: Parent information, Child information
[1847] Data processing: Creation of parent accounts and child profiles
[1848] Output: Parent account and child profile stored in database
[1849] Step 3:
[1850] The server synchronizes the created child profile to the remote device, which then configures itself based on the received profile information.
[1851] Input: Generated child profile
[1852] Output: Profile information synced to the remote device
[1853] Step 4:
[1854] The user uses the device application to input the child's activity schedule, for example, "16:00 - Play," "18:00 - Dinner," "19:00 - TV," etc.
[1855] Input: Activity schedule information
[1856] Output: Schedule information entered on the terminal
[1857] Step 5:
[1858] The terminal transmits the input schedule information to the server, which then transmits the schedule information to the remote terminal.
[1859] Input: Activity schedule information
[1860] Output: Schedule information sent to the remote device
[1861] Step 6:
[1862] The server starts the activity according to the schedule set in the remote terminal, and the remote terminal automatically performs the activity according to the specified time.
[1863] Input: Schedule information synchronized to the remote device
[1864] Output: Each activity started
[1865] Step 7:
[1866] The server notifies the remote device of the progress of its activities in real time, which the user can then view through the application.
[1867] Input: Remote terminal activity progress
[1868] Output: Notifications displayed on the device
[1869] Step 8:
[1870] The user monitors the activities of the remote terminal through the terminal, and checks whether the activities are proceeding according to schedule.
[1871] Input: Notified activity progress
[1872] Output: Monitoring information that can be viewed by the user
[1873] Step 9:
[1874] When the parent user feels it is necessary, the terminal sends an instruction to change the activity to the remote terminal via the server. The remote terminal changes the activity based on the received instruction.
[1875] Input: Change instruction information from parent user
[1876] Output: Change orders sent to the remote device
[1877] Step 10:
[1878] The server collects and analyzes voice and image data to recognize the parent user's emotions using an emotion engine, and sends the recognized emotion information to the remote device, which then adjusts its activities accordingly.
[1879] Input: Parent user's voice data, image data
[1880] Data processing: Recognition and analysis of emotional information
[1881] Output: Instructions for adjusting activities
[1882] (Application example 2)
[1883] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1884] In recent years, with the increase in dual-income households, the burden of transporting children to and from school has become a major social issue. A reliable transportation method is needed, especially when parents are away from home due to work or other reasons. There is also a need for a system that can manage flexible schedules that take into account the emotional state of parents while ensuring the safety of children. Traditional manual management places a significant burden on both time and mental health, and new technologies are needed to address this.
[1885] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for registering parent account information, means for generating a child profile based on the registered information, means for synchronizing the child profile with the remote terminal and issuing activity instructions, means for transmitting a daily activity schedule set by a parent user to the remote terminal, means for the remote terminal to execute child pick-up and drop-off activities in real time in the autonomously driven vehicle based on the set schedule, and means for notifying the parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions. This enables the autonomously driven vehicle to safely pick up and drop off the child based on the schedule set by the parent and notify the parent of the activity status in real time. In addition, flexible adjustments can be made taking into account the parent's emotional state, reducing stress and realizing efficient transportation management.
[1886] A "parent account" is an account in which a parent's personal information is registered to manage their child's activities.
[1887] A "child profile" is an individual profile that includes information about a child's age, interests, and preferences for certain activities.
[1888] The "remote terminal" is a remotely operable device that carries out activities for picking up and dropping off children based on a schedule set by the parents and notifies the parents of the activity status.
[1889] An "activity instruction" is an instruction indicating the specific activity content to be carried out by the remote terminal based on the child's profile and schedule.
[1890] The "daily activity schedule" is a timetable set by parents that lists the timetable and content of their child's daily activities.
[1891] An "autonomous vehicle" is a vehicle that has the ability to automatically carry out child pick-up and drop-off activities according to a programmed schedule.
[1892] "Performing an activity in real time" means performing a child's activity in real time according to a set schedule.
[1893] "Notifying parent user of activity status" means informing the parent in real time of the progress of the activity being executed by the remote terminal.
[1894] "Confirmation and adjustment instructions" means that the parent checks the progress of the activity via the remote terminal and gives instructions for changes as necessary.
[1895] The program of the system that embodies this invention manages everything from registering information in a parent account to picking up and dropping off a child. The system generates a child profile based on the information in the parent account, synchronizes it with a remote terminal, and performs regular pick-up and drop-off using an autonomous vehicle.
[1896] System implementation configuration
[1897] 1. Register parent account information and create a profile
[1898] The user (parent) creates a parent account using a dedicated smartphone application. After entering the parent's information (name, email address) and the child's information (age, name, interests), this information is sent to the server and stored in a database. The child's profile is then generated and synchronized to the remote device.
[1899] 2. Schedule your daily activities
[1900] Through the application, users can set up a daily activity schedule for their children, which is entered by the parent and sent to the server, where it is then sent to the remote device as a timetable.
[1901] 3. Transportation using self-driving vehicles
[1902] The remote terminal will use the autonomous vehicle to pick up and drop off the child in real time based on the set schedule, and the autonomous vehicle will notify the parent of its current location and planned route in real time.
[1903] 4. Notification of activity status and adjustment instructions
[1904] The remote device sends the progress of the transportation activity to the server in real time and notifies the parent's smartphone. The parent can check the current situation through the application and send instructions to the remote device to adjust the activity content as necessary.
[1905] 5. Use of Emotion Engine
[1906] The emotion engine analyzes the parent's emotional state in real time and adjusts the pick-up route and time accordingly. For example, if the parent is tired, the system will automatically adjust the pick-up time to a little earlier.
[1907] Program processing
[1908] The server generates a parent account and a child profile and synchronizes them with the remote device, which then operates the autonomous vehicle based on a set schedule, performs real-time pickup and drop-off activities, and reports the activity status to the server, providing an interface for parents to view the status and issue adjustment instructions.
[1909] Specific examples
[1910] For example, a parent may set a schedule to pick up their child from school at 4:00 PM and return home at 5:00 PM. If the parent's emotion engine recognizes that they are tired, the autonomous vehicle will begin picking them up at 3:45 PM. The system will notify the parent in real time of their location and activity status, allowing them to wait at home with peace of mind.
[1911] Prompt Sentence Examples
[1912] My child's name is Hanako, she's 5 years old, and she's interested in dinosaurs. I want to pick her up from school at 4:00 PM and take her home at 5:00 PM. Her emotional state is calm. Please send the pickup instructions to the autonomous vehicle.
[1913] The above is an embodiment of the present system.
[1914] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1915] Step 1:
[1916] To register information for a parent account, a user opens a smartphone application and enters the parent's name, email address, child's name, age, interests, etc. The entered information is converted to JSON format by the device and sent to the server, which receives the information and stores it in a database.
[1917] Input: Parent's personal information, Child's profile information
[1918] Output: Parent account and child profile information stored in the database.
[1919] Step 2:
[1920] The server uses the information stored in the database to create a profile for the child, including the child's age, name, interests, and preferences for specific activities, and then synchronizes this profile with the remote device.
[1921] Input: Parent account information in the database, child profile information
[1922] Output: Synced child profile
[1923] Step 3:
[1924] A user uses a smartphone application to input a child's daily activity schedule. The schedule includes activities by time period. This schedule information is sent from the device to a server. The server links the schedule information to the child's profile and sends it to the remote device as a timetable.
[1925] Input: Parent-entered activity schedule
[1926] Output: Schedule sent to remote device
[1927] Step 4:
[1928] The remote terminal sends instructions to the autonomous vehicle based on a set schedule. The autonomous vehicle follows the instructions and carries out child pick-up and drop-off activities in real time. The vehicle's current location and planned route are sent to the server via the remote terminal.
[1929] Input: Schedule information from the server
[1930] Output: Pick-up instructions sent to the autonomous vehicle, pick-up activity execution
[1931] Step 5:
[1932] While the remote device is performing the pick-up and drop-off activity, it sends the activity status to the server in real time. The server receives this information and notifies the user's smartphone application. Parents can check the current status through the application and send change instructions to the remote device as necessary.
[1933] Input: Activity from remote terminal
[1934] Output: Activity status notified to parent's smartphone, adjustment instructions from parent
[1935] Step 6:
[1936] The server uses an emotion engine to analyze the parent's emotional state. For example, if it detects that the parent is tired, it will adjust the pickup time of the self-driving vehicle accordingly. This information is then transmitted to a remote device, which can then adjust the schedule flexibly.
[1937] Input: Parent emotion data
[1938] Output: Schedule adjustment instructions based on emotion analysis results
[1939] The above are the specific processing steps of this system, and clearly show what inputs are received at each step, how the data is processed, and how the final output is obtained.
[1940] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1941] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1942] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1943] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1944] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1945] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1946] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1947] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1948] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1949] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1950] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1951] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1952] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1953] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1954] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1955] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1956] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1957] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1958] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1959] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1960] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1961] The following is further disclosed regarding the above embodiment.
[1962] (Claim 1)
[1963] A means of registering parent account information,
[1964] means for generating a child profile based on the registered information;
[1965] means for synchronizing the child's profile with a remote terminal and providing activity instructions;
[1966] means for transmitting a daily activity schedule set by a parent user to the remote terminal;
[1967] means for the remote terminal to execute activities in real time based on a set schedule;
[1968] means for notifying a parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions;
[1969] A system including:
[1970] (Claim 2)
[1971] 2. The system according to claim 1, wherein the parent user's input information is sent to the server in JSON format.
[1972] (Claim 3)
[1973] 2. The system according to claim 1, wherein the remote terminal automatically selects an appropriate activity based on preference information set by a parent user when playing with a child.
[1974] "Example 1"
[1975] (Claim 1)
[1976] A means of registering parent account information,
[1977] means for generating a child profile based on the registered information;
[1978] means for synchronizing the child's profile with a remote terminal and providing activity instructions;
[1979] means for transmitting a daily activity schedule set by a parent user to the remote terminal;
[1980] means for the remote terminal to execute activities in real time based on a set schedule;
[1981] means for notifying a parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions;
[1982] means for transmitting said parent account and child profile information to a server, said server storing said information in a database;
[1983] A means for the server to synchronize and update profile information on the remote terminal;
[1984] means for transmitting the activity schedule input by the parent user to a server, and for the server to transmit the schedule to the remote terminal;
[1985] A system including:
[1986] (Claim 2)
[1987] 2. The system according to claim 1, wherein the parent user's input information is sent to the server in JSON format.
[1988] (Claim 3)
[1989] 2. The system according to claim 1, wherein the remote terminal automatically selects an appropriate activity based on preference information set by a parent user when playing with a child.
[1990] "Application Example 1"
[1991] (Claim 1)
[1992] A means of registering parent account information,
[1993] means for generating a child profile based on the registered information;
[1994] means for synchronizing the child's profile with a remote terminal and providing activity instructions;
[1995] means for transmitting a daily activity schedule set by a parent user to the remote terminal;
[1996] means for the remote terminal to execute activities in real time based on a set schedule;
[1997] means for notifying a parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions;
[1998] A way to input children's activity schedules in physical stores, and
[1999] A means for monitoring children's activities in real time in physical stores and notifying parent users;
[2000] A system including:
[2001] (Claim 2)
[2002] 2. The system according to claim 1, wherein the parent user's input information is sent to the server in JSON format.
[2003] (Claim 3)
[2004] 2. The system according to claim 1, wherein the remote terminal automatically selects an appropriate activity based on preference information set by a parent user when playing with a child.
[2005] "Example 2: Combining Emotion Engines"
[2006] (Claim 1)
[2007] A means of registering parent account information,
[2008] means for generating a child profile based on the registered information;
[2009] means for synchronizing the child's profile with a remote terminal and providing activity instructions;
[2010] means for transmitting a daily activity schedule set by a parent user to the remote terminal;
[2011] means for the remote terminal to execute activities in real time based on a set schedule;
[2012] means for notifying a parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions;
[2013] means for recognizing the parent user's emotions using an emotion engine and adjusting the activities of the remote device based on the emotion;
[2014] A system including:
[2015] (Claim 2)
[2016] 2. The system according to claim 1, wherein the parent user's input information is sent to the server in JSON format.
[2017] (Claim 3)
[2018] 2. The system according to claim 1, wherein the remote terminal automatically selects an appropriate activity based on preference information set by a parent user when playing with a child.
[2019] "Application example 2 when combining emotion engines"
[2020] (Claim 1)
[2021] A means of registering parent account information,
[2022] means for generating a child profile based on the registered information;
[2023] means for synchronizing the child's profile with a remote terminal and providing activity instructions;
[2024] means for transmitting a daily activity schedule set by a parent user to the remote terminal;
[2025] A means for the remote terminal to execute a child pick-up and drop-off activity in real time in the autonomous vehicle based on a set schedule;
[2026] means for notifying a parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions;
[2027] A system including:
[2028] (Claim 2)
[2029] 2. The system according to claim 1, wherein the parent user's input information is sent to the server in JSON format.
[2030] (Claim 3)
[2031] 2. The system according to claim 1, wherein when the remote terminal picks up or drops off a child, the remote terminal automatically selects an appropriate pick-up time and route based on preference information set by a parent user. [Explanation of symbols]
[2032] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. A means of registering parent account information, means for generating a child profile based on the registered information; means for synchronizing the child's profile with a remote terminal and providing activity instructions; means for transmitting a daily activity schedule set by a parent user to the remote terminal; means for the remote terminal to execute activities in real time based on a set schedule; means for notifying a parent user of the activity status of the remote terminal and receiving confirmation and adjustment instructions; A system including:
2. The system according to claim 1, wherein the parent user's input information is transmitted to the server in JSON format.
3. The system according to claim 1 , wherein the remote terminal automatically selects an appropriate activity when playing with a child based on preference information set by a parent user.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A