System
The system uses a child tag and generative AI to prevent children from straying by offering real-time guidance and notifications, effectively addressing the limitations of existing child loss prevention systems.
Patent Information
- Application Number
- JP2024137114
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-16
- Publication Date
- 2026-02-27
AI Technical Summary
Existing child loss prevention systems are ineffective in preventing children from getting lost before they stray from a designated area and lack real-time guidance and notification capabilities.
A system comprising a child tag synchronized with a parent's communication device, a server that monitors location, and a generative AI that provides interactive instructions and guidance when the child deviates from a safe range, calculating and guiding the child back using landmarks.
Prevents children from getting lost by providing real-time guidance and notifications, ensuring their safety and reducing parental anxiety.
Smart Images

Figure 2026033993000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] The challenge with existing child loss prevention systems is that they are difficult to prevent before a child gets lost. Specifically, existing systems are limited to identifying a child's location and notifying the parent's smartphone, and most of the time they only respond after the child has already gotten lost. Therefore, there is a need for systems that can prevent children from getting lost before they get lost, and also provide appropriate instructions and guidance when they are in danger of getting lost. [Means for solving the problem]
[0005] To solve the above problems, the present invention provides a system that includes a child tag synchronized with a parent's communication device, a means for the tag to transmit location information about the child's current location, a means for the communication device to register the child's school route and range of activities, and a server that receives location information from the tag and communication device and detects an abnormality if the child exceeds a certain distance or moves outside the designated range of activities. The system also includes a means for the server to activate a generative AI and provide interactive instructions to the child via the tag when the server detects an abnormality. The system also includes a means for the server to calculate an optimal route based on the child's current location and destination and send the route to the tag, and a means for the generative AI to guide the child using specific landmarks based on the optimal route. The system also provides a system that includes a means for the server to monitor and notify interactions between the tag and communication device in real time. This system makes it possible to prevent children from getting lost and safely guide them if they do get lost.
[0006] A "communication terminal" is an electronic device such as a smartphone or tablet held by a parent, which is used to monitor and notify the child's location information through communication with a server.
[0007] A "tag" is a device worn by a child that transmits location information; it is a small electronic tag with GPS functionality that is synchronized with the parent's communication device.
[0008] The "server" is a computer system that receives location information from communication terminals and tags and performs the necessary processing. It is a central device that notifies users of abnormalities, calculates routes, and controls the generative AI.
[0009] "Location information" refers to geographic coordinate data, and is information about the current location obtained by tags or communication devices using technologies such as GPS.
[0010] The "area of activity" is a specific geographical area that a parent registers with the server using a communication terminal, and is an area where a child is deemed safe to move around.
[0011] "Abnormality" refers to an abnormal situation detected by the server when the tag goes out of its range or when the tag and communication terminal exceed a certain distance.
[0012] "Generative AI" is an artificial intelligence system installed on a server or tag, which uses natural language processing to communicate and give instructions in a way that is easy for children to understand.
[0013] "Landmarks" are points or objects that are easily recognizable by children and are used by generative AI to guide children along a route.
[0014] "Route information" is information that the server calculates the optimal route from the current location to the destination and sends to the tag.
[0015] "Real-time" refers to processing that is carried out almost immediately at the current point in time, meaning that the server monitors the exchange between the tag and the communication terminal and responds quickly. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[0038] The system configuration will be explained in the following steps.
[0039] System configuration
[0040] communication terminal
[0041] This is a device that the parent has, typically a smartphone or tablet. This device has a GPS function and is capable of communicating with a server.
[0042] The parent's communication device communicates with the server to register and update information about the school route and range of movement.
[0043] tag
[0044] The tag is a small device worn by children and contains a GPS module and a communication module, which transmits the child's current location information to a server.
[0045] The tag is equipped with generative AI and has the ability to give instructions to children in an interactive format.
[0046] server
[0047] This is the central computer system that manages all communications. The server receives and analyzes location information from communication terminals and tags, and notifies users in the event of an abnormality.
[0048] The server also controls the generative AI, calculating and sending route guidance and appropriate instructions depending on the scenario.
[0049] Program processing
[0050] 1. Initialization
[0051] The server synchronizes the parent's communication device with the child's tag.
[0052] The communication terminal registers the school route and movement range data in the server.
[0053] 2. Location monitoring
[0054] The tag periodically transmits its location information to the server.
[0055] The parent's communication device also periodically sends location information to the server.
[0056] 3. Anomaly Detection
[0057] The server detects an "abnormality" if the tag is outside the set movement range or if the distance between the parent communication terminal and the tag exceeds a certain range.
[0058] 4. Generative AI dialogue and guidance
[0059] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[0060] The server calculates the optimal route from the current location to the destination (the location of the parent's communication device or the nearest police box).
[0061] 5. Real-time guidance
[0062] The generative AI guides the child in real time, showing them specific landmarks through the tag's built-in speakers and display.
[0063] 6. Parental Notification
[0064] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[0065] 7. Emergency Response
[0066] If the abnormality is not resolved within a certain period of time, the server sends an emergency notification to a nearby response agency (e.g., a police box).
[0067] Specific examples
[0068] Scenario: A kindergartener named Taro is about to get lost while playing.
[0069] 1. Initialization
[0070] Taro's mother's communication device and Taro's tag are synchronized with the server, and Taro's range of activities, including kindergarten and play areas, is registered in advance on the server from his mother's communication device.
[0071] 2. Location monitoring
[0072] Taro's tag continues to periodically send location information from the play area to the server.
[0073] The mother's communication device also sends her current location to the server.
[0074] 3. Anomaly Detection
[0075] The server detects when Taro leaves the play area. If the tag becomes too far from his mother's communication device, this is also detected as an abnormality.
[0076] 4. Generative AI dialogue
[0077] When the server detects an abnormality, it immediately activates the generative AI and sends instructions through Taro's tag, such as, "Taro, you've left the playground. Next, try going to that blue bench."
[0078] 5. Real-time guidance
[0079] The server calculates the optimal route based on Taro's current location and the location of his mother's communication device, and the generative AI guides Taro using specific landmarks.
[0080] 6. Parental Notification
[0081] The server also sends a notification to the mother's communication device, displaying Taro's location and current instructions in real time.
[0082] 7. Emergency Response
[0083] If Taro does not follow the specified route or the abnormality persists, the server will send an emergency notification to the nearest police station.
[0084] In this way, the lost child prevention system of the present invention can automatically detect children before they get lost and safely guide them back to their parents or a designated safe place.
[0085] The processing flow will be explained below.
[0086] Step 1:
[0087] Communication device (parent's smartphone)
[0088] A parent uses their smartphone to synchronize their child's tag with the server, which establishes communication between the parent's smartphone and the tag.
[0089] Step 2:
[0090] Communication device (parent's smartphone)
[0091] Parents register information about their child's school route and range of movement on the server from their smartphones, which then sets up an area where the child can move around safely.
[0092] Step 3:
[0093] Terminal (tag)
[0094] The tag's GPS function is turned on and periodically retrieves its current location, which is continuously stored in the background.
[0095] Step 4:
[0096] Terminal (tag), server
[0097] The tag sends its current location to the server at regular intervals (e.g., every 30 seconds). The server receives the location information sent from the tag and stores it in a database.
[0098] Step 5:
[0099] Device (parent's smartphone)
[0100] The parent's smartphone also periodically sends its current location to the server, which uses this data to calculate the distance to the child's location.
[0101] Step 6:
[0102] server
[0103] The server compares the location information of the tag with that of the parent's smartphone to monitor whether it is within range, and also calculates the distance between the tag and the communication terminal.
[0104] Step 7:
[0105] server
[0106] The server detects an abnormality if the tag goes beyond its set range of movement or if the distance between the tag and the parent's smartphone exceeds a certain range.
[0107] Step 8:
[0108] server
[0109] When the server detects an abnormality, it activates the generative AI module and sends an abnormality notification and instructions to the tag.
[0110] Step 9:
[0111] Terminal (tag)
[0112] When the tag receives an abnormality notification, its generative AI activates and begins giving instructions to the child in a conversational format, such as, "Hanako, it looks like you've taken a wrong turn. Next time, turn right and go to the green and light blue convenience store."
[0113] Step 10:
[0114] server
[0115] The server calculates the optimal route based on the current location and destination (parent's location or police station), and this route information is generated in real time.
[0116] Step 11:
[0117] server
[0118] The server sends the calculated optimal route information to the tag. When the tag receives this information, the generative AI continues the route guidance. Example: "Next, try heading for the red post you see on the right."
[0119] Step 12:
[0120] server
[0121] The server continues to monitor the interaction between the tag and the parent's smartphone in real time, and responds again if the situation changes or new abnormalities occur.
[0122] Step 13:
[0123] server
[0124] The server sends the child's current location information and instructions from the generative AI to the parent's smartphone via push notification.
[0125] Step 14:
[0126] Device (parent's smartphone)
[0127] The parent's smartphone can check the child's location on a map in real time and can send additional instructions to the server if necessary.
[0128] Step 15:
[0129] server
[0130] If the abnormality persists for a certain period of time, the server sends an emergency notification to the nearest police box, which then coordinates an emergency response based on the notification.
[0131] Step 16:
[0132] server
[0133] After receiving confirmation from the police station, the server notifies the tag and the parent's smartphone of the latest information and decides on further action.
[0134] Example 1
[0135] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0136] Conventional child loss prevention systems require parents to manually track their children's location information, making it difficult to respond in real time. Furthermore, they lack the ability to respond quickly when a child leaves a designated area, or to immediately notify parents when an abnormality occurs. Therefore, a system that provides complete peace of mind is needed.
[0137] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0138] In this invention, the server includes a means for notifying the parent's communication device of the child's current location information and the generative AI's instructions in real time, a means for the generative AI to issue specific instructions to the child via a speaker or display equipped on the tag, and a means for the parent's communication device to display the notification received from the server via an application. This allows the system to quickly detect when the child moves outside of their range of movement and use the generative AI to guide them in real time. In addition, in the event of an abnormality, the system can quickly notify the parent or response agency, ensuring the child's safety.
[0139] A "parental communication device" is a device owned by a parent and used to monitor and receive location information about a child, typically a mobile device such as a smartphone or tablet.
[0140] A "child tag" is a small device that a child carries and is equipped with a GPS module and a communication module for transmitting current location information.
[0141] "Location Information" means geographic location data determined using a positioning system such as GPS.
[0142] A "communication terminal" is a terminal used for data communication, and is usually a device such as a smartphone, tablet, or PC.
[0143] "School route and range of movement" refers to the geographical area within which a child is permitted to travel, as defined and registered in advance by the parent.
[0144] The "server" is a central computer system that manages communication between multiple devices, receives and analyzes location information, and controls the generative AI.
[0145] The "certain distance" is a distance set between the parent's communication terminal and the child's tag that is recognized as being outside the range of movement.
[0146] An "abnormality" is a situation that is detected when a child's tag goes outside the set range of movement or exceeds a certain distance.
[0147] "Generative AI" is a system that uses artificial intelligence technology to give children interactive instructions, such as an AI model that provides route guidance or responds to abnormal situations.
[0148] "A means of giving interactive instructions" is a function that allows the generative AI to give specific instructions to children via tags.
[0149] An "optimal route" is a calculated shortest or safest route from your current location to your destination.
[0150] "Landmarks" are buildings or objects that serve as landmarks used to guide children.
[0151] "Means for notifying in real time" is a function that allows the server to immediately notify the parent communication terminal of any abnormalities or the current situation.
[0152] An "emergency notification" is an emergency alert sent to nearby response agencies if the abnormality is not resolved within a certain period of time.
[0153] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[0154] Equipment and software configuration
[0155] Parent's communication device:
[0156] The communication devices held by parents are smartphones or tablets. These devices have GPS functionality and are capable of data communication with a server. The communication devices must have an application installed to register information about the school route and range of movement.
[0157] Kids Tags:
[0158] The tag is a small device worn by a child and is equipped with a GPS module and a communication module. The tag transmits the current location information to a server. Furthermore, the tag is equipped with a generative AI that can give instructions to the child in an interactive format. The tag also has a speaker and a display that are used to communicate the generative AI's instructions to the child.
[0159] server:
[0160] The server is a central computer system that manages all communications. It receives and analyzes location information from communication devices and tags, and notifies users in the event of an abnormality. It also controls the generative AI, calculating and sending route guidance and appropriate instructions according to the scenario.
[0161] Process Overview
[0162] 1. Initialization
[0163] The server synchronizes the parent's communication device with the child's tag, and the parent uses the communication device to register data about the child's school route and range of activities on the server.
[0164] 2. Location monitoring
[0165] The child's tag periodically transmits its location information to the server, and the parent's communication device also transmits its current location information to the server.
[0166] 3. Anomaly Detection
[0167] The server analyzes the transmitted location information and detects abnormalities if the tag moves outside the set range of movement or if the distance between the parent communication terminal and the tag exceeds a certain range.
[0168] 4. Generative AI dialogue and guidance
[0169] If an abnormality is detected, the server activates a generative AI that gives interactive instructions to the child via the tag.
[0170] 5. Real-time guidance
[0171] The server calculates the optimal route from the current location to the destination, and the generative AI gives the child instructions using specific landmarks, e.g., "Walk toward the next blue bench you see."
[0172] 6. Parental Notification
[0173] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[0174] 7. Emergency Response
[0175] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to a nearby responding agency (e.g., the police station).
[0176] Specific examples
[0177] Scenario: A kindergarten-aged child is about to get lost while playing.
[0178] 1. Initialization
[0179] The parent's communication device (smartphone) and the child's tag are synchronized with the server. The parent's communication device registers the child's favorite kindergarten and play areas in advance on the server.
[0180] 2. Location monitoring
[0181] The child's tag periodically sends location information from the playground to a server, and the parent's device also sends their current location to the server.
[0182] 3. Anomaly Detection
[0183] The server detects if the child leaves the play area or if the distance between the tag and the parent's communication device exceeds a set range.
[0184] 4. Generative AI dialogue
[0185] When the server detects an abnormality, the generative AI is activated and issues instructions via tags, such as, "You've left the playground. Next, try going to that blue bench."
[0186] 5. Real-time guidance
[0187] The server calculates the optimal route from the child's current location to the location of the parent's communication device, and the generative AI guides the child using specific landmarks.
[0188] 6. Parental Notification
[0189] The server sends a notification to the parent's communication device, displaying the child's location and the instructions of the generative AI in real time.
[0190] 7. Emergency Response
[0191] If the child does not follow the designated route or the abnormality persists, the server will send an emergency notification to the nearby police station or police box.
[0192] Example input to a generative AI model
[0193] Below are some example prompts to input to a generative AI model:
[0194] For example: "Child is out of range. Please guide them to the next landmark. For example, 'Let's try that blue bench next.'"
[0195] The above is a specific embodiment for carrying out the invention. This system ensures the safety of children and reduces parental anxiety.
[0196] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0197] Step 1: Initialization
[0198] The server synchronizes the parent's communication device with the child's tag, and data on the parent's school route and range of movement is sent from the communication device to the server.
[0199] How it works: Parents use their communication devices to enter information about their child's range of activities, such as the route to school and playgrounds, into a dedicated application, and then upload the data to a server, which then stores this information in a database.
[0200] Input: School route and movement range data sent from parent's communication device.
[0201] Output: Home range information stored in a database.
[0202] Step 2: Location Monitoring
[0203] The tag periodically acquires its location information from GPS and sends it to the server. The parent's communication device also periodically sends its current location information to the server.
[0204] Specific operation: The tag and the parent communication device activate their respective GPS functions to obtain their current location information, which is then sent to the server via the communication module.
[0205] Input: Location information sent from the tag and parent communication device.
[0206] Output: Location data collected on the server.
[0207] Step 3: Anomaly detection
[0208] The server analyzes the location information sent from the tag and the parent's communication device and detects abnormalities if the tag moves out of its range or exceeds a certain distance.
[0209] How it works: The server analyzes the location information in real time and compares it with the movement range data stored in the database. If the device goes out of range or exceeds a certain distance, an anomaly flag is raised and an abnormality is detected.
[0210] Input: Location information sent from the tag and parent communication device.
[0211] Output: Anomaly flag and anomaly detection notification.
[0212] Step 4: Generative AI dialogue and guidance
[0213] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[0214] Specific operation: The server inputs prompt text into the generative AI, generates appropriate instructions, and sends the generated instructions to the tag, which then communicates them to the child via a speaker or display.
[0215] Input: Abnormal flag, prompt for the generative AI.
[0216] Output: Specific instructions for the child.
[0217] Step 5: Real-time guidance
[0218] Based on the instructions sent to the tag, the generative AI guides the child in real time using specific landmarks via speakers and displays.
[0219] How it works: The server calculates the optimal route from the current location to the destination and sends it back to the generative AI. The generative AI then generates instructions, such as "Walk towards the next blue bench you see," and sends them to the tag. The tag then relays this to the child via a speaker or display.
[0220] Input: Current location, destination, and prompt for the generative AI.
[0221] Output: Specific instructions using landmarks.
[0222] Step 6: Parental Notification
[0223] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[0224] How it works: The server sends the child's current location and the instructions of the generative AI to the parent's device, who can then view this information through a dedicated application.
[0225] Input: Current child location, instructions for the generative AI.
[0226] Output: Real-time notification to parent's communication device.
[0227] Step 7: Emergency response
[0228] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to nearby response agencies.
[0229] Specific operation: If the abnormality is not resolved within the set time, the server will send an emergency notification to pre-registered nearby response agencies (e.g., police stations, police boxes). The emergency notification will include the child's current location and details of the abnormality.
[0230] Input: Abnormal condition, time information.
[0231] Output: Emergency notification to responding agencies.
[0232] The above is a detailed flow of the program processing of this system.
[0233] (Application example 1)
[0234] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0235] Previous child location monitoring systems lacked sufficient measures to deal with situations where a child went outside the child's range, and had limited functionality for notifying parents of accurate location information in real time. As a result, there were problems with children becoming lost or falling into dangerous situations. Furthermore, there was a lack of specific instructions for children when an abnormality occurred, and appropriate responses in emergencies.
[0236] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0237] In this invention, the server is equipped with a tag for the child that is synchronized with the parent's communication terminal, and includes means for the tag to transmit location information of the current location, means for the parent's communication terminal to register the school route and range of activities, means for the server to receive location information from the tag and the communication terminal and detect an abnormality if the distance exceeds a certain distance or the designated range of activities, means for the server to activate a generative AI and give interactive instructions to the child via the tag when the server detects an abnormality, means for the server to calculate an optimal route from the current location and destination and send it to the tag, means for the generative AI to guide the child based on the optimal route using specific landmarks, means for the server to monitor and notify interactions between the tag and communication terminal in real time, means for the server to send an emergency notification to nearby response agencies if the abnormality is not resolved within a certain period of time, and means for the generative AI to explain the abnormal situation to the child interactively and give instructions based on specific landmarks. This allows for rapid detection of abnormalities even if a child goes outside the child's range, and specific instructions and guidance can be given using generative AI, enabling real-time notifications to parents and rapid emergency notifications to nearby response agencies.
[0238] A "parent's communication device" is a device with communication capabilities owned by the parent, and is primarily a smartphone or tablet.
[0239] A "child tag" is a small device worn by a child that is equipped with a GPS module and a communication module and has the ability to transmit current location information.
[0240] The "server" is a centralized management system that receives location information from communication terminals and tags, and analyzes and issues instructions.
[0241] "Generative AI" refers to generative artificial intelligence that has the ability to generate sentences and images and interact with users.
[0242] "A means of giving instructions in an interactive format" refers to a system in which the generative AI provides guidance and instructions to children via voice or text.
[0243] "Means for calculating optimal route" refers to a function that executes an algorithm to calculate the most efficient and safe route based on information about the current location and destination.
[0244] A "landmark" is a building, place, or object that serves as a landmark for children.
[0245] "Means for real-time monitoring and notification" refers to a function in which the server constantly checks location information and immediately notifies if an abnormality occurs.
[0246] "Emergency notification" is a system that quickly contacts pre-registered response organizations when a crisis situation occurs.
[0247] MODE FOR CARRYING OUT THE INVENTION
[0248] System Configuration
[0249] To implement this invention, a parent's communication terminal (smartphone), a child's tag device, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[0250] Hardware
[0251] Parent's communication device: Smartphone or tablet (with GPS and communication functions)
[0252] Child tag device: A device equipped with a GPS module and a communication module
[0253] Server: Cloud platform (e.g., Amazon Web Services (AWS®), Microsoft® Azure®)
[0254] software
[0255] Generative AI: Generative AI such as OpenAI (registered trademark), GPT-4 (registered trademark), GPT-3 (registered trademark), and 5
[0256] Server management software: location analysis and notification system
[0257] Program processing description
[0258] The server receives location information, detects abnormalities, activates the generative AI, and performs a series of processes including real-time instructions and notifications, making it possible to detect and respond to abnormalities when a child goes outside the set range of movement.
[0259] 1. Receiving and registering location information
[0260] The parent's communication terminal registers data on the school route and range of movement on the server.
[0261] The child's tag device and the parent's communication terminal periodically transmit location information to a server.
[0262] 2. Anomaly detection and generative AI activation
[0263] The server analyzes the data and detects an abnormality if the tag goes beyond its range or exceeds a certain distance.
[0264] When an abnormality is detected, the server activates a generative AI and issues specific instructions to the child via the tag.
[0265] 3. Optimal route calculation and guidance
[0266] The server calculates the optimal route based on the current location and destination.
[0267] Generative AI guides children using specific landmarks.
[0268] 4. Real-time monitoring and notification
[0269] The server monitors the data between the tag and the parent's communication terminal in real time and notifies the parent in the event of an abnormality.
[0270] If the anomaly persists for a certain period of time, the server will send an emergency notification to nearby response agencies.
[0271] Example: Measures to prevent children from getting lost in the store
[0272] For example, while shopping at a mall, a parent launches the "Kids Secure" app and sets a range of movement. If the child goes outside the set range within the store, the tag notifies the server of the abnormality, and the server activates the generative AI. The generative AI then gives the child instructions in a dialogue format, as follows:
[0273] Generative AI interaction with children:
[0274] "○○-kun, you have exceeded the mall's set range. Please return to the elevator."
[0275] Parental Notice:
[0276] "○○ has gone out of range. He is currently near the elevator on Floor B."
[0277] This system allows for a quick response in the event of a child going missing, ensuring parents and responding authorities are notified quickly.
[0278] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0279] Step 1:
[0280] The server initializes and synchronizes the parent's communication device and the child's tag. It receives data on the school route and activity range from the parent's communication device and registers this on the server. The input is the school route and activity range data sent from the parent's communication device, and the output is storage in the server's registration database. Specifically, the parent's communication device sends GPS setting information to the server, which stores it in the database.
[0281] Step 2:
[0282] The server periodically receives location information from the child's tag device and the parent's communication terminal. The input is the location information sent from the tag device and the parent's communication terminal, and the output is the storage of the received location information in the server. In this process, the tag device and the parent's communication terminal periodically send location information to the server, which then stores it in a database.
[0283] Step 3:
[0284] The server analyzes the received location information in real time and detects an anomaly if the tag goes beyond the set movement range or if the distance between the tag and the communication terminal exceeds a certain range. The input is the location information stored on the server, and the output is the anomaly detection result. Specifically, an algorithm in the server analyzes the location information and checks for deviation from the movement range or excess distance.
[0285] Step 4:
[0286] When the server detects an abnormality, it activates the generative AI and gives interactive instructions to the child via the tag device. The input is the abnormality detection result, and the output is the instructions created by the generative AI. The generative AI generates a prompt such as "Taro, move from your current position to the blue bench" and sends it to the tag device.
[0287] Step 5:
[0288] The server uses generative AI to calculate the optimal route based on the current location and destination. The input is current location information from the child's tag device and the parent's communication device, and the output is the calculated optimal route. In this process, the server calculates the route using GPS data for the current location and destination and sends it to the tag device.
[0289] Step 6:
[0290] The generative AI guides the child along the calculated optimal route, using specific landmarks. The input is the calculated optimal route and landmark information, and the output is detailed guidance instructions created by the generative AI. Specific landmark instructions, such as "Next, turn right in front of that red postbox," are displayed on the tag device or sent via voice.
[0291] Step 7:
[0292] The server monitors the exchange between the tag device and the parent's communication terminal in real time, and notifies the parent in the event of an abnormality. The input is the location information received in real time and the abnormality detection results, and the output is the notification content to the parent. In concrete terms, the server notifies the parent's communication terminal, for example, "Taro has exceeded the set range. His current location is near the elevator on floor B."
[0293] Step 8:
[0294] If the abnormality is not resolved for a certain period of time, the server will send an emergency notification to a nearby response agency. The input is the result of continuous abnormality detection, and the output is the content of the emergency notification to the nearby response agency. Specifically, the server automatically notifies the response agency based on the registered emergency contact information, saying, "The child has exceeded the set range and the abnormality continues. The current location is ____."
[0295] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0296] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays and processes data between the devices are required. Furthermore, the tag must be equipped with a generative AI and an emotion engine.
[0297] The system configuration is explained as follows.
[0298] System configuration
[0299] communication terminal
[0300] This is something that parents have, typically a smartphone or tablet. This device has a GPS function and is capable of communicating with a server.
[0301] The parent's communication device communicates with the server to register and update information about the school route and range of movement.
[0302] tag
[0303] The tag is a small device worn by children, equipped with a GPS module, a communication module, a generative AI, and an emotion engine. The tag transmits the child's current location to a server.
[0304] The emotion engine has the ability to analyze a child's tone of voice and facial expressions to recognize their emotions.
[0305] server
[0306] This is the central computer system that manages all communications. The server receives and analyzes location information from communication terminals and tags, and notifies users in the event of an abnormality.
[0307] The server also controls the generative AI and emotion engine, calculating and sending route guidance and appropriate instructions depending on the scenario.
[0308] Program processing
[0309] 1. Initialization
[0310] The server synchronizes the parent communication terminal with the child tag, thereby establishing communication between the parent communication terminal and the tag.
[0311] Information about the school route and range of movement is registered on the server from the communication terminal.
[0312] 2. Location monitoring
[0313] The tag periodically obtains its current location and sends it to the server.
[0314] The parent's communication device also periodically sends current location information to the server.
[0315] 3. Anomaly Detection
[0316] The server compares the location information of the tag with that of the parent device, monitors whether it is within its range, and calculates the distance between the tag and the device.
[0317] An abnormality is detected when the tag goes beyond the set movement range or when the distance between the tag and the parent communication terminal exceeds a certain range.
[0318] 4. Generative AI dialogue and guidance
[0319] When the server detects an abnormality, it activates the generative AI and gives the child interactive instructions via tags. The generative AI uses landmarks to give clear instructions.
[0320] 5. Leveraging Emotional Engines
[0321] The tag's emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state, and if they express anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child.
[0322] For example: "Don't worry, Taro. Let's go to where Mommy is. Next, take the path to the right and wait for me at the blue bench at the end."
[0323] 6. Real-time guidance
[0324] The server calculates the optimal route based on the current location and destination (parent's location or police station), and the generative AI provides appropriate route guidance using tags. The emotion engine adjusts the instructions in real time.
[0325] 7. Parental Notification
[0326] The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the emotional state of the emotion engine.
[0327] 8. Emergency Response
[0328] If the abnormality persists for a certain period of time, the server sends an emergency notification to a nearby responding agency (e.g., a police box).
[0329] Specific examples
[0330] Scenario: Kindergartener Taro is about to get lost on the playground.
[0331] 1. Initialization
[0332] The mother's communication device and Taro's tag are synchronized with the server, and the play area setting range is pre-registered on the mother's communication device.
[0333] 2. Location monitoring
[0334] Taro's tag periodically sends location information from the play area to a server.
[0335] The mother's communication device also sends her current location to the server.
[0336] 3. Anomaly Detection
[0337] The server detects when Taro leaves the set range of the play area. An abnormality is also detected when the distance between the tag and the mother's communication device exceeds a certain range.
[0338] 4. Generative AI dialogue
[0339] When the server detects an abnormality, it activates the generative AI and sends instructions through Taro's tag, such as, "Taro, it looks like you've taken the wrong turn. Next time, turn right and head towards the blue bench."
[0340] 5. Leveraging Emotional Engines
[0341] The emotion engine analyzes Taro's tone of voice and recognizes that he is feeling anxious. The generative AI then repeats the instructions in a gentler tone, saying, "Don't worry, Mommy is nearby. Let's go together to the blue bench."
[0342] 6. Real-time guidance
[0343] The server calculates the optimal route based on Taro's current location and his mother's location, and the generative AI guides Taro using specific landmarks.
[0344] 7. Parental Notification
[0345] The server notifies the mother's communication device of Taro's current location, the instructions of the generative AI, and the analysis results of the emotion engine, allowing the mother to check Taro's location on a map in real time.
[0346] 8. Emergency Response
[0347] If Taro does not follow the designated route or if the abnormality is not resolved, the server will send an emergency notification to the nearest police station, which will then work together to ensure Taro's safety.
[0348] In this way, the lost child prevention system of the present invention can automatically detect children before they get lost and use generative AI and an emotion engine to safely guide them back to their parents or a designated safe place.
[0349] The processing flow will be explained below.
[0350] Step 1:
[0351] server
[0352] The server synchronizes the parent's communication device with the child's tag, allowing the parent's communication device and the tag to communicate bidirectionally via the server.
[0353] Step 2:
[0354] Device (parent's smartphone)
[0355] Parents use their smartphones to register information about their school route and range of activities on the server, which allows the system to pre-determine areas and routes where children can safely move around.
[0356] Step 3:
[0357] Terminal (tag)
[0358] The tag's GPS function is activated and periodically retrieves its current location, a process that occurs continuously in the background.
[0359] Step 4:
[0360] Terminal (tag), server
[0361] The tag sends the acquired location information to the server at regular intervals (e.g., every 30 seconds). The server receives the location information sent from the tag and stores it in a database.
[0362] Step 5:
[0363] Device (parent's smartphone)
[0364] The parent's smartphone also periodically sends its current location to the server, which is used to calculate the distance to the child's tag location.
[0365] Step 6:
[0366] server
[0367] The server compares the location information of the tag with that of the parent's smartphone to monitor whether the tag is within the set range of movement, and also calculates the distance between the tag and the parent's communication device.
[0368] Step 7:
[0369] server
[0370] The server detects an abnormality if the tag goes beyond its set range of movement or if the distance between the tag and the parent's smartphone exceeds a certain range.
[0371] Step 8:
[0372] server
[0373] When the server detects an abnormality, it immediately activates the generative AI module and sends an abnormality notification and instructions to the tag.
[0374] Step 9:
[0375] Terminal (tag)
[0376] When the tag receives an abnormality notification, its generative AI activates and begins giving instructions to the child in a conversational format. For example, "Taro, you seem lost. Let's go to the nearest blue bench first."
[0377] Step 10:
[0378] Terminal (tag)
[0379] The tag's built-in emotion engine analyzes the child's tone of voice and facial expressions to recognize their current emotional state. If they express anxiety or fear, the generative AI adjusts its instructions to reassure them. For example: "Don't worry, Taro. Mommy's right there. Let's go together to the blue bench."
[0380] Step 11:
[0381] server
[0382] The server calculates the optimal route based on the tag's current location and the location of the parent's communication device, and sends the information to the tag in real time. Based on this information, the generative AI continues to provide route guidance.
[0383] Step 12:
[0384] Terminal (tag)
[0385] The generative AI uses optimal route information to provide guidance using specific landmarks. For example, "Next, try heading for the red postbox on the right." The emotion engine analyzes the child's reactions and continually adjusts the tone and content of the guidance.
[0386] Step 13:
[0387] server
[0388] The server monitors the interaction between the tag and the parent's smartphone in real time, and if any abnormalities occur again, it responds quickly.
[0389] Step 14:
[0390] server
[0391] The server sends push notifications to the parent's smartphone with the child's current location, instructions from the generative AI, and the results of emotion analysis by the emotion engine.
[0392] Step 15:
[0393] Device (parent's smartphone)
[0394] The parent's smartphone receives a notification, allowing them to see their child's location on a map in real time and send further instructions to the server if necessary.
[0395] Step 16:
[0396] server
[0397] If the abnormality persists for a certain period of time, the server will send an emergency notification to a nearby police station or other appropriate agency, including the child's location and details of the abnormality.
[0398] Step 17:
[0399] server
[0400] After receiving confirmation from the police station or other appropriate agency, the server notifies the tag and the parent's smartphone of the latest situation and coordinates further response.
[0401] In this way, the lost child prevention system of the present invention can detect children before they get lost and safely guide them back to their parents by making full use of generative AI and an emotion engine.
[0402] Example 2
[0403] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0404] Today's children are at increased risk of getting lost on their way to school or at playgrounds. However, it is difficult for parents to keep track of their children's locations at all times, and there is a lack of ways to provide appropriate instructions and reassurance when a child gets lost. There is a need for an efficient and effective system that solves these problems and helps children get to school and out safely.
[0405] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for transmitting location information of the current locations of the parent's communication terminal and the child's tag; means for registering the school route and activity range; means for receiving location information and detecting an abnormality when the child exceeds a certain distance or deviates from the designated activity range; means for activating the generative AI and issuing instructions in an interactive format; means for calculating an optimal route from the current location and destination and transmitting the optimal route to the tag; means for the generative AI to guide the child using specific landmarks based on the optimal route; means for analyzing the child's emotional state using an emotion engine and adjusting the tone and content of the generative AI; means for monitoring and notifying interactions between the tag and communication terminal in real time; and means for transmitting emergency notifications to response agencies. This allows parents to always know their child's location and status while their child safely commutes to school or goes out.
[0406] "Parent's communication device" refers to a device owned by the parent that has GPS functionality and is capable of data communication with the server.
[0407] A "child tag" is a small device worn by a child that is equipped with a GPS module, a communication module, a generative AI, and an emotion engine.
[0408] "Means for transmitting location information" refers to the function of tags or communication terminals to transmit GPS information of their current location to a server.
[0409] "Means for registering school routes and areas of activity" refers to the function by which parents use a communication terminal to set and register information about specific school routes and areas of activity in advance on a server.
[0410] "Means for detecting abnormalities" refers to the function that issues an alarm based on the location information received by the server from the tag or communication terminal if the device exceeds a certain distance or goes outside a specified range of movement.
[0411] "Generative AI" refers to a system that uses artificial intelligence technology to give children interactive instructions and respond according to the situation.
[0412] "A means of giving instructions in an interactive format" refers to the function by which the generative AI gives children clear, specific instructions through tags.
[0413] "Means for calculating the optimal route" refers to the function by which the server calculates the optimal route based on the current location and destination and sends that information to the tag.
[0414] "Means of guidance using landmarks" refers to the function in which the generative AI provides children with specific route guidance using surrounding landmarks.
[0415] The "emotion engine" refers to a system that analyzes a child's tone of voice and facial expressions to recognize their emotional state.
[0416] "Means for analyzing the emotional state and adjusting the tone and content of the generative AI" refers to the function in which the emotion engine analyzes the child's emotions and adjusts the instructions and tone of the generative AI based on the results.
[0417] "Means for monitoring and notifying in real time" refers to the function by which the server monitors the location information and interactions of the tag and communication device in real time and sends notifications to parents.
[0418] "Means for sending an emergency notification to a response agency" refers to a function in which the server sends an emergency notification to a nearby response agency (e.g., a police box) if the abnormality is not resolved within a certain period of time.
[0419] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays and processes data between the devices are required. Furthermore, the tag must be equipped with a generative AI and an emotion engine. The system configuration is explained as follows:
[0420] System configuration
[0421] communication terminal
[0422] These devices are usually smartphones or tablets owned by parents. These devices have GPS functionality and are capable of communicating with the server. The parent's device communicates with the server to register and update information about the child's school route and range of movement.
[0423] tag
[0424] The tag is a small device worn by children and is equipped with a GPS module, a communication module, a generative AI, and an emotion engine. The tag transmits the child's current location to a server, and the emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state.
[0425] server
[0426] The server is a central computer system that manages all communications. It receives and analyzes location information from communication devices and tags, and notifies users in the event of an abnormality. It also controls the generative AI and emotion engine, calculating and sending route guidance and appropriate instructions according to the scenario.
[0427] Program processing
[0428] 1. Initialization
[0429] The server synchronizes the parent's communication device with the child's tag, establishing communication between the parent's communication device and the tag. The parent's communication device registers information about the child's school route and range of movement on the server. The hardware used is a smartphone, tablet, and server, and the software is a GPS function and communication module.
[0430] 2. Location monitoring
[0431] The tag periodically acquires its current location information and sends it to the server. The parent communication device also periodically sends its current location information to the server. The hardware used is a GPS module and a communication module, and the data is treated as location information.
[0432] 3. Anomaly Detection
[0433] The server compares the location information of the tag with that of the parent communication device to monitor whether it is within its range of movement. It also calculates the distance between the tag and the communication device and detects an abnormality if it exceeds the set range. The software used is a location information analysis algorithm.
[0434] 4. Generative AI dialogue and guidance
[0435] When the server detects an abnormality, it activates a generative AI and gives instructions to the child interactively via tags. The generative AI uses landmarks to give clear instructions. The software includes a generative AI model and natural language processing.
[0436] 5. Leveraging Emotional Engines
[0437] The tag's built-in emotion engine analyzes a child's tone of voice and facial expressions to recognize their emotional state. If the child expresses anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child. The software includes an emotion analysis algorithm.
[0438] 6. Real-time guidance
[0439] The server calculates the optimal route based on the current location and destination (parent's location or police station), and the generative AI provides appropriate route guidance through tags. The emotion engine adjusts the instructions in real time. The hardware used is a GPS module and a communications module, and the software is a route calculation algorithm.
[0440] 7. Parental Notification
[0441] The server sends the child's current location, instructions from the generative AI, and the emotional state of the emotion engine to the parent's communication device, allowing the parent to understand the child's status in real time. The software includes a notification system.
[0442] 8. Emergency Response
[0443] If the abnormality persists for a certain period of time, the server sends an emergency notification to a nearby response agency (e.g., a police station). This allows for a prompt local response. The hardware used is a communication module, and the software is an emergency notification system.
[0444] Specific examples
[0445] Scenario: A kindergartener is lost on the playground.
[0446] 1. Initialization
[0447] The parent's communication device and the child's tag are synchronized with the server, and the set range of the play area is registered in advance from the communication device.
[0448] 2. Location monitoring
[0449] The child's tag periodically transmits the location information of the play area to the server, and the parent's communication device also transmits the current location to the server.
[0450] 3. Anomaly Detection
[0451] If the child exceeds the set range, the server detects an abnormality, and an abnormality is also detected if the distance between the tag and the parent's communication terminal exceeds a certain range.
[0452] 4. Generative AI dialogue and guidance
[0453] When the server detects an abnormality, it activates the generative AI and issues instructions via the child's tag, such as "Next, turn right and go towards the blue bench."
[0454] 5. Leveraging Emotional Engines
[0455] The emotion engine analyzes the child's anxiety, and the generative AI gives another instruction in a gentle tone: "Don't worry, let's go together to the blue bench."
[0456] 6. Real-time guidance
[0457] The server calculates the optimal route based on the child's current location and the parent's location, and the generative AI guides the child using specific landmarks.
[0458] 7. Parental Notification
[0459] The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the analysis results of the emotion engine, allowing the parent to check the child's location on a map in real time.
[0460] 8. Emergency Response
[0461] If the child does not follow the designated route or the abnormality persists, the server sends an emergency notification to the nearest police station, which then takes action on-site.
[0462] Example prompts for generative AI models
[0463] "Please explain in detail the processing steps of a system that links a parent's communication device with a child's tag, and uses a generative AI to guide the child in a dialogue format when the child strays from a set range of movement, and an emotion engine to provide a sense of security."
[0464] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0465] Step 1: Initialization
[0466] Operational description: The server synchronizes the parent's communication device with the child's tag. It requires information from the parent's communication device and the child's tag as input, and provides the status of established communication as output. The parent uses the communication device to register the school route and range of activities, and sends that information to the server.
[0467] Data processing and calculation: The server analyzes the information on the school route and range of movement received from the parent's communication device and stores it in a database. This makes it possible to compare location information in a later step.
[0468] Specific operation: The user (parent) operates the smartphone app, sets the school route and area of movement on a map, and sends that information to the server.
[0469] Step 2: Location Monitoring
[0470] Operation: The tag periodically acquires its current location information and sends it to the server. The parent communication device also sends its current location information to the server. Location information from GPS is required as input, and location data is sent to the server as output.
[0471] Data processing and calculation: The server receives the location information sent from the tag and communication terminal and records it in a database. This information is then used in the subsequent anomaly detection step.
[0472] How it works: The tag uses a GPS module to obtain its current location every five minutes and sends the data to a server. The parent's smartphone also sends the location information at the same interval.
[0473] Step 3: Anomaly detection
[0474] Operation: The server compares the location information of the tag with that of the parent communication device, and monitors whether the tag is within its range. It also calculates the distance between the tag and the communication device, and detects an abnormality if it exceeds the set range. Location information is required as input, and the result of the abnormality detection is output.
[0475] Data processing and calculation: The server calculates the distance based on the location information, compares it with the set movement range, and executes an algorithm to detect abnormalities.
[0476] Specific operation: The server receives location information, calculates the distance between the tag and the parent communication device, and detects an abnormality if it exceeds 100 meters.
[0477] Step 4: Generative AI dialogue and guidance
[0478] Operation: When the server detects an abnormality, it activates the generative AI and gives instructions to the child in an interactive format via tags. The generative AI uses landmarks to give easy-to-understand instructions. The inputs required are the results of the anomaly detection and current location information, and the output is the instructions.
[0479] Data processing and calculation: Generative AI generates appropriate interactive instructions based on the results of anomaly detection and location information.
[0480] Specific operation: The server guides the user through tags, saying, "Next, turn right and head towards the blue bench."
[0481] Step 5: Leverage the Emotion Engine
[0482] How it works: The tag's built-in emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state. If the child expresses anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child. The input requires the child's emotional data, and the output is adjusted instructions.
[0483] Data processing and calculation: The emotion engine evaluates emotions through voice and facial expression analysis and provides that information to the generative AI.
[0484] Specific operation: The emotion engine analyzes Taro's anxiety, and the generative AI gives another instruction in a gentle tone, saying, "Don't worry, let's go together to the blue bench."
[0485] Step 6: Real-time guidance
[0486] Operation: The server calculates the optimal route based on the current location and destination (parent's location or police box), and the generative AI provides appropriate route guidance through tags. The emotion engine adjusts the instructions in real time. Current location information and destination information are required as input, and the optimal route is output.
[0487] Data processing and calculation: The server uses the current location and destination location information to calculate the optimal route. The generative AI also adjusts the instructions based on the emotion engine's evaluation.
[0488] Specific operation: The server calculates the optimal route and gives specific instructions such as, "Turn left at the next corner, then go straight and you will see a blue bench."
[0489] Step 7: Parental Notification
[0490] Operation: The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the emotional state of the emotion engine. The inputs required are the child's current location and the instructions of the generative AI, and the output is the notification content.
[0491] Data processing and calculation: The server aggregates this information and sends a notification to the parent communication device.
[0492] Specific operation: The server sends a notification to the mother's smartphone, displaying a message saying, "Taro is currently heading towards the blue bench. He seems anxious, so please speak to him."
[0493] Step 8: Emergency response
[0494] Operational Description: If an anomaly is not resolved for a certain period of time, the server sends an emergency notification to a nearby responding agency (e.g., police station). It requires unresolved anomaly data as input and an emergency notification as output.
[0495] Data processing and calculation: If the abnormality is not resolved within a certain period of time, the server formats the information as an emergency notification and sends it to the appropriate agency.
[0496] Specific operation: The server sends an emergency notification to the nearest police station saying, "Taro is lost near the blue bench. Please help."
[0497] In this way, the system performs specific data processing and calculations at each step, ensuring children's safety in real time and providing parents with peace of mind.
[0498] (Application example 2)
[0499] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0500] In recent years, there has been an increase in the number of occasions where parents and children enjoy shopping together at shopping malls and large stores, but at the same time, there are also many cases of children getting lost. While conventional child-loss prevention systems can track a child's location, they do not provide sufficient emotional support, making it difficult to completely alleviate the anxiety of lost children. There is also a need for technology that can quickly and accurately guide children back to their parents within the store. Furthermore, there is also a need for a system that can take emergency action if the abnormality cannot be resolved.
[0501] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0502] In this invention, the server is provided with a tag for the child synchronized with the parent's communication terminal, and includes means for the tag to transmit location information of the current location, means for the communication terminal to register the school route and range of activities, means for the server to receive location information from the tag and the communication terminal and detect an abnormality if the distance exceeds a certain distance or if the child deviates from the designated range of activities, means for the server to start a generative AI and give instructions to the child in an interactive format via the tag when the server detects an abnormality, means for the server to calculate an optimal route from the current location and destination and transmit the calculated route to the tag, and means for the generative AI to guide the child using specific landmarks based on the optimal route. The system includes a means for detecting an abnormality, a means for the tag to be equipped with an emotion engine that analyzes the child's tone of voice and facial expressions to recognize emotions and adjust the instructions, a means for the server to notify the parent's communication device of the child's current location, the instructions of the generative AI, and the emotion state of the emotion engine, a means for the server to send an emergency notification to nearby response agencies if the abnormality is not resolved within a specified period of time, a means for the parent's communication device to monitor and report the location information of the parent and child and a set range of movement within the shopping area, a means for the generative AI to provide directions to the child based on specified landmarks, and a means for the server to send an emergency notification to in-store staff if an abnormality occurs. This allows a lost child to be quickly and safely guided to their parent, reducing the child's anxiety in the process and enabling appropriate action to be taken in an emergency.
[0503] The "parent's communication terminal" is a device that communicates with the child's tag, registers the child's route to school and range of activities, and transmits location information to a server.
[0504] A "child tag" is a small device worn by a child that transmits their current location and is equipped with a generative AI and emotion engine.
[0505] "Location information" is information indicating a current geographical location obtained using technology such as GPS.
[0506] The "server" is a central computer system that analyzes location information received from communication terminals and child tags, and performs abnormality detection, generates instructions, and sends emergency notifications.
[0507] The "means for detecting abnormalities" is a method for monitoring the location information sent from the child's tag and the parent's communication device, and recognizing an abnormality if the child exceeds a certain distance or goes outside a designated range of movement.
[0508] "Generative AI" is an artificial intelligence technology that activates when an abnormality is detected and gives instructions to the child in an interactive format.
[0509] The "Emotion Engine" is a technology that analyzes a child's tone of voice and facial expressions, recognizes their emotions, and adjusts the content of their instructions accordingly.
[0510] "Optimal Route" is a method for calculating the most efficient and safe route from your current location to your destination.
[0511] A "landmark" is a geographic or visual landmark used for navigation or direction.
[0512] An "emergency notification" is warning information that is sent to nearby response agencies and store staff if the abnormality is not resolved.
[0513] A "shopping area" is an area that includes commercial facilities and stores that parents and children are expected to visit.
[0514] "In-store staff" refers to employees who work in the store to respond to emergencies.
[0515] The system for implementing the present invention utilizes a parent's communication terminal, a child's tag, and a server. The detailed configuration and processing for implementation will be described below.
[0516] Hardware and Software
[0517] 1. Hardware:
[0518] Parent's communication device: A smartphone or tablet with GPS functionality that can communicate with the server.
[0519] Kid's Tag: A small device equipped with a GPS module, a communication module, a generative AI, and an emotion engine.
[0520] Server: A cloud-based central computer system that receives and analyzes data from communication devices and child tags.
[0521] 2. Software:
[0522] Generative AI model (e.g. GPT-4): Activated when an anomaly is detected, it provides instructions to the child in a dialogue format.
[0523] Emotion Engine: Using a voice emotion analysis model, it recognizes emotions by analyzing the child's tone of voice and facial expressions.
[0524] Server program: Performs communication management, location information analysis, anomaly detection, and notification management.
[0525] Data processing and calculation procedures
[0526] 1. Initialization:
[0527] The server synchronizes the parent's communication device with the child's tag, establishing communication and registering the set school route and range of movement information on the server.
[0528] 2. Location Monitoring:
[0529] The child's tag periodically sends its current location information to the server, and the parent's communication device also periodically sends its current location information to the server.
[0530] 3. Anomaly detection:
[0531] The server compares the tag's location information with that of the parent communication device and detects an abnormality if the tag exceeds a set range or a certain distance.
[0532] 4. Generative AI dialogue and guidance:
[0533] If an anomaly is detected, the generative AI will provide interactive instructions through the child's tag, using specific landmarks to guide the child in the appropriate direction.
[0534] Example: "If your child gets lost, you can tell them to walk straight from where they are and head towards the yellow sign."
[0535] 5. Leveraging the Emotion Engine:
[0536] The emotion engine analyzes the child's tone of voice and facial expressions to recognize emotions such as anxiety, and the generative AI reissues instructions in a gentler tone depending on the recognized emotion.
[0537] Example: "If your child seems anxious, give them a gentle reminder, 'It's okay, I'm here for you.'"
[0538] 6. Real-time guidance:
[0539] The server calculates the optimal route based on the current location and destination, and the generation AI guides the child using specific landmarks.
[0540] 7. Parental Notice:
[0541] The server sends the child's current location, the instructions of the AI generator, and the emotional state of the emotion engine to the parent's communication device, allowing the parent to check the child's location in real time on their smartphone screen.
[0542] 8. Emergency Response:
[0543] If the abnormality is not resolved within a certain period of time, the server will send an emergency notification to nearby response agencies and store staff to take prompt action.
[0544] Prompt Sentence Examples
[0545] "Please give gentle instructions to a lost child to help them avoid getting lost. The child's name is ____. They are currently in the central plaza of the shopping area. There is a yellow sign nearby."
[0546] This system allows parents and children to move around safely in shopping malls and large stores, and enables swift and appropriate action to be taken if a child gets lost. By using generative AI and an emotion engine, it is possible to reduce a child's anxiety and safely guide them back to their parents.
[0547] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0548] Step 1:
[0549] Initialization:
[0550] The server synchronizes the parent's communication device with the child's tag. Information about the school route and activity range is registered on the server from the parent's communication device. The input is the school route and activity range information from the parent's communication device, and the output is that information is saved on the server. This establishes communication between the server and the device.
[0551] Step 2:
[0552] Location Monitoring:
[0553] The child's tag periodically acquires its current location information and sends it to the server. In addition, the parent's communication device also periodically sends its current location information to the server. The input is location information from the tag and communication device, and the output is that location information is aggregated on the server. The server uses this data to monitor the location in real time.
[0554] Step 3:
[0555] Anomaly detection:
[0556] The server compares the location information of the tag with that of the parent communication device, and detects an abnormality if the tag goes beyond the set movement range or a certain distance. The input is the location information from the tag and communication device, and the set movement range information, and the output is the result of the abnormality detection. The server processes this and determines whether an abnormality has occurred.
[0557] Step 4:
[0558] Generative AI dialogue and guidance:
[0559] If an anomaly is detected, the server activates the generation AI and provides interactive instructions via the child's tag. Specific landmarks are used to guide the child in the appropriate direction. The input is the detected anomaly and the child's current location, and the output is instructions generated by the generation AI. The generation AI processes this information and provides instructions in a format that is easy for the child to understand.
[0560] Step 5:
[0561] Leveraging the Emotion Engine:
[0562] The emotion engine analyzes the child's tone of voice and facial expression data sent from the tag to recognize emotions such as anxiety. Based on the recognition results, the generation AI adjusts the instructions and issues them again in a gentler tone. The input is the emotional data analyzed by the emotion engine, and the output is the adjusted instructions. The emotion engine analyzes this data and provides feedback to the generation AI.
[0563] Step 6:
[0564] Real-time guidance:
[0565] The server calculates the optimal route based on the current location and destination, and the generation AI guides the child using specific landmarks. The input is the current location and destination location information, and the output is navigation instructions. The server calculates the route and provides the information to the generation AI.
[0566] Step 7:
[0567] Parental Notice:
[0568] The server notifies the parent's communication device of the child's current location, the instructions from the generation AI, and the emotional state of the emotion engine. The input is the child's location, the instructions from the generation AI, and the analysis results from the emotion engine, and the output is the notification content. The server sends this to the parent's communication device in real time.
[0569] Step 8:
[0570] Emergency Response:
[0571] If the abnormality persists for a certain period of time, the server sends an emergency notification to nearby response agencies and store staff. The input is information indicating that the abnormality has not been resolved, and the output is an emergency notification. Based on this, the server initiates an emergency response and requests prompt support.
[0572] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0573] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0574] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0575] [Second embodiment]
[0576] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0577] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0578] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0579] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0580] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0581] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0582] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0583] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0584] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0585] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0586] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0587] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0588] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[0589] The system configuration will be explained in the following steps.
[0590] System configuration
[0591] communication terminal
[0592] This is a device that the parent has, typically a smartphone or tablet. This device has a GPS function and is capable of communicating with a server.
[0593] The parent's communication device communicates with the server to register and update information about the school route and range of movement.
[0594] tag
[0595] The tag is a small device worn by children and contains a GPS module and a communication module, which transmits the child's current location information to a server.
[0596] The tag is equipped with generative AI and has the ability to give instructions to children in an interactive format.
[0597] server
[0598] This is the central computer system that manages all communications. The server receives and analyzes location information from communication terminals and tags, and notifies users in the event of an abnormality.
[0599] The server also controls the generative AI, calculating and sending route guidance and appropriate instructions depending on the scenario.
[0600] Program processing
[0601] 1. Initialization
[0602] The server synchronizes the parent's communication device with the child's tag.
[0603] The communication terminal registers the school route and movement range data in the server.
[0604] 2. Location monitoring
[0605] The tag periodically transmits its location information to the server.
[0606] The parent's communication device also periodically sends location information to the server.
[0607] 3. Anomaly Detection
[0608] The server detects an "abnormality" if the tag is outside the set movement range or if the distance between the parent communication terminal and the tag exceeds a certain range.
[0609] 4. Generative AI dialogue and guidance
[0610] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[0611] The server calculates the optimal route from the current location to the destination (the location of the parent's communication device or the nearest police box).
[0612] 5. Real-time guidance
[0613] The generative AI guides the child in real time, showing them specific landmarks through the tag's built-in speakers and display.
[0614] 6. Parental Notification
[0615] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[0616] 7. Emergency Response
[0617] If the abnormality is not resolved within a certain period of time, the server sends an emergency notification to a nearby response agency (e.g., a police box).
[0618] Specific examples
[0619] Scenario: A kindergartener named Taro is about to get lost while playing.
[0620] 1. Initialization
[0621] Taro's mother's communication device and Taro's tag are synchronized with the server, and Taro's range of activities, including kindergarten and play areas, is registered in advance on the server from his mother's communication device.
[0622] 2. Location monitoring
[0623] Taro's tag continues to periodically send location information from the play area to the server.
[0624] The mother's communication device also sends her current location to the server.
[0625] 3. Anomaly Detection
[0626] The server detects when Taro leaves the play area. If the tag becomes too far from his mother's communication device, this is also detected as an abnormality.
[0627] 4. Generative AI dialogue
[0628] When the server detects an abnormality, it immediately activates the generative AI and sends instructions through Taro's tag, such as, "Taro, you've left the playground. Next, try going to that blue bench."
[0629] 5. Real-time guidance
[0630] The server calculates the optimal route based on Taro's current location and the location of his mother's communication device, and the generative AI guides Taro using specific landmarks.
[0631] 6. Parental Notification
[0632] The server also sends a notification to the mother's communication device, displaying Taro's location and current instructions in real time.
[0633] 7. Emergency Response
[0634] If Taro does not follow the specified route or the abnormality persists, the server will send an emergency notification to the nearest police station.
[0635] In this way, the lost child prevention system of the present invention can automatically detect children before they get lost and safely guide them back to their parents or a designated safe place.
[0636] The processing flow will be explained below.
[0637] Step 1:
[0638] Communication device (parent's smartphone)
[0639] A parent uses their smartphone to synchronize their child's tag with the server, which establishes communication between the parent's smartphone and the tag.
[0640] Step 2:
[0641] Communication device (parent's smartphone)
[0642] Parents register information about their child's school route and range of movement on the server from their smartphones, which then sets up an area where the child can move around safely.
[0643] Step 3:
[0644] Terminal (tag)
[0645] The tag's GPS function is turned on and periodically retrieves its current location, which is continuously stored in the background.
[0646] Step 4:
[0647] Terminal (tag), server
[0648] The tag sends its current location to the server at regular intervals (e.g., every 30 seconds). The server receives the location information sent from the tag and stores it in a database.
[0649] Step 5:
[0650] Device (parent's smartphone)
[0651] The parent's smartphone also periodically sends its current location to the server, which uses this data to calculate the distance to the child's location.
[0652] Step 6:
[0653] server
[0654] The server compares the location information of the tag with that of the parent's smartphone to monitor whether it is within range, and also calculates the distance between the tag and the communication terminal.
[0655] Step 7:
[0656] server
[0657] The server detects an abnormality if the tag goes beyond its set range of movement or if the distance between the tag and the parent's smartphone exceeds a certain range.
[0658] Step 8:
[0659] server
[0660] When the server detects an abnormality, it activates the generative AI module and sends an abnormality notification and instructions to the tag.
[0661] Step 9:
[0662] Terminal (tag)
[0663] When the tag receives an abnormality notification, its generative AI activates and begins giving instructions to the child in a conversational format, such as, "Hanako, it looks like you've taken a wrong turn. Next time, turn right and go to the green and light blue convenience store."
[0664] Step 10:
[0665] server
[0666] The server calculates the optimal route based on the current location and destination (parent's location or police station), and this route information is generated in real time.
[0667] Step 11:
[0668] server
[0669] The server sends the calculated optimal route information to the tag. When the tag receives this information, the generative AI continues the route guidance. Example: "Next, try heading for the red post you see on the right."
[0670] Step 12:
[0671] server
[0672] The server continues to monitor the interaction between the tag and the parent's smartphone in real time, and responds again if the situation changes or new abnormalities occur.
[0673] Step 13:
[0674] server
[0675] The server sends the child's current location information and instructions from the generative AI to the parent's smartphone via push notification.
[0676] Step 14:
[0677] Device (parent's smartphone)
[0678] The parent's smartphone can check the child's location on a map in real time and can send additional instructions to the server if necessary.
[0679] Step 15:
[0680] server
[0681] If the abnormality persists for a certain period of time, the server sends an emergency notification to the nearest police box, which then coordinates an emergency response based on the notification.
[0682] Step 16:
[0683] server
[0684] After receiving confirmation from the police station, the server notifies the tag and the parent's smartphone of the latest information and decides on further action.
[0685] Example 1
[0686] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0687] Conventional child loss prevention systems require parents to manually track their children's location information, making it difficult to respond in real time. Furthermore, they lack the ability to respond quickly when a child leaves a designated area, or to immediately notify parents when an abnormality occurs. Therefore, a system that provides complete peace of mind is needed.
[0688] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0689] In this invention, the server includes a means for notifying the parent's communication device of the child's current location information and the generative AI's instructions in real time, a means for the generative AI to issue specific instructions to the child via a speaker or display equipped on the tag, and a means for the parent's communication device to display the notification received from the server via an application. This allows the system to quickly detect when the child moves outside of their range of movement and use the generative AI to guide them in real time. In addition, in the event of an abnormality, the system can quickly notify the parent or response agency, ensuring the child's safety.
[0690] A "parental communication device" is a device owned by a parent and used to monitor and receive location information about a child, typically a mobile device such as a smartphone or tablet.
[0691] A "child tag" is a small device that a child carries and is equipped with a GPS module and a communication module for transmitting current location information.
[0692] "Location Information" means geographic location data determined using a positioning system such as GPS.
[0693] A "communication terminal" is a terminal used for data communication, and is usually a device such as a smartphone, tablet, or PC.
[0694] "School route and range of movement" refers to the geographical area within which a child is permitted to travel, as defined and registered in advance by the parent.
[0695] The "server" is a central computer system that manages communication between multiple devices, receives and analyzes location information, and controls the generative AI.
[0696] The "certain distance" is a distance set between the parent's communication terminal and the child's tag that is recognized as being outside the range of movement.
[0697] An "abnormality" is a situation that is detected when a child's tag goes outside the set range of movement or exceeds a certain distance.
[0698] "Generative AI" is a system that uses artificial intelligence technology to give children interactive instructions, such as an AI model that provides route guidance or responds to abnormal situations.
[0699] "A means of giving interactive instructions" is a function that allows the generative AI to give specific instructions to children via tags.
[0700] An "optimal route" is a calculated shortest or safest route from your current location to your destination.
[0701] "Landmarks" are buildings or objects that serve as landmarks used to guide children.
[0702] "Means for notifying in real time" is a function that allows the server to immediately notify the parent communication terminal of any abnormalities or the current situation.
[0703] An "emergency notification" is an emergency alert sent to nearby response agencies if the abnormality is not resolved within a certain period of time.
[0704] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[0705] Equipment and software configuration
[0706] Parent's communication device:
[0707] The communication devices held by parents are smartphones or tablets. These devices have GPS functionality and are capable of data communication with a server. The communication devices must have an application installed to register information about the school route and range of movement.
[0708] Kids Tags:
[0709] The tag is a small device worn by a child and is equipped with a GPS module and a communication module. The tag transmits the current location information to a server. Furthermore, the tag is equipped with a generative AI that can give instructions to the child in an interactive format. The tag also has a speaker and a display that are used to communicate the generative AI's instructions to the child.
[0710] server:
[0711] The server is a central computer system that manages all communications. It receives and analyzes location information from communication devices and tags, and notifies users in the event of an abnormality. It also controls the generative AI, calculating and sending route guidance and appropriate instructions according to the scenario.
[0712] Process Overview
[0713] 1. Initialization
[0714] The server synchronizes the parent's communication device with the child's tag, and the parent uses the communication device to register data about the child's school route and range of activities on the server.
[0715] 2. Location monitoring
[0716] The child's tag periodically transmits its location information to the server, and the parent's communication device also transmits its current location information to the server.
[0717] 3. Anomaly Detection
[0718] The server analyzes the transmitted location information and detects abnormalities if the tag moves outside the set range of movement or if the distance between the parent communication terminal and the tag exceeds a certain range.
[0719] 4. Generative AI dialogue and guidance
[0720] If an abnormality is detected, the server activates a generative AI that gives interactive instructions to the child via the tag.
[0721] 5. Real-time guidance
[0722] The server calculates the optimal route from the current location to the destination, and the generative AI gives the child instructions using specific landmarks, e.g., "Walk toward the next blue bench you see."
[0723] 6. Parental Notification
[0724] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[0725] 7. Emergency Response
[0726] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to a nearby responding agency (e.g., the police station).
[0727] Specific examples
[0728] Scenario: A kindergarten-aged child is about to get lost while playing.
[0729] 1. Initialization
[0730] The parent's communication device (smartphone) and the child's tag are synchronized with the server. The parent's communication device registers the child's favorite kindergarten and play areas in advance on the server.
[0731] 2. Location monitoring
[0732] The child's tag periodically sends location information from the playground to a server, and the parent's device also sends their current location to the server.
[0733] 3. Anomaly Detection
[0734] The server detects if the child leaves the play area or if the distance between the tag and the parent's communication device exceeds a set range.
[0735] 4. Generative AI dialogue
[0736] When the server detects an abnormality, the generative AI is activated and issues instructions via tags, such as, "You've left the playground. Next, try going to that blue bench."
[0737] 5. Real-time guidance
[0738] The server calculates the optimal route from the child's current location to the location of the parent's communication device, and the generative AI guides the child using specific landmarks.
[0739] 6. Parental Notification
[0740] The server sends a notification to the parent's communication device, displaying the child's location and the instructions of the generative AI in real time.
[0741] 7. Emergency Response
[0742] If the child does not follow the designated route or the abnormality persists, the server will send an emergency notification to the nearby police station or police box.
[0743] Example input to a generative AI model
[0744] Below are some example prompts to input to a generative AI model:
[0745] For example: "Child is out of range. Please guide them to the next landmark. For example, 'Let's try that blue bench next.'"
[0746] The above is a specific embodiment for carrying out the invention. This system ensures the safety of children and reduces parental anxiety.
[0747] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0748] Step 1: Initialization
[0749] The server synchronizes the parent's communication device with the child's tag, and data on the parent's school route and range of movement is sent from the communication device to the server.
[0750] How it works: Parents use their communication devices to enter information about their child's range of activities, such as the route to school and playgrounds, into a dedicated application, and then upload the data to a server, which then stores this information in a database.
[0751] Input: School route and movement range data sent from parent's communication device.
[0752] Output: Home range information stored in a database.
[0753] Step 2: Location Monitoring
[0754] The tag periodically acquires its location information from GPS and sends it to the server. The parent's communication device also periodically sends its current location information to the server.
[0755] Specific operation: The tag and the parent communication device activate their respective GPS functions to obtain their current location information, which is then sent to the server via the communication module.
[0756] Input: Location information sent from the tag and parent communication device.
[0757] Output: Location data collected on the server.
[0758] Step 3: Anomaly detection
[0759] The server analyzes the location information sent from the tag and the parent's communication device and detects abnormalities if the tag moves out of its range or exceeds a certain distance.
[0760] How it works: The server analyzes the location information in real time and compares it with the movement range data stored in the database. If the device goes out of range or exceeds a certain distance, an anomaly flag is raised and an abnormality is detected.
[0761] Input: Location information sent from the tag and parent communication device.
[0762] Output: Anomaly flag and anomaly detection notification.
[0763] Step 4: Generative AI dialogue and guidance
[0764] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[0765] Specific operation: The server inputs prompt text into the generative AI, generates appropriate instructions, and sends the generated instructions to the tag, which then communicates them to the child via a speaker or display.
[0766] Input: Abnormal flag, prompt for the generative AI.
[0767] Output: Specific instructions for the child.
[0768] Step 5: Real-time guidance
[0769] Based on the instructions sent to the tag, the generative AI guides the child in real time using specific landmarks via speakers and displays.
[0770] How it works: The server calculates the optimal route from the current location to the destination and sends it back to the generative AI. The generative AI then generates instructions, such as "Walk towards the next blue bench you see," and sends them to the tag. The tag then relays this to the child via a speaker or display.
[0771] Input: Current location, destination, and prompt for the generative AI.
[0772] Output: Specific instructions using landmarks.
[0773] Step 6: Parental Notification
[0774] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[0775] How it works: The server sends the child's current location and the instructions of the generative AI to the parent's device, who can then view this information through a dedicated application.
[0776] Input: Current child location, instructions for the generative AI.
[0777] Output: Real-time notification to parent's communication device.
[0778] Step 7: Emergency response
[0779] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to nearby response agencies.
[0780] Specific operation: If the abnormality is not resolved within the set time, the server will send an emergency notification to pre-registered nearby response agencies (e.g., police stations, police boxes). The emergency notification will include the child's current location and details of the abnormality.
[0781] Input: Abnormal condition, time information.
[0782] Output: Emergency notification to responding agencies.
[0783] The above is a detailed flow of the program processing of this system.
[0784] (Application example 1)
[0785] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0786] Previous child location monitoring systems lacked sufficient measures to deal with situations where a child went outside the child's range, and had limited functionality for notifying parents of accurate location information in real time. As a result, there were problems with children becoming lost or falling into dangerous situations. Furthermore, there was a lack of specific instructions for children when an abnormality occurred, and appropriate responses in emergencies.
[0787] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0788] In this invention, the server is equipped with a tag for the child that is synchronized with the parent's communication terminal, and includes means for the tag to transmit location information of the current location, means for the parent's communication terminal to register the school route and range of activities, means for the server to receive location information from the tag and the communication terminal and detect an abnormality if the distance exceeds a certain distance or the designated range of activities, means for the server to activate a generative AI and give interactive instructions to the child via the tag when the server detects an abnormality, means for the server to calculate an optimal route from the current location and destination and send it to the tag, means for the generative AI to guide the child based on the optimal route using specific landmarks, means for the server to monitor and notify interactions between the tag and communication terminal in real time, means for the server to send an emergency notification to nearby response agencies if the abnormality is not resolved within a certain period of time, and means for the generative AI to explain the abnormal situation to the child interactively and give instructions based on specific landmarks. This allows for rapid detection of abnormalities even if a child goes outside the child's range, and specific instructions and guidance can be given using generative AI, enabling real-time notifications to parents and rapid emergency notifications to nearby response agencies.
[0789] A "parent's communication device" is a device with communication capabilities owned by the parent, and is primarily a smartphone or tablet.
[0790] A "child tag" is a small device worn by a child that is equipped with a GPS module and a communication module and has the ability to transmit current location information.
[0791] The "server" is a centralized management system that receives location information from communication terminals and tags, and analyzes and issues instructions.
[0792] "Generative AI" refers to generative artificial intelligence that has the ability to generate sentences and images and interact with users.
[0793] "A means of giving instructions in an interactive format" refers to a system in which the generative AI provides guidance and instructions to children via voice or text.
[0794] "Means for calculating optimal route" refers to a function that executes an algorithm to calculate the most efficient and safe route based on information about the current location and destination.
[0795] A "landmark" is a building, place, or object that serves as a landmark for children.
[0796] "Means for real-time monitoring and notification" refers to a function in which the server constantly checks location information and immediately notifies if an abnormality occurs.
[0797] "Emergency notification" is a system that quickly contacts pre-registered response organizations when a crisis situation occurs.
[0798] MODE FOR CARRYING OUT THE INVENTION
[0799] System Configuration
[0800] To implement this invention, a parent's communication terminal (smartphone), a child's tag device, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[0801] Hardware
[0802] Parent's communication device: Smartphone or tablet (with GPS and communication functions)
[0803] Child tag device: A device equipped with a GPS module and a communication module
[0804] Server: Cloud platform (e.g., Amazon Web Services (AWS), Microsoft Azure)
[0805] software
[0806] Generative AI: Generative AI such as OpenAI GPT-4 and GPT-3.5
[0807] Server management software: location analysis and notification system
[0808] Program processing description
[0809] The server receives location information, detects abnormalities, activates the generative AI, and performs a series of processes including real-time instructions and notifications, making it possible to detect and respond to abnormalities when a child goes outside the set range of movement.
[0810] 1. Receiving and registering location information
[0811] The parent's communication terminal registers data on the school route and range of movement on the server.
[0812] The child's tag device and the parent's communication terminal periodically transmit location information to a server.
[0813] 2. Anomaly detection and generative AI activation
[0814] The server analyzes the data and detects an abnormality if the tag goes beyond its range or exceeds a certain distance.
[0815] When an abnormality is detected, the server activates a generative AI and issues specific instructions to the child via the tag.
[0816] 3. Optimal route calculation and guidance
[0817] The server calculates the optimal route based on the current location and destination.
[0818] Generative AI guides children using specific landmarks.
[0819] 4. Real-time monitoring and notification
[0820] The server monitors the data between the tag and the parent's communication terminal in real time and notifies the parent in the event of an abnormality.
[0821] If the anomaly persists for a certain period of time, the server will send an emergency notification to nearby response agencies.
[0822] Example: Measures to prevent children from getting lost in the store
[0823] For example, while shopping at a mall, a parent launches the "Kids Secure" app and sets a range of movement. If the child goes outside the set range within the store, the tag notifies the server of the abnormality, and the server activates the generative AI. The generative AI then gives the child instructions in a dialogue format, as follows:
[0824] Generative AI interaction with children:
[0825] "○○-kun, you have exceeded the mall's set range. Please return to the elevator."
[0826] Parental Notice:
[0827] "○○ has gone out of range. He is currently near the elevator on Floor B."
[0828] This system allows for a quick response in the event of a child going missing, ensuring parents and responding authorities are notified quickly.
[0829] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0830] Step 1:
[0831] The server initializes and synchronizes the parent's communication device and the child's tag. It receives data on the school route and activity range from the parent's communication device and registers this on the server. The input is the school route and activity range data sent from the parent's communication device, and the output is storage in the server's registration database. Specifically, the parent's communication device sends GPS setting information to the server, which stores it in the database.
[0832] Step 2:
[0833] The server periodically receives location information from the child's tag device and the parent's communication terminal. The input is the location information sent from the tag device and the parent's communication terminal, and the output is the storage of the received location information in the server. In this process, the tag device and the parent's communication terminal periodically send location information to the server, which then stores it in a database.
[0834] Step 3:
[0835] The server analyzes the received location information in real time and detects an anomaly if the tag goes beyond the set movement range or if the distance between the tag and the communication terminal exceeds a certain range. The input is the location information stored on the server, and the output is the anomaly detection result. Specifically, an algorithm in the server analyzes the location information and checks for deviation from the movement range or excess distance.
[0836] Step 4:
[0837] When the server detects an abnormality, it activates the generative AI and gives interactive instructions to the child via the tag device. The input is the abnormality detection result, and the output is the instructions created by the generative AI. The generative AI generates a prompt such as "Taro, move from your current position to the blue bench" and sends it to the tag device.
[0838] Step 5:
[0839] The server uses generative AI to calculate the optimal route based on the current location and destination. The input is current location information from the child's tag device and the parent's communication device, and the output is the calculated optimal route. In this process, the server calculates the route using GPS data for the current location and destination and sends it to the tag device.
[0840] Step 6:
[0841] The generative AI guides the child along the calculated optimal route, using specific landmarks. The input is the calculated optimal route and landmark information, and the output is detailed guidance instructions created by the generative AI. Specific landmark instructions, such as "Next, turn right in front of that red postbox," are displayed on the tag device or sent via voice.
[0842] Step 7:
[0843] The server monitors the exchange between the tag device and the parent's communication terminal in real time, and notifies the parent in the event of an abnormality. The input is the location information received in real time and the abnormality detection results, and the output is the notification content to the parent. In concrete terms, the server notifies the parent's communication terminal, for example, "Taro has exceeded the set range. His current location is near the elevator on floor B."
[0844] Step 8:
[0845] If the abnormality is not resolved for a certain period of time, the server will send an emergency notification to a nearby response agency. The input is the result of continuous abnormality detection, and the output is the content of the emergency notification to the nearby response agency. Specifically, the server automatically notifies the response agency based on the registered emergency contact information, saying, "The child has exceeded the set range and the abnormality continues. The current location is ____."
[0846] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0847] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays and processes data between the devices are required. Furthermore, the tag must be equipped with a generative AI and an emotion engine.
[0848] The system configuration is explained as follows.
[0849] System configuration
[0850] communication terminal
[0851] This is something that parents have, typically a smartphone or tablet. This device has a GPS function and is capable of communicating with a server.
[0852] The parent's communication device communicates with the server to register and update information about the school route and range of movement.
[0853] tag
[0854] The tag is a small device worn by children, equipped with a GPS module, a communication module, a generative AI, and an emotion engine. The tag transmits the child's current location to a server.
[0855] The emotion engine has the ability to analyze a child's tone of voice and facial expressions to recognize their emotions.
[0856] server
[0857] This is the central computer system that manages all communications. The server receives and analyzes location information from communication terminals and tags, and notifies users in the event of an abnormality.
[0858] The server also controls the generative AI and emotion engine, calculating and sending route guidance and appropriate instructions depending on the scenario.
[0859] Program processing
[0860] 1. Initialization
[0861] The server synchronizes the parent communication terminal with the child tag, thereby establishing communication between the parent communication terminal and the tag.
[0862] Information about the school route and range of movement is registered on the server from the communication terminal.
[0863] 2. Location monitoring
[0864] The tag periodically obtains its current location and sends it to the server.
[0865] The parent's communication device also periodically sends current location information to the server.
[0866] 3. Anomaly Detection
[0867] The server compares the location information of the tag with that of the parent device, monitors whether it is within its range, and calculates the distance between the tag and the device.
[0868] An abnormality is detected when the tag goes beyond the set movement range or when the distance between the tag and the parent communication terminal exceeds a certain range.
[0869] 4. Generative AI dialogue and guidance
[0870] When the server detects an abnormality, it activates the generative AI and gives the child interactive instructions via tags. The generative AI uses landmarks to give clear instructions.
[0871] 5. Leveraging Emotional Engines
[0872] The tag's emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state, and if they express anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child.
[0873] For example: "Don't worry, Taro. Let's go to where Mommy is. Next, take the path to the right and wait for me at the blue bench at the end."
[0874] 6. Real-time guidance
[0875] The server calculates the optimal route based on the current location and destination (parent's location or police station), and the generative AI provides appropriate route guidance using tags. The emotion engine adjusts the instructions in real time.
[0876] 7. Parental Notification
[0877] The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the emotional state of the emotion engine.
[0878] 8. Emergency Response
[0879] If the abnormality persists for a certain period of time, the server sends an emergency notification to a nearby responding agency (e.g., a police box).
[0880] Specific examples
[0881] Scenario: Kindergartener Taro is about to get lost on the playground.
[0882] 1. Initialization
[0883] The mother's communication device and Taro's tag are synchronized with the server, and the play area setting range is pre-registered on the mother's communication device.
[0884] 2. Location monitoring
[0885] Taro's tag periodically sends location information from the play area to a server.
[0886] The mother's communication device also sends her current location to the server.
[0887] 3. Anomaly Detection
[0888] The server detects when Taro leaves the set range of the play area. An abnormality is also detected when the distance between the tag and the mother's communication device exceeds a certain range.
[0889] 4. Generative AI dialogue
[0890] When the server detects an abnormality, it activates the generative AI and sends instructions through Taro's tag, such as, "Taro, it looks like you've taken the wrong turn. Next time, turn right and head towards the blue bench."
[0891] 5. Leveraging Emotional Engines
[0892] The emotion engine analyzes Taro's tone of voice and recognizes that he is feeling anxious. The generative AI then repeats the instructions in a gentler tone, saying, "Don't worry, Mommy is nearby. Let's go together to the blue bench."
[0893] 6. Real-time guidance
[0894] The server calculates the optimal route based on Taro's current location and his mother's location, and the generative AI guides Taro using specific landmarks.
[0895] 7. Parental Notification
[0896] The server notifies the mother's communication device of Taro's current location, the instructions of the generative AI, and the analysis results of the emotion engine, allowing the mother to check Taro's location on a map in real time.
[0897] 8. Emergency Response
[0898] If Taro does not follow the designated route or if the abnormality is not resolved, the server will send an emergency notification to the nearest police station, which will then work together to ensure Taro's safety.
[0899] In this way, the lost child prevention system of the present invention can automatically detect children before they get lost and use generative AI and an emotion engine to safely guide them back to their parents or a designated safe place.
[0900] The processing flow will be explained below.
[0901] Step 1:
[0902] server
[0903] The server synchronizes the parent's communication device with the child's tag, allowing the parent's communication device and the tag to communicate bidirectionally via the server.
[0904] Step 2:
[0905] Device (parent's smartphone)
[0906] Parents use their smartphones to register information about their school route and range of activities on the server, which allows the system to pre-determine areas and routes where children can safely move around.
[0907] Step 3:
[0908] Terminal (tag)
[0909] The tag's GPS function is activated and periodically retrieves its current location, a process that occurs continuously in the background.
[0910] Step 4:
[0911] Terminal (tag), server
[0912] The tag sends the acquired location information to the server at regular intervals (e.g., every 30 seconds). The server receives the location information sent from the tag and stores it in a database.
[0913] Step 5:
[0914] Device (parent's smartphone)
[0915] The parent's smartphone also periodically sends its current location to the server, which is used to calculate the distance to the child's tag location.
[0916] Step 6:
[0917] server
[0918] The server compares the location information of the tag with that of the parent's smartphone to monitor whether the tag is within the set range of movement, and also calculates the distance between the tag and the parent's communication device.
[0919] Step 7:
[0920] server
[0921] The server detects an abnormality if the tag goes beyond its set range of movement or if the distance between the tag and the parent's smartphone exceeds a certain range.
[0922] Step 8:
[0923] server
[0924] When the server detects an abnormality, it immediately activates the generative AI module and sends an abnormality notification and instructions to the tag.
[0925] Step 9:
[0926] Terminal (tag)
[0927] When the tag receives an abnormality notification, its generative AI activates and begins giving instructions to the child in a conversational format. For example, "Taro, you seem lost. Let's go to the nearest blue bench first."
[0928] Step 10:
[0929] Terminal (tag)
[0930] The tag's built-in emotion engine analyzes the child's tone of voice and facial expressions to recognize their current emotional state. If they express anxiety or fear, the generative AI adjusts its instructions to reassure them. For example: "Don't worry, Taro. Mommy's right there. Let's go together to the blue bench."
[0931] Step 11:
[0932] server
[0933] The server calculates the optimal route based on the tag's current location and the location of the parent's communication device, and sends the information to the tag in real time. Based on this information, the generative AI continues to provide route guidance.
[0934] Step 12:
[0935] Terminal (tag)
[0936] The generative AI uses optimal route information to provide guidance using specific landmarks. For example, "Next, try heading for the red postbox on the right." The emotion engine analyzes the child's reactions and continually adjusts the tone and content of the guidance.
[0937] Step 13:
[0938] server
[0939] The server monitors the interaction between the tag and the parent's smartphone in real time, and if any abnormalities occur again, it responds quickly.
[0940] Step 14:
[0941] server
[0942] The server sends push notifications to the parent's smartphone with the child's current location, instructions from the generative AI, and the results of emotion analysis by the emotion engine.
[0943] Step 15:
[0944] Device (parent's smartphone)
[0945] The parent's smartphone receives a notification, allowing them to see their child's location on a map in real time and send further instructions to the server if necessary.
[0946] Step 16:
[0947] server
[0948] If the abnormality persists for a certain period of time, the server will send an emergency notification to a nearby police station or other appropriate agency, including the child's location and details of the abnormality.
[0949] Step 17:
[0950] server
[0951] After receiving confirmation from the police station or other appropriate agency, the server notifies the tag and the parent's smartphone of the latest situation and coordinates further response.
[0952] In this way, the lost child prevention system of the present invention can detect children before they get lost and safely guide them back to their parents by making full use of generative AI and an emotion engine.
[0953] Example 2
[0954] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0955] Today's children are at increased risk of getting lost on their way to school or at playgrounds. However, it is difficult for parents to keep track of their children's locations at all times, and there is a lack of ways to provide appropriate instructions and reassurance when a child gets lost. There is a need for an efficient and effective system that solves these problems and helps children get to school and out safely.
[0956] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for transmitting location information of the current locations of the parent's communication terminal and the child's tag; means for registering the school route and activity range; means for receiving location information and detecting an abnormality when the child exceeds a certain distance or deviates from the designated activity range; means for activating the generative AI and issuing instructions in an interactive format; means for calculating an optimal route from the current location and destination and transmitting the optimal route to the tag; means for the generative AI to guide the child using specific landmarks based on the optimal route; means for analyzing the child's emotional state using an emotion engine and adjusting the tone and content of the generative AI; means for monitoring and notifying interactions between the tag and communication terminal in real time; and means for transmitting emergency notifications to response agencies. This allows parents to always know their child's location and status while their child safely commutes to school or goes out.
[0957] "Parent's communication device" refers to a device owned by the parent that has GPS functionality and is capable of data communication with the server.
[0958] A "child tag" is a small device worn by a child that is equipped with a GPS module, a communication module, a generative AI, and an emotion engine.
[0959] "Means for transmitting location information" refers to the function of tags or communication terminals to transmit GPS information of their current location to a server.
[0960] "Means for registering school routes and areas of activity" refers to the function by which parents use a communication terminal to set and register information about specific school routes and areas of activity in advance on a server.
[0961] "Means for detecting abnormalities" refers to the function that issues an alarm based on the location information received by the server from the tag or communication terminal if the device exceeds a certain distance or goes outside a specified range of movement.
[0962] "Generative AI" refers to a system that uses artificial intelligence technology to give children interactive instructions and respond according to the situation.
[0963] "A means of giving instructions in an interactive format" refers to the function by which the generative AI gives children clear, specific instructions through tags.
[0964] "Means for calculating the optimal route" refers to the function by which the server calculates the optimal route based on the current location and destination and sends that information to the tag.
[0965] "Means of guidance using landmarks" refers to the function in which the generative AI provides children with specific route guidance using surrounding landmarks.
[0966] The "emotion engine" refers to a system that analyzes a child's tone of voice and facial expressions to recognize their emotional state.
[0967] "Means for analyzing the emotional state and adjusting the tone and content of the generative AI" refers to the function in which the emotion engine analyzes the child's emotions and adjusts the instructions and tone of the generative AI based on the results.
[0968] "Means for monitoring and notifying in real time" refers to the function by which the server monitors the location information and interactions of the tag and communication device in real time and sends notifications to parents.
[0969] "Means for sending an emergency notification to a response agency" refers to a function in which the server sends an emergency notification to a nearby response agency (e.g., a police box) if the abnormality is not resolved within a certain period of time.
[0970] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays and processes data between the devices are required. Furthermore, the tag must be equipped with a generative AI and an emotion engine. The system configuration is explained as follows:
[0971] System configuration
[0972] communication terminal
[0973] These devices are usually smartphones or tablets owned by parents. These devices have GPS functionality and are capable of communicating with the server. The parent's device communicates with the server to register and update information about the child's school route and range of movement.
[0974] tag
[0975] The tag is a small device worn by children and is equipped with a GPS module, a communication module, a generative AI, and an emotion engine. The tag transmits the child's current location to a server, and the emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state.
[0976] server
[0977] The server is a central computer system that manages all communications. It receives and analyzes location information from communication devices and tags, and notifies users in the event of an abnormality. It also controls the generative AI and emotion engine, calculating and sending route guidance and appropriate instructions according to the scenario.
[0978] Program processing
[0979] 1. Initialization
[0980] The server synchronizes the parent's communication device with the child's tag, establishing communication between the parent's communication device and the tag. The parent's communication device registers information about the child's school route and range of movement on the server. The hardware used is a smartphone, tablet, and server, and the software is a GPS function and communication module.
[0981] 2. Location monitoring
[0982] The tag periodically acquires its current location information and sends it to the server. The parent communication device also periodically sends its current location information to the server. The hardware used is a GPS module and a communication module, and the data is treated as location information.
[0983] 3. Anomaly Detection
[0984] The server compares the location information of the tag with that of the parent communication device to monitor whether it is within its range of movement. It also calculates the distance between the tag and the communication device and detects an abnormality if it exceeds the set range. The software used is a location information analysis algorithm.
[0985] 4. Generative AI dialogue and guidance
[0986] When the server detects an abnormality, it activates a generative AI and gives instructions to the child interactively via tags. The generative AI uses landmarks to give clear instructions. The software includes a generative AI model and natural language processing.
[0987] 5. Leveraging Emotional Engines
[0988] The tag's built-in emotion engine analyzes a child's tone of voice and facial expressions to recognize their emotional state. If the child expresses anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child. The software includes an emotion analysis algorithm.
[0989] 6. Real-time guidance
[0990] The server calculates the optimal route based on the current location and destination (parent's location or police station), and the generative AI provides appropriate route guidance through tags. The emotion engine adjusts the instructions in real time. The hardware used is a GPS module and a communications module, and the software is a route calculation algorithm.
[0991] 7. Parental Notification
[0992] The server sends the child's current location, instructions from the generative AI, and the emotional state of the emotion engine to the parent's communication device, allowing the parent to understand the child's status in real time. The software includes a notification system.
[0993] 8. Emergency Response
[0994] If the abnormality persists for a certain period of time, the server sends an emergency notification to a nearby response agency (e.g., a police station). This allows for a prompt local response. The hardware used is a communication module, and the software is an emergency notification system.
[0995] Specific examples
[0996] Scenario: A kindergartener is lost on the playground.
[0997] 1. Initialization
[0998] The parent's communication device and the child's tag are synchronized with the server, and the set range of the play area is registered in advance from the communication device.
[0999] 2. Location monitoring
[1000] The child's tag periodically transmits the location information of the play area to the server, and the parent's communication device also transmits the current location to the server.
[1001] 3. Anomaly Detection
[1002] If the child exceeds the set range, the server detects an abnormality, and an abnormality is also detected if the distance between the tag and the parent's communication terminal exceeds a certain range.
[1003] 4. Generative AI dialogue and guidance
[1004] When the server detects an abnormality, it activates the generative AI and issues instructions via the child's tag, such as "Next, turn right and go towards the blue bench."
[1005] 5. Leveraging Emotional Engines
[1006] The emotion engine analyzes the child's anxiety, and the generative AI gives another instruction in a gentle tone: "Don't worry, let's go together to the blue bench."
[1007] 6. Real-time guidance
[1008] The server calculates the optimal route based on the child's current location and the parent's location, and the generative AI guides the child using specific landmarks.
[1009] 7. Parental Notification
[1010] The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the analysis results of the emotion engine, allowing the parent to check the child's location on a map in real time.
[1011] 8. Emergency Response
[1012] If the child does not follow the designated route or the abnormality persists, the server sends an emergency notification to the nearest police station, which then takes action on-site.
[1013] Example prompts for generative AI models
[1014] "Please explain in detail the processing steps of a system that links a parent's communication device with a child's tag, and uses a generative AI to guide the child in a dialogue format when the child strays from a set range of movement, and an emotion engine to provide a sense of security."
[1015] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1016] Step 1: Initialization
[1017] Operational description: The server synchronizes the parent's communication device with the child's tag. It requires information from the parent's communication device and the child's tag as input, and provides the status of established communication as output. The parent uses the communication device to register the school route and range of activities, and sends that information to the server.
[1018] Data processing and calculation: The server analyzes the information on the school route and range of movement received from the parent's communication device and stores it in a database. This makes it possible to compare location information in a later step.
[1019] Specific operation: The user (parent) operates the smartphone app, sets the school route and area of movement on a map, and sends that information to the server.
[1020] Step 2: Location Monitoring
[1021] Operation: The tag periodically acquires its current location information and sends it to the server. The parent communication device also sends its current location information to the server. Location information from GPS is required as input, and location data is sent to the server as output.
[1022] Data processing and calculation: The server receives the location information sent from the tag and communication terminal and records it in a database. This information is then used in the subsequent anomaly detection step.
[1023] How it works: The tag uses a GPS module to obtain its current location every five minutes and sends the data to a server. The parent's smartphone also sends the location information at the same interval.
[1024] Step 3: Anomaly detection
[1025] Operation: The server compares the location information of the tag with that of the parent communication device, and monitors whether the tag is within its range. It also calculates the distance between the tag and the communication device, and detects an abnormality if it exceeds the set range. Location information is required as input, and the result of the abnormality detection is output.
[1026] Data processing and calculation: The server calculates the distance based on the location information, compares it with the set movement range, and executes an algorithm to detect abnormalities.
[1027] Specific operation: The server receives location information, calculates the distance between the tag and the parent communication device, and detects an abnormality if it exceeds 100 meters.
[1028] Step 4: Generative AI dialogue and guidance
[1029] Operation: When the server detects an abnormality, it activates the generative AI and gives instructions to the child in an interactive format via tags. The generative AI uses landmarks to give easy-to-understand instructions. The inputs required are the results of the anomaly detection and current location information, and the output is the instructions.
[1030] Data processing and calculation: Generative AI generates appropriate interactive instructions based on the results of anomaly detection and location information.
[1031] Specific operation: The server guides the user through tags, saying, "Next, turn right and head towards the blue bench."
[1032] Step 5: Leverage the Emotion Engine
[1033] How it works: The tag's built-in emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state. If the child expresses anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child. The input requires the child's emotional data, and the output is adjusted instructions.
[1034] Data processing and calculation: The emotion engine evaluates emotions through voice and facial expression analysis and provides that information to the generative AI.
[1035] Specific operation: The emotion engine analyzes Taro's anxiety, and the generative AI gives another instruction in a gentle tone, saying, "Don't worry, let's go together to the blue bench."
[1036] Step 6: Real-time guidance
[1037] Operation: The server calculates the optimal route based on the current location and destination (parent's location or police box), and the generative AI provides appropriate route guidance through tags. The emotion engine adjusts the instructions in real time. Current location information and destination information are required as input, and the optimal route is output.
[1038] Data processing and calculation: The server uses the current location and destination location information to calculate the optimal route. The generative AI also adjusts the instructions based on the emotion engine's evaluation.
[1039] Specific operation: The server calculates the optimal route and gives specific instructions such as, "Turn left at the next corner, then go straight and you will see a blue bench."
[1040] Step 7: Parental Notification
[1041] Operation: The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the emotional state of the emotion engine. The inputs required are the child's current location and the instructions of the generative AI, and the output is the notification content.
[1042] Data processing and calculation: The server aggregates this information and sends a notification to the parent communication device.
[1043] Specific operation: The server sends a notification to the mother's smartphone, displaying a message saying, "Taro is currently heading towards the blue bench. He seems anxious, so please speak to him."
[1044] Step 8: Emergency response
[1045] Operational Description: If an anomaly is not resolved for a certain period of time, the server sends an emergency notification to a nearby responding agency (e.g., police station). It requires unresolved anomaly data as input and an emergency notification as output.
[1046] Data processing and calculation: If the abnormality is not resolved within a certain period of time, the server formats the information as an emergency notification and sends it to the appropriate agency.
[1047] Specific operation: The server sends an emergency notification to the nearest police station saying, "Taro is lost near the blue bench. Please help."
[1048] In this way, the system performs specific data processing and calculations at each step, ensuring children's safety in real time and providing parents with peace of mind.
[1049] (Application example 2)
[1050] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1051] In recent years, there has been an increase in the number of occasions where parents and children enjoy shopping together at shopping malls and large stores, but at the same time, there are also many cases of children getting lost. While conventional child-loss prevention systems can track a child's location, they do not provide sufficient emotional support, making it difficult to completely alleviate the anxiety of lost children. There is also a need for technology that can quickly and accurately guide children back to their parents within the store. Furthermore, there is also a need for a system that can take emergency action if the abnormality cannot be resolved.
[1052] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1053] In this invention, the server is provided with a tag for the child synchronized with the parent's communication terminal, and includes means for the tag to transmit location information of the current location, means for the communication terminal to register the school route and range of activities, means for the server to receive location information from the tag and the communication terminal and detect an abnormality if the distance exceeds a certain distance or if the child deviates from the designated range of activities, means for the server to start a generative AI and give instructions to the child in an interactive format via the tag when the server detects an abnormality, means for the server to calculate an optimal route from the current location and destination and transmit the calculated route to the tag, and means for the generative AI to guide the child using specific landmarks based on the optimal route. The system includes a means for detecting an abnormality, a means for the tag to be equipped with an emotion engine that analyzes the child's tone of voice and facial expressions to recognize emotions and adjust the instructions, a means for the server to notify the parent's communication device of the child's current location, the instructions of the generative AI, and the emotion state of the emotion engine, a means for the server to send an emergency notification to nearby response agencies if the abnormality is not resolved within a specified period of time, a means for the parent's communication device to monitor and report the location information of the parent and child and a set range of movement within the shopping area, a means for the generative AI to provide directions to the child based on specified landmarks, and a means for the server to send an emergency notification to in-store staff if an abnormality occurs. This allows a lost child to be quickly and safely guided to their parent, reducing the child's anxiety in the process and enabling appropriate action to be taken in an emergency.
[1054] The "parent's communication terminal" is a device that communicates with the child's tag, registers the child's route to school and range of activities, and transmits location information to a server.
[1055] A "child tag" is a small device worn by a child that transmits their current location and is equipped with a generative AI and emotion engine.
[1056] "Location information" is information indicating a current geographical location obtained using technology such as GPS.
[1057] The "server" is a central computer system that analyzes location information received from communication terminals and child tags, and performs abnormality detection, generates instructions, and sends emergency notifications.
[1058] The "means for detecting abnormalities" is a method for monitoring the location information sent from the child's tag and the parent's communication device, and recognizing an abnormality if the child exceeds a certain distance or goes outside a designated range of movement.
[1059] "Generative AI" is an artificial intelligence technology that activates when an abnormality is detected and gives instructions to the child in an interactive format.
[1060] The "Emotion Engine" is a technology that analyzes a child's tone of voice and facial expressions, recognizes their emotions, and adjusts the content of their instructions accordingly.
[1061] "Optimal Route" is a method for calculating the most efficient and safe route from your current location to your destination.
[1062] A "landmark" is a geographic or visual landmark used for navigation or direction.
[1063] An "emergency notification" is warning information that is sent to nearby response agencies and store staff if the abnormality is not resolved.
[1064] A "shopping area" is an area that includes commercial facilities and stores that parents and children are expected to visit.
[1065] "In-store staff" refers to employees who work in the store to respond to emergencies.
[1066] The system for implementing the present invention utilizes a parent's communication terminal, a child's tag, and a server. The detailed configuration and processing for implementation will be described below.
[1067] Hardware and Software
[1068] 1. Hardware:
[1069] Parent's communication device: A smartphone or tablet with GPS functionality that can communicate with the server.
[1070] Kid's Tag: A small device equipped with a GPS module, a communication module, a generative AI, and an emotion engine.
[1071] Server: A cloud-based central computer system that receives and analyzes data from communication devices and child tags.
[1072] 2. Software:
[1073] Generative AI model (e.g. GPT-4): Activated when an anomaly is detected, it provides instructions to the child in a dialogue format.
[1074] Emotion Engine: Using a voice emotion analysis model, it recognizes emotions by analyzing the child's tone of voice and facial expressions.
[1075] Server program: Performs communication management, location information analysis, anomaly detection, and notification management.
[1076] Data processing and calculation procedures
[1077] 1. Initialization:
[1078] The server synchronizes the parent's communication device with the child's tag, establishing communication and registering the set school route and range of movement information on the server.
[1079] 2. Location Monitoring:
[1080] The child's tag periodically sends its current location information to the server, and the parent's communication device also periodically sends its current location information to the server.
[1081] 3. Anomaly detection:
[1082] The server compares the tag's location information with that of the parent communication device and detects an abnormality if the tag exceeds a set range or a certain distance.
[1083] 4. Generative AI dialogue and guidance:
[1084] If an anomaly is detected, the generative AI will provide interactive instructions through the child's tag, using specific landmarks to guide the child in the appropriate direction.
[1085] Example: "If your child gets lost, you can tell them to walk straight from where they are and head towards the yellow sign."
[1086] 5. Leveraging the Emotion Engine:
[1087] The emotion engine analyzes the child's tone of voice and facial expressions to recognize emotions such as anxiety, and the generative AI reissues instructions in a gentler tone depending on the recognized emotion.
[1088] Example: "If your child seems anxious, give them a gentle reminder, 'It's okay, I'm here for you.'"
[1089] 6. Real-time guidance:
[1090] The server calculates the optimal route based on the current location and destination, and the generation AI guides the child using specific landmarks.
[1091] 7. Parental Notice:
[1092] The server sends the child's current location, the instructions of the AI generator, and the emotional state of the emotion engine to the parent's communication device, allowing the parent to check the child's location in real time on their smartphone screen.
[1093] 8. Emergency Response:
[1094] If the abnormality is not resolved within a certain period of time, the server will send an emergency notification to nearby response agencies and store staff to take prompt action.
[1095] Prompt Sentence Examples
[1096] "Please give gentle instructions to a lost child to help them avoid getting lost. The child's name is ____. They are currently in the central plaza of the shopping area. There is a yellow sign nearby."
[1097] This system allows parents and children to move around safely in shopping malls and large stores, and enables swift and appropriate action to be taken if a child gets lost. By using generative AI and an emotion engine, it is possible to reduce a child's anxiety and safely guide them back to their parents.
[1098] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1099] Step 1:
[1100] Initialization:
[1101] The server synchronizes the parent's communication device with the child's tag. Information about the school route and activity range is registered on the server from the parent's communication device. The input is the school route and activity range information from the parent's communication device, and the output is that information is saved on the server. This establishes communication between the server and the device.
[1102] Step 2:
[1103] Location Monitoring:
[1104] The child's tag periodically acquires its current location information and sends it to the server. In addition, the parent's communication device also periodically sends its current location information to the server. The input is location information from the tag and communication device, and the output is that location information is aggregated on the server. The server uses this data to monitor the location in real time.
[1105] Step 3:
[1106] Anomaly detection:
[1107] The server compares the location information of the tag with that of the parent communication device, and detects an abnormality if the tag goes beyond the set movement range or a certain distance. The input is the location information from the tag and communication device, and the set movement range information, and the output is the result of the abnormality detection. The server processes this and determines whether an abnormality has occurred.
[1108] Step 4:
[1109] Generative AI dialogue and guidance:
[1110] If an anomaly is detected, the server activates the generation AI and provides interactive instructions via the child's tag. Specific landmarks are used to guide the child in the appropriate direction. The input is the detected anomaly and the child's current location, and the output is instructions generated by the generation AI. The generation AI processes this information and provides instructions in a format that is easy for the child to understand.
[1111] Step 5:
[1112] Leveraging the Emotion Engine:
[1113] The emotion engine analyzes the child's tone of voice and facial expression data sent from the tag to recognize emotions such as anxiety. Based on the recognition results, the generation AI adjusts the instructions and issues them again in a gentler tone. The input is the emotional data analyzed by the emotion engine, and the output is the adjusted instructions. The emotion engine analyzes this data and provides feedback to the generation AI.
[1114] Step 6:
[1115] Real-time guidance:
[1116] The server calculates the optimal route based on the current location and destination, and the generation AI guides the child using specific landmarks. The input is the current location and destination location information, and the output is navigation instructions. The server calculates the route and provides the information to the generation AI.
[1117] Step 7:
[1118] Parental Notice:
[1119] The server notifies the parent's communication device of the child's current location, the instructions from the generation AI, and the emotional state of the emotion engine. The input is the child's location, the instructions from the generation AI, and the analysis results from the emotion engine, and the output is the notification content. The server sends this to the parent's communication device in real time.
[1120] Step 8:
[1121] Emergency Response:
[1122] If the abnormality persists for a certain period of time, the server sends an emergency notification to nearby response agencies and store staff. The input is information indicating that the abnormality has not been resolved, and the output is an emergency notification. Based on this, the server initiates an emergency response and requests prompt support.
[1123] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1124] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1125] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1126] [Third embodiment]
[1127] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1128] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1129] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1130] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1131] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1132] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1133] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1134] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1135] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1136] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1137] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1138] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1139] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[1140] The system configuration will be explained in the following steps.
[1141] System configuration
[1142] communication terminal
[1143] This is a device that the parent has, typically a smartphone or tablet. This device has a GPS function and is capable of communicating with a server.
[1144] The parent's communication device communicates with the server to register and update information about the school route and range of movement.
[1145] tag
[1146] The tag is a small device worn by children and contains a GPS module and a communication module, which transmits the child's current location information to a server.
[1147] The tag is equipped with generative AI and has the ability to give instructions to children in an interactive format.
[1148] server
[1149] This is the central computer system that manages all communications. The server receives and analyzes location information from communication terminals and tags, and notifies users in the event of an abnormality.
[1150] The server also controls the generative AI, calculating and sending route guidance and appropriate instructions depending on the scenario.
[1151] Program processing
[1152] 1. Initialization
[1153] The server synchronizes the parent's communication device with the child's tag.
[1154] The communication terminal registers the school route and movement range data in the server.
[1155] 2. Location monitoring
[1156] The tag periodically transmits its location information to the server.
[1157] The parent's communication device also periodically sends location information to the server.
[1158] 3. Anomaly Detection
[1159] The server detects an "abnormality" if the tag is outside the set movement range or if the distance between the parent communication terminal and the tag exceeds a certain range.
[1160] 4. Generative AI dialogue and guidance
[1161] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[1162] The server calculates the optimal route from the current location to the destination (the location of the parent's communication device or the nearest police box).
[1163] 5. Real-time guidance
[1164] The generative AI guides the child in real time, showing them specific landmarks through the tag's built-in speakers and display.
[1165] 6. Parental Notification
[1166] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[1167] 7. Emergency Response
[1168] If the abnormality is not resolved within a certain period of time, the server sends an emergency notification to a nearby response agency (e.g., a police box).
[1169] Specific examples
[1170] Scenario: A kindergartener named Taro is about to get lost while playing.
[1171] 1. Initialization
[1172] Taro's mother's communication device and Taro's tag are synchronized with the server, and Taro's range of activities, including kindergarten and play areas, is registered in advance on the server from his mother's communication device.
[1173] 2. Location monitoring
[1174] Taro's tag continues to periodically send location information from the play area to the server.
[1175] The mother's communication device also sends her current location to the server.
[1176] 3. Anomaly Detection
[1177] The server detects when Taro leaves the play area. If the tag becomes too far from his mother's communication device, this is also detected as an abnormality.
[1178] 4. Generative AI dialogue
[1179] When the server detects an abnormality, it immediately activates the generative AI and sends instructions through Taro's tag, such as, "Taro, you've left the playground. Next, try going to that blue bench."
[1180] 5. Real-time guidance
[1181] The server calculates the optimal route based on Taro's current location and the location of his mother's communication device, and the generative AI guides Taro using specific landmarks.
[1182] 6. Parental Notification
[1183] The server also sends a notification to the mother's communication device, displaying Taro's location and current instructions in real time.
[1184] 7. Emergency Response
[1185] If Taro does not follow the specified route or the abnormality persists, the server will send an emergency notification to the nearest police station.
[1186] In this way, the lost child prevention system of the present invention can automatically detect children before they get lost and safely guide them back to their parents or a designated safe place.
[1187] The processing flow will be explained below.
[1188] Step 1:
[1189] Communication device (parent's smartphone)
[1190] A parent uses their smartphone to synchronize their child's tag with the server, which establishes communication between the parent's smartphone and the tag.
[1191] Step 2:
[1192] Communication device (parent's smartphone)
[1193] Parents register information about their child's school route and range of movement on the server from their smartphones, which then sets up an area where the child can move around safely.
[1194] Step 3:
[1195] Terminal (tag)
[1196] The tag's GPS function is turned on and periodically retrieves its current location, which is continuously stored in the background.
[1197] Step 4:
[1198] Terminal (tag), server
[1199] The tag sends its current location to the server at regular intervals (e.g., every 30 seconds). The server receives the location information sent from the tag and stores it in a database.
[1200] Step 5:
[1201] Device (parent's smartphone)
[1202] The parent's smartphone also periodically sends its current location to the server, which uses this data to calculate the distance to the child's location.
[1203] Step 6:
[1204] server
[1205] The server compares the location information of the tag with that of the parent's smartphone to monitor whether it is within range, and also calculates the distance between the tag and the communication terminal.
[1206] Step 7:
[1207] server
[1208] The server detects an abnormality if the tag goes beyond its set range of movement or if the distance between the tag and the parent's smartphone exceeds a certain range.
[1209] Step 8:
[1210] server
[1211] When the server detects an abnormality, it activates the generative AI module and sends an abnormality notification and instructions to the tag.
[1212] Step 9:
[1213] Terminal (tag)
[1214] When the tag receives an abnormality notification, its generative AI activates and begins giving instructions to the child in a conversational format, such as, "Hanako, it looks like you've taken a wrong turn. Next time, turn right and go to the green and light blue convenience store."
[1215] Step 10:
[1216] server
[1217] The server calculates the optimal route based on the current location and destination (parent's location or police station), and this route information is generated in real time.
[1218] Step 11:
[1219] server
[1220] The server sends the calculated optimal route information to the tag. When the tag receives this information, the generative AI continues the route guidance. Example: "Next, try heading for the red post you see on the right."
[1221] Step 12:
[1222] server
[1223] The server continues to monitor the interaction between the tag and the parent's smartphone in real time, and responds again if the situation changes or new abnormalities occur.
[1224] Step 13:
[1225] server
[1226] The server sends the child's current location information and instructions from the generative AI to the parent's smartphone via push notification.
[1227] Step 14:
[1228] Device (parent's smartphone)
[1229] The parent's smartphone can check the child's location on a map in real time and can send additional instructions to the server if necessary.
[1230] Step 15:
[1231] server
[1232] If the abnormality persists for a certain period of time, the server sends an emergency notification to the nearest police box, which then coordinates an emergency response based on the notification.
[1233] Step 16:
[1234] server
[1235] After receiving confirmation from the police station, the server notifies the tag and the parent's smartphone of the latest information and decides on further action.
[1236] Example 1
[1237] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1238] Conventional child loss prevention systems require parents to manually track their children's location information, making it difficult to respond in real time. Furthermore, they lack the ability to respond quickly when a child leaves a designated area, or to immediately notify parents when an abnormality occurs. Therefore, a system that provides complete peace of mind is needed.
[1239] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1240] In this invention, the server includes a means for notifying the parent's communication device of the child's current location information and the generative AI's instructions in real time, a means for the generative AI to issue specific instructions to the child via a speaker or display equipped on the tag, and a means for the parent's communication device to display the notification received from the server via an application. This allows the system to quickly detect when the child moves outside of their range of movement and use the generative AI to guide them in real time. In addition, in the event of an abnormality, the system can quickly notify the parent or response agency, ensuring the child's safety.
[1241] A "parental communication device" is a device owned by a parent and used to monitor and receive location information about a child, typically a mobile device such as a smartphone or tablet.
[1242] A "child tag" is a small device that a child carries and is equipped with a GPS module and a communication module for transmitting current location information.
[1243] "Location Information" means geographic location data determined using a positioning system such as GPS.
[1244] A "communication terminal" is a terminal used for data communication, and is usually a device such as a smartphone, tablet, or PC.
[1245] "School route and range of movement" refers to the geographical area within which a child is permitted to travel, as defined and registered in advance by the parent.
[1246] The "server" is a central computer system that manages communication between multiple devices, receives and analyzes location information, and controls the generative AI.
[1247] The "certain distance" is a distance set between the parent's communication terminal and the child's tag that is recognized as being outside the range of movement.
[1248] An "abnormality" is a situation that is detected when a child's tag goes outside the set range of movement or exceeds a certain distance.
[1249] "Generative AI" is a system that uses artificial intelligence technology to give children interactive instructions, such as an AI model that provides route guidance or responds to abnormal situations.
[1250] "A means of giving interactive instructions" is a function that allows the generative AI to give specific instructions to children via tags.
[1251] An "optimal route" is a calculated shortest or safest route from your current location to your destination.
[1252] "Landmarks" are buildings or objects that serve as landmarks used to guide children.
[1253] "Means for notifying in real time" is a function that allows the server to immediately notify the parent communication terminal of any abnormalities or the current situation.
[1254] An "emergency notification" is an emergency alert sent to nearby response agencies if the abnormality is not resolved within a certain period of time.
[1255] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[1256] Equipment and software configuration
[1257] Parent's communication device:
[1258] The communication devices held by parents are smartphones or tablets. These devices have GPS functionality and are capable of data communication with a server. The communication devices must have an application installed to register information about the school route and range of movement.
[1259] Kids Tags:
[1260] The tag is a small device worn by a child and is equipped with a GPS module and a communication module. The tag transmits the current location information to a server. Furthermore, the tag is equipped with a generative AI that can give instructions to the child in an interactive format. The tag also has a speaker and a display that are used to communicate the generative AI's instructions to the child.
[1261] server:
[1262] The server is a central computer system that manages all communications. It receives and analyzes location information from communication devices and tags, and notifies users in the event of an abnormality. It also controls the generative AI, calculating and sending route guidance and appropriate instructions according to the scenario.
[1263] Process Overview
[1264] 1. Initialization
[1265] The server synchronizes the parent's communication device with the child's tag, and the parent uses the communication device to register data about the child's school route and range of activities on the server.
[1266] 2. Location monitoring
[1267] The child's tag periodically transmits its location information to the server, and the parent's communication device also transmits its current location information to the server.
[1268] 3. Anomaly Detection
[1269] The server analyzes the transmitted location information and detects abnormalities if the tag moves outside the set range of movement or if the distance between the parent communication terminal and the tag exceeds a certain range.
[1270] 4. Generative AI dialogue and guidance
[1271] If an abnormality is detected, the server activates a generative AI that gives interactive instructions to the child via the tag.
[1272] 5. Real-time guidance
[1273] The server calculates the optimal route from the current location to the destination, and the generative AI gives the child instructions using specific landmarks, e.g., "Walk toward the next blue bench you see."
[1274] 6. Parental Notification
[1275] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[1276] 7. Emergency Response
[1277] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to a nearby responding agency (e.g., the police station).
[1278] Specific examples
[1279] Scenario: A kindergarten-aged child is about to get lost while playing.
[1280] 1. Initialization
[1281] The parent's communication device (smartphone) and the child's tag are synchronized with the server. The parent's communication device registers the child's favorite kindergarten and play areas in advance on the server.
[1282] 2. Location monitoring
[1283] The child's tag periodically sends location information from the playground to a server, and the parent's device also sends their current location to the server.
[1284] 3. Anomaly Detection
[1285] The server detects if the child leaves the play area or if the distance between the tag and the parent's communication device exceeds a set range.
[1286] 4. Generative AI dialogue
[1287] When the server detects an abnormality, the generative AI is activated and issues instructions via tags, such as, "You've left the playground. Next, try going to that blue bench."
[1288] 5. Real-time guidance
[1289] The server calculates the optimal route from the child's current location to the location of the parent's communication device, and the generative AI guides the child using specific landmarks.
[1290] 6. Parental Notification
[1291] The server sends a notification to the parent's communication device, displaying the child's location and the instructions of the generative AI in real time.
[1292] 7. Emergency Response
[1293] If the child does not follow the designated route or the abnormality persists, the server will send an emergency notification to the nearby police station or police box.
[1294] Example input to a generative AI model
[1295] Below are some example prompts to input to a generative AI model:
[1296] For example: "Child is out of range. Please guide them to the next landmark. For example, 'Let's try that blue bench next.'"
[1297] The above is a specific embodiment for carrying out the invention. This system ensures the safety of children and reduces parental anxiety.
[1298] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1299] Step 1: Initialization
[1300] The server synchronizes the parent's communication device with the child's tag, and data on the parent's school route and range of movement is sent from the communication device to the server.
[1301] How it works: Parents use their communication devices to enter information about their child's range of activities, such as the route to school and playgrounds, into a dedicated application, and then upload the data to a server, which then stores this information in a database.
[1302] Input: School route and movement range data sent from parent's communication device.
[1303] Output: Home range information stored in a database.
[1304] Step 2: Location Monitoring
[1305] The tag periodically acquires its location information from GPS and sends it to the server. The parent's communication device also periodically sends its current location information to the server.
[1306] Specific operation: The tag and the parent communication device activate their respective GPS functions to obtain their current location information, which is then sent to the server via the communication module.
[1307] Input: Location information sent from the tag and parent communication device.
[1308] Output: Location data collected on the server.
[1309] Step 3: Anomaly detection
[1310] The server analyzes the location information sent from the tag and the parent's communication device and detects abnormalities if the tag moves out of its range or exceeds a certain distance.
[1311] How it works: The server analyzes the location information in real time and compares it with the movement range data stored in the database. If the device goes out of range or exceeds a certain distance, an anomaly flag is raised and an abnormality is detected.
[1312] Input: Location information sent from the tag and parent communication device.
[1313] Output: Anomaly flag and anomaly detection notification.
[1314] Step 4: Generative AI dialogue and guidance
[1315] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[1316] Specific operation: The server inputs prompt text into the generative AI, generates appropriate instructions, and sends the generated instructions to the tag, which then communicates them to the child via a speaker or display.
[1317] Input: Abnormal flag, prompt for the generative AI.
[1318] Output: Specific instructions for the child.
[1319] Step 5: Real-time guidance
[1320] Based on the instructions sent to the tag, the generative AI guides the child in real time using specific landmarks via speakers and displays.
[1321] How it works: The server calculates the optimal route from the current location to the destination and sends it back to the generative AI. The generative AI then generates instructions, such as "Walk towards the next blue bench you see," and sends them to the tag. The tag then relays this to the child via a speaker or display.
[1322] Input: Current location, destination, and prompt for the generative AI.
[1323] Output: Specific instructions using landmarks.
[1324] Step 6: Parental Notification
[1325] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[1326] How it works: The server sends the child's current location and the instructions of the generative AI to the parent's device, who can then view this information through a dedicated application.
[1327] Input: Current child location, instructions for the generative AI.
[1328] Output: Real-time notification to parent's communication device.
[1329] Step 7: Emergency response
[1330] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to nearby response agencies.
[1331] Specific operation: If the abnormality is not resolved within the set time, the server will send an emergency notification to pre-registered nearby response agencies (e.g., police stations, police boxes). The emergency notification will include the child's current location and details of the abnormality.
[1332] Input: Abnormal condition, time information.
[1333] Output: Emergency notification to responding agencies.
[1334] The above is a detailed flow of the program processing of this system.
[1335] (Application example 1)
[1336] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1337] Previous child location monitoring systems lacked sufficient measures to deal with situations where a child went outside the child's range, and had limited functionality for notifying parents of accurate location information in real time. As a result, there were problems with children becoming lost or falling into dangerous situations. Furthermore, there was a lack of specific instructions for children when an abnormality occurred, and appropriate responses in emergencies.
[1338] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1339] In this invention, the server is equipped with a tag for the child that is synchronized with the parent's communication terminal, and includes means for the tag to transmit location information of the current location, means for the parent's communication terminal to register the school route and range of activities, means for the server to receive location information from the tag and the communication terminal and detect an abnormality if the distance exceeds a certain distance or the designated range of activities, means for the server to activate a generative AI and give interactive instructions to the child via the tag when the server detects an abnormality, means for the server to calculate an optimal route from the current location and destination and send it to the tag, means for the generative AI to guide the child based on the optimal route using specific landmarks, means for the server to monitor and notify interactions between the tag and communication terminal in real time, means for the server to send an emergency notification to nearby response agencies if the abnormality is not resolved within a certain period of time, and means for the generative AI to explain the abnormal situation to the child interactively and give instructions based on specific landmarks. This allows for rapid detection of abnormalities even if a child goes outside the child's range, and specific instructions and guidance can be given using generative AI, enabling real-time notifications to parents and rapid emergency notifications to nearby response agencies.
[1340] A "parent's communication device" is a device with communication capabilities owned by the parent, and is primarily a smartphone or tablet.
[1341] A "child tag" is a small device worn by a child that is equipped with a GPS module and a communication module and has the ability to transmit current location information.
[1342] The "server" is a centralized management system that receives location information from communication terminals and tags, and analyzes and issues instructions.
[1343] "Generative AI" refers to generative artificial intelligence that has the ability to generate sentences and images and interact with users.
[1344] "A means of giving instructions in an interactive format" refers to a system in which the generative AI provides guidance and instructions to children via voice or text.
[1345] "Means for calculating optimal route" refers to a function that executes an algorithm to calculate the most efficient and safe route based on information about the current location and destination.
[1346] A "landmark" is a building, place, or object that serves as a landmark for children.
[1347] "Means for real-time monitoring and notification" refers to a function in which the server constantly checks location information and immediately notifies if an abnormality occurs.
[1348] "Emergency notification" is a system that quickly contacts pre-registered response organizations when a crisis situation occurs.
[1349] MODE FOR CARRYING OUT THE INVENTION
[1350] System Configuration
[1351] To implement this invention, a parent's communication terminal (smartphone), a child's tag device, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[1352] Hardware
[1353] Parent's communication device: Smartphone or tablet (with GPS and communication functions)
[1354] Child tag device: A device equipped with a GPS module and a communication module
[1355] Server: Cloud platform (e.g., Amazon Web Services (AWS), Microsoft Azure)
[1356] software
[1357] Generative AI: Generative AI such as OpenAI GPT-4 and GPT-3.5
[1358] Server management software: location analysis and notification system
[1359] Program processing description
[1360] The server receives location information, detects abnormalities, activates the generative AI, and performs a series of processes including real-time instructions and notifications, making it possible to detect and respond to abnormalities when a child goes outside the set range of movement.
[1361] 1. Receiving and registering location information
[1362] The parent's communication terminal registers data on the school route and range of movement on the server.
[1363] The child's tag device and the parent's communication terminal periodically transmit location information to a server.
[1364] 2. Anomaly detection and generative AI activation
[1365] The server analyzes the data and detects an abnormality if the tag goes beyond its range or exceeds a certain distance.
[1366] When an abnormality is detected, the server activates a generative AI and issues specific instructions to the child via the tag.
[1367] 3. Optimal route calculation and guidance
[1368] The server calculates the optimal route based on the current location and destination.
[1369] Generative AI guides children using specific landmarks.
[1370] 4. Real-time monitoring and notification
[1371] The server monitors the data between the tag and the parent's communication terminal in real time and notifies the parent in the event of an abnormality.
[1372] If the anomaly persists for a certain period of time, the server will send an emergency notification to nearby response agencies.
[1373] Example: Measures to prevent children from getting lost in the store
[1374] For example, while shopping at a mall, a parent launches the "Kids Secure" app and sets a range of movement. If the child goes outside the set range within the store, the tag notifies the server of the abnormality, and the server activates the generative AI. The generative AI then gives the child instructions in a dialogue format, as follows:
[1375] Generative AI interaction with children:
[1376] "○○-kun, you have exceeded the mall's set range. Please return to the elevator."
[1377] Parental Notice:
[1378] "○○ has gone out of range. He is currently near the elevator on Floor B."
[1379] This system allows for a quick response in the event of a child going missing, ensuring parents and responding authorities are notified quickly.
[1380] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1381] Step 1:
[1382] The server initializes and synchronizes the parent's communication device and the child's tag. It receives data on the school route and activity range from the parent's communication device and registers this on the server. The input is the school route and activity range data sent from the parent's communication device, and the output is storage in the server's registration database. Specifically, the parent's communication device sends GPS setting information to the server, which stores it in the database.
[1383] Step 2:
[1384] The server periodically receives location information from the child's tag device and the parent's communication terminal. The input is the location information sent from the tag device and the parent's communication terminal, and the output is the storage of the received location information in the server. In this process, the tag device and the parent's communication terminal periodically send location information to the server, which then stores it in a database.
[1385] Step 3:
[1386] The server analyzes the received location information in real time and detects an anomaly if the tag goes beyond the set movement range or if the distance between the tag and the communication terminal exceeds a certain range. The input is the location information stored on the server, and the output is the anomaly detection result. Specifically, an algorithm in the server analyzes the location information and checks for deviation from the movement range or excess distance.
[1387] Step 4:
[1388] When the server detects an abnormality, it activates the generative AI and gives interactive instructions to the child via the tag device. The input is the abnormality detection result, and the output is the instructions created by the generative AI. The generative AI generates a prompt such as "Taro, move from your current position to the blue bench" and sends it to the tag device.
[1389] Step 5:
[1390] The server uses generative AI to calculate the optimal route based on the current location and destination. The input is current location information from the child's tag device and the parent's communication device, and the output is the calculated optimal route. In this process, the server calculates the route using GPS data for the current location and destination and sends it to the tag device.
[1391] Step 6:
[1392] The generative AI guides the child along the calculated optimal route, using specific landmarks. The input is the calculated optimal route and landmark information, and the output is detailed guidance instructions created by the generative AI. Specific landmark instructions, such as "Next, turn right in front of that red postbox," are displayed on the tag device or sent via voice.
[1393] Step 7:
[1394] The server monitors the exchange between the tag device and the parent's communication terminal in real time, and notifies the parent in the event of an abnormality. The input is the location information received in real time and the abnormality detection results, and the output is the notification content to the parent. In concrete terms, the server notifies the parent's communication terminal, for example, "Taro has exceeded the set range. His current location is near the elevator on floor B."
[1395] Step 8:
[1396] If the abnormality is not resolved for a certain period of time, the server will send an emergency notification to a nearby response agency. The input is the result of continuous abnormality detection, and the output is the content of the emergency notification to the nearby response agency. Specifically, the server automatically notifies the response agency based on the registered emergency contact information, saying, "The child has exceeded the set range and the abnormality continues. The current location is ____."
[1397] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1398] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays and processes data between the devices are required. Furthermore, the tag must be equipped with a generative AI and an emotion engine.
[1399] The system configuration is explained as follows.
[1400] System configuration
[1401] communication terminal
[1402] This is something that parents have, typically a smartphone or tablet. This device has a GPS function and is capable of communicating with a server.
[1403] The parent's communication device communicates with the server to register and update information about the school route and range of movement.
[1404] tag
[1405] The tag is a small device worn by children, equipped with a GPS module, a communication module, a generative AI, and an emotion engine. The tag transmits the child's current location to a server.
[1406] The emotion engine has the ability to analyze a child's tone of voice and facial expressions to recognize their emotions.
[1407] server
[1408] This is the central computer system that manages all communications. The server receives and analyzes location information from communication terminals and tags, and notifies users in the event of an abnormality.
[1409] The server also controls the generative AI and emotion engine, calculating and sending route guidance and appropriate instructions depending on the scenario.
[1410] Program processing
[1411] 1. Initialization
[1412] The server synchronizes the parent communication terminal with the child tag, thereby establishing communication between the parent communication terminal and the tag.
[1413] Information about the school route and range of movement is registered on the server from the communication terminal.
[1414] 2. Location monitoring
[1415] The tag periodically obtains its current location and sends it to the server.
[1416] The parent's communication device also periodically sends current location information to the server.
[1417] 3. Anomaly Detection
[1418] The server compares the location information of the tag with that of the parent device, monitors whether it is within its range, and calculates the distance between the tag and the device.
[1419] An abnormality is detected when the tag goes beyond the set movement range or when the distance between the tag and the parent communication terminal exceeds a certain range.
[1420] 4. Generative AI dialogue and guidance
[1421] When the server detects an abnormality, it activates the generative AI and gives the child interactive instructions via tags. The generative AI uses landmarks to give clear instructions.
[1422] 5. Leveraging Emotional Engines
[1423] The tag's emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state, and if they express anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child.
[1424] For example: "Don't worry, Taro. Let's go to where Mommy is. Next, take the path to the right and wait for me at the blue bench at the end."
[1425] 6. Real-time guidance
[1426] The server calculates the optimal route based on the current location and destination (parent's location or police station), and the generative AI provides appropriate route guidance using tags. The emotion engine adjusts the instructions in real time.
[1427] 7. Parental Notification
[1428] The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the emotional state of the emotion engine.
[1429] 8. Emergency Response
[1430] If the abnormality persists for a certain period of time, the server sends an emergency notification to a nearby responding agency (e.g., a police box).
[1431] Specific examples
[1432] Scenario: Kindergartener Taro is about to get lost on the playground.
[1433] 1. Initialization
[1434] The mother's communication device and Taro's tag are synchronized with the server, and the play area setting range is pre-registered on the mother's communication device.
[1435] 2. Location monitoring
[1436] Taro's tag periodically sends location information from the play area to a server.
[1437] The mother's communication device also sends her current location to the server.
[1438] 3. Anomaly Detection
[1439] The server detects when Taro leaves the set range of the play area. An abnormality is also detected when the distance between the tag and the mother's communication device exceeds a certain range.
[1440] 4. Generative AI dialogue
[1441] When the server detects an abnormality, it activates the generative AI and sends instructions through Taro's tag, such as, "Taro, it looks like you've taken the wrong turn. Next time, turn right and head towards the blue bench."
[1442] 5. Leveraging Emotional Engines
[1443] The emotion engine analyzes Taro's tone of voice and recognizes that he is feeling anxious. The generative AI then repeats the instructions in a gentler tone, saying, "Don't worry, Mommy is nearby. Let's go together to the blue bench."
[1444] 6. Real-time guidance
[1445] The server calculates the optimal route based on Taro's current location and his mother's location, and the generative AI guides Taro using specific landmarks.
[1446] 7. Parental Notification
[1447] The server notifies the mother's communication device of Taro's current location, the instructions of the generative AI, and the analysis results of the emotion engine, allowing the mother to check Taro's location on a map in real time.
[1448] 8. Emergency Response
[1449] If Taro does not follow the designated route or if the abnormality is not resolved, the server will send an emergency notification to the nearest police station, which will then work together to ensure Taro's safety.
[1450] In this way, the lost child prevention system of the present invention can automatically detect children before they get lost and use generative AI and an emotion engine to safely guide them back to their parents or a designated safe place.
[1451] The processing flow will be explained below.
[1452] Step 1:
[1453] server
[1454] The server synchronizes the parent's communication device with the child's tag, allowing the parent's communication device and the tag to communicate bidirectionally via the server.
[1455] Step 2:
[1456] Device (parent's smartphone)
[1457] Parents use their smartphones to register information about their school route and range of activities on the server, which allows the system to pre-determine areas and routes where children can safely move around.
[1458] Step 3:
[1459] Terminal (tag)
[1460] The tag's GPS function is activated and periodically retrieves its current location, a process that occurs continuously in the background.
[1461] Step 4:
[1462] Terminal (tag), server
[1463] The tag sends the acquired location information to the server at regular intervals (e.g., every 30 seconds). The server receives the location information sent from the tag and stores it in a database.
[1464] Step 5:
[1465] Device (parent's smartphone)
[1466] The parent's smartphone also periodically sends its current location to the server, which is used to calculate the distance to the child's tag location.
[1467] Step 6:
[1468] server
[1469] The server compares the location information of the tag with that of the parent's smartphone to monitor whether the tag is within the set range of movement, and also calculates the distance between the tag and the parent's communication device.
[1470] Step 7:
[1471] server
[1472] The server detects an abnormality if the tag goes beyond its set range of movement or if the distance between the tag and the parent's smartphone exceeds a certain range.
[1473] Step 8:
[1474] server
[1475] When the server detects an abnormality, it immediately activates the generative AI module and sends an abnormality notification and instructions to the tag.
[1476] Step 9:
[1477] Terminal (tag)
[1478] When the tag receives an abnormality notification, its generative AI activates and begins giving instructions to the child in a conversational format. For example, "Taro, you seem lost. Let's go to the nearest blue bench first."
[1479] Step 10:
[1480] Terminal (tag)
[1481] The tag's built-in emotion engine analyzes the child's tone of voice and facial expressions to recognize their current emotional state. If they express anxiety or fear, the generative AI adjusts its instructions to reassure them. For example: "Don't worry, Taro. Mommy's right there. Let's go together to the blue bench."
[1482] Step 11:
[1483] server
[1484] The server calculates the optimal route based on the tag's current location and the location of the parent's communication device, and sends the information to the tag in real time. Based on this information, the generative AI continues to provide route guidance.
[1485] Step 12:
[1486] Terminal (tag)
[1487] The generative AI uses optimal route information to provide guidance using specific landmarks. For example, "Next, try heading for the red postbox on the right." The emotion engine analyzes the child's reactions and continually adjusts the tone and content of the guidance.
[1488] Step 13:
[1489] server
[1490] The server monitors the interaction between the tag and the parent's smartphone in real time, and if any abnormalities occur again, it responds quickly.
[1491] Step 14:
[1492] server
[1493] The server sends push notifications to the parent's smartphone with the child's current location, instructions from the generative AI, and the results of emotion analysis by the emotion engine.
[1494] Step 15:
[1495] Device (parent's smartphone)
[1496] The parent's smartphone receives a notification, allowing them to see their child's location on a map in real time and send further instructions to the server if necessary.
[1497] Step 16:
[1498] server
[1499] If the abnormality persists for a certain period of time, the server will send an emergency notification to a nearby police station or other appropriate agency, including the child's location and details of the abnormality.
[1500] Step 17:
[1501] server
[1502] After receiving confirmation from the police station or other appropriate agency, the server notifies the tag and the parent's smartphone of the latest situation and coordinates further response.
[1503] In this way, the lost child prevention system of the present invention can detect children before they get lost and safely guide them back to their parents by making full use of generative AI and an emotion engine.
[1504] Example 2
[1505] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1506] Today's children are at increased risk of getting lost on their way to school or at playgrounds. However, it is difficult for parents to keep track of their children's locations at all times, and there is a lack of ways to provide appropriate instructions and reassurance when a child gets lost. There is a need for an efficient and effective system that solves these problems and helps children get to school and out safely.
[1507] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for transmitting location information of the current locations of the parent's communication terminal and the child's tag; means for registering the school route and activity range; means for receiving location information and detecting an abnormality when the child exceeds a certain distance or deviates from the designated activity range; means for activating the generative AI and issuing instructions in an interactive format; means for calculating an optimal route from the current location and destination and transmitting the optimal route to the tag; means for the generative AI to guide the child using specific landmarks based on the optimal route; means for analyzing the child's emotional state using an emotion engine and adjusting the tone and content of the generative AI; means for monitoring and notifying interactions between the tag and communication terminal in real time; and means for transmitting emergency notifications to response agencies. This allows parents to always know their child's location and status while their child safely commutes to school or goes out.
[1508] "Parent's communication device" refers to a device owned by the parent that has GPS functionality and is capable of data communication with the server.
[1509] A "child tag" is a small device worn by a child that is equipped with a GPS module, a communication module, a generative AI, and an emotion engine.
[1510] "Means for transmitting location information" refers to the function of tags or communication terminals to transmit GPS information of their current location to a server.
[1511] "Means for registering school routes and areas of activity" refers to the function by which parents use a communication terminal to set and register information about specific school routes and areas of activity in advance on a server.
[1512] "Means for detecting abnormalities" refers to the function that issues an alarm based on the location information received by the server from the tag or communication terminal if the device exceeds a certain distance or goes outside a specified range of movement.
[1513] "Generative AI" refers to a system that uses artificial intelligence technology to give children interactive instructions and respond according to the situation.
[1514] "A means of giving instructions in an interactive format" refers to the function by which the generative AI gives children clear, specific instructions through tags.
[1515] "Means for calculating the optimal route" refers to the function by which the server calculates the optimal route based on the current location and destination and sends that information to the tag.
[1516] "Means of guidance using landmarks" refers to the function in which the generative AI provides children with specific route guidance using surrounding landmarks.
[1517] The "emotion engine" refers to a system that analyzes a child's tone of voice and facial expressions to recognize their emotional state.
[1518] "Means for analyzing the emotional state and adjusting the tone and content of the generative AI" refers to the function in which the emotion engine analyzes the child's emotions and adjusts the instructions and tone of the generative AI based on the results.
[1519] "Means for monitoring and notifying in real time" refers to the function by which the server monitors the location information and interactions of the tag and communication device in real time and sends notifications to parents.
[1520] "Means for sending an emergency notification to a response agency" refers to a function in which the server sends an emergency notification to a nearby response agency (e.g., a police box) if the abnormality is not resolved within a certain period of time.
[1521] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays and processes data between the devices are required. Furthermore, the tag must be equipped with a generative AI and an emotion engine. The system configuration is explained as follows:
[1522] System configuration
[1523] communication terminal
[1524] These devices are usually smartphones or tablets owned by parents. These devices have GPS functionality and are capable of communicating with the server. The parent's device communicates with the server to register and update information about the child's school route and range of movement.
[1525] tag
[1526] The tag is a small device worn by children and is equipped with a GPS module, a communication module, a generative AI, and an emotion engine. The tag transmits the child's current location to a server, and the emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state.
[1527] server
[1528] The server is a central computer system that manages all communications. It receives and analyzes location information from communication devices and tags, and notifies users in the event of an abnormality. It also controls the generative AI and emotion engine, calculating and sending route guidance and appropriate instructions according to the scenario.
[1529] Program processing
[1530] 1. Initialization
[1531] The server synchronizes the parent's communication device with the child's tag, establishing communication between the parent's communication device and the tag. The parent's communication device registers information about the child's school route and range of movement on the server. The hardware used is a smartphone, tablet, and server, and the software is a GPS function and communication module.
[1532] 2. Location monitoring
[1533] The tag periodically acquires its current location information and sends it to the server. The parent communication device also periodically sends its current location information to the server. The hardware used is a GPS module and a communication module, and the data is treated as location information.
[1534] 3. Anomaly Detection
[1535] The server compares the location information of the tag with that of the parent communication device to monitor whether it is within its range of movement. It also calculates the distance between the tag and the communication device and detects an abnormality if it exceeds the set range. The software used is a location information analysis algorithm.
[1536] 4. Generative AI dialogue and guidance
[1537] When the server detects an abnormality, it activates a generative AI and gives instructions to the child interactively via tags. The generative AI uses landmarks to give clear instructions. The software includes a generative AI model and natural language processing.
[1538] 5. Leveraging Emotional Engines
[1539] The tag's built-in emotion engine analyzes a child's tone of voice and facial expressions to recognize their emotional state. If the child expresses anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child. The software includes an emotion analysis algorithm.
[1540] 6. Real-time guidance
[1541] The server calculates the optimal route based on the current location and destination (parent's location or police station), and the generative AI provides appropriate route guidance through tags. The emotion engine adjusts the instructions in real time. The hardware used is a GPS module and a communications module, and the software is a route calculation algorithm.
[1542] 7. Parental Notification
[1543] The server sends the child's current location, instructions from the generative AI, and the emotional state of the emotion engine to the parent's communication device, allowing the parent to understand the child's status in real time. The software includes a notification system.
[1544] 8. Emergency Response
[1545] If the abnormality persists for a certain period of time, the server sends an emergency notification to a nearby response agency (e.g., a police station). This allows for a prompt local response. The hardware used is a communication module, and the software is an emergency notification system.
[1546] Specific examples
[1547] Scenario: A kindergartener is lost on the playground.
[1548] 1. Initialization
[1549] The parent's communication device and the child's tag are synchronized with the server, and the set range of the play area is registered in advance from the communication device.
[1550] 2. Location monitoring
[1551] The child's tag periodically transmits the location information of the play area to the server, and the parent's communication device also transmits the current location to the server.
[1552] 3. Anomaly Detection
[1553] If the child exceeds the set range, the server detects an abnormality, and an abnormality is also detected if the distance between the tag and the parent's communication terminal exceeds a certain range.
[1554] 4. Generative AI dialogue and guidance
[1555] When the server detects an abnormality, it activates the generative AI and issues instructions via the child's tag, such as "Next, turn right and go towards the blue bench."
[1556] 5. Leveraging Emotional Engines
[1557] The emotion engine analyzes the child's anxiety, and the generative AI gives another instruction in a gentle tone: "Don't worry, let's go together to the blue bench."
[1558] 6. Real-time guidance
[1559] The server calculates the optimal route based on the child's current location and the parent's location, and the generative AI guides the child using specific landmarks.
[1560] 7. Parental Notification
[1561] The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the analysis results of the emotion engine, allowing the parent to check the child's location on a map in real time.
[1562] 8. Emergency Response
[1563] If the child does not follow the designated route or the abnormality persists, the server sends an emergency notification to the nearest police station, which then takes action on-site.
[1564] Example prompts for generative AI models
[1565] "Please explain in detail the processing steps of a system that links a parent's communication device with a child's tag, and uses a generative AI to guide the child in a dialogue format when the child strays from a set range of movement, and an emotion engine to provide a sense of security."
[1566] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1567] Step 1: Initialization
[1568] Operational description: The server synchronizes the parent's communication device with the child's tag. It requires information from the parent's communication device and the child's tag as input, and provides the status of established communication as output. The parent uses the communication device to register the school route and range of activities, and sends that information to the server.
[1569] Data processing and calculation: The server analyzes the information on the school route and range of movement received from the parent's communication device and stores it in a database. This makes it possible to compare location information in a later step.
[1570] Specific operation: The user (parent) operates the smartphone app, sets the school route and area of movement on a map, and sends that information to the server.
[1571] Step 2: Location Monitoring
[1572] Operation: The tag periodically acquires its current location information and sends it to the server. The parent communication device also sends its current location information to the server. Location information from GPS is required as input, and location data is sent to the server as output.
[1573] Data processing and calculation: The server receives the location information sent from the tag and communication terminal and records it in a database. This information is then used in the subsequent anomaly detection step.
[1574] How it works: The tag uses a GPS module to obtain its current location every five minutes and sends the data to a server. The parent's smartphone also sends the location information at the same interval.
[1575] Step 3: Anomaly detection
[1576] Operation: The server compares the location information of the tag with that of the parent communication device, and monitors whether the tag is within its range. It also calculates the distance between the tag and the communication device, and detects an abnormality if it exceeds the set range. Location information is required as input, and the result of the abnormality detection is output.
[1577] Data processing and calculation: The server calculates the distance based on the location information, compares it with the set movement range, and executes an algorithm to detect abnormalities.
[1578] Specific operation: The server receives location information, calculates the distance between the tag and the parent communication device, and detects an abnormality if it exceeds 100 meters.
[1579] Step 4: Generative AI dialogue and guidance
[1580] Operation: When the server detects an abnormality, it activates the generative AI and gives instructions to the child in an interactive format via tags. The generative AI uses landmarks to give easy-to-understand instructions. The inputs required are the results of the anomaly detection and current location information, and the output is the instructions.
[1581] Data processing and calculation: Generative AI generates appropriate interactive instructions based on the results of anomaly detection and location information.
[1582] Specific operation: The server guides the user through tags, saying, "Next, turn right and head towards the blue bench."
[1583] Step 5: Leverage the Emotion Engine
[1584] How it works: The tag's built-in emotion engine analyzes the child's tone of voice and facial expressions to recognize their emotional state. If the child expresses anxiety or fear, it adjusts the tone and content of the generative AI to reassure the child. The input requires the child's emotional data, and the output is adjusted instructions.
[1585] Data processing and calculation: The emotion engine evaluates emotions through voice and facial expression analysis and provides that information to the generative AI.
[1586] Specific operation: The emotion engine analyzes Taro's anxiety, and the generative AI gives another instruction in a gentle tone, saying, "Don't worry, let's go together to the blue bench."
[1587] Step 6: Real-time guidance
[1588] Operation: The server calculates the optimal route based on the current location and destination (parent's location or police box), and the generative AI provides appropriate route guidance through tags. The emotion engine adjusts the instructions in real time. Current location information and destination information are required as input, and the optimal route is output.
[1589] Data processing and calculation: The server uses the current location and destination location information to calculate the optimal route. The generative AI also adjusts the instructions based on the emotion engine's evaluation.
[1590] Specific operation: The server calculates the optimal route and gives specific instructions such as, "Turn left at the next corner, then go straight and you will see a blue bench."
[1591] Step 7: Parental Notification
[1592] Operation: The server notifies the parent's communication device of the child's current location, the instructions of the generative AI, and the emotional state of the emotion engine. The inputs required are the child's current location and the instructions of the generative AI, and the output is the notification content.
[1593] Data processing and calculation: The server aggregates this information and sends a notification to the parent communication device.
[1594] Specific operation: The server sends a notification to the mother's smartphone, displaying a message saying, "Taro is currently heading towards the blue bench. He seems anxious, so please speak to him."
[1595] Step 8: Emergency response
[1596] Operational Description: If an anomaly is not resolved for a certain period of time, the server sends an emergency notification to a nearby responding agency (e.g., police station). It requires unresolved anomaly data as input and an emergency notification as output.
[1597] Data processing and calculation: If the abnormality is not resolved within a certain period of time, the server formats the information as an emergency notification and sends it to the appropriate agency.
[1598] Specific operation: The server sends an emergency notification to the nearest police station saying, "Taro is lost near the blue bench. Please help."
[1599] In this way, the system performs specific data processing and calculations at each step, ensuring children's safety in real time and providing parents with peace of mind.
[1600] (Application example 2)
[1601] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1602] In recent years, there has been an increase in the number of occasions where parents and children enjoy shopping together at shopping malls and large stores, but at the same time, there are also many cases of children getting lost. While conventional child-loss prevention systems can track a child's location, they do not provide sufficient emotional support, making it difficult to completely alleviate the anxiety of lost children. There is also a need for technology that can quickly and accurately guide children back to their parents within the store. Furthermore, there is also a need for a system that can take emergency action if the abnormality cannot be resolved.
[1603] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1604] In this invention, the server is provided with a tag for the child synchronized with the parent's communication terminal, and includes means for the tag to transmit location information of the current location, means for the communication terminal to register the school route and range of activities, means for the server to receive location information from the tag and the communication terminal and detect an abnormality if the distance exceeds a certain distance or if the child deviates from the designated range of activities, means for the server to start a generative AI and give instructions to the child in an interactive format via the tag when the server detects an abnormality, means for the server to calculate an optimal route from the current location and destination and transmit the calculated route to the tag, and means for the generative AI to guide the child using specific landmarks based on the optimal route. The system includes a means for detecting an abnormality, a means for the tag to be equipped with an emotion engine that analyzes the child's tone of voice and facial expressions to recognize emotions and adjust the instructions, a means for the server to notify the parent's communication device of the child's current location, the instructions of the generative AI, and the emotion state of the emotion engine, a means for the server to send an emergency notification to nearby response agencies if the abnormality is not resolved within a specified period of time, a means for the parent's communication device to monitor and report the location information of the parent and child and a set range of movement within the shopping area, a means for the generative AI to provide directions to the child based on specified landmarks, and a means for the server to send an emergency notification to in-store staff if an abnormality occurs. This allows a lost child to be quickly and safely guided to their parent, reducing the child's anxiety in the process and enabling appropriate action to be taken in an emergency.
[1605] The "parent's communication terminal" is a device that communicates with the child's tag, registers the child's route to school and range of activities, and transmits location information to a server.
[1606] A "child tag" is a small device worn by a child that transmits their current location and is equipped with a generative AI and emotion engine.
[1607] "Location information" is information indicating a current geographical location obtained using technology such as GPS.
[1608] The "server" is a central computer system that analyzes location information received from communication terminals and child tags, and performs abnormality detection, generates instructions, and sends emergency notifications.
[1609] The "means for detecting abnormalities" is a method for monitoring the location information sent from the child's tag and the parent's communication device, and recognizing an abnormality if the child exceeds a certain distance or goes outside a designated range of movement.
[1610] "Generative AI" is an artificial intelligence technology that activates when an abnormality is detected and gives instructions to the child in an interactive format.
[1611] The "Emotion Engine" is a technology that analyzes a child's tone of voice and facial expressions, recognizes their emotions, and adjusts the content of their instructions accordingly.
[1612] "Optimal Route" is a method for calculating the most efficient and safe route from your current location to your destination.
[1613] A "landmark" is a geographic or visual landmark used for navigation or direction.
[1614] An "emergency notification" is warning information that is sent to nearby response agencies and store staff if the abnormality is not resolved.
[1615] A "shopping area" is an area that includes commercial facilities and stores that parents and children are expected to visit.
[1616] "In-store staff" refers to employees who work in the store to respond to emergencies.
[1617] The system for implementing the present invention utilizes a parent's communication terminal, a child's tag, and a server. The detailed configuration and processing for implementation will be described below.
[1618] Hardware and Software
[1619] 1. Hardware:
[1620] Parent's communication device: A smartphone or tablet with GPS functionality that can communicate with the server.
[1621] Kid's Tag: A small device equipped with a GPS module, a communication module, a generative AI, and an emotion engine.
[1622] Server: A cloud-based central computer system that receives and analyzes data from communication devices and child tags.
[1623] 2. Software:
[1624] Generative AI model (e.g. GPT-4): Activated when an anomaly is detected, it provides instructions to the child in a dialogue format.
[1625] Emotion Engine: Using a voice emotion analysis model, it recognizes emotions by analyzing the child's tone of voice and facial expressions.
[1626] Server program: Performs communication management, location information analysis, anomaly detection, and notification management.
[1627] Data processing and calculation procedures
[1628] 1. Initialization:
[1629] The server synchronizes the parent's communication device with the child's tag, establishing communication and registering the set school route and range of movement information on the server.
[1630] 2. Location Monitoring:
[1631] The child's tag periodically sends its current location information to the server, and the parent's communication device also periodically sends its current location information to the server.
[1632] 3. Anomaly detection:
[1633] The server compares the tag's location information with that of the parent communication device and detects an abnormality if the tag exceeds a set range or a certain distance.
[1634] 4. Generative AI dialogue and guidance:
[1635] If an anomaly is detected, the generative AI will provide interactive instructions through the child's tag, using specific landmarks to guide the child in the appropriate direction.
[1636] Example: "If your child gets lost, you can tell them to walk straight from where they are and head towards the yellow sign."
[1637] 5. Leveraging the Emotion Engine:
[1638] The emotion engine analyzes the child's tone of voice and facial expressions to recognize emotions such as anxiety, and the generative AI reissues instructions in a gentler tone depending on the recognized emotion.
[1639] Example: "If your child seems anxious, give them a gentle reminder, 'It's okay, I'm here for you.'"
[1640] 6. Real-time guidance:
[1641] The server calculates the optimal route based on the current location and destination, and the generation AI guides the child using specific landmarks.
[1642] 7. Parental Notice:
[1643] The server sends the child's current location, the instructions of the AI generator, and the emotional state of the emotion engine to the parent's communication device, allowing the parent to check the child's location in real time on their smartphone screen.
[1644] 8. Emergency Response:
[1645] If the abnormality is not resolved within a certain period of time, the server will send an emergency notification to nearby response agencies and store staff to take prompt action.
[1646] Prompt Sentence Examples
[1647] "Please give gentle instructions to a lost child to help them avoid getting lost. The child's name is ____. They are currently in the central plaza of the shopping area. There is a yellow sign nearby."
[1648] This system allows parents and children to move around safely in shopping malls and large stores, and enables swift and appropriate action to be taken if a child gets lost. By using generative AI and an emotion engine, it is possible to reduce a child's anxiety and safely guide them back to their parents.
[1649] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1650] Step 1:
[1651] Initialization:
[1652] The server synchronizes the parent's communication device with the child's tag. Information about the school route and activity range is registered on the server from the parent's communication device. The input is the school route and activity range information from the parent's communication device, and the output is that information is saved on the server. This establishes communication between the server and the device.
[1653] Step 2:
[1654] Location Monitoring:
[1655] The child's tag periodically acquires its current location information and sends it to the server. In addition, the parent's communication device also periodically sends its current location information to the server. The input is location information from the tag and communication device, and the output is that location information is aggregated on the server. The server uses this data to monitor the location in real time.
[1656] Step 3:
[1657] Anomaly detection:
[1658] The server compares the location information of the tag with that of the parent communication device, and detects an abnormality if the tag goes beyond the set movement range or a certain distance. The input is the location information from the tag and communication device, and the set movement range information, and the output is the result of the abnormality detection. The server processes this and determines whether an abnormality has occurred.
[1659] Step 4:
[1660] Generative AI dialogue and guidance:
[1661] If an anomaly is detected, the server activates the generation AI and provides interactive instructions via the child's tag. Specific landmarks are used to guide the child in the appropriate direction. The input is the detected anomaly and the child's current location, and the output is instructions generated by the generation AI. The generation AI processes this information and provides instructions in a format that is easy for the child to understand.
[1662] Step 5:
[1663] Leveraging the Emotion Engine:
[1664] The emotion engine analyzes the child's tone of voice and facial expression data sent from the tag to recognize emotions such as anxiety. Based on the recognition results, the generation AI adjusts the instructions and issues them again in a gentler tone. The input is the emotional data analyzed by the emotion engine, and the output is the adjusted instructions. The emotion engine analyzes this data and provides feedback to the generation AI.
[1665] Step 6:
[1666] Real-time guidance:
[1667] The server calculates the optimal route based on the current location and destination, and the generation AI guides the child using specific landmarks. The input is the current location and destination location information, and the output is navigation instructions. The server calculates the route and provides the information to the generation AI.
[1668] Step 7:
[1669] Parental Notice:
[1670] The server notifies the parent's communication device of the child's current location, the instructions from the generation AI, and the emotional state of the emotion engine. The input is the child's location, the instructions from the generation AI, and the analysis results from the emotion engine, and the output is the notification content. The server sends this to the parent's communication device in real time.
[1671] Step 8:
[1672] Emergency Response:
[1673] If the abnormality persists for a certain period of time, the server sends an emergency notification to nearby response agencies and store staff. The input is information indicating that the abnormality has not been resolved, and the output is an emergency notification. Based on this, the server initiates an emergency response and requests prompt support.
[1674] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1675] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1676] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1677] [Fourth embodiment]
[1678] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1679] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1680] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1681] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1682] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1683] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1684] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1685] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1686] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1687] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1688] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1689] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1690] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1691] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[1692] The system configuration will be explained in the following steps.
[1693] System configuration
[1694] communication terminal
[1695] This is a device that the parent has, typically a smartphone or tablet. This device has a GPS function and is capable of communicating with a server.
[1696] The parent's communication device communicates with the server to register and update information about the school route and range of movement.
[1697] tag
[1698] The tag is a small device worn by children and contains a GPS module and a communication module, which transmits the child's current location information to a server.
[1699] The tag is equipped with generative AI and has the ability to give instructions to children in an interactive format.
[1700] server
[1701] This is the central computer system that manages all communications. The server receives and analyzes location information from communication terminals and tags, and notifies users in the event of an abnormality.
[1702] The server also controls the generative AI, calculating and sending route guidance and appropriate instructions depending on the scenario.
[1703] Program processing
[1704] 1. Initialization
[1705] The server synchronizes the parent's communication device with the child's tag.
[1706] The communication terminal registers the school route and movement range data in the server.
[1707] 2. Location monitoring
[1708] The tag periodically transmits its location information to the server.
[1709] The parent's communication device also periodically sends location information to the server.
[1710] 3. Anomaly Detection
[1711] The server detects an "abnormality" if the tag is outside the set movement range or if the distance between the parent communication terminal and the tag exceeds a certain range.
[1712] 4. Generative AI dialogue and guidance
[1713] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[1714] The server calculates the optimal route from the current location to the destination (the location of the parent's communication device or the nearest police box).
[1715] 5. Real-time guidance
[1716] The generative AI guides the child in real time, showing them specific landmarks through the tag's built-in speakers and display.
[1717] 6. Parental Notification
[1718] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[1719] 7. Emergency Response
[1720] If the abnormality is not resolved within a certain period of time, the server sends an emergency notification to a nearby response agency (e.g., a police box).
[1721] Specific examples
[1722] Scenario: A kindergartener named Taro is about to get lost while playing.
[1723] 1. Initialization
[1724] Taro's mother's communication device and Taro's tag are synchronized with the server, and Taro's range of activities, including kindergarten and play areas, is registered in advance on the server from his mother's communication device.
[1725] 2. Location monitoring
[1726] Taro's tag continues to periodically send location information from the play area to the server.
[1727] The mother's communication device also sends her current location to the server.
[1728] 3. Anomaly Detection
[1729] The server detects when Taro leaves the play area. If the tag becomes too far from his mother's communication device, this is also detected as an abnormality.
[1730] 4. Generative AI dialogue
[1731] When the server detects an abnormality, it immediately activates the generative AI and sends instructions through Taro's tag, such as, "Taro, you've left the playground. Next, try going to that blue bench."
[1732] 5. Real-time guidance
[1733] The server calculates the optimal route based on Taro's current location and the location of his mother's communication device, and the generative AI guides Taro using specific landmarks.
[1734] 6. Parental Notification
[1735] The server also sends a notification to the mother's communication device, displaying Taro's location and current instructions in real time.
[1736] 7. Emergency Response
[1737] If Taro does not follow the specified route or the abnormality persists, the server will send an emergency notification to the nearest police station.
[1738] In this way, the lost child prevention system of the present invention can automatically detect children before they get lost and safely guide them back to their parents or a designated safe place.
[1739] The processing flow will be explained below.
[1740] Step 1:
[1741] Communication device (parent's smartphone)
[1742] A parent uses their smartphone to synchronize their child's tag with the server, which establishes communication between the parent's smartphone and the tag.
[1743] Step 2:
[1744] Communication device (parent's smartphone)
[1745] Parents register information about their child's school route and range of movement on the server from their smartphones, which then sets up an area where the child can move around safely.
[1746] Step 3:
[1747] Terminal (tag)
[1748] The tag's GPS function is turned on and periodically retrieves its current location, which is continuously stored in the background.
[1749] Step 4:
[1750] Terminal (tag), server
[1751] The tag sends its current location to the server at regular intervals (e.g., every 30 seconds). The server receives the location information sent from the tag and stores it in a database.
[1752] Step 5:
[1753] Device (parent's smartphone)
[1754] The parent's smartphone also periodically sends its current location to the server, which uses this data to calculate the distance to the child's location.
[1755] Step 6:
[1756] server
[1757] The server compares the location information of the tag with that of the parent's smartphone to monitor whether it is within range, and also calculates the distance between the tag and the communication terminal.
[1758] Step 7:
[1759] server
[1760] The server detects an abnormality if the tag goes beyond its set range of movement or if the distance between the tag and the parent's smartphone exceeds a certain range.
[1761] Step 8:
[1762] server
[1763] When the server detects an abnormality, it activates the generative AI module and sends an abnormality notification and instructions to the tag.
[1764] Step 9:
[1765] Terminal (tag)
[1766] When the tag receives an abnormality notification, its generative AI activates and begins giving instructions to the child in a conversational format, such as, "Hanako, it looks like you've taken a wrong turn. Next time, turn right and go to the green and light blue convenience store."
[1767] Step 10:
[1768] server
[1769] The server calculates the optimal route based on the current location and destination (parent's location or police station), and this route information is generated in real time.
[1770] Step 11:
[1771] server
[1772] The server sends the calculated optimal route information to the tag. When the tag receives this information, the generative AI continues the route guidance. Example: "Next, try heading for the red post you see on the right."
[1773] Step 12:
[1774] server
[1775] The server continues to monitor the interaction between the tag and the parent's smartphone in real time, and responds again if the situation changes or new abnormalities occur.
[1776] Step 13:
[1777] server
[1778] The server sends the child's current location information and instructions from the generative AI to the parent's smartphone via push notification.
[1779] Step 14:
[1780] Device (parent's smartphone)
[1781] The parent's smartphone can check the child's location on a map in real time and can send additional instructions to the server if necessary.
[1782] Step 15:
[1783] server
[1784] If the abnormality persists for a certain period of time, the server sends an emergency notification to the nearest police box, which then coordinates an emergency response based on the notification.
[1785] Step 16:
[1786] server
[1787] After receiving confirmation from the police station, the server notifies the tag and the parent's smartphone of the latest information and decides on further action.
[1788] Example 1
[1789] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1790] Conventional child loss prevention systems require parents to manually track their children's location information, making it difficult to respond in real time. Furthermore, they lack the ability to respond quickly when a child leaves a designated area, or to immediately notify parents when an abnormality occurs. Therefore, a system that provides complete peace of mind is needed.
[1791] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1792] In this invention, the server includes a means for notifying the parent's communication device of the child's current location information and the generative AI's instructions in real time, a means for the generative AI to issue specific instructions to the child via a speaker or display equipped on the tag, and a means for the parent's communication device to display the notification received from the server via an application. This allows the system to quickly detect when the child moves outside of their range of movement and use the generative AI to guide them in real time. In addition, in the event of an abnormality, the system can quickly notify the parent or response agency, ensuring the child's safety.
[1793] A "parental communication device" is a device owned by a parent and used to monitor and receive location information about a child, typically a mobile device such as a smartphone or tablet.
[1794] A "child tag" is a small device that a child carries and is equipped with a GPS module and a communication module for transmitting current location information.
[1795] "Location Information" means geographic location data determined using a positioning system such as GPS.
[1796] A "communication terminal" is a terminal used for data communication, and is usually a device such as a smartphone, tablet, or PC.
[1797] "School route and range of movement" refers to the geographical area within which a child is permitted to travel, as defined and registered in advance by the parent.
[1798] The "server" is a central computer system that manages communication between multiple devices, receives and analyzes location information, and controls the generative AI.
[1799] The "certain distance" is a distance set between the parent's communication terminal and the child's tag that is recognized as being outside the range of movement.
[1800] An "abnormality" is a situation that is detected when a child's tag goes outside the set range of movement or exceeds a certain distance.
[1801] "Generative AI" is a system that uses artificial intelligence technology to give children interactive instructions, such as an AI model that provides route guidance or responds to abnormal situations.
[1802] "A means of giving interactive instructions" is a function that allows the generative AI to give specific instructions to children via tags.
[1803] An "optimal route" is a calculated shortest or safest route from your current location to your destination.
[1804] "Landmarks" are buildings or objects that serve as landmarks used to guide children.
[1805] "Means for notifying in real time" is a function that allows the server to immediately notify the parent communication terminal of any abnormalities or the current situation.
[1806] An "emergency notification" is an emergency alert sent to nearby response agencies if the abnormality is not resolved within a certain period of time.
[1807] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[1808] Equipment and software configuration
[1809] Parent's communication device:
[1810] The communication devices held by parents are smartphones or tablets. These devices have GPS functionality and are capable of data communication with a server. The communication devices must have an application installed to register information about the school route and range of movement.
[1811] Kids Tags:
[1812] The tag is a small device worn by a child and is equipped with a GPS module and a communication module. The tag transmits the current location information to a server. Furthermore, the tag is equipped with a generative AI that can give instructions to the child in an interactive format. The tag also has a speaker and a display that are used to communicate the generative AI's instructions to the child.
[1813] server:
[1814] The server is a central computer system that manages all communications. It receives and analyzes location information from communication devices and tags, and notifies users in the event of an abnormality. It also controls the generative AI, calculating and sending route guidance and appropriate instructions according to the scenario.
[1815] Process Overview
[1816] 1. Initialization
[1817] The server synchronizes the parent's communication device with the child's tag, and the parent uses the communication device to register data about the child's school route and range of activities on the server.
[1818] 2. Location monitoring
[1819] The child's tag periodically transmits its location information to the server, and the parent's communication device also transmits its current location information to the server.
[1820] 3. Anomaly Detection
[1821] The server analyzes the transmitted location information and detects abnormalities if the tag moves outside the set range of movement or if the distance between the parent communication terminal and the tag exceeds a certain range.
[1822] 4. Generative AI dialogue and guidance
[1823] If an abnormality is detected, the server activates a generative AI that gives interactive instructions to the child via the tag.
[1824] 5. Real-time guidance
[1825] The server calculates the optimal route from the current location to the destination, and the generative AI gives the child instructions using specific landmarks, e.g., "Walk toward the next blue bench you see."
[1826] 6. Parental Notification
[1827] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[1828] 7. Emergency Response
[1829] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to a nearby responding agency (e.g., the police station).
[1830] Specific examples
[1831] Scenario: A kindergarten-aged child is about to get lost while playing.
[1832] 1. Initialization
[1833] The parent's communication device (smartphone) and the child's tag are synchronized with the server. The parent's communication device registers the child's favorite kindergarten and play areas in advance on the server.
[1834] 2. Location monitoring
[1835] The child's tag periodically sends location information from the playground to a server, and the parent's device also sends their current location to the server.
[1836] 3. Anomaly Detection
[1837] The server detects if the child leaves the play area or if the distance between the tag and the parent's communication device exceeds a set range.
[1838] 4. Generative AI dialogue
[1839] When the server detects an abnormality, the generative AI is activated and issues instructions via tags, such as, "You've left the playground. Next, try going to that blue bench."
[1840] 5. Real-time guidance
[1841] The server calculates the optimal route from the child's current location to the location of the parent's communication device, and the generative AI guides the child using specific landmarks.
[1842] 6. Parental Notification
[1843] The server sends a notification to the parent's communication device, displaying the child's location and the instructions of the generative AI in real time.
[1844] 7. Emergency Response
[1845] If the child does not follow the designated route or the abnormality persists, the server will send an emergency notification to the nearby police station or police box.
[1846] Example input to a generative AI model
[1847] Below are some example prompts to input to a generative AI model:
[1848] For example: "Child is out of range. Please guide them to the next landmark. For example, 'Let's try that blue bench next.'"
[1849] The above is a specific embodiment for carrying out the invention. This system ensures the safety of children and reduces parental anxiety.
[1850] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1851] Step 1: Initialization
[1852] The server synchronizes the parent's communication device with the child's tag, and data on the parent's school route and range of movement is sent from the communication device to the server.
[1853] How it works: Parents use their communication devices to enter information about their child's range of activities, such as the route to school and playgrounds, into a dedicated application, and then upload the data to a server, which then stores this information in a database.
[1854] Input: School route and movement range data sent from parent's communication device.
[1855] Output: Home range information stored in a database.
[1856] Step 2: Location Monitoring
[1857] The tag periodically acquires its location information from GPS and sends it to the server. The parent's communication device also periodically sends its current location information to the server.
[1858] Specific operation: The tag and the parent communication device activate their respective GPS functions to obtain their current location information, which is then sent to the server via the communication module.
[1859] Input: Location information sent from the tag and parent communication device.
[1860] Output: Location data collected on the server.
[1861] Step 3: Anomaly detection
[1862] The server analyzes the location information sent from the tag and the parent's communication device and detects abnormalities if the tag moves out of its range or exceeds a certain distance.
[1863] How it works: The server analyzes the location information in real time and compares it with the movement range data stored in the database. If the device goes out of range or exceeds a certain distance, an anomaly flag is raised and an abnormality is detected.
[1864] Input: Location information sent from the tag and parent communication device.
[1865] Output: Anomaly flag and anomaly detection notification.
[1866] Step 4: Generative AI dialogue and guidance
[1867] When the server detects an abnormality, it activates a generative AI and gives interactive instructions to the child via the tag.
[1868] Specific operation: The server inputs prompt text into the generative AI, generates appropriate instructions, and sends the generated instructions to the tag, which then communicates them to the child via a speaker or display.
[1869] Input: Abnormal flag, prompt for the generative AI.
[1870] Output: Specific instructions for the child.
[1871] Step 5: Real-time guidance
[1872] Based on the instructions sent to the tag, the generative AI guides the child in real time using specific landmarks via speakers and displays.
[1873] How it works: The server calculates the optimal route from the current location to the destination and sends it back to the generative AI. The generative AI then generates instructions, such as "Walk towards the next blue bench you see," and sends them to the tag. The tag then relays this to the child via a speaker or display.
[1874] Input: Current location, destination, and prompt for the generative AI.
[1875] Output: Specific instructions using landmarks.
[1876] Step 6: Parental Notification
[1877] The server notifies the parent's communication device in real time of the child's current location and the instructions of the generative AI.
[1878] How it works: The server sends the child's current location and the instructions of the generative AI to the parent's device, who can then view this information through a dedicated application.
[1879] Input: Current child location, instructions for the generative AI.
[1880] Output: Real-time notification to parent's communication device.
[1881] Step 7: Emergency response
[1882] If the abnormality persists for a certain period of time or if the child does not follow the instructions of the generative AI, the server will send an emergency notification to nearby response agencies.
[1883] Specific operation: If the abnormality is not resolved within the set time, the server will send an emergency notification to pre-registered nearby response agencies (e.g., police stations, police boxes). The emergency notification will include the child's current location and details of the abnormality.
[1884] Input: Abnormal condition, time information.
[1885] Output: Emergency notification to responding agencies.
[1886] The above is a detailed flow of the program processing of this system.
[1887] (Application example 1)
[1888] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1889] Previous child location monitoring systems lacked sufficient measures to deal with situations where a child went outside the child's range, and had limited functionality for notifying parents of accurate location information in real time. As a result, there were problems with children becoming lost or falling into dangerous situations. Furthermore, there was a lack of specific instructions for children when an abnormality occurred, and appropriate responses in emergencies.
[1890] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1891] In this invention, the server is equipped with a tag for the child that is synchronized with the parent's communication terminal, and includes means for the tag to transmit location information of the current location, means for the parent's communication terminal to register the school route and range of activities, means for the server to receive location information from the tag and the communication terminal and detect an abnormality if the distance exceeds a certain distance or the designated range of activities, means for the server to activate a generative AI and give interactive instructions to the child via the tag when the server detects an abnormality, means for the server to calculate an optimal route from the current location and destination and send it to the tag, means for the generative AI to guide the child based on the optimal route using specific landmarks, means for the server to monitor and notify interactions between the tag and communication terminal in real time, means for the server to send an emergency notification to nearby response agencies if the abnormality is not resolved within a certain period of time, and means for the generative AI to explain the abnormal situation to the child interactively and give instructions based on specific landmarks. This allows for rapid detection of abnormalities even if a child goes outside the child's range, and specific instructions and guidance can be given using generative AI, enabling real-time notifications to parents and rapid emergency notifications to nearby response agencies.
[1892] A "parent's communication device" is a device with communication capabilities owned by the parent, and is primarily a smartphone or tablet.
[1893] A "child tag" is a small device worn by a child that is equipped with a GPS module and a communication module and has the ability to transmit current location information.
[1894] The "server" is a centralized management system that receives location information from communication terminals and tags, and analyzes and issues instructions.
[1895] "Generative AI" refers to generative artificial intelligence that has the ability to generate sentences and images and interact with users.
[1896] "A means of giving instructions in an interactive format" refers to a system in which the generative AI provides guidance and instructions to children via voice or text.
[1897] "Means for calculating optimal route" refers to a function that executes an algorithm to calculate the most efficient and safe route based on information about the current location and destination.
[1898] A "landmark" is a building, place, or object that serves as a landmark for children.
[1899] "Means for real-time monitoring and notification" refers to a function in which the server constantly checks location information and immediately notifies if an abnormality occurs.
[1900] "Emergency notification" is a system that quickly contacts pre-registered response organizations when a crisis situation occurs.
[1901] MODE FOR CARRYING OUT THE INVENTION
[1902] System Configuration
[1903] To implement this invention, a parent's communication terminal (smartphone), a child's tag device, and a server that relays data between these devices are required. Software including generative AI must also be installed on the tag and server.
[1904] Hardware
[1905] Parent's communication device: Smartphone or tablet (with GPS and communication functions)
[1906] Child tag device: A device equipped with a GPS module and a communication module
[1907] Server: Cloud platform (e.g., Amazon Web Services (AWS), Microsoft Azure)
[1908] software
[1909] Generative AI: Generative AI such as OpenAI GPT-4 and GPT-3.5
[1910] Server management software: location analysis and notification system
[1911] Program processing description
[1912] The server receives location information, detects abnormalities, activates the generative AI, and performs a series of processes including real-time instructions and notifications, making it possible to detect and respond to abnormalities when a child goes outside the set range of movement.
[1913] 1. Receiving and registering location information
[1914] The parent's communication terminal registers data on the school route and range of movement on the server.
[1915] The child's tag device and the parent's communication terminal periodically transmit location information to a server.
[1916] 2. Anomaly detection and generative AI activation
[1917] The server analyzes the data and detects an abnormality if the tag goes beyond its range or exceeds a certain distance.
[1918] When an abnormality is detected, the server activates a generative AI and issues specific instructions to the child via the tag.
[1919] 3. Optimal route calculation and guidance
[1920] The server calculates the optimal route based on the current location and destination.
[1921] Generative AI guides children using specific landmarks.
[1922] 4. Real-time monitoring and notification
[1923] The server monitors the data between the tag and the parent's communication terminal in real time and notifies the parent in the event of an abnormality.
[1924] If the anomaly persists for a certain period of time, the server will send an emergency notification to nearby response agencies.
[1925] Example: Measures to prevent children from getting lost in the store
[1926] For example, while shopping at a mall, a parent launches the "Kids Secure" app and sets a range of movement. If the child goes outside the set range within the store, the tag notifies the server of the abnormality, and the server activates the generative AI. The generative AI then gives the child instructions in a dialogue format, as follows:
[1927] Generative AI interaction with children:
[1928] "○○-kun, you have exceeded the mall's set range. Please return to the elevator."
[1929] Parental Notice:
[1930] "○○ has gone out of range. He is currently near the elevator on Floor B."
[1931] This system allows for a quick response in the event of a child going missing, ensuring parents and responding authorities are notified quickly.
[1932] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1933] Step 1:
[1934] The server initializes and synchronizes the parent's communication device and the child's tag. It receives data on the school route and activity range from the parent's communication device and registers this on the server. The input is the school route and activity range data sent from the parent's communication device, and the output is storage in the server's registration database. Specifically, the parent's communication device sends GPS setting information to the server, which stores it in the database.
[1935] Step 2:
[1936] The server periodically receives location information from the child's tag device and the parent's communication terminal. The input is the location information sent from the tag device and the parent's communication terminal, and the output is the storage of the received location information in the server. In this process, the tag device and the parent's communication terminal periodically send location information to the server, which then stores it in a database.
[1937] Step 3:
[1938] The server analyzes the received location information in real time and detects an anomaly if the tag goes beyond the set movement range or if the distance between the tag and the communication terminal exceeds a certain range. The input is the location information stored on the server, and the output is the anomaly detection result. Specifically, an algorithm in the server analyzes the location information and checks for deviation from the movement range or excess distance.
[1939] Step 4:
[1940] When the server detects an abnormality, it activates the generative AI and gives interactive instructions to the child via the tag device. The input is the abnormality detection result, and the output is the instructions created by the generative AI. The generative AI generates a prompt such as "Taro, move from your current position to the blue bench" and sends it to the tag device.
[1941] Step 5:
[1942] The server uses generative AI to calculate the optimal route based on the current location and destination. The input is current location information from the child's tag device and the parent's communication device, and the output is the calculated optimal route. In this process, the server calculates the route using GPS data for the current location and destination and sends it to the tag device.
[1943] Step 6:
[1944] The generative AI guides the child along the calculated optimal route, using specific landmarks. The input is the calculated optimal route and landmark information, and the output is detailed guidance instructions created by the generative AI. Specific landmark instructions, such as "Next, turn right in front of that red postbox," are displayed on the tag device or sent via voice.
[1945] Step 7:
[1946] The server monitors the exchange between the tag device and the parent's communication terminal in real time, and notifies the parent in the event of an abnormality. The input is the location information received in real time and the abnormality detection results, and the output is the notification content to the parent. In concrete terms, the server notifies the parent's communication terminal, for example, "Taro has exceeded the set range. His current location is near the elevator on floor B."
[1947] Step 8:
[1948] If the abnormality is not resolved for a certain period of time, the server will send an emergency notification to a nearby response agency. The input is the result of continuous abnormality detection, and the output is the content of the emergency notification to the nearby response agency. Specifically, the server automatically notifies the response agency based on the registered emergency contact information, saying, "The child has exceeded the set range and the abnormality continues. The current location is ____."
[1949] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1950] To implement this invention, a parent's communication terminal, a child's tag, and a server that relays and processes data between the devices are required. Furthermore, the tag must be equipped with a generative AI and an emotion engine.
[1951] The system configuration is explained as follows.
[1952] System configuration
[1953] communication terminal ...
Claims
1. A tag for a child synchronized with a parent's communication terminal, the tag transmitting location information of the child's current location; A means for registering a school route and a range of activities in the communication terminal; a server that receives location information from the tag and the communication terminal, and detects an abnormality when the tag and the communication terminal exceed a certain distance or deviate from a designated movement range; means for activating a generative AI when the server detects an abnormality and giving interactive instructions to the child via the tag; A means for the server to calculate an optimal route from the current location and the destination and transmit the route to the tag; A means for the generative AI to guide the child using specific landmarks based on the optimal route; The system includes a means for the server to monitor and notify in real time the interaction between the tag and the communication terminal.
2. 2. The system according to claim 1, wherein the generative AI comprises means for providing route guidance to a child using specific landmarks.
3. 2. The system according to claim 1, wherein said server comprises means for sending an emergency notification to a nearby response organization if the abnormality is not resolved within a certain period of time.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A