System

Abstract

A system is provided.SOLUTION: A system, comprising: means for storing a normal activity range of a child; means for acquiring current location information of the child; means for matching the normal activity range with the acquired current location information; means for generating an alert if the child goes out of the normal activity range; means for sending the generated alert to a terminal of a guardian; and means for contacting police if the mentioned alert is approved by the guardian.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Ensuring the safety of children is an important issue in modern society. In particular, there is an increasing risk of children straying from their normal range of movement or entering dangerous areas. In such situations, parents are required to quickly detect abnormal behavior from their children and take appropriate action. However, current systems require parents to manually check their children's location information, making real-time monitoring difficult. Furthermore, there is a lack of a means to quickly contact the police when abnormal behavior occurs, which raises concerns that parents may be slow to respond. The present invention aims to solve these problems and provide a system that enables parents to reliably ensure the safety of their children. [Means for solving the problem]

[0005] The present invention provides a system that stores a child's usual range of activity, acquires current location information, and compares it. Specifically, the system uses a means for storing a child's usual range of activity and a means including a wearable device that periodically acquires the child's current location information. This generates an alert if the child leaves the usual range of activity and sends the alert to the parent's device in real time. It also includes a means for automatically contacting the police if the generated alert is approved by the parent. This allows parents to quickly detect abnormal behavior in their children and take appropriate action.

[0006] "Means for storing a child's usual range of activities" refers to a function or device that records a child's daily travel routes and locations as information such as GPS coordinates and time of day.

[0007] A "means for obtaining a child's current location" is a function or device for obtaining the GPS coordinates of a child's current location.

[0008] "Means for comparing the usual range of movement with the acquired current location information" refers to a function or device that compares the child's stored usual range of movement with the current location information acquired in real time and determines whether there are any matches or abnormalities.

[0009] "Means for generating an alert" refers to a function or device that generates a warning message when a child deviates from their normal range of behavior or enters a dangerous area.

[0010] "Means for sending the generated alert to the parent's device" refers to a function or device that notifies the parent of the generated warning message on a device such as a smartphone or tablet used by the parent.

[0011] "Means to contact the police" refers to a function or device that automatically sends a message to the nearest police station when a parent or guardian determines that their child is lost. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0013] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0014] First, the terms used in the following description will be explained.

[0015] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0016] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0017] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0018] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0019] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0020] [First embodiment]

[0021] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0022] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0023] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0024] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0025] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0026] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0027] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0028] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0029] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0030] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0031] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0032] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0033] The present invention is a system for monitoring a child's range of activity and detecting abnormal behavior. This system comprises a means for storing the child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert when the child goes outside the usual range of activity, a means for sending the generated alert to a parent's device, and a means for contacting the police.

[0034] Memory of range of movement

[0035] Subject: User (parent)

[0036] Parents use a smartphone app to define their child's usual range of movement, which is defined as a geographical area associated with GPS coordinates. Parents register locations such as home, school, and parks through the app interface.

[0037] Subject: Server

[0038] The server receives the movement range data sent by the parents and stores it in a database, which is used to map the child's usual movement patterns geographically.

[0039] Monitoring range of activities

[0040] Subject: Terminal (wearable device)

[0041] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[0042] Subject: Device (smartphone)

[0043] The location information obtained by the wearable device is sent to the parent's smartphone app and uploaded from the app to a server.

[0044] Subject: Server

[0045] The server stores the received location information and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, it is determined to be abnormal activity.

[0046] Abnormal behavior detection

[0047] Subject: Server

[0048] The server generates an alert message when abnormal behavior is detected, which includes the child's current location, details of the abnormal behavior, and emergency contact information.

[0049] Subject: Device (smartphone)

[0050] The alert message is sent to the parent's smartphone as a push notification, allowing the parent to immediately receive the message and consider how to respond.

[0051] Identifying a missing child and contacting the police

[0052] Subject: User (parent)

[0053] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[0054] Subject: Device (smartphone)

[0055] The lost child identification information is immediately sent to the server.

[0056] Subject: Server

[0057] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification to the nearest police station, including the child's last known location and the parent's contact information.

[0058] Specific examples

[0059] For example, if a child is playing in a park on their way home from school after school, a parent can use a smartphone app to set three locations - home, school, and the park - as their child's normal range of activity. As long as the child is playing within the designated range of activity, the parent will not receive any special alerts.

[0060] However, if a child deviates from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server, which determines this as abnormal behavior. The server immediately generates an alert and sends it to the parent's smartphone via push notification. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to the police. This allows for a swift and effective response.

[0061] This system allows parents to go about their daily lives with peace of mind while ensuring the safety of their children.

[0062] The processing flow will be explained below.

[0063] Step 1:

[0064] Subject: User (parent)

[0065] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[0066] Step 2:

[0067] Subject: Server

[0068] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[0069] Step 3:

[0070] Subject: Terminal (wearable device)

[0071] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[0072] Step 4:

[0073] Subject: Terminal (wearable device)

[0074] The acquired location information is sent to the parent's smartphone app in real time, and the location information is constantly updated.

[0075] Step 5:

[0076] Subject: Device (smartphone)

[0077] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[0078] Step 6:

[0079] Subject: Server

[0080] The server stores the location information received in real time and compares it with stored data on normal activity ranges. If the comparison results in the location being outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal.

[0081] Step 7:

[0082] Subject: Server

[0083] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior.

[0084] Step 8:

[0085] Subject: Server

[0086] The generated alert message is sent as a push notification to the parent's smartphone.

[0087] Step 9:

[0088] Subject: Device (smartphone)

[0089] A push notification is sent to the parent's smartphone, and an alert message is displayed on the screen. The parent can then review the message and consider how to respond.

[0090] Step 10:

[0091] Subject: User (parent)

[0092] The parent presses the "Confirm Lost Child" button in the app. This action notifies the server that the child is lost.

[0093] Step 11:

[0094] Subject: Device (smartphone)

[0095] The lost child certification information is sent to the server.

[0096] Step 12:

[0097] Subject: Server

[0098] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[0099] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt appropriate action.

[0100] Example 1

[0101] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0102] Modern society demands technology to ensure the safety of children. However, many monitoring systems only track children's locations and lack the means to detect abnormal behavior or respond quickly. This creates a need for a system that allows parents to monitor their children's safety in real time and respond quickly when abnormal behavior occurs. To address this issue, the present invention aims to provide a system that monitors the range of children's activities, sends an alert to parents when an abnormality is detected, and contacts the police if necessary.

[0103] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0104] In this invention, the server includes a means for storing the child's normal range of movement set by the guardian, a means for periodically acquiring the child's current location information, and a means for comparing the normal range of movement with the acquired current location information. This allows an alert to be generated if the child leaves the normal range of movement, indicating abnormal behavior, and the alert can be sent as a push notification to the guardian's mobile information terminal. The server also includes a means for automatically sending contact information to police authorities if the guardian receives the alert and identifies the child as lost. This ensures the child's safety and enables a prompt and effective response.

[0105] "Area of ​​Activity" refers to the geographic area where a child typically moves, as designated by a parent, and is defined by GPS coordinates.

[0106] "Current location information" is real-time GPS data acquired by a portable device worn by the child, and indicates the child's current location.

[0107] "Abnormal behavior" is behavior detected when a child moves outside of their normal range of movement or into a designated danger zone.

[0108] An "alert" is a notification message that is generated when abnormal behavior is detected and includes the child's current location and details of the abnormal behavior.

[0109] "Mobile information terminal" means a mobile device, such as a smartphone or tablet, used by a parent or guardian to receive alerts.

[0110] "Lost child recognition" is an operation that parents perform within the app when they determine that their child is lost, and it triggers the sending of contact information to police authorities.

[0111] "Law enforcement authorities" are public agencies that receive contact when a child goes missing.

[0112] "Location means" refers to technology for determining a child's current location, specifically the Global Positioning System (GPS).

[0113] The present invention provides a system for monitoring a child's range of movement and detecting abnormal behavior, which is implemented using the following hardware and software.

[0114] Hardware

[0115] 1. User (parent) smartphone:

[0116] Parents use a smartphone app to set their child's usual range of movement, and the parent's smartphone receives the child's location information sent from the wearable device and uploads it to a server.

[0117] Specific hardware used: Smartphones (e.g., iPhones, Android devices)

[0118] 2. Children's wearable devices:

[0119] The wearable device worn by the child periodically obtains its current location information using GPS, and this information is sent to the parent's smartphone at regular intervals (e.g., every minute).

[0120] Specific hardware used: Wearable devices (e.g., Apple Watch, Fitbit)

[0121] 3. Server:

[0122] The server receives location information from the parents' smartphones, stores it in a database, and compares the parents' usual range of movement with the current location information.

[0123] Specific hardware used: Servers (e.g. AWS, Google Cloud)

[0124] software

[0125] 1. Smartphone app:

[0126] This is an application installed by parents, through which users can set their child's movement limits and receive notifications of abnormal behavior.

[0127] Specific software used: Mobile apps (e.g. iOS apps, Android apps)

[0128] 2. Server-side software:

[0129] The server stores and compares location information and generates an alert if abnormal behavior is detected. The generated alert is sent to the parent's smartphone. In addition, if the parent declares the child lost, contact information is automatically sent to the police.

[0130] Specific software used: database management systems, notification systems (e.g., MySQL, Firebase)

[0131] Specific operation explanation

[0132] For example, a child can play in a park on their way home from school after school. Parents can use a smartphone app to set three locations - home, school, and the park - as their normal range of activity. As long as the child is playing within the designated range of activity, no alerts will be generated.

[0133] However, if a child strays from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server. The server compares this location information with their usual range of movement and determines that the behavior is abnormal. The server immediately generates an alert and sends it as a push notification to the parent's smartphone. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to police authorities. This enables a swift and effective response.

[0134] Prompt Sentence Examples

[0135] Here are some examples of prompts for generative AI models:

[0136] Please explain the system's process for generating an alert and notifying parents when a child deviates from their normal range of movement. Please use sentences with the server, device, or user as the subject, clearly indicating the names of the specific hardware and software used, and include the type of data processing and calculations performed. Please also provide an explanation of each stage: recording the range of movement, monitoring, detecting abnormal behavior, recognizing the child as lost, and contacting the police, and provide specific examples.

[0137] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0138] Step 1:

[0139] Subject: User (parent)

[0140] Parents use a smartphone app to set the usual range of their child's activities. Through the app interface, parents register locations such as home, school, and park with GPS coordinates. This input data (GPS coordinates) is entered through the smartphone interface and sent to the server.

[0141] Input: GPS coordinates entered by parent

[0142] Output: Movement range data sent to the server

[0143] Step 2:

[0144] Subject: Server

[0145] The server receives the movement range data sent by the parent and stores it in a database, which is later used to match the child's location data.

[0146] Input: Movement range data sent by parent

[0147] Output: Home range data stored in a database

[0148] Step 3:

[0149] Subject: Terminal (wearable device)

[0150] The wearable device worn by the child uses GPS to obtain current location information at regular intervals, for example, once every minute, and sends this location information to the parent's smartphone via Bluetooth or Wi-Fi.

[0151] Input: GPS location information obtained periodically

[0152] Output: Location information sent to parent's smartphone

[0153] Step 4:

[0154] Subject: Device (smartphone)

[0155] The location information sent from the wearable device is received by the parent's smartphone app, which then uploads the location information to a server.

[0156] Input: Location information received from a wearable device

[0157] Output: Location information uploaded to the server

[0158] Step 5:

[0159] Subject: Server

[0160] The server stores the received location information in a database and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, the server determines this as abnormal activity and generates an alert.

[0161] Input: Location information sent from a wearable device

[0162] Data processing: Matching location information with pre-stored movement range data

[0163] Output: Alert when abnormal behavior is detected

[0164] Step 6:

[0165] Subject: Server

[0166] When abnormal behavior is detected, an alert message containing the child's current location and details about the abnormal behavior is generated and sent as a push notification to the parent's smartphone.

[0167] Input: Anomalous behavior detection results and corresponding details

[0168] Output: Alert notification sent to parent's smartphone

[0169] Step 7:

[0170] Subject: User (parent)

[0171] If a parent or guardian checks the alert notification and determines that their child is lost, they can press the "Confirm Lost Child" button in the smartphone app, which sends the lost child confirmation information to the server.

[0172] Input: Parental control to identify lost child

[0173] Output: Lost child certification information sent to the server

[0174] Step 8:

[0175] Subject: Server

[0176] The server receives the missing child identification information, consults the database of nearby police stations, and automatically sends a report to the nearest police station, including the child's last known location and the parent's contact information.

[0177] Input: Lost child identification information sent by parent

[0178] Output: Police report sent to authorities

[0179] (Application example 1)

[0180] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0181] Conventional child safety monitoring systems have limitations in real-timeness and accuracy when acquiring location information and generating and sending alerts, and parents have had to work hard to properly set their child's range of movement. Furthermore, they lacked a means of quickly responding when abnormal behavior was detected, which could lead to delays in identifying a child as lost and contacting the police. The purpose of this invention is to solve these problems, more reliably ensure the safety of children, and allow parents to live their daily lives with peace of mind.

[0182] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0183] In this invention, the server includes a means for setting a range of movement based on GPS coordinates set by the guardian, a means for periodically sending location information acquired from the wearable device to the server, a means for the server to compare the location information with the normal range of movement, generate an alert, and send it as a push notification, a means for providing a button for the guardian to declare the child as lost based on the alert message, and a means for the server to receive the child's recognition information from the guardian and automatically send a notification to the police. This enables early detection of abnormal behavior outside the normal range of movement and rapid alert transmission, allowing for faster recognition of the child as lost and automatic reporting to the police, significantly improving the safety of children.

[0184] "Child" refers to a minor under a certain age.

[0185] The "normal range of activity" is the range of a child's general activities set by the parent or guardian, and is a geographical area set based on GPS coordinates.

[0186] "Current location information" refers to a child's specific geographic coordinates and is data obtained through location measurement technology such as GPS.

[0187] "Verifying" refers to comparing the obtained current location information with the stored normal range of movement to determine whether there is a match or a mismatch.

[0188] An "alert" is a warning message that is generated and notified to parents when a child goes outside of their normal range of activity.

[0189] A "guardian" is someone who has supervisory responsibility for a child, usually a parent or legal guardian.

[0190] "Terminal" refers to a device that forms part of the system, and in this case, this mainly refers to smartphones and wearable devices.

[0191] A "server" is a computer system that processes and stores data, and is responsible for storing and collating location information, generating alerts, etc.

[0192] "GPS coordinates" are numerical data that indicate a specific location on Earth, and are composed of latitude and longitude.

[0193] A "wearable device" is a portable electronic device worn by a child that can acquire location information and collect other data.

[0194] "Push notification" is a method of sending information in real time to devices such as smartphone apps.

[0195] "Lost child certification" refers to the act of a parent confirming an alert, determining that their child is lost, and registering that information in the system.

[0196] "Automatic notification" is a mechanism by which a server sends information without requiring human intervention when certain conditions are met.

[0197] System Program

[0198] The system according to the present invention is a program for monitoring a child's range of movement and detecting abnormal behavior. The system consists of the following main components:

[0199] 1. A way to remember your child's normal range of behavior

[0200] User (Parent)

[0201] Parents use a smartphone app to define their child's usual range of movement, which is registered as GPS coordinates. Parents input the location of their home, school, park, etc. through the app interface.

[0202] 2. How to get your child's current location

[0203] Terminal (wearable device)

[0204] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[0205] 3. Sending and saving location information to the server

[0206] Device (smartphone)

[0207] The location information acquired by the wearable device is sent to the parent's smartphone app, which then sends the location information to a server.

[0208] 4. Matching your usual range of movement with your current location

[0209] server

[0210] The server stores the received location information in a database. The server compares it with normal movement range data and detects abnormal behavior. If the user moves outside the specified range, it is determined to be abnormal behavior.

[0211] 5. Detecting Abnormal Behavior and Generating Alerts

[0212] server

[0213] When abnormal behavior is detected, the server generates an alert message, which includes the current location and details of the abnormal behavior.

[0214] 6. Push notifications for parents

[0215] Device (smartphone)

[0216] The alert message is sent to the parent's smartphone as a push notification, so the parent can receive the notification immediately.

[0217] 7. Confirming the child is lost and contacting the police

[0218] User (Parent)

[0219] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[0220] Device (smartphone)

[0221] The lost child certification information is sent to the server.

[0222] server

[0223] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification containing the child's last known location and parental contact information.

[0224] Hardware and software used

[0225] Hardware:

[0226] Smartphone (iOS, Android)

[0227] Wearable devices (GPS trackers)

[0228] Server (AWS, Google Cloud)

[0229] software:

[0230] Smartphone app (Xcode, Android Studio)

[0231] Server-side program (Node.js)

[0232] Database (MongoDB)

[0233] Communication protocol (REST API)

[0234] Push notification service (Firebase)

[0235] Specific examples and prompts for the generative AI model

[0236] Specific examples

[0237] For example, when a child is playing in a park on their way home from school after school, parents can set their home, school, and park as their normal range of movement. If the child strays from this range and moves to a dangerous neighboring town, the wearable device detects the child's location, and the data is sent to the server, where it is detected as an anomaly. The server immediately sends an alert to the parent via push notification, and the parent can "recognize the child as lost" within the app, and the information is then sent to the police.

[0238] Prompt sentence for generative AI model

[0239] Based on your invention, please generate sample code for a smartphone application that monitors children's movements and detects abnormal behavior. The application will have the following features:

[0240] 1. A feature that allows parents to set a normal range of movement (based on GPS coordinates)

[0241] 2. A function to send location information obtained from a child's wearable device to a server

[0242] 3. A feature that generates an alert and sends a push notification to the parent's smartphone if the child moves outside of their normal range of movement.

[0243] 4. A function that automatically sends a notification to the police if a parent or guardian declares the child lost.

[0244] The code should utilize Node.js and MongoDB and include server-side processing.

[0245] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0246] Step 1:

[0247] Subject: User (parent)

[0248] Parents launch the smartphone app and set their child's usual range of movement by entering GPS coordinates of their home, school, park, etc. through the app interface. This data is temporarily stored in the smartphone app and then sent to the server.

[0249] Step 2:

[0250] Subject: Server

[0251] The server receives the movement range data sent by the guardian and stores it in a database. The received data is kept as movement range setting information and used for later matching processing. The server confirms that the saving is complete and returns a completion message to the guardian's smartphone.

[0252] Step 3:

[0253] Subject: Terminal (wearable device)

[0254] The wearable device worn by the child periodically obtains its current location information using GPS. This location data is sent to a smartphone at regular intervals (e.g., every minute). The input is sensor data, and the output is the current GPS coordinates.

[0255] Step 4:

[0256] Subject: Device (smartphone)

[0257] The location information received from the wearable device is temporarily stored in the smartphone, and then sent to the server. The smartphone app sends the location information to the server using an HTTP request (e.g., POST method). The input of this step is the location data of the wearable device, and the output is a request to the server.

[0258] Step 5:

[0259] Subject: Server

[0260] The server receives location information sent from the smartphone and stores it in a database. The stored location information is compared with stored data on the user's normal range of movement. This comparison is performed using SQL queries and database search algorithms. The input is the location data, and the output is the comparison result.

[0261] Step 6:

[0262] Subject: Server

[0263] If the server determines that the location information is outside the normal range of activity, it generates an alert as an abnormal behavior determination. This alert message includes the current location information and details of the abnormal behavior. The generated alert is sent to the parent's smartphone as a push notification. The input is location data and activity range data, and the output is the alert message. The server sends the message using a push notification service such as Firebase.

[0264] Step 7:

[0265] Subject: Device (smartphone)

[0266] An alert message is sent to the parent's smartphone. The parent checks the notification and confirms any abnormal behavior through the app. When the parent presses the "Confirm Lost Child" button, the information is sent from the smartphone to the server. The input is the user's operation, and the output is the transmission of the confirmation information to the server.

[0267] Step 8:

[0268] Subject: Server

[0269] The server receives the lost child identification information and automatically sends a notification by referencing the database of the local police station. This notification includes the child's last known location and the parent's contact information. The input is the identification information, and the output is a notification to the police. This process allows for a quick response.

[0270] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0271] The present invention is a system that combines a system that monitors a child's range of activity and detects abnormal behavior with an emotion engine that recognizes the parent's emotions in response to alert notifications and proposes optimal countermeasures. This system is composed of a means for storing a child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert if the child goes outside the usual range of activity, a means for sending the generated alert to the parent's device, a means for the emotion engine that recognizes the parent's emotions, and a means for contacting the police.

[0272] The introduction of the emotion engine makes it possible to perform the following specific processes:

[0273] Memory of range of movement

[0274] Subject: User (parent)

[0275] Parents use a smartphone app to define their child's usual range of movement, which is then associated with GPS coordinates and stored in the system.

[0276] Subject: Server

[0277] The server receives the movement range data sent by the parents and stores it in a database, which is used to geographically map the child's usual movement patterns.

[0278] Monitoring range of activities

[0279] Subject: Terminal (wearable device)

[0280] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information changes in real time.

[0281] Subject: Device (smartphone)

[0282] The acquired location information is sent to a server via the parent's smartphone app.

[0283] Subject: Server

[0284] The server stores the location information it receives and compares it with data on normal activity ranges. If the person moves outside their normal activity range or into a dangerous area, it flags the person's behavior as abnormal.

[0285] Abnormal behavior detection and emotion recognition

[0286] Subject: Server

[0287] When abnormal behavior is detected, the server generates an alert message, which includes the child's current location, details of the abnormal behavior, and information required by the emotion engine.

[0288] Subject: Device (smartphone)

[0289] The parent's smartphone app receives alerts via push notification, displays them on the screen, and provides an interface for parents to input their reactions and emotions.

[0290] Subject: Emotion Engine

[0291] The emotion engine has a function of analyzing the emotion (e.g., anxiety, surprise, relief, etc.) expressed by the parent when viewing the notification. The analyzed emotion data is sent to the server.

[0292] Alert tuning and response suggestions

[0293] Subject: Server

[0294] The server receives emotion analysis data from the emotion engine, adjusts the urgency of the alert, and suggests appropriate actions based on the parent's emotion (e.g., encouraging a phone call, displaying a detailed map, prioritizing automatic contact with the police, etc.).

[0295] Identifying a missing child and contacting the police

[0296] Subject: User (parent)

[0297] The parent presses the "Confirm Lost" button within the app, after confirming the suggestion from the emotion engine.

[0298] Subject: Server

[0299] The server receives the missing child information, consults the local police station database, and automatically sends a notification, including the child's last known location and the parent's contact information.

[0300] Specific examples

[0301] For example, if a child strays from the park, which is their usual range of activity, after school and heads to a neighboring town, the location information from the wearable device is sent to the server, which detects this as an abnormality. The server immediately generates an alert and sends it to the parent's smartphone. The parent checks the notification, enters their response in the app, and the emotion engine analyzes it. If it determines that the child is feeling anxious, the urgency of the alert is adjusted. Following the emotion engine's suggestions, the parent can declare the child lost, and the server will automatically notify the police.

[0302] In this way, by combining the emotion engine, it becomes possible to respond flexibly and quickly according to the psychological state of the parent, thereby more reliably ensuring the safety of the child.

[0303] The processing flow will be explained below.

[0304] Step 1:

[0305] Subject: User (parent)

[0306] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[0307] Step 2:

[0308] Subject: Server

[0309] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[0310] Step 3:

[0311] Subject: Terminal (wearable device)

[0312] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[0313] Step 4:

[0314] Subject: Terminal (wearable device)

[0315] The acquired location information is sent to the parent's smartphone app, and this data communication is carried out in real time.

[0316] Step 5:

[0317] Subject: Device (smartphone)

[0318] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[0319] Step 6:

[0320] Subject: Server

[0321] The server compares the real-time location information received with stored data on normal movement ranges, and flags any abnormal behavior if the location information goes outside the normal movement range or into a dangerous area.

[0322] Step 7:

[0323] Subject: Server

[0324] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior. At the same time, the emotion engine works to prepare for analyzing the parent's emotions.

[0325] Step 8:

[0326] Subject: Server

[0327] The generated alert message is sent as a push notification to the parent's smartphone.

[0328] Step 9:

[0329] Subject: Device (smartphone)

[0330] The parent's smartphone receives a push notification and an alert message appears on the screen. The parent checks the alert content and operates the emotion input interface within the app.

[0331] Step 10:

[0332] Subject: Emotion Engine

[0333] The emotion engine analyzes the parent's reactions and emotions, determining their emotional state (e.g., anxiety, surprise, relief) based on data collected by the emotion input interface.

[0334] Step 11:

[0335] Subject: Server

[0336] The server receives the analysis results from the emotion engine and adjusts the urgency of the alert. For example, if anxiety is high, the urgency of the alert is set high.

[0337] Step 12:

[0338] Subject: Server

[0339] The server then suggests the best course of action based on the parent's feelings, offering options such as prompting a quick phone call, displaying a detailed map, or immediately contacting the police.

[0340] Step 13:

[0341] Subject: User (parent)

[0342] The parent presses the "Confirm Lost" button within the app, after accepting the suggestion from the emotion engine.

[0343] Step 14:

[0344] Subject: Device (smartphone)

[0345] The lost child certification information is sent to the server.

[0346] Step 15:

[0347] Subject: Server

[0348] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[0349] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt parents to take appropriate action based on their emotions.

[0350] Example 2

[0351] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0352] In modern society, to ensure children's safety, it is important to monitor their movements and detect abnormal behavior early. However, conventional systems issue uniform alerts without considering the feelings of parents, which can cause excessive anxiety. Furthermore, because appropriate countermeasures are not clearly stated, prompt action may not be taken in an emergency. This poses a problem in that the effectiveness of the monitoring system cannot be fully achieved.

[0353] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0354] In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child leaves the usual range of activity, means for sending the generated alert to the parent's device, means for analyzing the parent's emotions when viewing the notification, means for adjusting the urgency of the alert based on the analyzed emotions, and means for contacting the police if the parent acknowledges the alert. This allows for flexible and prompt responses according to the parent's psychological state, and more reliably ensures the safety of the child.

[0355] "Child's usual range of movement" refers to the area where a child typically moves, as set by a parent or guardian and defined using GPS coordinates.

[0356] "Current Location Information" means a child's current geographic location periodically obtained from a wearable device or other GPS-enabled device worn by the child.

[0357] "Verifying" means comparing the current location information with a preset movement range to see if it matches or if it is outside the range.

[0358] An "alert" is a warning message that is generated and sent to a parent's device when a child goes outside their normal range of behavior.

[0359] A "parent's device" refers to an electronic device, such as a smartphone or tablet, used by a parent to monitor their child's range of activities or abnormal behavior.

[0360] "Analyzing emotions" means analyzing the reactions and emotions (e.g., anxiety, surprise, relief, etc.) shown by the parent in response to the alert, and quantifying or categorizing those emotions.

[0361] "Emotion Engine" refers to the software components and algorithms used to analyze emotions expressed by parents.

[0362] "Adjusting the urgency" means changing the importance and priority of an alert based on the results of sentiment analysis and suggesting appropriate countermeasures.

[0363] "Means to contact law enforcement" refers to the communications methods and protocols that automatically notify law enforcement if a parent acknowledges the alert.

[0364] This invention combines a system that monitors a child's range of movement and detects abnormal behavior with an emotion engine that recognizes the parent's emotions and suggests optimal countermeasures. This system uses a wearable device and a smartphone as hardware, and a server, GPS, and emotion engine as software.

[0365] Hardware and Software Configuration

[0366] Wearable devices

[0367] Wearable devices are worn by children and periodically acquire their current location information using GPS, allowing you to track your child's location in real time. Examples include smartwatches.

[0368] Smartphone

[0369] A dedicated app is installed on the parent's smartphone to receive location information sent from the wearable device, and provides multiple functions, such as receiving alerts, allowing parents to input their emotions, and displaying the results of the emotion engine.

[0370] Servers and Databases

[0371] The server receives location information sent from the smartphone app and compares it with data on the child's normal range of movement. The database stores information such as the child's normal range of movement, location information, and emotional data of the guardian.

[0372] Emotion Engine

[0373] The emotion engine analyzes the emotions expressed by parents when they receive an alert. Using an emotion input interface, the emotion expressed by the parent is acquired as data, and this data is then passed through an analysis algorithm to adjust the level of urgency. The analyzed data is sent to a server, which then presents appropriate countermeasures.

[0374] Specific examples

[0375] For example, if a child leaves the park, which is his usual area of ​​activity, after school and moves to a neighboring town, the system operates as follows.

[0376] 1. Obtaining location information: The wearable device worn by the child uses GPS to obtain location information when the child moves to the next town.

[0377] 2. Location information transmission: This location information is sent in real time to the parent's smartphone app, from where it is uploaded to a server.

[0378] 3. Detecting abnormal behavior: The server compares the received location information with normal activity range data and determines that it is abnormal.

[0379] 4. Alert generation and notification: The server instantly generates an alert and sends a push notification to the parent's smartphone.

[0380] 5. Emotion recognition: When parents view notifications and express concern within the app, the emotion engine analyzes this and adjusts the urgency level.

[0381] 6. Proposal of countermeasures: Following the suggestion of the emotion engine, the parent / guardian will certify the child as lost, and the server will automatically notify the police.

[0382] Prompt Sentence Examples

[0383] Examples of prompts for this system include:

[0384] "Please explain the process of the system that generates abnormal behavior alerts when a child goes outside of their normal range of behavior, analyzes the parent's emotions, and suggests appropriate countermeasures."

[0385] By utilizing this invention, flexible and prompt responses based on the psychological state of the guardian are possible, and the safety of the child can be more reliably ensured.

[0386] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0387] Step 1:

[0388] Setting the scope of action

[0389] User (Parent)

[0390] Parents use a smartphone app to set their child's usual range of movement by selecting a specific area (e.g., around their home, park, school, etc.) on a map based on GPS coordinates and registering that area as their child's range of movement.

[0391] Input: Parental area selection information (GPS coordinates)

[0392] Output: Set movement range data

[0393] server

[0394] The server receives the activity range data sent by the parent and stores it in a database, which is used to understand the child's usual behavioral patterns.

[0395] Input: Movement range data sent by parent

[0396] Output: Home range data stored in a database

[0397] Step 2:

[0398] Get current location

[0399] Terminal (wearable device)

[0400] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information is saved in real time.

[0401] Input: GPS data

[0402] Output: Current location

[0403] Step 3:

[0404] Sending location information

[0405] Terminal (wearable device)

[0406] The acquired location information is sent to the parent's smartphone app at regular intervals via Bluetooth, Wi-Fi, or mobile data.

[0407] Input: Current location

[0408] Output: Location information sent to the smartphone

[0409] Device (smartphone)

[0410] The parent's smartphone then sends the location information it receives to a server. The transmission is done in real time, and the latest location information is always uploaded to the server.

[0411] Input: Location information sent from a wearable device

[0412] Output: Location information sent to the server

[0413] Step 4:

[0414] Abnormal behavior detection

[0415] server

[0416] The server compares the received location information with the normal movement range data. If the location information is outside the set movement range or if the user enters a dangerous area, it flags the behavior as abnormal at that point. Furthermore, when a flag is raised, a detailed log is recorded in the database.

[0417] Input: Location information, movement range data

[0418] Output: Abnormal behavior flag, detailed log

[0419] Step 5:

[0420] Alert generation and notification

[0421] server

[0422] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location, details of the abnormal behavior, and information needed by the emotion engine.

[0423] Input: Abnormal behavior flag, child's current location

[0424] Output: Alert message

[0425] Device (smartphone)

[0426] Parents' smartphones receive push notifications and an alert appears on their screen, showing the child's specific location and a map of the surrounding area.

[0427] Input: Alert message

[0428] Output: Parental Notice

[0429] Step 6:

[0430] Emotion recognition

[0431] User (Parent)

[0432] Parents can view the notification and enter their emotion within the app by choosing from the options provided (e.g., anxious, surprised, relieved, etc.) or by typing their emotion as a text input.

[0433] Input: Parent's emotional input data

[0434] Output: Parent's emotional data in the app

[0435] Emotion Engine

[0436] The emotion engine analyzes the emotional data entered by the parent or guardian. This analysis is carried out using NLP (natural language processing) technology, and the results are converted into numerical values ​​and sent to the server.

[0437] Input: Parent's emotional input data

[0438] Output: Quantified emotion data

[0439] Step 7:

[0440] Alert tuning and response suggestions

[0441] server

[0442] The server receives emotion analysis data from the emotion engine and adjusts the urgency of the alert. If the urgency is high, it displays a detailed map, options to call directly, and suggests automatic contact with the police, depending on the situation.

[0443] Input: Sentiment analysis data

[0444] Output: Adjusted alert, suggested action

[0445] Step 8:

[0446] Identifying a missing child and contacting the police

[0447] User (Parent)

[0448] Based on the emotion engine's suggestions, parents can press the "Confirm Lost" button in the app, which automatically sends a notification to the police.

[0449] Input: Suggestions from the emotion engine, parental authorization actions

[0450] Output: Lost child recognition data

[0451] server

[0452] The server receives the lost child identification request and automatically searches the database of the local police station and sends a notification, which includes the child's last known location and the parent's contact information.

[0453] Input: Lost child certification data

[0454] Output: Police notification

[0455] (Application example 2)

[0456] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0457] Conventional child location monitoring systems only generate alerts when a child deviates from their normal range of movement, but do not take into account the emotional state of the parent or suggest countermeasures, which means that it takes a long time to respond in an emergency. Another issue is that it is difficult for parents to determine the appropriate response when they are emotionally upset.

[0458] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child goes outside the usual range of activity, means for sending the generated alert to the parent's terminal, means for contacting a public institution when the parent approves the alert, an emotion analysis engine for recognizing the parent's emotions, and means for adjusting the urgency of the alert based on the emotion analysis engine and proposing appropriate countermeasures. This enables flexible and prompt responses according to the parent's emotional state.

[0459] A "child's usual range of activity" refers to the geographical area in which a child moves or engages on a daily basis, and is defined by GPS coordinates set by the parent or guardian, for example.

[0460] "Current location information" is real-time geographic coordinate information that indicates where the child is currently located.

[0461] "Matching" is the process of comparing the acquired current location information with the child's stored usual range of movement.

[0462] An "alert" is a warning message that is generated when a child goes outside of their normal range of activity and is sent to the parent's device.

[0463] "Parent's device" means an electronic device such as a smartphone or tablet used by a parent.

[0464] "Public authorities" refers to the police and other public authorities, who will be contacted in an emergency if necessary.

[0465] The "emotion analysis engine" is an artificial intelligence system that analyzes parents' emotions and has the ability to analyze their reactions and emotions and digitize them.

[0466] "Adjusting the urgency" means changing the importance of the alert based on the parent's emotional information analyzed by the emotion analysis engine.

[0467] "Proposing appropriate countermeasures" means presenting appropriate actions and options to parents based on the analyzed emotional information.

[0468] The present invention aims to realize a system that monitors the range of a child's activities, detects abnormal behavior, and proposes countermeasures. Specific embodiments of the system will be described below.

[0469] System Configuration

[0470] The system mainly consists of the following hardware and software:

[0471] A wearable device (with GPS function) worn by children

[0472] Parents' smartphones and tablets

[0473] server

[0474] Sentiment analysis engine (artificial intelligence model)

[0475] Communication modules (e.g. Wi-Fi, 4G / 5G)

[0476] Memorizing the child's range of activities

[0477] The server receives data on the child's usual range of movement (e.g., GPS coordinates) sent by the parent and stores it in a database. Based on this data, the child's usual behavioral patterns can be geographically determined.

[0478] Location acquisition and monitoring

[0479] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via the parent's smartphone app.

[0480] Abnormal behavior detection

[0481] The server compares the received location information with stored data on normal activity ranges. If the child moves outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal. If abnormal activity is detected, the server immediately generates an alert message and sends it to the parent's device.

[0482] Emotion recognition and suggestions

[0483] The emotion analysis engine analyzes the emotional input and reactions of parents provided through the parent's smartphone app. The analysis results are sent to the server, which then adjusts the urgency of the alerts accordingly.

[0484] Furthermore, the server suggests appropriate countermeasures based on the parent's emotions. For example, if emotion analysis indicates high anxiety, the system will immediately display detailed map information and automatically contact public authorities (e.g., police) if necessary.

[0485] Specific examples

[0486] For example, if a child gets lost in a shopping mall and a security robot detects the child's unusual movements, the robot will immediately send an alert to the parent's smartphone, and if the emotion analysis engine detects the parent's anxiety, it will notify the nearest security staff and simultaneously display a detailed map to the parent.

[0487] Example prompts for generative AI models

[0488] Below is an example of a prompt sentence to input to the sentiment analysis model:

[0489] Prompt: "What emotional reaction did you have to the parent alert notification? Please choose from the following options: [anxiety, surprise, relief]"

[0490] Based on this prompt, the emotion analysis engine analyzes the parent's emotions and suggests countermeasures.

[0491] This allows the system to respond flexibly and quickly to the emotional state of parents, making it possible to more reliably ensure the safety of children.

[0492] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0493] Step 1:

[0494] The server receives data from parents about the child's usual range of movement (e.g., GPS coordinates) and stores it in a database, which is used to compare with subsequent location information.

[0495] Input: Normal movement range data (GPS coordinates) sent by the parent

[0496] Data processing: recording to database

[0497] Output: Saved normal movement range data

[0498] Specific operation: Parents use a smartphone app to set their child's movement range, and that information is sent to the server.

[0499] Step 2:

[0500] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via a parent's smartphone app.

[0501] Input: Location information obtained from GPS

[0502] Data processing: Periodic acquisition and real-time transmission

[0503] Output: Current location sent to the server

[0504] Specific operation: The wearable device obtains current location information at regular intervals and uploads that information to a server via a smartphone app.

[0505] Step 3:

[0506] The server compares the current location information received with normal movement range data, and if the user moves outside of the normal movement range, it flags the behavior as abnormal and generates an alert.

[0507] Input: Current location information, usual movement range data

[0508] Data calculations: location matching, flagging abnormal behavior

[0509] Output: Generated alerts

[0510] What it does: The server compares the current location with the range of movement stored in the database and creates an alert if an anomaly is detected.

[0511] Step 4:

[0512] The server sends the generated alert to the parent's terminal.

[0513] Input: Generated alert

[0514] Data processing: Push notification generation

[0515] Output: Alert sent to parent's device

[0516] Specific operation: The server generates an alert message and sends it to the parent's smartphone using the push notification function.

[0517] Step 5:

[0518] The parent's device receives the alert and provides an interface for inputting the user's reactions and emotions.

[0519] Input: Received alert

[0520] Data processing: User input interface generation

[0521] Output: Input emotion information

[0522] Specific actions: Parents check the alert on their smartphone app and enter their emotional state using the interface displayed there.

[0523] Step 6:

[0524] The emotion analysis engine analyzes the input emotion information and generates emotion data of the parent / guardian, which is then sent to the server.

[0525] Input: Emotion information

[0526] Data Computing: Sentiment Analysis

[0527] Output: Parsed emotion data

[0528] How it works: The emotion analysis engine takes parental input and uses a generative AI model to analyze their emotional state.

[0529] Step 7:

[0530] The server receives the sentiment analysis data, adjusts the urgency of the alert, and suggests appropriate countermeasures.

[0531] Input: Sentiment analysis data, alerts

[0532] Data calculation: Adjusting the level of urgency and generating countermeasures

[0533] Output: Adjusted alerts, suggested actions

[0534] Specific operation: The server adjusts the urgency of the alert based on emotion analysis data and suggests appropriate responses to parents.

[0535] Step 8:

[0536] The user follows the suggested measures and takes the necessary action (e.g., contacting the police, checking a detailed map).

[0537] Input: Proposed action

[0538] Data manipulation: Implementing countermeasures

[0539] Output: Actions taken

[0540] Specific operation: Parents take action by pressing a button or other means in response to the app's suggestions, and the results are reflected in the system.

[0541] The above steps enable monitoring of children's location information and flexible responses based on parents' feelings.

[0542] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0543] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0544] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0545] [Second embodiment]

[0546] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0547] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0548] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0549] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0550] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0551] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0552] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0553] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0554] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0555] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0556] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0557] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0558] The present invention is a system for monitoring a child's range of activity and detecting abnormal behavior. This system comprises a means for storing the child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert when the child goes outside the usual range of activity, a means for sending the generated alert to a parent's device, and a means for contacting the police.

[0559] Memory of range of movement

[0560] Subject: User (parent)

[0561] Parents use a smartphone app to define their child's usual range of movement, which is defined as a geographical area associated with GPS coordinates. Parents register locations such as home, school, and parks through the app interface.

[0562] Subject: Server

[0563] The server receives the movement range data sent by the parents and stores it in a database, which is used to map the child's usual movement patterns geographically.

[0564] Monitoring range of activities

[0565] Subject: Terminal (wearable device)

[0566] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[0567] Subject: Device (smartphone)

[0568] The location information obtained by the wearable device is sent to the parent's smartphone app and uploaded from the app to a server.

[0569] Subject: Server

[0570] The server stores the received location information and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, it is determined to be abnormal activity.

[0571] Abnormal behavior detection

[0572] Subject: Server

[0573] The server generates an alert message when abnormal behavior is detected, which includes the child's current location, details of the abnormal behavior, and emergency contact information.

[0574] Subject: Device (smartphone)

[0575] The alert message is sent to the parent's smartphone as a push notification, allowing the parent to immediately receive the message and consider how to respond.

[0576] Identifying a missing child and contacting the police

[0577] Subject: User (parent)

[0578] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[0579] Subject: Device (smartphone)

[0580] The lost child identification information is immediately sent to the server.

[0581] Subject: Server

[0582] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification to the nearest police station, including the child's last known location and the parent's contact information.

[0583] Specific examples

[0584] For example, if a child is playing in a park on their way home from school after school, a parent can use a smartphone app to set three locations - home, school, and the park - as their child's normal range of activity. As long as the child is playing within the designated range of activity, the parent will not receive any special alerts.

[0585] However, if a child deviates from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server, which determines this as abnormal behavior. The server immediately generates an alert and sends it to the parent's smartphone via push notification. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to the police. This allows for a swift and effective response.

[0586] This system allows parents to go about their daily lives with peace of mind while ensuring the safety of their children.

[0587] The processing flow will be explained below.

[0588] Step 1:

[0589] Subject: User (parent)

[0590] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[0591] Step 2:

[0592] Subject: Server

[0593] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[0594] Step 3:

[0595] Subject: Terminal (wearable device)

[0596] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[0597] Step 4:

[0598] Subject: Terminal (wearable device)

[0599] The acquired location information is sent to the parent's smartphone app in real time, and the location information is constantly updated.

[0600] Step 5:

[0601] Subject: Device (smartphone)

[0602] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[0603] Step 6:

[0604] Subject: Server

[0605] The server stores the location information received in real time and compares it with stored data on normal activity ranges. If the comparison results in the location being outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal.

[0606] Step 7:

[0607] Subject: Server

[0608] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior.

[0609] Step 8:

[0610] Subject: Server

[0611] The generated alert message is sent as a push notification to the parent's smartphone.

[0612] Step 9:

[0613] Subject: Device (smartphone)

[0614] A push notification is sent to the parent's smartphone, and an alert message is displayed on the screen. The parent can then review the message and consider how to respond.

[0615] Step 10:

[0616] Subject: User (parent)

[0617] The parent presses the "Confirm Lost Child" button in the app. This action notifies the server that the child is lost.

[0618] Step 11:

[0619] Subject: Device (smartphone)

[0620] The lost child certification information is sent to the server.

[0621] Step 12:

[0622] Subject: Server

[0623] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[0624] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt appropriate action.

[0625] Example 1

[0626] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0627] Modern society demands technology to ensure the safety of children. However, many monitoring systems only track children's locations and lack the means to detect abnormal behavior or respond quickly. This creates a need for a system that allows parents to monitor their children's safety in real time and respond quickly when abnormal behavior occurs. To address this issue, the present invention aims to provide a system that monitors the range of children's activities, sends an alert to parents when an abnormality is detected, and contacts the police if necessary.

[0628] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0629] In this invention, the server includes a means for storing the child's normal range of movement set by the guardian, a means for periodically acquiring the child's current location information, and a means for comparing the normal range of movement with the acquired current location information. This allows an alert to be generated if the child leaves the normal range of movement, indicating abnormal behavior, and the alert can be sent as a push notification to the guardian's mobile information terminal. The server also includes a means for automatically sending contact information to police authorities if the guardian receives the alert and identifies the child as lost. This ensures the child's safety and enables a prompt and effective response.

[0630] "Area of ​​Activity" refers to the geographic area where a child typically moves, as designated by a parent, and is defined by GPS coordinates.

[0631] "Current location information" is real-time GPS data acquired by a portable device worn by the child, and indicates the child's current location.

[0632] "Abnormal behavior" is behavior detected when a child moves outside of their normal range of movement or into a designated danger zone.

[0633] An "alert" is a notification message that is generated when abnormal behavior is detected and includes the child's current location and details of the abnormal behavior.

[0634] "Mobile information terminal" means a mobile device, such as a smartphone or tablet, used by a parent or guardian to receive alerts.

[0635] "Lost child recognition" is an operation that parents perform within the app when they determine that their child is lost, and it triggers the sending of contact information to police authorities.

[0636] "Law enforcement authorities" are public agencies that receive contact when a child goes missing.

[0637] "Location means" refers to technology for determining a child's current location, specifically the Global Positioning System (GPS).

[0638] The present invention provides a system for monitoring a child's range of movement and detecting abnormal behavior, which is implemented using the following hardware and software.

[0639] Hardware

[0640] 1. User (parent) smartphone:

[0641] Parents use a smartphone app to set their child's usual range of movement, and the parent's smartphone receives the child's location information sent from the wearable device and uploads it to a server.

[0642] Specific hardware used: Smartphones (e.g., iPhones, Android devices)

[0643] 2. Children's wearable devices:

[0644] The wearable device worn by the child periodically obtains its current location information using GPS, and this information is sent to the parent's smartphone at regular intervals (e.g., every minute).

[0645] Specific hardware used: Wearable devices (e.g., Apple Watch, Fitbit)

[0646] 3. Server:

[0647] The server receives location information from the parents' smartphones, stores it in a database, and compares the parents' usual range of movement with the current location information.

[0648] Specific hardware used: Servers (e.g. AWS, Google Cloud)

[0649] software

[0650] 1. Smartphone app:

[0651] This is an application installed by parents, through which users can set their child's movement limits and receive notifications of abnormal behavior.

[0652] Specific software used: Mobile apps (e.g. iOS apps, Android apps)

[0653] 2. Server-side software:

[0654] The server stores and compares location information and generates an alert if abnormal behavior is detected. The generated alert is sent to the parent's smartphone. In addition, if the parent declares the child lost, contact information is automatically sent to the police.

[0655] Specific software used: database management systems, notification systems (e.g., MySQL, Firebase)

[0656] Specific operation explanation

[0657] For example, a child can play in a park on their way home from school after school. Parents can use a smartphone app to set three locations - home, school, and the park - as their normal range of activity. As long as the child is playing within the designated range of activity, no alerts will be generated.

[0658] However, if a child strays from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server. The server compares this location information with their usual range of movement and determines that the behavior is abnormal. The server immediately generates an alert and sends it as a push notification to the parent's smartphone. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to police authorities. This enables a swift and effective response.

[0659] Prompt Sentence Examples

[0660] Here are some examples of prompts for generative AI models:

[0661] Please explain the system's process for generating an alert and notifying parents when a child deviates from their normal range of movement. Please use sentences with the server, device, or user as the subject, clearly indicating the names of the specific hardware and software used, and include the type of data processing and calculations performed. Please also provide an explanation of each stage: recording the range of movement, monitoring, detecting abnormal behavior, recognizing the child as lost, and contacting the police, and provide specific examples.

[0662] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0663] Step 1:

[0664] Subject: User (parent)

[0665] Parents use a smartphone app to set the usual range of their child's activities. Through the app interface, parents register locations such as home, school, and park with GPS coordinates. This input data (GPS coordinates) is entered through the smartphone interface and sent to the server.

[0666] Input: GPS coordinates entered by parent

[0667] Output: Movement range data sent to the server

[0668] Step 2:

[0669] Subject: Server

[0670] The server receives the movement range data sent by the parent and stores it in a database, which is later used to match the child's location data.

[0671] Input: Movement range data sent by parent

[0672] Output: Home range data stored in a database

[0673] Step 3:

[0674] Subject: Terminal (wearable device)

[0675] The wearable device worn by the child uses GPS to obtain current location information at regular intervals, for example, once every minute, and sends this location information to the parent's smartphone via Bluetooth or Wi-Fi.

[0676] Input: GPS location information obtained periodically

[0677] Output: Location information sent to parent's smartphone

[0678] Step 4:

[0679] Subject: Device (smartphone)

[0680] The location information sent from the wearable device is received by the parent's smartphone app, which then uploads the location information to a server.

[0681] Input: Location information received from a wearable device

[0682] Output: Location information uploaded to the server

[0683] Step 5:

[0684] Subject: Server

[0685] The server stores the received location information in a database and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, the server determines this as abnormal activity and generates an alert.

[0686] Input: Location information sent from a wearable device

[0687] Data processing: Matching location information with pre-stored movement range data

[0688] Output: Alert when abnormal behavior is detected

[0689] Step 6:

[0690] Subject: Server

[0691] When abnormal behavior is detected, an alert message containing the child's current location and details about the abnormal behavior is generated and sent as a push notification to the parent's smartphone.

[0692] Input: Anomalous behavior detection results and corresponding details

[0693] Output: Alert notification sent to parent's smartphone

[0694] Step 7:

[0695] Subject: User (parent)

[0696] If a parent or guardian checks the alert notification and determines that their child is lost, they can press the "Confirm Lost Child" button in the smartphone app, which sends the lost child confirmation information to the server.

[0697] Input: Parental control to identify lost child

[0698] Output: Lost child certification information sent to the server

[0699] Step 8:

[0700] Subject: Server

[0701] The server receives the missing child identification information, consults the database of nearby police stations, and automatically sends a report to the nearest police station, including the child's last known location and the parent's contact information.

[0702] Input: Lost child identification information sent by parent

[0703] Output: Police report sent to authorities

[0704] (Application example 1)

[0705] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0706] Conventional child safety monitoring systems have limitations in real-timeness and accuracy when acquiring location information and generating and sending alerts, and parents have had to work hard to properly set their child's range of movement. Furthermore, they lacked a means of quickly responding when abnormal behavior was detected, which could lead to delays in identifying a child as lost and contacting the police. The purpose of this invention is to solve these problems, more reliably ensure the safety of children, and allow parents to live their daily lives with peace of mind.

[0707] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0708] In this invention, the server includes a means for setting a range of movement based on GPS coordinates set by the guardian, a means for periodically sending location information acquired from the wearable device to the server, a means for the server to compare the location information with the normal range of movement, generate an alert, and send it as a push notification, a means for providing a button for the guardian to declare the child as lost based on the alert message, and a means for the server to receive the child's recognition information from the guardian and automatically send a notification to the police. This enables early detection of abnormal behavior outside the normal range of movement and rapid alert transmission, allowing for faster recognition of the child as lost and automatic reporting to the police, significantly improving the safety of children.

[0709] "Child" refers to a minor under a certain age.

[0710] The "normal range of activity" is the range of a child's general activities set by the parent or guardian, and is a geographical area set based on GPS coordinates.

[0711] "Current location information" refers to a child's specific geographic coordinates and is data obtained through location measurement technology such as GPS.

[0712] "Verifying" refers to comparing the obtained current location information with the stored normal range of movement to determine whether there is a match or a mismatch.

[0713] An "alert" is a warning message that is generated and notified to parents when a child goes outside of their normal range of activity.

[0714] A "guardian" is someone who has supervisory responsibility for a child, usually a parent or legal guardian.

[0715] "Terminal" refers to a device that forms part of the system, and in this case, this mainly refers to smartphones and wearable devices.

[0716] A "server" is a computer system that processes and stores data, and is responsible for storing and collating location information, generating alerts, etc.

[0717] "GPS coordinates" are numerical data that indicate a specific location on Earth, and are composed of latitude and longitude.

[0718] A "wearable device" is a portable electronic device worn by a child that can acquire location information and collect other data.

[0719] "Push notification" is a method of sending information in real time to devices such as smartphone apps.

[0720] "Lost child certification" refers to the act of a parent confirming an alert, determining that their child is lost, and registering that information in the system.

[0721] "Automatic notification" is a mechanism by which a server sends information without requiring human intervention when certain conditions are met.

[0722] System Program

[0723] The system according to the present invention is a program for monitoring a child's range of movement and detecting abnormal behavior. The system consists of the following main components:

[0724] 1. A way to remember your child's normal range of behavior

[0725] User (Parent)

[0726] Parents use a smartphone app to define their child's usual range of movement, which is registered as GPS coordinates. Parents input the location of their home, school, park, etc. through the app interface.

[0727] 2. How to get your child's current location

[0728] Terminal (wearable device)

[0729] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[0730] 3. Sending and saving location information to the server

[0731] Device (smartphone)

[0732] The location information acquired by the wearable device is sent to the parent's smartphone app, which then sends the location information to a server.

[0733] 4. Matching your usual range of movement with your current location

[0734] server

[0735] The server stores the received location information in a database. The server compares it with normal movement range data and detects abnormal behavior. If the user moves outside the specified range, it is determined to be abnormal behavior.

[0736] 5. Detecting Abnormal Behavior and Generating Alerts

[0737] server

[0738] When abnormal behavior is detected, the server generates an alert message, which includes the current location and details of the abnormal behavior.

[0739] 6. Push notifications for parents

[0740] Device (smartphone)

[0741] The alert message is sent to the parent's smartphone as a push notification, so the parent can receive the notification immediately.

[0742] 7. Confirming the child is lost and contacting the police

[0743] User (Parent)

[0744] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[0745] Device (smartphone)

[0746] The lost child certification information is sent to the server.

[0747] server

[0748] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification containing the child's last known location and parental contact information.

[0749] Hardware and software used

[0750] Hardware:

[0751] Smartphone (iOS, Android)

[0752] Wearable devices (GPS trackers)

[0753] Server (AWS, Google Cloud)

[0754] software:

[0755] Smartphone app (Xcode, Android Studio)

[0756] Server-side program (Node.js)

[0757] Database (MongoDB)

[0758] Communication protocol (REST API)

[0759] Push notification service (Firebase)

[0760] Specific examples and prompts for the generative AI model

[0761] Specific examples

[0762] For example, when a child is playing in a park on their way home from school after school, parents can set their home, school, and park as their normal range of movement. If the child strays from this range and moves to a dangerous neighboring town, the wearable device detects the child's location, and the data is sent to the server, where it is detected as an anomaly. The server immediately sends an alert to the parent via push notification, and the parent can "recognize the child as lost" within the app, and the information is then sent to the police.

[0763] Prompt sentence for generative AI model

[0764] Based on your invention, please generate sample code for a smartphone application that monitors children's movements and detects abnormal behavior. The application will have the following features:

[0765] 1. A feature that allows parents to set a normal range of movement (based on GPS coordinates)

[0766] 2. A function to send location information obtained from a child's wearable device to a server

[0767] 3. A feature that generates an alert and sends a push notification to the parent's smartphone if the child moves outside of their normal range of movement.

[0768] 4. A function that automatically sends a notification to the police if a parent or guardian declares the child lost.

[0769] The code should utilize Node.js and MongoDB and include server-side processing.

[0770] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0771] Step 1:

[0772] Subject: User (parent)

[0773] Parents launch the smartphone app and set their child's usual range of movement by entering GPS coordinates of their home, school, park, etc. through the app interface. This data is temporarily stored in the smartphone app and then sent to the server.

[0774] Step 2:

[0775] Subject: Server

[0776] The server receives the movement range data sent by the guardian and stores it in a database. The received data is kept as movement range setting information and used for later matching processing. The server confirms that the saving is complete and returns a completion message to the guardian's smartphone.

[0777] Step 3:

[0778] Subject: Terminal (wearable device)

[0779] The wearable device worn by the child periodically obtains its current location information using GPS. This location data is sent to a smartphone at regular intervals (e.g., every minute). The input is sensor data, and the output is the current GPS coordinates.

[0780] Step 4:

[0781] Subject: Device (smartphone)

[0782] The location information received from the wearable device is temporarily stored in the smartphone, and then sent to the server. The smartphone app sends the location information to the server using an HTTP request (e.g., POST method). The input of this step is the location data of the wearable device, and the output is a request to the server.

[0783] Step 5:

[0784] Subject: Server

[0785] The server receives location information sent from the smartphone and stores it in a database. The stored location information is compared with stored data on the user's normal range of movement. This comparison is performed using SQL queries and database search algorithms. The input is the location data, and the output is the comparison result.

[0786] Step 6:

[0787] Subject: Server

[0788] If the server determines that the location information is outside the normal range of activity, it generates an alert as an abnormal behavior determination. This alert message includes the current location information and details of the abnormal behavior. The generated alert is sent to the parent's smartphone as a push notification. The input is location data and activity range data, and the output is the alert message. The server sends the message using a push notification service such as Firebase.

[0789] Step 7:

[0790] Subject: Device (smartphone)

[0791] An alert message is sent to the parent's smartphone. The parent checks the notification and confirms any abnormal behavior through the app. When the parent presses the "Confirm Lost Child" button, the information is sent from the smartphone to the server. The input is the user's operation, and the output is the transmission of the confirmation information to the server.

[0792] Step 8:

[0793] Subject: Server

[0794] The server receives the lost child identification information and automatically sends a notification by referencing the database of the local police station. This notification includes the child's last known location and the parent's contact information. The input is the identification information, and the output is a notification to the police. This process allows for a quick response.

[0795] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0796] The present invention is a system that combines a system that monitors a child's range of activity and detects abnormal behavior with an emotion engine that recognizes the parent's emotions in response to alert notifications and proposes optimal countermeasures. This system is composed of a means for storing a child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert if the child goes outside the usual range of activity, a means for sending the generated alert to the parent's device, a means for the emotion engine that recognizes the parent's emotions, and a means for contacting the police.

[0797] The introduction of the emotion engine makes it possible to perform the following specific processes:

[0798] Memory of range of movement

[0799] Subject: User (parent)

[0800] Parents use a smartphone app to define their child's usual range of movement, which is then associated with GPS coordinates and stored in the system.

[0801] Subject: Server

[0802] The server receives the movement range data sent by the parents and stores it in a database, which is used to geographically map the child's usual movement patterns.

[0803] Monitoring range of activities

[0804] Subject: Terminal (wearable device)

[0805] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information changes in real time.

[0806] Subject: Device (smartphone)

[0807] The acquired location information is sent to a server via the parent's smartphone app.

[0808] Subject: Server

[0809] The server stores the location information it receives and compares it with data on normal activity ranges. If the person moves outside their normal activity range or into a dangerous area, it flags the person's behavior as abnormal.

[0810] Abnormal behavior detection and emotion recognition

[0811] Subject: Server

[0812] When abnormal behavior is detected, the server generates an alert message, which includes the child's current location, details of the abnormal behavior, and information required by the emotion engine.

[0813] Subject: Device (smartphone)

[0814] The parent's smartphone app receives alerts via push notification, displays them on the screen, and provides an interface for parents to input their reactions and emotions.

[0815] Subject: Emotion Engine

[0816] The emotion engine has a function of analyzing the emotion (e.g., anxiety, surprise, relief, etc.) expressed by the parent when viewing the notification. The analyzed emotion data is sent to the server.

[0817] Alert tuning and response suggestions

[0818] Subject: Server

[0819] The server receives emotion analysis data from the emotion engine, adjusts the urgency of the alert, and suggests appropriate actions based on the parent's emotion (e.g., encouraging a phone call, displaying a detailed map, prioritizing automatic contact with the police, etc.).

[0820] Identifying a missing child and contacting the police

[0821] Subject: User (parent)

[0822] The parent presses the "Confirm Lost" button within the app, after confirming the suggestion from the emotion engine.

[0823] Subject: Server

[0824] The server receives the missing child information, consults the local police station database, and automatically sends a notification, including the child's last known location and the parent's contact information.

[0825] Specific examples

[0826] For example, if a child strays from the park, which is their usual range of activity, after school and heads to a neighboring town, the location information from the wearable device is sent to the server, which detects this as an abnormality. The server immediately generates an alert and sends it to the parent's smartphone. The parent checks the notification, enters their response in the app, and the emotion engine analyzes it. If it determines that the child is feeling anxious, the urgency of the alert is adjusted. Following the emotion engine's suggestions, the parent can declare the child lost, and the server will automatically notify the police.

[0827] In this way, by combining the emotion engine, it becomes possible to respond flexibly and quickly according to the psychological state of the parent, thereby more reliably ensuring the safety of the child.

[0828] The processing flow will be explained below.

[0829] Step 1:

[0830] Subject: User (parent)

[0831] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[0832] Step 2:

[0833] Subject: Server

[0834] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[0835] Step 3:

[0836] Subject: Terminal (wearable device)

[0837] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[0838] Step 4:

[0839] Subject: Terminal (wearable device)

[0840] The acquired location information is sent to the parent's smartphone app, and this data communication is carried out in real time.

[0841] Step 5:

[0842] Subject: Device (smartphone)

[0843] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[0844] Step 6:

[0845] Subject: Server

[0846] The server compares the real-time location information received with stored data on normal movement ranges, and flags any abnormal behavior if the location information goes outside the normal movement range or into a dangerous area.

[0847] Step 7:

[0848] Subject: Server

[0849] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior. At the same time, the emotion engine works to prepare for analyzing the parent's emotions.

[0850] Step 8:

[0851] Subject: Server

[0852] The generated alert message is sent as a push notification to the parent's smartphone.

[0853] Step 9:

[0854] Subject: Device (smartphone)

[0855] The parent's smartphone receives a push notification and an alert message appears on the screen. The parent checks the alert content and operates the emotion input interface within the app.

[0856] Step 10:

[0857] Subject: Emotion Engine

[0858] The emotion engine analyzes the parent's reactions and emotions, determining their emotional state (e.g., anxiety, surprise, relief) based on data collected by the emotion input interface.

[0859] Step 11:

[0860] Subject: Server

[0861] The server receives the analysis results from the emotion engine and adjusts the urgency of the alert. For example, if anxiety is high, the urgency of the alert is set high.

[0862] Step 12:

[0863] Subject: Server

[0864] The server then suggests the best course of action based on the parent's feelings, offering options such as prompting a quick phone call, displaying a detailed map, or immediately contacting the police.

[0865] Step 13:

[0866] Subject: User (parent)

[0867] The parent presses the "Confirm Lost" button within the app, after accepting the suggestion from the emotion engine.

[0868] Step 14:

[0869] Subject: Device (smartphone)

[0870] The lost child certification information is sent to the server.

[0871] Step 15:

[0872] Subject: Server

[0873] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[0874] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt parents to take appropriate action based on their emotions.

[0875] Example 2

[0876] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0877] In modern society, to ensure children's safety, it is important to monitor their movements and detect abnormal behavior early. However, conventional systems issue uniform alerts without considering the feelings of parents, which can cause excessive anxiety. Furthermore, because appropriate countermeasures are not clearly stated, prompt action may not be taken in an emergency. This poses a problem in that the effectiveness of the monitoring system cannot be fully achieved.

[0878] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0879] In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child leaves the usual range of activity, means for sending the generated alert to the parent's device, means for analyzing the parent's emotions when viewing the notification, means for adjusting the urgency of the alert based on the analyzed emotions, and means for contacting the police if the parent acknowledges the alert. This allows for flexible and prompt responses according to the parent's psychological state, and more reliably ensures the safety of the child.

[0880] "Child's usual range of movement" refers to the area where a child typically moves, as set by a parent or guardian and defined using GPS coordinates.

[0881] "Current Location Information" means a child's current geographic location periodically obtained from a wearable device or other GPS-enabled device worn by the child.

[0882] "Verifying" means comparing the current location information with a preset movement range to see if it matches or if it is outside the range.

[0883] An "alert" is a warning message that is generated and sent to a parent's device when a child goes outside their normal range of behavior.

[0884] A "parent's device" refers to an electronic device, such as a smartphone or tablet, used by a parent to monitor their child's range of activities or abnormal behavior.

[0885] "Analyzing emotions" means analyzing the reactions and emotions (e.g., anxiety, surprise, relief, etc.) shown by the parent in response to the alert, and quantifying or categorizing those emotions.

[0886] "Emotion Engine" refers to the software components and algorithms used to analyze emotions expressed by parents.

[0887] "Adjusting the urgency" means changing the importance and priority of an alert based on the results of sentiment analysis and suggesting appropriate countermeasures.

[0888] "Means to contact law enforcement" refers to the communications methods and protocols that automatically notify law enforcement if a parent acknowledges the alert.

[0889] This invention combines a system that monitors a child's range of movement and detects abnormal behavior with an emotion engine that recognizes the parent's emotions and suggests optimal countermeasures. This system uses a wearable device and a smartphone as hardware, and a server, GPS, and emotion engine as software.

[0890] Hardware and Software Configuration

[0891] Wearable devices

[0892] Wearable devices are worn by children and periodically acquire their current location information using GPS, allowing you to track your child's location in real time. Examples include smartwatches.

[0893] Smartphone

[0894] A dedicated app is installed on the parent's smartphone to receive location information sent from the wearable device, and provides multiple functions, such as receiving alerts, allowing parents to input their emotions, and displaying the results of the emotion engine.

[0895] Servers and Databases

[0896] The server receives location information sent from the smartphone app and compares it with data on the child's normal range of movement. The database stores information such as the child's normal range of movement, location information, and emotional data of the guardian.

[0897] Emotion Engine

[0898] The emotion engine analyzes the emotions expressed by parents when they receive an alert. Using an emotion input interface, the emotion expressed by the parent is acquired as data, and this data is then passed through an analysis algorithm to adjust the level of urgency. The analyzed data is sent to a server, which then presents appropriate countermeasures.

[0899] Specific examples

[0900] For example, if a child leaves the park, which is his usual area of ​​activity, after school and moves to a neighboring town, the system operates as follows.

[0901] 1. Obtaining location information: The wearable device worn by the child uses GPS to obtain location information when the child moves to the next town.

[0902] 2. Location information transmission: This location information is sent in real time to the parent's smartphone app, from where it is uploaded to a server.

[0903] 3. Detecting abnormal behavior: The server compares the received location information with normal activity range data and determines that it is abnormal.

[0904] 4. Alert generation and notification: The server instantly generates an alert and sends a push notification to the parent's smartphone.

[0905] 5. Emotion recognition: When parents view notifications and express concern within the app, the emotion engine analyzes this and adjusts the urgency level.

[0906] 6. Proposal of countermeasures: Following the suggestion of the emotion engine, the parent / guardian will certify the child as lost, and the server will automatically notify the police.

[0907] Prompt Sentence Examples

[0908] Examples of prompts for this system include:

[0909] "Please explain the process of the system that generates abnormal behavior alerts when a child goes outside of their normal range of behavior, analyzes the parent's emotions, and suggests appropriate countermeasures."

[0910] By utilizing this invention, flexible and prompt responses based on the psychological state of the guardian are possible, and the safety of the child can be more reliably ensured.

[0911] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0912] Step 1:

[0913] Setting the scope of action

[0914] User (Parent)

[0915] Parents use a smartphone app to set their child's usual range of movement by selecting a specific area (e.g., around their home, park, school, etc.) on a map based on GPS coordinates and registering that area as their child's range of movement.

[0916] Input: Parental area selection information (GPS coordinates)

[0917] Output: Set movement range data

[0918] server

[0919] The server receives the activity range data sent by the parent and stores it in a database, which is used to understand the child's usual behavioral patterns.

[0920] Input: Movement range data sent by parent

[0921] Output: Home range data stored in a database

[0922] Step 2:

[0923] Get current location

[0924] Terminal (wearable device)

[0925] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information is saved in real time.

[0926] Input: GPS data

[0927] Output: Current location

[0928] Step 3:

[0929] Sending location information

[0930] Terminal (wearable device)

[0931] The acquired location information is sent to the parent's smartphone app at regular intervals via Bluetooth, Wi-Fi, or mobile data.

[0932] Input: Current location

[0933] Output: Location information sent to the smartphone

[0934] Device (smartphone)

[0935] The parent's smartphone then sends the location information it receives to a server. The transmission is done in real time, and the latest location information is always uploaded to the server.

[0936] Input: Location information sent from a wearable device

[0937] Output: Location information sent to the server

[0938] Step 4:

[0939] Abnormal behavior detection

[0940] server

[0941] The server compares the received location information with the normal movement range data. If the location information is outside the set movement range or if the user enters a dangerous area, it flags the behavior as abnormal at that point. Furthermore, when a flag is raised, a detailed log is recorded in the database.

[0942] Input: Location information, movement range data

[0943] Output: Abnormal behavior flag, detailed log

[0944] Step 5:

[0945] Alert generation and notification

[0946] server

[0947] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location, details of the abnormal behavior, and information needed by the emotion engine.

[0948] Input: Abnormal behavior flag, child's current location

[0949] Output: Alert message

[0950] Device (smartphone)

[0951] Parents' smartphones receive push notifications and an alert appears on their screen, showing the child's specific location and a map of the surrounding area.

[0952] Input: Alert message

[0953] Output: Parental Notice

[0954] Step 6:

[0955] Emotion recognition

[0956] User (Parent)

[0957] Parents can view the notification and enter their emotion within the app by choosing from the options provided (e.g., anxious, surprised, relieved, etc.) or by typing their emotion as a text input.

[0958] Input: Parent's emotional input data

[0959] Output: Parent's emotional data in the app

[0960] Emotion Engine

[0961] The emotion engine analyzes the emotional data entered by the parent or guardian. This analysis is carried out using NLP (natural language processing) technology, and the results are converted into numerical values ​​and sent to the server.

[0962] Input: Parent's emotional input data

[0963] Output: Quantified emotion data

[0964] Step 7:

[0965] Alert tuning and response suggestions

[0966] server

[0967] The server receives emotion analysis data from the emotion engine and adjusts the urgency of the alert. If the urgency is high, it displays a detailed map, options to call directly, and suggests automatic contact with the police, depending on the situation.

[0968] Input: Sentiment analysis data

[0969] Output: Adjusted alert, suggested action

[0970] Step 8:

[0971] Identifying a missing child and contacting the police

[0972] User (Parent)

[0973] Based on the emotion engine's suggestions, parents can press the "Confirm Lost" button in the app, which automatically sends a notification to the police.

[0974] Input: Suggestions from the emotion engine, parental authorization actions

[0975] Output: Lost child recognition data

[0976] server

[0977] The server receives the lost child identification request and automatically searches the database of the local police station and sends a notification, which includes the child's last known location and the parent's contact information.

[0978] Input: Lost child certification data

[0979] Output: Police notification

[0980] (Application example 2)

[0981] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0982] Conventional child location monitoring systems only generate alerts when a child deviates from their normal range of movement, but do not take into account the emotional state of the parent or suggest countermeasures, which means that it takes a long time to respond in an emergency. Another issue is that it is difficult for parents to determine the appropriate response when they are emotionally upset.

[0983] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child goes outside the usual range of activity, means for sending the generated alert to the parent's terminal, means for contacting a public institution when the parent approves the alert, an emotion analysis engine for recognizing the parent's emotions, and means for adjusting the urgency of the alert based on the emotion analysis engine and proposing appropriate countermeasures. This enables flexible and prompt responses according to the parent's emotional state.

[0984] A "child's usual range of activity" refers to the geographical area in which a child moves or engages on a daily basis, and is defined by GPS coordinates set by the parent or guardian, for example.

[0985] "Current location information" is real-time geographic coordinate information that indicates where the child is currently located.

[0986] "Matching" is the process of comparing the acquired current location information with the child's stored usual range of movement.

[0987] An "alert" is a warning message that is generated when a child goes outside of their normal range of activity and is sent to the parent's device.

[0988] "Parent's device" means an electronic device such as a smartphone or tablet used by a parent.

[0989] "Public authorities" refers to the police and other public authorities, who will be contacted in an emergency if necessary.

[0990] The "emotion analysis engine" is an artificial intelligence system that analyzes parents' emotions and has the ability to analyze their reactions and emotions and digitize them.

[0991] "Adjusting the urgency" means changing the importance of the alert based on the parent's emotional information analyzed by the emotion analysis engine.

[0992] "Proposing appropriate countermeasures" means presenting appropriate actions and options to parents based on the analyzed emotional information.

[0993] The present invention aims to realize a system that monitors the range of a child's activities, detects abnormal behavior, and proposes countermeasures. Specific embodiments of the system will be described below.

[0994] System Configuration

[0995] The system mainly consists of the following hardware and software:

[0996] A wearable device (with GPS function) worn by children

[0997] Parents' smartphones and tablets

[0998] server

[0999] Sentiment analysis engine (artificial intelligence model)

[1000] Communication modules (e.g. Wi-Fi, 4G / 5G)

[1001] Memorizing the child's range of activities

[1002] The server receives data on the child's usual range of movement (e.g., GPS coordinates) sent by the parent and stores it in a database. Based on this data, the child's usual behavioral patterns can be geographically determined.

[1003] Location acquisition and monitoring

[1004] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via the parent's smartphone app.

[1005] Abnormal behavior detection

[1006] The server compares the received location information with stored data on normal activity ranges. If the child moves outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal. If abnormal activity is detected, the server immediately generates an alert message and sends it to the parent's device.

[1007] Emotion recognition and suggestions

[1008] The emotion analysis engine analyzes the emotional input and reactions of parents provided through the parent's smartphone app. The analysis results are sent to the server, which then adjusts the urgency of the alerts accordingly.

[1009] Furthermore, the server suggests appropriate countermeasures based on the parent's emotions. For example, if emotion analysis indicates high anxiety, the system will immediately display detailed map information and automatically contact public authorities (e.g., police) if necessary.

[1010] Specific examples

[1011] For example, if a child gets lost in a shopping mall and a security robot detects the child's unusual movements, the robot will immediately send an alert to the parent's smartphone, and if the emotion analysis engine detects the parent's anxiety, it will notify the nearest security staff and simultaneously display a detailed map to the parent.

[1012] Example prompts for generative AI models

[1013] Below is an example of a prompt sentence to input to the sentiment analysis model:

[1014] Prompt: "What emotional reaction did you have to the parent alert notification? Please choose from the following options: [anxiety, surprise, relief]"

[1015] Based on this prompt, the emotion analysis engine analyzes the parent's emotions and suggests countermeasures.

[1016] This allows the system to respond flexibly and quickly to the emotional state of parents, making it possible to more reliably ensure the safety of children.

[1017] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1018] Step 1:

[1019] The server receives data from parents about the child's usual range of movement (e.g., GPS coordinates) and stores it in a database, which is used to compare with subsequent location information.

[1020] Input: Normal movement range data (GPS coordinates) sent by the parent

[1021] Data processing: recording to database

[1022] Output: Saved normal movement range data

[1023] Specific operation: Parents use a smartphone app to set their child's movement range, and that information is sent to the server.

[1024] Step 2:

[1025] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via a parent's smartphone app.

[1026] Input: Location information obtained from GPS

[1027] Data processing: Periodic acquisition and real-time transmission

[1028] Output: Current location sent to the server

[1029] Specific operation: The wearable device obtains current location information at regular intervals and uploads that information to a server via a smartphone app.

[1030] Step 3:

[1031] The server compares the current location information received with normal movement range data, and if the user moves outside of the normal movement range, it flags the behavior as abnormal and generates an alert.

[1032] Input: Current location information, usual movement range data

[1033] Data calculations: location matching, flagging abnormal behavior

[1034] Output: Generated alerts

[1035] What it does: The server compares the current location with the range of movement stored in the database and creates an alert if an anomaly is detected.

[1036] Step 4:

[1037] The server sends the generated alert to the parent's terminal.

[1038] Input: Generated alert

[1039] Data processing: Push notification generation

[1040] Output: Alert sent to parent's device

[1041] Specific operation: The server generates an alert message and sends it to the parent's smartphone using the push notification function.

[1042] Step 5:

[1043] The parent's device receives the alert and provides an interface for inputting the user's reactions and emotions.

[1044] Input: Received alert

[1045] Data processing: User input interface generation

[1046] Output: Input emotion information

[1047] Specific actions: Parents check the alert on their smartphone app and enter their emotional state using the interface displayed there.

[1048] Step 6:

[1049] The emotion analysis engine analyzes the input emotion information and generates emotion data of the parent / guardian, which is then sent to the server.

[1050] Input: Emotion information

[1051] Data Computing: Sentiment Analysis

[1052] Output: Parsed emotion data

[1053] How it works: The emotion analysis engine takes parental input and uses a generative AI model to analyze their emotional state.

[1054] Step 7:

[1055] The server receives the sentiment analysis data, adjusts the urgency of the alert, and suggests appropriate countermeasures.

[1056] Input: Sentiment analysis data, alerts

[1057] Data calculation: Adjusting the level of urgency and generating countermeasures

[1058] Output: Adjusted alerts, suggested actions

[1059] Specific operation: The server adjusts the urgency of the alert based on emotion analysis data and suggests appropriate responses to parents.

[1060] Step 8:

[1061] The user follows the suggested measures and takes the necessary action (e.g., contacting the police, checking a detailed map).

[1062] Input: Proposed action

[1063] Data manipulation: Implementing countermeasures

[1064] Output: Actions taken

[1065] Specific operation: Parents take action by pressing a button or other means in response to the app's suggestions, and the results are reflected in the system.

[1066] The above steps enable monitoring of children's location information and flexible responses based on parents' feelings.

[1067] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1068] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1069] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1070] [Third embodiment]

[1071] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1072] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1073] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1074] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1075] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1076] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1077] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1078] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1079] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1080] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1081] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1082] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1083] The present invention is a system for monitoring a child's range of activity and detecting abnormal behavior. This system comprises a means for storing the child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert when the child goes outside the usual range of activity, a means for sending the generated alert to a parent's device, and a means for contacting the police.

[1084] Memory of range of movement

[1085] Subject: User (parent)

[1086] Parents use a smartphone app to define their child's usual range of movement, which is defined as a geographical area associated with GPS coordinates. Parents register locations such as home, school, and parks through the app interface.

[1087] Subject: Server

[1088] The server receives the movement range data sent by the parents and stores it in a database, which is used to map the child's usual movement patterns geographically.

[1089] Monitoring range of activities

[1090] Subject: Terminal (wearable device)

[1091] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[1092] Subject: Device (smartphone)

[1093] The location information obtained by the wearable device is sent to the parent's smartphone app and uploaded from the app to a server.

[1094] Subject: Server

[1095] The server stores the received location information and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, it is determined to be abnormal activity.

[1096] Abnormal behavior detection

[1097] Subject: Server

[1098] The server generates an alert message when abnormal behavior is detected, which includes the child's current location, details of the abnormal behavior, and emergency contact information.

[1099] Subject: Device (smartphone)

[1100] The alert message is sent to the parent's smartphone as a push notification, allowing the parent to immediately receive the message and consider how to respond.

[1101] Identifying a missing child and contacting the police

[1102] Subject: User (parent)

[1103] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[1104] Subject: Device (smartphone)

[1105] The lost child identification information is immediately sent to the server.

[1106] Subject: Server

[1107] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification to the nearest police station, including the child's last known location and the parent's contact information.

[1108] Specific examples

[1109] For example, if a child is playing in a park on their way home from school after school, a parent can use a smartphone app to set three locations - home, school, and the park - as their child's normal range of activity. As long as the child is playing within the designated range of activity, the parent will not receive any special alerts.

[1110] However, if a child deviates from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server, which determines this as abnormal behavior. The server immediately generates an alert and sends it to the parent's smartphone via push notification. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to the police. This allows for a swift and effective response.

[1111] This system allows parents to go about their daily lives with peace of mind while ensuring the safety of their children.

[1112] The processing flow will be explained below.

[1113] Step 1:

[1114] Subject: User (parent)

[1115] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[1116] Step 2:

[1117] Subject: Server

[1118] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[1119] Step 3:

[1120] Subject: Terminal (wearable device)

[1121] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[1122] Step 4:

[1123] Subject: Terminal (wearable device)

[1124] The acquired location information is sent to the parent's smartphone app in real time, and the location information is constantly updated.

[1125] Step 5:

[1126] Subject: Device (smartphone)

[1127] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[1128] Step 6:

[1129] Subject: Server

[1130] The server stores the location information received in real time and compares it with stored data on normal activity ranges. If the comparison results in the location being outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal.

[1131] Step 7:

[1132] Subject: Server

[1133] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior.

[1134] Step 8:

[1135] Subject: Server

[1136] The generated alert message is sent as a push notification to the parent's smartphone.

[1137] Step 9:

[1138] Subject: Device (smartphone)

[1139] A push notification is sent to the parent's smartphone, and an alert message is displayed on the screen. The parent can then review the message and consider how to respond.

[1140] Step 10:

[1141] Subject: User (parent)

[1142] The parent presses the "Confirm Lost Child" button in the app. This action notifies the server that the child is lost.

[1143] Step 11:

[1144] Subject: Device (smartphone)

[1145] The lost child certification information is sent to the server.

[1146] Step 12:

[1147] Subject: Server

[1148] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[1149] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt appropriate action.

[1150] Example 1

[1151] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1152] Modern society demands technology to ensure the safety of children. However, many monitoring systems only track children's locations and lack the means to detect abnormal behavior or respond quickly. This creates a need for a system that allows parents to monitor their children's safety in real time and respond quickly when abnormal behavior occurs. To address this issue, the present invention aims to provide a system that monitors the range of children's activities, sends an alert to parents when an abnormality is detected, and contacts the police if necessary.

[1153] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1154] In this invention, the server includes a means for storing the child's normal range of movement set by the guardian, a means for periodically acquiring the child's current location information, and a means for comparing the normal range of movement with the acquired current location information. This allows an alert to be generated if the child leaves the normal range of movement, indicating abnormal behavior, and the alert can be sent as a push notification to the guardian's mobile information terminal. The server also includes a means for automatically sending contact information to police authorities if the guardian receives the alert and identifies the child as lost. This ensures the child's safety and enables a prompt and effective response.

[1155] "Area of ​​Activity" refers to the geographic area where a child typically moves, as designated by a parent, and is defined by GPS coordinates.

[1156] "Current location information" is real-time GPS data acquired by a portable device worn by the child, and indicates the child's current location.

[1157] "Abnormal behavior" is behavior detected when a child moves outside of their normal range of movement or into a designated danger zone.

[1158] An "alert" is a notification message that is generated when abnormal behavior is detected and includes the child's current location and details of the abnormal behavior.

[1159] "Mobile information terminal" means a mobile device, such as a smartphone or tablet, used by a parent or guardian to receive alerts.

[1160] "Lost child recognition" is an operation that parents perform within the app when they determine that their child is lost, and it triggers the sending of contact information to police authorities.

[1161] "Law enforcement authorities" are public agencies that receive contact when a child goes missing.

[1162] "Location means" refers to technology for determining a child's current location, specifically the Global Positioning System (GPS).

[1163] The present invention provides a system for monitoring a child's range of movement and detecting abnormal behavior, which is implemented using the following hardware and software.

[1164] Hardware

[1165] 1. User (parent) smartphone:

[1166] Parents use a smartphone app to set their child's usual range of movement, and the parent's smartphone receives the child's location information sent from the wearable device and uploads it to a server.

[1167] Specific hardware used: Smartphones (e.g., iPhones, Android devices)

[1168] 2. Children's wearable devices:

[1169] The wearable device worn by the child periodically obtains its current location information using GPS, and this information is sent to the parent's smartphone at regular intervals (e.g., every minute).

[1170] Specific hardware used: Wearable devices (e.g., Apple Watch, Fitbit)

[1171] 3. Server:

[1172] The server receives location information from the parents' smartphones, stores it in a database, and compares the parents' usual range of movement with the current location information.

[1173] Specific hardware used: Servers (e.g. AWS, Google Cloud)

[1174] software

[1175] 1. Smartphone app:

[1176] This is an application installed by parents, through which users can set their child's movement limits and receive notifications of abnormal behavior.

[1177] Specific software used: Mobile apps (e.g. iOS apps, Android apps)

[1178] 2. Server-side software:

[1179] The server stores and compares location information and generates an alert if abnormal behavior is detected. The generated alert is sent to the parent's smartphone. In addition, if the parent declares the child lost, contact information is automatically sent to the police.

[1180] Specific software used: database management systems, notification systems (e.g., MySQL, Firebase)

[1181] Specific operation explanation

[1182] For example, a child can play in a park on their way home from school after school. Parents can use a smartphone app to set three locations - home, school, and the park - as their normal range of activity. As long as the child is playing within the designated range of activity, no alerts will be generated.

[1183] However, if a child strays from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server. The server compares this location information with their usual range of movement and determines that the behavior is abnormal. The server immediately generates an alert and sends it as a push notification to the parent's smartphone. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to police authorities. This enables a swift and effective response.

[1184] Prompt Sentence Examples

[1185] Here are some examples of prompts for generative AI models:

[1186] Please explain the system's process for generating an alert and notifying parents when a child deviates from their normal range of movement. Please use sentences with the server, device, or user as the subject, clearly indicating the names of the specific hardware and software used, and include the type of data processing and calculations performed. Please also provide an explanation of each stage: recording the range of movement, monitoring, detecting abnormal behavior, recognizing the child as lost, and contacting the police, and provide specific examples.

[1187] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1188] Step 1:

[1189] Subject: User (parent)

[1190] Parents use a smartphone app to set the usual range of their child's activities. Through the app interface, parents register locations such as home, school, and park with GPS coordinates. This input data (GPS coordinates) is entered through the smartphone interface and sent to the server.

[1191] Input: GPS coordinates entered by parent

[1192] Output: Movement range data sent to the server

[1193] Step 2:

[1194] Subject: Server

[1195] The server receives the movement range data sent by the parent and stores it in a database, which is later used to match the child's location data.

[1196] Input: Movement range data sent by parent

[1197] Output: Home range data stored in a database

[1198] Step 3:

[1199] Subject: Terminal (wearable device)

[1200] The wearable device worn by the child uses GPS to obtain current location information at regular intervals, for example, once every minute, and sends this location information to the parent's smartphone via Bluetooth or Wi-Fi.

[1201] Input: GPS location information obtained periodically

[1202] Output: Location information sent to parent's smartphone

[1203] Step 4:

[1204] Subject: Device (smartphone)

[1205] The location information sent from the wearable device is received by the parent's smartphone app, which then uploads the location information to a server.

[1206] Input: Location information received from a wearable device

[1207] Output: Location information uploaded to the server

[1208] Step 5:

[1209] Subject: Server

[1210] The server stores the received location information in a database and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, the server determines this as abnormal activity and generates an alert.

[1211] Input: Location information sent from a wearable device

[1212] Data processing: Matching location information with pre-stored movement range data

[1213] Output: Alert when abnormal behavior is detected

[1214] Step 6:

[1215] Subject: Server

[1216] When abnormal behavior is detected, an alert message containing the child's current location and details about the abnormal behavior is generated and sent as a push notification to the parent's smartphone.

[1217] Input: Anomalous behavior detection results and corresponding details

[1218] Output: Alert notification sent to parent's smartphone

[1219] Step 7:

[1220] Subject: User (parent)

[1221] If a parent or guardian checks the alert notification and determines that their child is lost, they can press the "Confirm Lost Child" button in the smartphone app, which sends the lost child confirmation information to the server.

[1222] Input: Parental control to identify lost child

[1223] Output: Lost child certification information sent to the server

[1224] Step 8:

[1225] Subject: Server

[1226] The server receives the missing child identification information, consults the database of nearby police stations, and automatically sends a report to the nearest police station, including the child's last known location and the parent's contact information.

[1227] Input: Lost child identification information sent by parent

[1228] Output: Police report sent to authorities

[1229] (Application example 1)

[1230] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1231] Conventional child safety monitoring systems have limitations in real-timeness and accuracy when acquiring location information and generating and sending alerts, and parents have had to work hard to properly set their child's range of movement. Furthermore, they lacked a means of quickly responding when abnormal behavior was detected, which could lead to delays in identifying a child as lost and contacting the police. The purpose of this invention is to solve these problems, more reliably ensure the safety of children, and allow parents to live their daily lives with peace of mind.

[1232] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1233] In this invention, the server includes a means for setting a range of movement based on GPS coordinates set by the guardian, a means for periodically sending location information acquired from the wearable device to the server, a means for the server to compare the location information with the normal range of movement, generate an alert, and send it as a push notification, a means for providing a button for the guardian to declare the child as lost based on the alert message, and a means for the server to receive the child's recognition information from the guardian and automatically send a notification to the police. This enables early detection of abnormal behavior outside the normal range of movement and rapid alert transmission, allowing for faster recognition of the child as lost and automatic reporting to the police, significantly improving the safety of children.

[1234] "Child" refers to a minor under a certain age.

[1235] The "normal range of activity" is the range of a child's general activities set by the parent or guardian, and is a geographical area set based on GPS coordinates.

[1236] "Current location information" refers to a child's specific geographic coordinates and is data obtained through location measurement technology such as GPS.

[1237] "Verifying" refers to comparing the obtained current location information with the stored normal range of movement to determine whether there is a match or a mismatch.

[1238] An "alert" is a warning message that is generated and notified to parents when a child goes outside of their normal range of activity.

[1239] A "guardian" is someone who has supervisory responsibility for a child, usually a parent or legal guardian.

[1240] "Terminal" refers to a device that forms part of the system, and in this case, this mainly refers to smartphones and wearable devices.

[1241] A "server" is a computer system that processes and stores data, and is responsible for storing and collating location information, generating alerts, etc.

[1242] "GPS coordinates" are numerical data that indicate a specific location on Earth, and are composed of latitude and longitude.

[1243] A "wearable device" is a portable electronic device worn by a child that can acquire location information and collect other data.

[1244] "Push notification" is a method of sending information in real time to devices such as smartphone apps.

[1245] "Lost child certification" refers to the act of a parent confirming an alert, determining that their child is lost, and registering that information in the system.

[1246] "Automatic notification" is a mechanism by which a server sends information without requiring human intervention when certain conditions are met.

[1247] System Program

[1248] The system according to the present invention is a program for monitoring a child's range of movement and detecting abnormal behavior. The system consists of the following main components:

[1249] 1. A way to remember your child's normal range of behavior

[1250] User (Parent)

[1251] Parents use a smartphone app to define their child's usual range of movement, which is registered as GPS coordinates. Parents input the location of their home, school, park, etc. through the app interface.

[1252] 2. How to get your child's current location

[1253] Terminal (wearable device)

[1254] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[1255] 3. Sending and saving location information to the server

[1256] Device (smartphone)

[1257] The location information acquired by the wearable device is sent to the parent's smartphone app, which then sends the location information to a server.

[1258] 4. Matching your usual range of movement with your current location

[1259] server

[1260] The server stores the received location information in a database. The server compares it with normal movement range data and detects abnormal behavior. If the user moves outside the specified range, it is determined to be abnormal behavior.

[1261] 5. Detecting Abnormal Behavior and Generating Alerts

[1262] server

[1263] When abnormal behavior is detected, the server generates an alert message, which includes the current location and details of the abnormal behavior.

[1264] 6. Push notifications for parents

[1265] Device (smartphone)

[1266] The alert message is sent to the parent's smartphone as a push notification, so the parent can receive the notification immediately.

[1267] 7. Confirming the child is lost and contacting the police

[1268] User (Parent)

[1269] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[1270] Device (smartphone)

[1271] The lost child certification information is sent to the server.

[1272] server

[1273] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification containing the child's last known location and parental contact information.

[1274] Hardware and software used

[1275] Hardware:

[1276] Smartphone (iOS, Android)

[1277] Wearable devices (GPS trackers)

[1278] Server (AWS, Google Cloud)

[1279] software:

[1280] Smartphone app (Xcode, Android Studio)

[1281] Server-side program (Node.js)

[1282] Database (MongoDB)

[1283] Communication protocol (REST API)

[1284] Push notification service (Firebase)

[1285] Specific examples and prompts for the generative AI model

[1286] Specific examples

[1287] For example, when a child is playing in a park on their way home from school after school, parents can set their home, school, and park as their normal range of movement. If the child strays from this range and moves to a dangerous neighboring town, the wearable device detects the child's location, and the data is sent to the server, where it is detected as an anomaly. The server immediately sends an alert to the parent via push notification, and the parent can "recognize the child as lost" within the app, and the information is then sent to the police.

[1288] Prompt sentence for generative AI model

[1289] Based on your invention, please generate sample code for a smartphone application that monitors children's movements and detects abnormal behavior. The application will have the following features:

[1290] 1. A feature that allows parents to set a normal range of movement (based on GPS coordinates)

[1291] 2. A function to send location information obtained from a child's wearable device to a server

[1292] 3. A feature that generates an alert and sends a push notification to the parent's smartphone if the child moves outside of their normal range of movement.

[1293] 4. A function that automatically sends a notification to the police if a parent or guardian declares the child lost.

[1294] The code should utilize Node.js and MongoDB and include server-side processing.

[1295] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1296] Step 1:

[1297] Subject: User (parent)

[1298] Parents launch the smartphone app and set their child's usual range of movement by entering GPS coordinates of their home, school, park, etc. through the app interface. This data is temporarily stored in the smartphone app and then sent to the server.

[1299] Step 2:

[1300] Subject: Server

[1301] The server receives the movement range data sent by the guardian and stores it in a database. The received data is kept as movement range setting information and used for later matching processing. The server confirms that the saving is complete and returns a completion message to the guardian's smartphone.

[1302] Step 3:

[1303] Subject: Terminal (wearable device)

[1304] The wearable device worn by the child periodically obtains its current location information using GPS. This location data is sent to a smartphone at regular intervals (e.g., every minute). The input is sensor data, and the output is the current GPS coordinates.

[1305] Step 4:

[1306] Subject: Device (smartphone)

[1307] The location information received from the wearable device is temporarily stored in the smartphone, and then sent to the server. The smartphone app sends the location information to the server using an HTTP request (e.g., POST method). The input of this step is the location data of the wearable device, and the output is a request to the server.

[1308] Step 5:

[1309] Subject: Server

[1310] The server receives location information sent from the smartphone and stores it in a database. The stored location information is compared with stored data on the user's normal range of movement. This comparison is performed using SQL queries and database search algorithms. The input is the location data, and the output is the comparison result.

[1311] Step 6:

[1312] Subject: Server

[1313] If the server determines that the location information is outside the normal range of activity, it generates an alert as an abnormal behavior determination. This alert message includes the current location information and details of the abnormal behavior. The generated alert is sent to the parent's smartphone as a push notification. The input is location data and activity range data, and the output is the alert message. The server sends the message using a push notification service such as Firebase.

[1314] Step 7:

[1315] Subject: Device (smartphone)

[1316] An alert message is sent to the parent's smartphone. The parent checks the notification and confirms any abnormal behavior through the app. When the parent presses the "Confirm Lost Child" button, the information is sent from the smartphone to the server. The input is the user's operation, and the output is the transmission of the confirmation information to the server.

[1317] Step 8:

[1318] Subject: Server

[1319] The server receives the lost child identification information and automatically sends a notification by referencing the database of the local police station. This notification includes the child's last known location and the parent's contact information. The input is the identification information, and the output is a notification to the police. This process allows for a quick response.

[1320] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1321] The present invention is a system that combines a system that monitors a child's range of activity and detects abnormal behavior with an emotion engine that recognizes the parent's emotions in response to alert notifications and proposes optimal countermeasures. This system is composed of a means for storing a child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert if the child goes outside the usual range of activity, a means for sending the generated alert to the parent's device, a means for the emotion engine that recognizes the parent's emotions, and a means for contacting the police.

[1322] The introduction of the emotion engine makes it possible to perform the following specific processes:

[1323] Memory of range of movement

[1324] Subject: User (parent)

[1325] Parents use a smartphone app to define their child's usual range of movement, which is then associated with GPS coordinates and stored in the system.

[1326] Subject: Server

[1327] The server receives the movement range data sent by the parents and stores it in a database, which is used to geographically map the child's usual movement patterns.

[1328] Monitoring range of activities

[1329] Subject: Terminal (wearable device)

[1330] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information changes in real time.

[1331] Subject: Device (smartphone)

[1332] The acquired location information is sent to a server via the parent's smartphone app.

[1333] Subject: Server

[1334] The server stores the location information it receives and compares it with data on normal activity ranges. If the person moves outside their normal activity range or into a dangerous area, it flags the person's behavior as abnormal.

[1335] Abnormal behavior detection and emotion recognition

[1336] Subject: Server

[1337] When abnormal behavior is detected, the server generates an alert message, which includes the child's current location, details of the abnormal behavior, and information required by the emotion engine.

[1338] Subject: Device (smartphone)

[1339] The parent's smartphone app receives alerts via push notification, displays them on the screen, and provides an interface for parents to input their reactions and emotions.

[1340] Subject: Emotion Engine

[1341] The emotion engine has a function of analyzing the emotion (e.g., anxiety, surprise, relief, etc.) expressed by the parent when viewing the notification. The analyzed emotion data is sent to the server.

[1342] Alert tuning and response suggestions

[1343] Subject: Server

[1344] The server receives emotion analysis data from the emotion engine, adjusts the urgency of the alert, and suggests appropriate actions based on the parent's emotion (e.g., encouraging a phone call, displaying a detailed map, prioritizing automatic contact with the police, etc.).

[1345] Identifying a missing child and contacting the police

[1346] Subject: User (parent)

[1347] The parent presses the "Confirm Lost" button within the app, after confirming the suggestion from the emotion engine.

[1348] Subject: Server

[1349] The server receives the missing child information, consults the local police station database, and automatically sends a notification, including the child's last known location and the parent's contact information.

[1350] Specific examples

[1351] For example, if a child strays from the park, which is their usual range of activity, after school and heads to a neighboring town, the location information from the wearable device is sent to the server, which detects this as an abnormality. The server immediately generates an alert and sends it to the parent's smartphone. The parent checks the notification, enters their response in the app, and the emotion engine analyzes it. If it determines that the child is feeling anxious, the urgency of the alert is adjusted. Following the emotion engine's suggestions, the parent can declare the child lost, and the server will automatically notify the police.

[1352] In this way, by combining the emotion engine, it becomes possible to respond flexibly and quickly according to the psychological state of the parent, thereby more reliably ensuring the safety of the child.

[1353] The processing flow will be explained below.

[1354] Step 1:

[1355] Subject: User (parent)

[1356] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[1357] Step 2:

[1358] Subject: Server

[1359] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[1360] Step 3:

[1361] Subject: Terminal (wearable device)

[1362] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[1363] Step 4:

[1364] Subject: Terminal (wearable device)

[1365] The acquired location information is sent to the parent's smartphone app, and this data communication is carried out in real time.

[1366] Step 5:

[1367] Subject: Device (smartphone)

[1368] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[1369] Step 6:

[1370] Subject: Server

[1371] The server compares the real-time location information received with stored data on normal movement ranges, and flags any abnormal behavior if the location information goes outside the normal movement range or into a dangerous area.

[1372] Step 7:

[1373] Subject: Server

[1374] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior. At the same time, the emotion engine works to prepare for analyzing the parent's emotions.

[1375] Step 8:

[1376] Subject: Server

[1377] The generated alert message is sent as a push notification to the parent's smartphone.

[1378] Step 9:

[1379] Subject: Device (smartphone)

[1380] The parent's smartphone receives a push notification and an alert message appears on the screen. The parent checks the alert content and operates the emotion input interface within the app.

[1381] Step 10:

[1382] Subject: Emotion Engine

[1383] The emotion engine analyzes the parent's reactions and emotions, determining their emotional state (e.g., anxiety, surprise, relief) based on data collected by the emotion input interface.

[1384] Step 11:

[1385] Subject: Server

[1386] The server receives the analysis results from the emotion engine and adjusts the urgency of the alert. For example, if anxiety is high, the urgency of the alert is set high.

[1387] Step 12:

[1388] Subject: Server

[1389] The server then suggests the best course of action based on the parent's feelings, offering options such as prompting a quick phone call, displaying a detailed map, or immediately contacting the police.

[1390] Step 13:

[1391] Subject: User (parent)

[1392] The parent presses the "Confirm Lost" button within the app, after accepting the suggestion from the emotion engine.

[1393] Step 14:

[1394] Subject: Device (smartphone)

[1395] The lost child certification information is sent to the server.

[1396] Step 15:

[1397] Subject: Server

[1398] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[1399] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt parents to take appropriate action based on their emotions.

[1400] Example 2

[1401] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1402] In modern society, to ensure children's safety, it is important to monitor their movements and detect abnormal behavior early. However, conventional systems issue uniform alerts without considering the feelings of parents, which can cause excessive anxiety. Furthermore, because appropriate countermeasures are not clearly stated, prompt action may not be taken in an emergency. This poses a problem in that the effectiveness of the monitoring system cannot be fully achieved.

[1403] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1404] In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child leaves the usual range of activity, means for sending the generated alert to the parent's device, means for analyzing the parent's emotions when viewing the notification, means for adjusting the urgency of the alert based on the analyzed emotions, and means for contacting the police if the parent acknowledges the alert. This allows for flexible and prompt responses according to the parent's psychological state, and more reliably ensures the safety of the child.

[1405] "Child's usual range of movement" refers to the area where a child typically moves, as set by a parent or guardian and defined using GPS coordinates.

[1406] "Current Location Information" means a child's current geographic location periodically obtained from a wearable device or other GPS-enabled device worn by the child.

[1407] "Verifying" means comparing the current location information with a preset movement range to see if it matches or if it is outside the range.

[1408] An "alert" is a warning message that is generated and sent to a parent's device when a child goes outside their normal range of behavior.

[1409] A "parent's device" refers to an electronic device, such as a smartphone or tablet, used by a parent to monitor their child's range of activities or abnormal behavior.

[1410] "Analyzing emotions" means analyzing the reactions and emotions (e.g., anxiety, surprise, relief, etc.) shown by the parent in response to the alert, and quantifying or categorizing those emotions.

[1411] "Emotion Engine" refers to the software components and algorithms used to analyze emotions expressed by parents.

[1412] "Adjusting the urgency" means changing the importance and priority of an alert based on the results of sentiment analysis and suggesting appropriate countermeasures.

[1413] "Means to contact law enforcement" refers to the communications methods and protocols that automatically notify law enforcement if a parent acknowledges the alert.

[1414] This invention combines a system that monitors a child's range of movement and detects abnormal behavior with an emotion engine that recognizes the parent's emotions and suggests optimal countermeasures. This system uses a wearable device and a smartphone as hardware, and a server, GPS, and emotion engine as software.

[1415] Hardware and Software Configuration

[1416] Wearable devices

[1417] Wearable devices are worn by children and periodically acquire their current location information using GPS, allowing you to track your child's location in real time. Examples include smartwatches.

[1418] Smartphone

[1419] A dedicated app is installed on the parent's smartphone to receive location information sent from the wearable device, and provides multiple functions, such as receiving alerts, allowing parents to input their emotions, and displaying the results of the emotion engine.

[1420] Servers and Databases

[1421] The server receives location information sent from the smartphone app and compares it with data on the child's normal range of movement. The database stores information such as the child's normal range of movement, location information, and emotional data of the guardian.

[1422] Emotion Engine

[1423] The emotion engine analyzes the emotions expressed by parents when they receive an alert. Using an emotion input interface, the emotion expressed by the parent is acquired as data, and this data is then passed through an analysis algorithm to adjust the level of urgency. The analyzed data is sent to a server, which then presents appropriate countermeasures.

[1424] Specific examples

[1425] For example, if a child leaves the park, which is his usual area of ​​activity, after school and moves to a neighboring town, the system operates as follows.

[1426] 1. Obtaining location information: The wearable device worn by the child uses GPS to obtain location information when the child moves to the next town.

[1427] 2. Location information transmission: This location information is sent in real time to the parent's smartphone app, from where it is uploaded to a server.

[1428] 3. Detecting abnormal behavior: The server compares the received location information with normal activity range data and determines that it is abnormal.

[1429] 4. Alert generation and notification: The server instantly generates an alert and sends a push notification to the parent's smartphone.

[1430] 5. Emotion recognition: When parents view notifications and express concern within the app, the emotion engine analyzes this and adjusts the urgency level.

[1431] 6. Proposal of countermeasures: Following the suggestion of the emotion engine, the parent / guardian will certify the child as lost, and the server will automatically notify the police.

[1432] Prompt Sentence Examples

[1433] Examples of prompts for this system include:

[1434] "Please explain the process of the system that generates abnormal behavior alerts when a child goes outside of their normal range of behavior, analyzes the parent's emotions, and suggests appropriate countermeasures."

[1435] By utilizing this invention, flexible and prompt responses based on the psychological state of the guardian are possible, and the safety of the child can be more reliably ensured.

[1436] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1437] Step 1:

[1438] Setting the scope of action

[1439] User (Parent)

[1440] Parents use a smartphone app to set their child's usual range of movement by selecting a specific area (e.g., around their home, park, school, etc.) on a map based on GPS coordinates and registering that area as their child's range of movement.

[1441] Input: Parental area selection information (GPS coordinates)

[1442] Output: Set movement range data

[1443] server

[1444] The server receives the activity range data sent by the parent and stores it in a database, which is used to understand the child's usual behavioral patterns.

[1445] Input: Movement range data sent by parent

[1446] Output: Home range data stored in a database

[1447] Step 2:

[1448] Get current location

[1449] Terminal (wearable device)

[1450] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information is saved in real time.

[1451] Input: GPS data

[1452] Output: Current location

[1453] Step 3:

[1454] Sending location information

[1455] Terminal (wearable device)

[1456] The acquired location information is sent to the parent's smartphone app at regular intervals via Bluetooth, Wi-Fi, or mobile data.

[1457] Input: Current location

[1458] Output: Location information sent to the smartphone

[1459] Device (smartphone)

[1460] The parent's smartphone then sends the location information it receives to a server. The transmission is done in real time, and the latest location information is always uploaded to the server.

[1461] Input: Location information sent from a wearable device

[1462] Output: Location information sent to the server

[1463] Step 4:

[1464] Abnormal behavior detection

[1465] server

[1466] The server compares the received location information with the normal movement range data. If the location information is outside the set movement range or if the user enters a dangerous area, it flags the behavior as abnormal at that point. Furthermore, when a flag is raised, a detailed log is recorded in the database.

[1467] Input: Location information, movement range data

[1468] Output: Abnormal behavior flag, detailed log

[1469] Step 5:

[1470] Alert generation and notification

[1471] server

[1472] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location, details of the abnormal behavior, and information needed by the emotion engine.

[1473] Input: Abnormal behavior flag, child's current location

[1474] Output: Alert message

[1475] Device (smartphone)

[1476] Parents' smartphones receive push notifications and an alert appears on their screen, showing the child's specific location and a map of the surrounding area.

[1477] Input: Alert message

[1478] Output: Parental Notice

[1479] Step 6:

[1480] Emotion recognition

[1481] User (Parent)

[1482] Parents can view the notification and enter their emotion within the app by choosing from the options provided (e.g., anxious, surprised, relieved, etc.) or by typing their emotion as a text input.

[1483] Input: Parent's emotional input data

[1484] Output: Parent's emotional data in the app

[1485] Emotion Engine

[1486] The emotion engine analyzes the emotional data entered by the parent or guardian. This analysis is carried out using NLP (natural language processing) technology, and the results are converted into numerical values ​​and sent to the server.

[1487] Input: Parent's emotional input data

[1488] Output: Quantified emotion data

[1489] Step 7:

[1490] Alert tuning and response suggestions

[1491] server

[1492] The server receives emotion analysis data from the emotion engine and adjusts the urgency of the alert. If the urgency is high, it displays a detailed map, options to call directly, and suggests automatic contact with the police, depending on the situation.

[1493] Input: Sentiment analysis data

[1494] Output: Adjusted alert, suggested action

[1495] Step 8:

[1496] Identifying a missing child and contacting the police

[1497] User (Parent)

[1498] Based on the emotion engine's suggestions, parents can press the "Confirm Lost" button in the app, which automatically sends a notification to the police.

[1499] Input: Suggestions from the emotion engine, parental authorization actions

[1500] Output: Lost child recognition data

[1501] server

[1502] The server receives the lost child identification request and automatically searches the database of the local police station and sends a notification, which includes the child's last known location and the parent's contact information.

[1503] Input: Lost child certification data

[1504] Output: Police notification

[1505] (Application example 2)

[1506] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1507] Conventional child location monitoring systems only generate alerts when a child deviates from their normal range of movement, but do not take into account the emotional state of the parent or suggest countermeasures, which means that it takes a long time to respond in an emergency. Another issue is that it is difficult for parents to determine the appropriate response when they are emotionally upset.

[1508] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child goes outside the usual range of activity, means for sending the generated alert to the parent's terminal, means for contacting a public institution when the parent approves the alert, an emotion analysis engine for recognizing the parent's emotions, and means for adjusting the urgency of the alert based on the emotion analysis engine and proposing appropriate countermeasures. This enables flexible and prompt responses according to the parent's emotional state.

[1509] A "child's usual range of activity" refers to the geographical area in which a child moves or engages on a daily basis, and is defined by GPS coordinates set by the parent or guardian, for example.

[1510] "Current location information" is real-time geographic coordinate information that indicates where the child is currently located.

[1511] "Matching" is the process of comparing the acquired current location information with the child's stored usual range of movement.

[1512] An "alert" is a warning message that is generated when a child goes outside of their normal range of activity and is sent to the parent's device.

[1513] "Parent's device" means an electronic device such as a smartphone or tablet used by a parent.

[1514] "Public authorities" refers to the police and other public authorities, who will be contacted in an emergency if necessary.

[1515] The "emotion analysis engine" is an artificial intelligence system that analyzes parents' emotions and has the ability to analyze their reactions and emotions and digitize them.

[1516] "Adjusting the urgency" means changing the importance of the alert based on the parent's emotional information analyzed by the emotion analysis engine.

[1517] "Proposing appropriate countermeasures" means presenting appropriate actions and options to parents based on the analyzed emotional information.

[1518] The present invention aims to realize a system that monitors the range of a child's activities, detects abnormal behavior, and proposes countermeasures. Specific embodiments of the system will be described below.

[1519] System Configuration

[1520] The system mainly consists of the following hardware and software:

[1521] A wearable device (with GPS function) worn by children

[1522] Parents' smartphones and tablets

[1523] server

[1524] Sentiment analysis engine (artificial intelligence model)

[1525] Communication modules (e.g. Wi-Fi, 4G / 5G)

[1526] Memorizing the child's range of activities

[1527] The server receives data on the child's usual range of movement (e.g., GPS coordinates) sent by the parent and stores it in a database. Based on this data, the child's usual behavioral patterns can be geographically determined.

[1528] Location acquisition and monitoring

[1529] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via the parent's smartphone app.

[1530] Abnormal behavior detection

[1531] The server compares the received location information with stored data on normal activity ranges. If the child moves outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal. If abnormal activity is detected, the server immediately generates an alert message and sends it to the parent's device.

[1532] Emotion recognition and suggestions

[1533] The emotion analysis engine analyzes the emotional input and reactions of parents provided through the parent's smartphone app. The analysis results are sent to the server, which then adjusts the urgency of the alerts accordingly.

[1534] Furthermore, the server suggests appropriate countermeasures based on the parent's emotions. For example, if emotion analysis indicates high anxiety, the system will immediately display detailed map information and automatically contact public authorities (e.g., police) if necessary.

[1535] Specific examples

[1536] For example, if a child gets lost in a shopping mall and a security robot detects the child's unusual movements, the robot will immediately send an alert to the parent's smartphone, and if the emotion analysis engine detects the parent's anxiety, it will notify the nearest security staff and simultaneously display a detailed map to the parent.

[1537] Example prompts for generative AI models

[1538] Below is an example of a prompt sentence to input to the sentiment analysis model:

[1539] Prompt: "What emotional reaction did you have to the parent alert notification? Please choose from the following options: [anxiety, surprise, relief]"

[1540] Based on this prompt, the emotion analysis engine analyzes the parent's emotions and suggests countermeasures.

[1541] This allows the system to respond flexibly and quickly to the emotional state of parents, making it possible to more reliably ensure the safety of children.

[1542] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1543] Step 1:

[1544] The server receives data from parents about the child's usual range of movement (e.g., GPS coordinates) and stores it in a database, which is used to compare with subsequent location information.

[1545] Input: Normal movement range data (GPS coordinates) sent by the parent

[1546] Data processing: recording to database

[1547] Output: Saved normal movement range data

[1548] Specific operation: Parents use a smartphone app to set their child's movement range, and that information is sent to the server.

[1549] Step 2:

[1550] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via a parent's smartphone app.

[1551] Input: Location information obtained from GPS

[1552] Data processing: Periodic acquisition and real-time transmission

[1553] Output: Current location sent to the server

[1554] Specific operation: The wearable device obtains current location information at regular intervals and uploads that information to a server via a smartphone app.

[1555] Step 3:

[1556] The server compares the current location information received with normal movement range data, and if the user moves outside of the normal movement range, it flags the behavior as abnormal and generates an alert.

[1557] Input: Current location information, usual movement range data

[1558] Data calculations: location matching, flagging abnormal behavior

[1559] Output: Generated alerts

[1560] What it does: The server compares the current location with the range of movement stored in the database and creates an alert if an anomaly is detected.

[1561] Step 4:

[1562] The server sends the generated alert to the parent's terminal.

[1563] Input: Generated alert

[1564] Data processing: Push notification generation

[1565] Output: Alert sent to parent's device

[1566] Specific operation: The server generates an alert message and sends it to the parent's smartphone using the push notification function.

[1567] Step 5:

[1568] The parent's device receives the alert and provides an interface for inputting the user's reactions and emotions.

[1569] Input: Received alert

[1570] Data processing: User input interface generation

[1571] Output: Input emotion information

[1572] Specific actions: Parents check the alert on their smartphone app and enter their emotional state using the interface displayed there.

[1573] Step 6:

[1574] The emotion analysis engine analyzes the input emotion information and generates emotion data of the parent / guardian, which is then sent to the server.

[1575] Input: Emotion information

[1576] Data Computing: Sentiment Analysis

[1577] Output: Parsed emotion data

[1578] How it works: The emotion analysis engine takes parental input and uses a generative AI model to analyze their emotional state.

[1579] Step 7:

[1580] The server receives the sentiment analysis data, adjusts the urgency of the alert, and suggests appropriate countermeasures.

[1581] Input: Sentiment analysis data, alerts

[1582] Data calculation: Adjusting the level of urgency and generating countermeasures

[1583] Output: Adjusted alerts, suggested actions

[1584] Specific operation: The server adjusts the urgency of the alert based on emotion analysis data and suggests appropriate responses to parents.

[1585] Step 8:

[1586] The user follows the suggested measures and takes the necessary action (e.g., contacting the police, checking a detailed map).

[1587] Input: Proposed action

[1588] Data manipulation: Implementing countermeasures

[1589] Output: Actions taken

[1590] Specific operation: Parents take action by pressing a button or other means in response to the app's suggestions, and the results are reflected in the system.

[1591] The above steps enable monitoring of children's location information and flexible responses based on parents' feelings.

[1592] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1593] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1594] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1595] [Fourth embodiment]

[1596] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1597] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1598] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1599] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1600] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1601] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1602] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1603] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1604] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1605] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1606] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1607] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1608] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1609] The present invention is a system for monitoring a child's range of activity and detecting abnormal behavior. This system comprises a means for storing the child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert when the child goes outside the usual range of activity, a means for sending the generated alert to a parent's device, and a means for contacting the police.

[1610] Memory of range of movement

[1611] Subject: User (parent)

[1612] Parents use a smartphone app to define their child's usual range of movement, which is defined as a geographical area associated with GPS coordinates. Parents register locations such as home, school, and parks through the app interface.

[1613] Subject: Server

[1614] The server receives the movement range data sent by the parents and stores it in a database, which is used to map the child's usual movement patterns geographically.

[1615] Monitoring range of activities

[1616] Subject: Terminal (wearable device)

[1617] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[1618] Subject: Device (smartphone)

[1619] The location information obtained by the wearable device is sent to the parent's smartphone app and uploaded from the app to a server.

[1620] Subject: Server

[1621] The server stores the received location information and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, it is determined to be abnormal activity.

[1622] Abnormal behavior detection

[1623] Subject: Server

[1624] The server generates an alert message when abnormal behavior is detected, which includes the child's current location, details of the abnormal behavior, and emergency contact information.

[1625] Subject: Device (smartphone)

[1626] The alert message is sent to the parent's smartphone as a push notification, allowing the parent to immediately receive the message and consider how to respond.

[1627] Identifying a missing child and contacting the police

[1628] Subject: User (parent)

[1629] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[1630] Subject: Device (smartphone)

[1631] The lost child identification information is immediately sent to the server.

[1632] Subject: Server

[1633] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification to the nearest police station, including the child's last known location and the parent's contact information.

[1634] Specific examples

[1635] For example, if a child is playing in a park on their way home from school after school, a parent can use a smartphone app to set three locations - home, school, and the park - as their child's normal range of activity. As long as the child is playing within the designated range of activity, the parent will not receive any special alerts.

[1636] However, if a child deviates from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server, which determines this as abnormal behavior. The server immediately generates an alert and sends it to the parent's smartphone via push notification. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to the police. This allows for a swift and effective response.

[1637] This system allows parents to go about their daily lives with peace of mind while ensuring the safety of their children.

[1638] The processing flow will be explained below.

[1639] Step 1:

[1640] Subject: User (parent)

[1641] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[1642] Step 2:

[1643] Subject: Server

[1644] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[1645] Step 3:

[1646] Subject: Terminal (wearable device)

[1647] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[1648] Step 4:

[1649] Subject: Terminal (wearable device)

[1650] The acquired location information is sent to the parent's smartphone app in real time, and the location information is constantly updated.

[1651] Step 5:

[1652] Subject: Device (smartphone)

[1653] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[1654] Step 6:

[1655] Subject: Server

[1656] The server stores the location information received in real time and compares it with stored data on normal activity ranges. If the comparison results in the location being outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal.

[1657] Step 7:

[1658] Subject: Server

[1659] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior.

[1660] Step 8:

[1661] Subject: Server

[1662] The generated alert message is sent as a push notification to the parent's smartphone.

[1663] Step 9:

[1664] Subject: Device (smartphone)

[1665] A push notification is sent to the parent's smartphone, and an alert message is displayed on the screen. The parent can then review the message and consider how to respond.

[1666] Step 10:

[1667] Subject: User (parent)

[1668] The parent presses the "Confirm Lost Child" button in the app. This action notifies the server that the child is lost.

[1669] Step 11:

[1670] Subject: Device (smartphone)

[1671] The lost child certification information is sent to the server.

[1672] Step 12:

[1673] Subject: Server

[1674] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[1675] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt appropriate action.

[1676] Example 1

[1677] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1678] Modern society demands technology to ensure the safety of children. However, many monitoring systems only track children's locations and lack the means to detect abnormal behavior or respond quickly. This creates a need for a system that allows parents to monitor their children's safety in real time and respond quickly when abnormal behavior occurs. To address this issue, the present invention aims to provide a system that monitors the range of children's activities, sends an alert to parents when an abnormality is detected, and contacts the police if necessary.

[1679] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1680] In this invention, the server includes a means for storing the child's normal range of movement set by the guardian, a means for periodically acquiring the child's current location information, and a means for comparing the normal range of movement with the acquired current location information. This allows an alert to be generated if the child leaves the normal range of movement, indicating abnormal behavior, and the alert can be sent as a push notification to the guardian's mobile information terminal. The server also includes a means for automatically sending contact information to police authorities if the guardian receives the alert and identifies the child as lost. This ensures the child's safety and enables a prompt and effective response.

[1681] "Area of ​​Activity" refers to the geographic area where a child typically moves, as designated by a parent, and is defined by GPS coordinates.

[1682] "Current location information" is real-time GPS data acquired by a portable device worn by the child, and indicates the child's current location.

[1683] "Abnormal behavior" is behavior detected when a child moves outside of their normal range of movement or into a designated danger zone.

[1684] An "alert" is a notification message that is generated when abnormal behavior is detected and includes the child's current location and details of the abnormal behavior.

[1685] "Mobile information terminal" means a mobile device, such as a smartphone or tablet, used by a parent or guardian to receive alerts.

[1686] "Lost child recognition" is an operation that parents perform within the app when they determine that their child is lost, and it triggers the sending of contact information to police authorities.

[1687] "Law enforcement authorities" are public agencies that receive contact when a child goes missing.

[1688] "Location means" refers to technology for determining a child's current location, specifically the Global Positioning System (GPS).

[1689] The present invention provides a system for monitoring a child's range of movement and detecting abnormal behavior, which is implemented using the following hardware and software.

[1690] Hardware

[1691] 1. User (parent) smartphone:

[1692] Parents use a smartphone app to set their child's usual range of movement, and the parent's smartphone receives the child's location information sent from the wearable device and uploads it to a server.

[1693] Specific hardware used: Smartphones (e.g., iPhones, Android devices)

[1694] 2. Children's wearable devices:

[1695] The wearable device worn by the child periodically obtains its current location information using GPS, and this information is sent to the parent's smartphone at regular intervals (e.g., every minute).

[1696] Specific hardware used: Wearable devices (e.g., Apple Watch, Fitbit)

[1697] 3. Server:

[1698] The server receives location information from the parents' smartphones, stores it in a database, and compares the parents' usual range of movement with the current location information.

[1699] Specific hardware used: Servers (e.g. AWS, Google Cloud)

[1700] software

[1701] 1. Smartphone app:

[1702] This is an application installed by parents, through which users can set their child's movement limits and receive notifications of abnormal behavior.

[1703] Specific software used: Mobile apps (e.g. iOS apps, Android apps)

[1704] 2. Server-side software:

[1705] The server stores and compares location information and generates an alert if abnormal behavior is detected. The generated alert is sent to the parent's smartphone. In addition, if the parent declares the child lost, contact information is automatically sent to the police.

[1706] Specific software used: database management systems, notification systems (e.g., MySQL, Firebase)

[1707] Specific operation explanation

[1708] For example, a child can play in a park on their way home from school after school. Parents can use a smartphone app to set three locations - home, school, and the park - as their normal range of activity. As long as the child is playing within the designated range of activity, no alerts will be generated.

[1709] However, if a child strays from their usual range of movement and travels to a neighboring town, location information from the wearable device is sent to the server. The server compares this location information with their usual range of movement and determines that the behavior is abnormal. The server immediately generates an alert and sends it as a push notification to the parent's smartphone. If the parent checks this notification and determines that their child is lost, they can "certify the child as lost" within the app, and the information is automatically sent to police authorities. This enables a swift and effective response.

[1710] Prompt Sentence Examples

[1711] Here are some examples of prompts for generative AI models:

[1712] Please explain the system's process for generating an alert and notifying parents when a child deviates from their normal range of movement. Please use sentences with the server, device, or user as the subject, clearly indicating the names of the specific hardware and software used, and include the type of data processing and calculations performed. Please also provide an explanation of each stage: recording the range of movement, monitoring, detecting abnormal behavior, recognizing the child as lost, and contacting the police, and provide specific examples.

[1713] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1714] Step 1:

[1715] Subject: User (parent)

[1716] Parents use a smartphone app to set the usual range of their child's activities. Through the app interface, parents register locations such as home, school, and park with GPS coordinates. This input data (GPS coordinates) is entered through the smartphone interface and sent to the server.

[1717] Input: GPS coordinates entered by parent

[1718] Output: Movement range data sent to the server

[1719] Step 2:

[1720] Subject: Server

[1721] The server receives the movement range data sent by the parent and stores it in a database, which is later used to match the child's location data.

[1722] Input: Movement range data sent by parent

[1723] Output: Home range data stored in a database

[1724] Step 3:

[1725] Subject: Terminal (wearable device)

[1726] The wearable device worn by the child uses GPS to obtain current location information at regular intervals, for example, once every minute, and sends this location information to the parent's smartphone via Bluetooth or Wi-Fi.

[1727] Input: GPS location information obtained periodically

[1728] Output: Location information sent to parent's smartphone

[1729] Step 4:

[1730] Subject: Device (smartphone)

[1731] The location information sent from the wearable device is received by the parent's smartphone app, which then uploads the location information to a server.

[1732] Input: Location information received from a wearable device

[1733] Output: Location information uploaded to the server

[1734] Step 5:

[1735] Subject: Server

[1736] The server stores the received location information in a database and compares it with the stored data on normal activity ranges. If the user moves outside the normal activity range or into a dangerous area, the server determines this as abnormal activity and generates an alert.

[1737] Input: Location information sent from a wearable device

[1738] Data processing: Matching location information with pre-stored movement range data

[1739] Output: Alert when abnormal behavior is detected

[1740] Step 6:

[1741] Subject: Server

[1742] When abnormal behavior is detected, an alert message containing the child's current location and details about the abnormal behavior is generated and sent as a push notification to the parent's smartphone.

[1743] Input: Anomalous behavior detection results and corresponding details

[1744] Output: Alert notification sent to parent's smartphone

[1745] Step 7:

[1746] Subject: User (parent)

[1747] If a parent or guardian checks the alert notification and determines that their child is lost, they can press the "Confirm Lost Child" button in the smartphone app, which sends the lost child confirmation information to the server.

[1748] Input: Parental control to identify lost child

[1749] Output: Lost child certification information sent to the server

[1750] Step 8:

[1751] Subject: Server

[1752] The server receives the missing child identification information, consults the database of nearby police stations, and automatically sends a report to the nearest police station, including the child's last known location and the parent's contact information.

[1753] Input: Lost child identification information sent by parent

[1754] Output: Police report sent to authorities

[1755] (Application example 1)

[1756] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1757] Conventional child safety monitoring systems have limitations in real-timeness and accuracy when acquiring location information and generating and sending alerts, and parents have had to work hard to properly set their child's range of movement. Furthermore, they lacked a means of quickly responding when abnormal behavior was detected, which could lead to delays in identifying a child as lost and contacting the police. The purpose of this invention is to solve these problems, more reliably ensure the safety of children, and allow parents to live their daily lives with peace of mind.

[1758] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1759] In this invention, the server includes a means for setting a range of movement based on GPS coordinates set by the guardian, a means for periodically sending location information acquired from the wearable device to the server, a means for the server to compare the location information with the normal range of movement, generate an alert, and send it as a push notification, a means for providing a button for the guardian to declare the child as lost based on the alert message, and a means for the server to receive the child's recognition information from the guardian and automatically send a notification to the police. This enables early detection of abnormal behavior outside the normal range of movement and rapid alert transmission, allowing for faster recognition of the child as lost and automatic reporting to the police, significantly improving the safety of children.

[1760] "Child" refers to a minor under a certain age.

[1761] The "normal range of activity" is the range of a child's general activities set by the parent or guardian, and is a geographical area set based on GPS coordinates.

[1762] "Current location information" refers to a child's specific geographic coordinates and is data obtained through location measurement technology such as GPS.

[1763] "Verifying" refers to comparing the obtained current location information with the stored normal range of movement to determine whether there is a match or a mismatch.

[1764] An "alert" is a warning message that is generated and notified to parents when a child goes outside of their normal range of activity.

[1765] A "guardian" is someone who has supervisory responsibility for a child, usually a parent or legal guardian.

[1766] "Terminal" refers to a device that forms part of the system, and in this case, this mainly refers to smartphones and wearable devices.

[1767] A "server" is a computer system that processes and stores data, and is responsible for storing and collating location information, generating alerts, etc.

[1768] "GPS coordinates" are numerical data that indicate a specific location on Earth, and are composed of latitude and longitude.

[1769] A "wearable device" is a portable electronic device worn by a child that can acquire location information and collect other data.

[1770] "Push notification" is a method of sending information in real time to devices such as smartphone apps.

[1771] "Lost child certification" refers to the act of a parent confirming an alert, determining that their child is lost, and registering that information in the system.

[1772] "Automatic notification" is a mechanism by which a server sends information without requiring human intervention when certain conditions are met.

[1773] System Program

[1774] The system according to the present invention is a program for monitoring a child's range of movement and detecting abnormal behavior. The system consists of the following main components:

[1775] 1. A way to remember your child's normal range of behavior

[1776] User (Parent)

[1777] Parents use a smartphone app to define their child's usual range of movement, which is registered as GPS coordinates. Parents input the location of their home, school, park, etc. through the app interface.

[1778] 2. How to get your child's current location

[1779] Terminal (wearable device)

[1780] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute).

[1781] 3. Sending and saving location information to the server

[1782] Device (smartphone)

[1783] The location information acquired by the wearable device is sent to the parent's smartphone app, which then sends the location information to a server.

[1784] 4. Matching your usual range of movement with your current location

[1785] server

[1786] The server stores the received location information in a database. The server compares it with normal movement range data and detects abnormal behavior. If the user moves outside the specified range, it is determined to be abnormal behavior.

[1787] 5. Detecting Abnormal Behavior and Generating Alerts

[1788] server

[1789] When abnormal behavior is detected, the server generates an alert message, which includes the current location and details of the abnormal behavior.

[1790] 6. Push notifications for parents

[1791] Device (smartphone)

[1792] The alert message is sent to the parent's smartphone as a push notification, so the parent can receive the notification immediately.

[1793] 7. Confirming the child is lost and contacting the police

[1794] User (Parent)

[1795] If a parent checks the alert notification and determines that their child is lost, they can press the "Confirm Lost" button in the app.

[1796] Device (smartphone)

[1797] The lost child certification information is sent to the server.

[1798] server

[1799] The server receives the missing child identification information, consults the local police station database, and automatically sends a notification containing the child's last known location and parental contact information.

[1800] Hardware and software used

[1801] Hardware:

[1802] Smartphone (iOS, Android)

[1803] Wearable devices (GPS trackers)

[1804] Server (AWS, Google Cloud)

[1805] software:

[1806] Smartphone app (Xcode, Android Studio)

[1807] Server-side program (Node.js)

[1808] Database (MongoDB)

[1809] Communication protocol (REST API)

[1810] Push notification service (Firebase)

[1811] Specific examples and prompts for the generative AI model

[1812] Specific examples

[1813] For example, when a child is playing in a park on their way home from school after school, parents can set their home, school, and park as their normal range of movement. If the child strays from this range and moves to a dangerous neighboring town, the wearable device detects the child's location, and the data is sent to the server, where it is detected as an anomaly. The server immediately sends an alert to the parent via push notification, and the parent can "recognize the child as lost" within the app, and the information is then sent to the police.

[1814] Prompt sentence for generative AI model

[1815] Based on your invention, please generate sample code for a smartphone application that monitors children's movements and detects abnormal behavior. The application will have the following features:

[1816] 1. A feature that allows parents to set a normal range of movement (based on GPS coordinates)

[1817] 2. A function to send location information obtained from a child's wearable device to a server

[1818] 3. A feature that generates an alert and sends a push notification to the parent's smartphone if the child moves outside of their normal range of movement.

[1819] 4. A function that automatically sends a notification to the police if a parent or guardian declares the child lost.

[1820] The code should utilize Node.js and MongoDB and include server-side processing.

[1821] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1822] Step 1:

[1823] Subject: User (parent)

[1824] Parents launch the smartphone app and set their child's usual range of movement by entering GPS coordinates of their home, school, park, etc. through the app interface. This data is temporarily stored in the smartphone app and then sent to the server.

[1825] Step 2:

[1826] Subject: Server

[1827] The server receives the movement range data sent by the guardian and stores it in a database. The received data is kept as movement range setting information and used for later matching processing. The server confirms that the saving is complete and returns a completion message to the guardian's smartphone.

[1828] Step 3:

[1829] Subject: Terminal (wearable device)

[1830] The wearable device worn by the child periodically obtains its current location information using GPS. This location data is sent to a smartphone at regular intervals (e.g., every minute). The input is sensor data, and the output is the current GPS coordinates.

[1831] Step 4:

[1832] Subject: Device (smartphone)

[1833] The location information received from the wearable device is temporarily stored in the smartphone, and then sent to the server. The smartphone app sends the location information to the server using an HTTP request (e.g., POST method). The input of this step is the location data of the wearable device, and the output is a request to the server.

[1834] Step 5:

[1835] Subject: Server

[1836] The server receives location information sent from the smartphone and stores it in a database. The stored location information is compared with stored data on the user's normal range of movement. This comparison is performed using SQL queries and database search algorithms. The input is the location data, and the output is the comparison result.

[1837] Step 6:

[1838] Subject: Server

[1839] If the server determines that the location information is outside the normal range of activity, it generates an alert as an abnormal behavior determination. This alert message includes the current location information and details of the abnormal behavior. The generated alert is sent to the parent's smartphone as a push notification. The input is location data and activity range data, and the output is the alert message. The server sends the message using a push notification service such as Firebase.

[1840] Step 7:

[1841] Subject: Device (smartphone)

[1842] An alert message is sent to the parent's smartphone. The parent checks the notification and confirms any abnormal behavior through the app. When the parent presses the "Confirm Lost Child" button, the information is sent from the smartphone to the server. The input is the user's operation, and the output is the transmission of the confirmation information to the server.

[1843] Step 8:

[1844] Subject: Server

[1845] The server receives the lost child identification information and automatically sends a notification by referencing the database of the local police station. This notification includes the child's last known location and the parent's contact information. The input is the identification information, and the output is a notification to the police. This process allows for a quick response.

[1846] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1847] The present invention is a system that combines a system that monitors a child's range of activity and detects abnormal behavior with an emotion engine that recognizes the parent's emotions in response to alert notifications and proposes optimal countermeasures. This system is composed of a means for storing a child's usual range of activity, a means for acquiring the child's current location information, a means for comparing the usual range of activity with the acquired current location information, a means for generating an alert if the child goes outside the usual range of activity, a means for sending the generated alert to the parent's device, a means for the emotion engine that recognizes the parent's emotions, and a means for contacting the police.

[1848] The introduction of the emotion engine makes it possible to perform the following specific processes:

[1849] Memory of range of movement

[1850] Subject: User (parent)

[1851] Parents use a smartphone app to define their child's usual range of movement, which is then associated with GPS coordinates and stored in the system.

[1852] Subject: Server

[1853] The server receives the movement range data sent by the parents and stores it in a database, which is used to geographically map the child's usual movement patterns.

[1854] Monitoring range of activities

[1855] Subject: Terminal (wearable device)

[1856] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information changes in real time.

[1857] Subject: Device (smartphone)

[1858] The acquired location information is sent to a server via the parent's smartphone app.

[1859] Subject: Server

[1860] The server stores the location information it receives and compares it with data on normal activity ranges. If the person moves outside their normal activity range or into a dangerous area, it flags the person's behavior as abnormal.

[1861] Abnormal behavior detection and emotion recognition

[1862] Subject: Server

[1863] When abnormal behavior is detected, the server generates an alert message, which includes the child's current location, details of the abnormal behavior, and information required by the emotion engine.

[1864] Subject: Device (smartphone)

[1865] The parent's smartphone app receives alerts via push notification, displays them on the screen, and provides an interface for parents to input their reactions and emotions.

[1866] Subject: Emotion Engine

[1867] The emotion engine has a function of analyzing the emotion (e.g., anxiety, surprise, relief, etc.) expressed by the parent when viewing the notification. The analyzed emotion data is sent to the server.

[1868] Alert tuning and response suggestions

[1869] Subject: Server

[1870] The server receives emotion analysis data from the emotion engine, adjusts the urgency of the alert, and suggests appropriate actions based on the parent's emotion (e.g., encouraging a phone call, displaying a detailed map, prioritizing automatic contact with the police, etc.).

[1871] Identifying a missing child and contacting the police

[1872] Subject: User (parent)

[1873] The parent presses the "Confirm Lost" button within the app, after confirming the suggestion from the emotion engine.

[1874] Subject: Server

[1875] The server receives the missing child information, consults the local police station database, and automatically sends a notification, including the child's last known location and the parent's contact information.

[1876] Specific examples

[1877] For example, if a child strays from the park, which is their usual range of activity, after school and heads to a neighboring town, the location information from the wearable device is sent to the server, which detects this as an abnormality. The server immediately generates an alert and sends it to the parent's smartphone. The parent checks the notification, enters their response in the app, and the emotion engine analyzes it. If it determines that the child is feeling anxious, the urgency of the alert is adjusted. Following the emotion engine's suggestions, the parent can declare the child lost, and the server will automatically notify the police.

[1878] In this way, by combining the emotion engine, it becomes possible to respond flexibly and quickly according to the psychological state of the parent, thereby more reliably ensuring the safety of the child.

[1879] The processing flow will be explained below.

[1880] Step 1:

[1881] Subject: User (parent)

[1882] Parents open the smartphone app and register their child's usual range of movement in the settings menu, specifically by entering the GPS coordinates of locations such as home, school, and park, and specifying the range for each.

[1883] Step 2:

[1884] Subject: Server

[1885] The server receives the movement range data sent by the parents and stores it in a database, which allows the geographical location of the child's usual movement range to be determined.

[1886] Step 3:

[1887] Subject: Terminal (wearable device)

[1888] The wearable device worn by the child acquires GPS location information at regular intervals (e.g., every minute), which indicates the child's current specific location.

[1889] Step 4:

[1890] Subject: Terminal (wearable device)

[1891] The acquired location information is sent to the parent's smartphone app, and this data communication is carried out in real time.

[1892] Step 5:

[1893] Subject: Device (smartphone)

[1894] The smartphone app uploads the location information received from the wearable device to the server, allowing the server to maintain the latest location information.

[1895] Step 6:

[1896] Subject: Server

[1897] The server compares the real-time location information received with stored data on normal movement ranges, and flags any abnormal behavior if the location information goes outside the normal movement range or into a dangerous area.

[1898] Step 7:

[1899] Subject: Server

[1900] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location and details of the abnormal behavior. At the same time, the emotion engine works to prepare for analyzing the parent's emotions.

[1901] Step 8:

[1902] Subject: Server

[1903] The generated alert message is sent as a push notification to the parent's smartphone.

[1904] Step 9:

[1905] Subject: Device (smartphone)

[1906] The parent's smartphone receives a push notification and an alert message appears on the screen. The parent checks the alert content and operates the emotion input interface within the app.

[1907] Step 10:

[1908] Subject: Emotion Engine

[1909] The emotion engine analyzes the parent's reactions and emotions, determining their emotional state (e.g., anxiety, surprise, relief) based on data collected by the emotion input interface.

[1910] Step 11:

[1911] Subject: Server

[1912] The server receives the analysis results from the emotion engine and adjusts the urgency of the alert. For example, if anxiety is high, the urgency of the alert is set high.

[1913] Step 12:

[1914] Subject: Server

[1915] The server then suggests the best course of action based on the parent's feelings, offering options such as prompting a quick phone call, displaying a detailed map, or immediately contacting the police.

[1916] Step 13:

[1917] Subject: User (parent)

[1918] The parent presses the "Confirm Lost" button within the app, after accepting the suggestion from the emotion engine.

[1919] Step 14:

[1920] Subject: Device (smartphone)

[1921] The lost child certification information is sent to the server.

[1922] Step 15:

[1923] Subject: Server

[1924] The server receives the missing child information, consults the database of nearby police stations, and automatically contacts the appropriate police station. The notification includes the child's last known location and the parent's contact information.

[1925] This allows the system to monitor children's safety with high accuracy, quickly detect abnormal behavior, and prompt parents to take appropriate action based on their emotions.

[1926] Example 2

[1927] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1928] In modern society, to ensure children's safety, it is important to monitor their movements and detect abnormal behavior early. However, conventional systems issue uniform alerts without considering the feelings of parents, which can cause excessive anxiety. Furthermore, because appropriate countermeasures are not clearly stated, prompt action may not be taken in an emergency. This poses a problem in that the effectiveness of the monitoring system cannot be fully achieved.

[1929] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1930] In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child leaves the usual range of activity, means for sending the generated alert to the parent's device, means for analyzing the parent's emotions when viewing the notification, means for adjusting the urgency of the alert based on the analyzed emotions, and means for contacting the police if the parent acknowledges the alert. This allows for flexible and prompt responses according to the parent's psychological state, and more reliably ensures the safety of the child.

[1931] "Child's usual range of movement" refers to the area where a child typically moves, as set by a parent or guardian and defined using GPS coordinates.

[1932] "Current Location Information" means a child's current geographic location periodically obtained from a wearable device or other GPS-enabled device worn by the child.

[1933] "Verifying" means comparing the current location information with a preset movement range to see if it matches or if it is outside the range.

[1934] An "alert" is a warning message that is generated and sent to a parent's device when a child goes outside their normal range of behavior.

[1935] A "parent's device" refers to an electronic device, such as a smartphone or tablet, used by a parent to monitor their child's range of activities or abnormal behavior.

[1936] "Analyzing emotions" means analyzing the reactions and emotions (e.g., anxiety, surprise, relief, etc.) shown by the parent in response to the alert, and quantifying or categorizing those emotions.

[1937] "Emotion Engine" refers to the software components and algorithms used to analyze emotions expressed by parents.

[1938] "Adjusting the urgency" means changing the importance and priority of an alert based on the results of sentiment analysis and suggesting appropriate countermeasures.

[1939] "Means to contact law enforcement" refers to the communications methods and protocols that automatically notify law enforcement if a parent acknowledges the alert.

[1940] This invention combines a system that monitors a child's range of movement and detects abnormal behavior with an emotion engine that recognizes the parent's emotions and suggests optimal countermeasures. This system uses a wearable device and a smartphone as hardware, and a server, GPS, and emotion engine as software.

[1941] Hardware and Software Configuration

[1942] Wearable devices

[1943] Wearable devices are worn by children and periodically acquire their current location information using GPS, allowing you to track your child's location in real time. Examples include smartwatches.

[1944] Smartphone

[1945] A dedicated app is installed on the parent's smartphone to receive location information sent from the wearable device, and provides multiple functions, such as receiving alerts, allowing parents to input their emotions, and displaying the results of the emotion engine.

[1946] Servers and Databases

[1947] The server receives location information sent from the smartphone app and compares it with data on the child's normal range of movement. The database stores information such as the child's normal range of movement, location information, and emotional data of the guardian.

[1948] Emotion Engine

[1949] The emotion engine analyzes the emotions expressed by parents when they receive an alert. Using an emotion input interface, the emotion expressed by the parent is acquired as data, and this data is then passed through an analysis algorithm to adjust the level of urgency. The analyzed data is sent to a server, which then presents appropriate countermeasures.

[1950] Specific examples

[1951] For example, if a child leaves the park, which is his usual area of ​​activity, after school and moves to a neighboring town, the system operates as follows.

[1952] 1. Obtaining location information: The wearable device worn by the child uses GPS to obtain location information when the child moves to the next town.

[1953] 2. Location information transmission: This location information is sent in real time to the parent's smartphone app, from where it is uploaded to a server.

[1954] 3. Detecting abnormal behavior: The server compares the received location information with normal activity range data and determines that it is abnormal.

[1955] 4. Alert generation and notification: The server instantly generates an alert and sends a push notification to the parent's smartphone.

[1956] 5. Emotion recognition: When parents view notifications and express concern within the app, the emotion engine analyzes this and adjusts the urgency level.

[1957] 6. Proposal of countermeasures: Following the suggestion of the emotion engine, the parent / guardian will certify the child as lost, and the server will automatically notify the police.

[1958] Prompt Sentence Examples

[1959] Examples of prompts for this system include:

[1960] "Please explain the process of the system that generates abnormal behavior alerts when a child goes outside of their normal range of behavior, analyzes the parent's emotions, and suggests appropriate countermeasures."

[1961] By utilizing this invention, flexible and prompt responses based on the psychological state of the guardian are possible, and the safety of the child can be more reliably ensured.

[1962] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1963] Step 1:

[1964] Setting the scope of action

[1965] User (Parent)

[1966] Parents use a smartphone app to set their child's usual range of movement by selecting a specific area (e.g., around their home, park, school, etc.) on a map based on GPS coordinates and registering that area as their child's range of movement.

[1967] Input: Parental area selection information (GPS coordinates)

[1968] Output: Set movement range data

[1969] server

[1970] The server receives the activity range data sent by the parent and stores it in a database, which is used to understand the child's usual behavioral patterns.

[1971] Input: Movement range data sent by parent

[1972] Output: Home range data stored in a database

[1973] Step 2:

[1974] Get current location

[1975] Terminal (wearable device)

[1976] The wearable device worn by the child uses GPS to obtain current location information at regular intervals (e.g., every minute), and this location information is saved in real time.

[1977] Input: GPS data

[1978] Output: Current location

[1979] Step 3:

[1980] Sending location information

[1981] Terminal (wearable device)

[1982] The acquired location information is sent to the parent's smartphone app at regular intervals via Bluetooth, Wi-Fi, or mobile data.

[1983] Input: Current location

[1984] Output: Location information sent to the smartphone

[1985] Device (smartphone)

[1986] The parent's smartphone then sends the location information it receives to a server. The transmission is done in real time, and the latest location information is always uploaded to the server.

[1987] Input: Location information sent from a wearable device

[1988] Output: Location information sent to the server

[1989] Step 4:

[1990] Abnormal behavior detection

[1991] server

[1992] The server compares the received location information with the normal movement range data. If the location information is outside the set movement range or if the user enters a dangerous area, it flags the behavior as abnormal at that point. Furthermore, when a flag is raised, a detailed log is recorded in the database.

[1993] Input: Location information, movement range data

[1994] Output: Abnormal behavior flag, detailed log

[1995] Step 5:

[1996] Alert generation and notification

[1997] server

[1998] When abnormal behavior is detected, the server immediately generates an alert message, which includes the child's current location, details of the abnormal behavior, and information needed by the emotion engine.

[1999] Input: Abnormal behavior flag, child's current location

[2000] Output: Alert message

[2001] Device (smartphone)

[2002] Parents' smartphones receive push notifications and an alert appears on their screen, showing the child's specific location and a map of the surrounding area.

[2003] Input: Alert message

[2004] Output: Parental Notice

[2005] Step 6:

[2006] Emotion recognition

[2007] User (Parent)

[2008] Parents can view the notification and enter their emotion within the app by choosing from the options provided (e.g., anxious, surprised, relieved, etc.) or by typing their emotion as a text input.

[2009] Input: Parent's emotional input data

[2010] Output: Parent's emotional data in the app

[2011] Emotion Engine

[2012] The emotion engine analyzes the emotional data entered by the parent or guardian. This analysis is carried out using NLP (natural language processing) technology, and the results are converted into numerical values ​​and sent to the server.

[2013] Input: Parent's emotional input data

[2014] Output: Quantified emotion data

[2015] Step 7:

[2016] Alert tuning and response suggestions

[2017] server

[2018] The server receives emotion analysis data from the emotion engine and adjusts the urgency of the alert. If the urgency is high, it displays a detailed map, options to call directly, and suggests automatic contact with the police, depending on the situation.

[2019] Input: Sentiment analysis data

[2020] Output: Adjusted alert, suggested action

[2021] Step 8:

[2022] Identifying a missing child and contacting the police

[2023] User (Parent)

[2024] Based on the emotion engine's suggestions, parents can press the "Confirm Lost" button in the app, which automatically sends a notification to the police.

[2025] Input: Suggestions from the emotion engine, parental authorization actions

[2026] Output: Lost child recognition data

[2027] server

[2028] The server receives the lost child identification request and automatically searches the database of the local police station and sends a notification, which includes the child's last known location and the parent's contact information.

[2029] Input: Lost child certification data

[2030] Output: Police notification

[2031] (Application example 2)

[2032] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2033] Conventional child location monitoring systems only generate alerts when a child deviates from their normal range of movement, but do not take into account the emotional state of the parent or suggest countermeasures, which means that it takes a long time to respond in an emergency. Another issue is that it is difficult for parents to determine the appropriate response when they are emotionally upset.

[2034] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for storing the child's usual range of activity, means for acquiring the child's current location information, means for comparing the usual range of activity with the acquired current location information, means for generating an alert when the child goes outside the usual range of activity, means for sending the generated alert to the parent's terminal, means for contacting a public institution when the parent approves the alert, an emotion analysis engine for recognizing the parent's emotions, and means for adjusting the urgency of the alert based on the emotion analysis engine and proposing appropriate countermeasures. This enables flexible and prompt responses according to the parent's emotional state.

[2035] A "child's usual range of activity" refers to the geographical area in which a child moves or engages on a daily basis, and is defined by GPS coordinates set by the parent or guardian, for example.

[2036] "Current location information" is real-time geographic coordinate information that indicates where the child is currently located.

[2037] "Matching" is the process of comparing the acquired current location information with the child's stored usual range of movement.

[2038] An "alert" is a warning message that is generated when a child goes outside of their normal range of activity and is sent to the parent's device.

[2039] "Parent's device" means an electronic device such as a smartphone or tablet used by a parent.

[2040] "Public authorities" refers to the police and other public authorities, who will be contacted in an emergency if necessary.

[2041] The "emotion analysis engine" is an artificial intelligence system that analyzes parents' emotions and has the ability to analyze their reactions and emotions and digitize them.

[2042] "Adjusting the urgency" means changing the importance of the alert based on the parent's emotional information analyzed by the emotion analysis engine.

[2043] "Proposing appropriate countermeasures" means presenting appropriate actions and options to parents based on the analyzed emotional information.

[2044] The present invention aims to realize a system that monitors the range of a child's activities, detects abnormal behavior, and proposes countermeasures. Specific embodiments of the system will be described below.

[2045] System Configuration

[2046] The system mainly consists of the following hardware and software:

[2047] A wearable device (with GPS function) worn by children

[2048] Parents' smartphones and tablets

[2049] server

[2050] Sentiment analysis engine (artificial intelligence model)

[2051] Communication modules (e.g. Wi-Fi, 4G / 5G)

[2052] Memorizing the child's range of activities

[2053] The server receives data on the child's usual range of movement (e.g., GPS coordinates) sent by the parent and stores it in a database. Based on this data, the child's usual behavioral patterns can be geographically determined.

[2054] Location acquisition and monitoring

[2055] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via the parent's smartphone app.

[2056] Abnormal behavior detection

[2057] The server compares the received location information with stored data on normal activity ranges. If the child moves outside of normal activity ranges or into dangerous areas, it flags the behavior as abnormal. If abnormal activity is detected, the server immediately generates an alert message and sends it to the parent's device.

[2058] Emotion recognition and suggestions

[2059] The emotion analysis engine analyzes the emotional input and reactions of parents provided through the parent's smartphone app. The analysis results are sent to the server, which then adjusts the urgency of the alerts accordingly.

[2060] Furthermore, the server suggests appropriate countermeasures based on the parent's emotions. For example, if emotion analysis indicates high anxiety, the system will immediately display detailed map information and automatically contact public authorities (e.g., police) if necessary.

[2061] Specific examples

[2062] For example, if a child gets lost in a shopping mall and a security robot detects the child's unusual movements, the robot will immediately send an alert to the parent's smartphone, and if the emotion analysis engine detects the parent's anxiety, it will notify the nearest security staff and simultaneously display a detailed map to the parent.

[2063] Example prompts for generative AI models

[2064] Below is an example of a prompt sentence to input to the sentiment analysis model:

[2065] Prompt: "What emotional reaction did you have to the parent alert notification? Please choose from the following options: [anxiety, surprise, relief]"

[2066] Based on this prompt, the emotion analysis engine analyzes the parent's emotions and suggests countermeasures.

[2067] This allows the system to respond flexibly and quickly to the emotional state of parents, making it possible to more reliably ensure the safety of children.

[2068] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2069] Step 1:

[2070] The server receives data from parents about the child's usual range of movement (e.g., GPS coordinates) and stores it in a database, which is used to compare with subsequent location information.

[2071] Input: Normal movement range data (GPS coordinates) sent by the parent

[2072] Data processing: recording to database

[2073] Output: Saved normal movement range data

[2074] Specific operation: Parents use a smartphone app to set their child's movement range, and that information is sent to the server.

[2075] Step 2:

[2076] The wearable device periodically obtains the child's current location information using GPS, which is then sent to a server in real time via a parent's smartphone app.

[2077] Input: Location information obtained from GPS

[2078] Data processing: Periodic acquisition and real-time transmission

[2079] Output: Current location sent to the server

[2080] Specific operation: The wearable device obtains current location information at regular intervals and uploads that information to a server via a smartphone app.

[2081] Step 3:

[2082] The server compares the current location information received with normal movement range data, and if the user moves outside of the normal movement range, it flags the behavior as abnormal and generates an alert.

[2083] Input: Current location information, usual movement range data

[2084] Data calculations: location matching, flagging abnormal behavior

[2085] Output: Generated alerts

[2086] What it does: The server compares the current location with the range of movement stored in the database and creates an alert if an anomaly is detected.

[2087] Step 4:

[2088] The server sends the generated alert to the parent's terminal.

[2089] Input: Generated alert

[2090] Data processing: Push notification generation

[2091] Output: Alert sent to parent's device

[2092] Specific operation: The server generates an alert message and sends it to the parent's smartphone using the push notification function.

[2093] Step 5:

[2094] The parent's device receives the alert and provides an interface for inputting the user's reactions and emotions.

[2095] Input: Received alert

[2096] Data processing: User input interface generation

[2097] Output: Input emotion information

[2098] Specific actions: Parents check the alert on their smartphone app and enter their emotional state using the interface displayed there.

[2099] Step 6:

[2100] The emotion analysis engine analyzes the input emotion information and generates emotion data of the parent / guardian, which is then sent to the server.

[2101] Input: Emotion information

[2102] Data Computing: Sentiment Analysis

[2103] Output: Parsed emotion data

[2104] How it works: The emotion analysis engine takes parental input and uses a generative AI model to analyze their emotional state.

[2105] Step 7:

[2106] The server receives the sentiment analysis data, adjusts the urgency of the alert, and suggests appropriate countermeasures.

[2107] Input: Sentiment analysis data, alerts

[2108] Data calculation: Adjusting the level of urgency and generating countermeasures

[2109] Output: Adjusted alerts, suggested actions

[2110] Specific operation: The server adjusts the urgency of the alert based on emotion analysis data and suggests appropriate responses to parents.

[2111] Step 8:

[2112] The user follows the suggested measures and takes the necessary action (e.g., contacting the police, checking a detailed map).

[2113] Input: Proposed action

[2114] Data manipulation: Implementing countermeasures

[2115] Output: Actions taken

[2116] Specific operation: Parents take action by pressing a button or other means in response to the app's suggestions, and the results are reflected in the system.

[2117] The above steps enable monitoring of children's location information and flexible responses based on parents' feelings.

[2118] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2119] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2120] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2121] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2122] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2123] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2124] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2125] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2126] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2127] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2128] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2129] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2130] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2131] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2132] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2133] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2134] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2135] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2136] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2137] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2138] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2139] The following is further disclosed regarding the above embodiment.

[2140] (Claim 1)

[2141] a means for remembering the child's normal range of activity;

[2142] a means for obtaining the child's current location;

[2143] A means for comparing the usual range of movement with the acquired current location information;

[2144] A means of generating an alert if the user moves outside of their normal range of behavior;

[2145] A means for sending the generated alert to a parent's device;

[2146] a means of contacting law enforcement if the alert is approved by a parent or guardian;

[2147] A system including:

[2148] (Claim 2)

[2149] 2. The system of claim 1, wherein the means for obtaining the child's current location information includes a wearable device that periodically obtains location information.

[2150] (Claim 3)

[2151] 2. The system of claim 1, wherein the usual range of movement is GPS coordinates set by a parent or guardian.

[2152] "Example 1"

[2153] (Claim 1)

[2154] a means for storing a normal range of movement of a child set by a parent;

[2155] a means for periodically obtaining the child's current location;

[2156] A means for comparing the usual range of movement with the acquired current location information;

[2157] A means for generating an alert when an abnormal behavior occurs outside of the normal range of behavior;

[2158] means for sending the generated alert as a push notification to the parent's mobile information device;

[2159] A means for automatically sending contact information to law enforcement authorities if the alert is deemed lost by a parent or guardian;

[2160] A system including:

[2161] (Claim 2)

[2162] 10. The system of claim 1, wherein the means for obtaining the child's current location information includes a mobile device that periodically obtains location information.

[2163] (Claim 3)

[2164] 2. The system of claim 1, wherein the normal range of movement is coordinates determined by a localization means set by a parent or guardian.

[2165] "Application Example 1"

[2166] (Claim 1)

[2167] a means for remembering the child's normal range of activity;

[2168] a means for obtaining the child's current location;

[2169] A means for comparing the usual range of movement with the acquired current location information;

[2170] A means of generating an alert if the user moves outside of their normal range of behavior;

[2171] A means for sending the generated alert to a parent's device;

[2172] a means of contacting law enforcement if the alert is approved by a parent or guardian;

[2173] A means for setting a range of movement based on GPS coordinates set by the parent;

[2174] a means for periodically transmitting location information acquired from the wearable device to a server;

[2175] The server compares the location information with the user's usual range of movement, generates an alert, and sends it via push notification.

[2176] A means for providing a button for a parent to confirm that the child is lost based on the alert message;

[2177] A server receives information on lost children from parents and automatically sends a notification to the police.

[2178] A system including:

[2179] (Claim 2)

[2180] The means for acquiring the child's current location information includes a wearable device that periodically acquires location information.

[2181] 10. The system of claim 1.

[2182] (Claim 3)

[2183] The usual range of movement is GPS coordinates set by the parent or guardian.

[2184] 10. The system of claim 1.

[2185] "Example 2: Combining Emotion Engines"

[2186] (Claim 1)

[2187] a means for remembering the child's normal range of activity;

[2188] a means for obtaining the child's current location;

[2189] A means for comparing the usual range of movement with the acquired current location information;

[2190] A means of generating an alert if the user moves outside of their normal range of behavior;

[2191] A means for sending the generated alert to a parent's device;

[2192] A means for analyzing emotions expressed by parents when viewing the notification;

[2193] a means for adjusting the urgency of the alert based on the analyzed sentiment;

[2194] a means of contacting law enforcement if the alert is approved by a parent;

[2195] A system including:

[2196] (Claim 2)

[2197] 2. The system of claim 1, wherein the means for obtaining the child's current location information includes a wearable device that periodically obtains location information.

[2198] (Claim 3)

[2199] 2. The system of claim 1, wherein the usual range of movement is GPS coordinates set by a parent or guardian.

[2200] "Application example 2 when combining emotion engines"

[2201] (Claim 1)

[2202] a means for remembering the child's normal range of activity;

[2203] a means for obtaining the child's current location;

[2204] A means for comparing the usual range of movement with the acquired current location information;

[2205] A means of generating an alert if the user moves outside of their normal range of behavior;

[2206] A means for sending the generated alert to a parent's device;

[2207] a means of contacting public authorities if the alert is approved by a parent; and

[2208] An emotion analysis engine that recognizes the emotions of parents;

[2209] A means to adjust the urgency of alerts and suggest appropriate countermeasures based on a sentiment analysis engine;

[2210] A system including:

[2211] (Claim 2)

[2212] 2. The system of claim 1, wherein the means for obtaining the child's current location information includes a wearable device that periodically obtains location information.

[2213] (Claim 3)

[2214] 2. The system according to claim 1, wherein the normal range of movement is location information set by a guardian. [Explanation of symbols]

[2215] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for remembering the child's normal range of activity; a means for obtaining the child's current location; A means for comparing the usual range of movement with the acquired current location information; A means of generating an alert if the user moves outside of their normal range of behavior; A means for sending the generated alert to a parent's device; a means of contacting law enforcement if the alert is approved by a parent or guardian; A system including:

2. The system of claim 1 , wherein the means for acquiring the child's current location information includes a wearable device that periodically acquires location information.

3. 2. The system of claim 1, wherein the usual range of movement is GPS coordinates set by a parent.

Images