system

Abstract

We provide the system. [Solution] A device that acquires the user's location information, A server that calculates the distance based on the location information received from the aforementioned terminal and detects deviation from a predetermined safety range, Means having a generation model that generates and sends an interactive message to the user when the aforementioned deviation is detected, A means of calculating the route from the current location to the destination and instructing the user on the route, A system to prevent children from getting lost, including a lost child prevention system.

Description

Technical Field

[0004] , , ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0006] "Location information" refers to a collection of latitude and longitude data that indicates the user's current geographical location.

[0007] A "terminal" is a device that acquires location information and transmits it to a server using a communication method.

[0008] A "server" is a central computing device that processes location information received from terminals and manages and generates information.

[0009] "Safe zone" refers to the geographical area, predetermined by the parent or administrator, within which the user's actions are permitted.

[0010] "Deviation" is a term that refers to a situation where the user has deviated from the predetermined safety range.

[0011] A "generative model" is an artificial intelligence algorithm used to create interactive messages and provide appropriate instructions to the user.

[0012] An "interactive message" is a message format that provides information or instructions to the user via voice or text.

[0013] A "route" is the recommended path for a user to travel from their current location to their destination.

[0014] "Destination" refers to the final point to which the user should be guided, and includes safe places such as parents' homes or police stations.

Brief Description of the Drawings

[0015] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] Shows an emotion map to which multiple emotions are mapped. [Figure 10] Shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Modes for Carrying Out the Invention

[0016] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0019] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0020] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0023] [First Embodiment]

[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0036] This invention is a child-prevention system designed to prevent children from getting lost. This system is primarily constructed through the collaboration of a terminal and a server. The program processing of this invention will be explained below in natural language, and specific examples of how to implement the invention will be provided.

[0037] Overall system configuration

[0038] The device is designed for children and is primarily responsible for obtaining location information and providing guidance to the user. This device periodically uses GPS to obtain the child's current location. The location information is sent to the server in real time.

[0039] The server is the central device that processes information received from the terminal. Based on the received location information, it calculates how far the child is from the parent and determines whether it has deviated from a pre-set safety range.

[0040] Processing of each component

[0041] The server compares the child's location information with the parent's current location or a set range to detect deviations in real time. If a deviation is detected, it uses a generative model to generate an interactive message.

[0042] The device receives interactive messages sent from the server and transmits them to the child as voice output. These messages contain instructions to help the child return safely, encouraging them to act without getting lost.

[0043] The server calculates the optimal route from the current location to a parent or safe place as needed. This route information is sent to the device and then delivered back to the child as voice.

[0044] Specific example

[0045] For example, suppose a child is playing in a park after school. The device detects that the child has left the park and moved more than 500 meters outside the range set by the parent, indicating a departure from the safe zone. At this point, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends an instruction to the device.

[0046] If the user (child) chooses to follow the instructions on the device, the server calculates the optimal route and provides specific instructions such as, "Keep going straight and turn right at the next corner." This ensures the user is reassured while reliably guiding them to a safe location such as their parents or a police station. In this way, the present invention effectively protects the safety of children.

[0047] Thus, the child loss prevention system provides concrete means to prevent the risk of children getting lost by monitoring their current location, providing optimal guidance, and generating interactive messages using generative models.

[0048] The following describes the processing flow.

[0049] Step 1:

[0050] The device periodically (e.g., every minute) acquires the child's location information via GPS. It sends location data, including the current latitude, longitude, and time stamp, to the server.

[0051] Step 2:

[0052] The server analyzes the location information received from the device and compares it with the location information from the parent's smartphone. It then determines whether the child's location has deviated from the set safety zone.

[0053] Step 3:

[0054] If the child goes outside the safe zone, the server activates a generative model and generates an interactive message to send to the child. This message might say something like, "○○, you've gone a little too far. You need to come back."

[0055] Step 4:

[0056] The device receives interactive messages from the server and transmits them to the child via voice output. The user (child) who receives the message can respond to it.

[0057] Step 5:

[0058] If the user indicates their willingness to follow the instructions on the device, the server calculates the optimal route from the child's location to a safe place such as a parent or a police station.

[0059] Step 6:

[0060] The server sends the calculated route guidance to the terminal. Based on this information, the terminal provides voice guidance such as, "Go straight for 200 meters, then turn left." The guidance is updated according to the route conditions to ensure the user is guided appropriately.

[0061] Step 7:

[0062] When the user reaches their destination, the device reports its location to the server. The server verifies the child's safety and sends a notification to the parent's smartphone.

[0063] (Example 1)

[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0065] The risk of children getting lost is always present, especially in public places and areas where many people gather. Conventional technologies have limited means of locating children, making it difficult to quickly and effectively protect them. Furthermore, simple location notifications alone are insufficient for prompt action after a child gets lost, and are not adequately guided to a safe place. Therefore, there is a need to develop more effective systems to ensure children's safety and provide peace of mind to both parents and children.

[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0067] In this invention, the server includes means for calculating distance based on location information received from a location information acquisition device and determining deviation from a set safety area; means having a generative AI model for generating and transmitting interactive information; and means for calculating a route from the current location to a destination point and outputting the received information as voice. This makes it possible to immediately grasp the situation when a child deviates and provide appropriate countermeasures, thereby reducing the risk of getting lost and enabling rapid guidance to a safe place.

[0068] A "location information acquisition device" is hardware that has the function of measuring the user's current location and transmitting that location information to a server in real time.

[0069] An "information processing device" is a computer system that is responsible for determining deviations from a safe area based on data received from a location information acquisition device.

[0070] A "generative AI model" is an artificial intelligence system that analyzes received data and generates interactive messages.

[0071] A "means of guiding a route" refers to a function that calculates the optimal travel route from the current location to the destination and enables the user to see that route via voice or visual means.

[0072] "Means of outputting audio" refers to a device or function that converts text information generated by a device into audio and provides the information to the user audibly.

[0073] "Mobility-related information" refers to time-dependent information related to traffic conditions and locations, and is data used for route optimization.

[0074] This invention is a lost child prevention system constructed using a location information acquisition device (hereinafter referred to as a terminal) carried by the child and an information processing device (hereinafter referred to as a server) that works in conjunction with it.

[0075] The device has the function of obtaining the child's current location using a GPS sensor. The acquired location information is transmitted to a server via wireless communication. This communication typically uses mobile communication technology or Wi-Fi.

[0076] Upon receiving location information, the server first determines whether the user has deviated from the safe zone. This determination uses geofencing technology and a location database, identifying a deviation if the user exceeds a certain distance from the safe zone. Once a deviation is detected, the server generates an interactive message via a generative AI model. This AI model utilizes natural language processing technology to enable flexible, context-aware dialogue. The generated message is then sent to the terminal.

[0077] The device outputs interactive messages received from the server using speech synthesis technology. This allows children to follow the voice guidance and take appropriate actions to return to a safe place.

[0078] As a concrete example, consider a scenario where a user (child) leaves the park after school and goes beyond the safety zone set by their parent. In this case, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends it to the device. The device then converts this message into voice and delivers it to the child. The server also calculates the optimal route from the child's current location back to the parent and provides the child with specific directions.

[0079] An example of a prompt message would be: "Please create an interactive message for when a child deviates from the safety zone set by their parent. Please set the parent's home as the destination."

[0080] In this way, this system provides a concrete means to prevent the risk of getting lost by combining location information acquisition, deviation detection, and the generation of interactive messages and voice guidance.

[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0082] Step 1:

[0083] The device periodically measures the user's (child's) current location using its built-in GPS sensor. Its input is a GPS signal, which is used to obtain latitude and longitude data. Its output is the generated location data, which is then transmitted to a server via wireless communication.

[0084] Step 2:

[0085] The server receives location data transmitted from the terminal as input. Based on the received data, it uses geofencing technology to determine deviation from the safe zone, using the user's current location and the coordinates of a pre-set safe zone. The output generates the deviation detection result and sets a flag to proceed to the next processing step.

[0086] Step 3:

[0087] If the deviation detection flag is set, the server uses a generative AI model to generate an interactive message. The input is contextual information about the deviation situation and the user's location, which is then used to input prompts into the generative AI model. The output is the generated text message, which is sent to the terminal.

[0088] Step 4:

[0089] The terminal receives an interactive message sent from the server as input. The input text data is converted into speech using speech synthesis technology and output to the user. The output is a voice message providing specific instructions to encourage safe behavior.

[0090] Step 5:

[0091] The server calculates the optimal route from the user's current location to a parent or safe location as needed. The inputs used are the user's current location and the destination coordinates. The server calculates the optimal route using map data and a route-finding algorithm, and outputs this route information, which is then sent to the terminal.

[0092] Step 6:

[0093] The terminal receives transmitted route information as input and converts specific navigation information into voice to provide to the user. The output is real-time voice guidance, providing instructions to help the user safely reach their destination.

[0094] (Application Example 1)

[0095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0096] Currently, children and visitors getting lost in designated spaces is a serious problem in many areas. In particular, in public places and commercial facilities, lost children pose significant safety risks and increase parental anxiety. Current lost child prevention systems are limited to warnings from individual devices and lack sufficient speed and accuracy. Therefore, a system capable of a wider range of rapid response is needed.

[0097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0098] In this invention, the server includes means having a device for acquiring the user's location information, means having an information processing device that calculates distance based on the location information received from the device and detects deviation from a predetermined safety area, and a generation model that generates and transmits interactive information to the user when the deviation is detected. This makes it possible to provide the user with a visible warning by linking the information to multiple display devices.

[0099] "Device" refers to an electronic device carried or used by a user to acquire location information.

[0100] An "information processing device" is a device that has the function of calculating distance based on received location information and detecting deviations from a set safety area.

[0101] A "generative model" is an algorithm or program that automatically generates and transmits interactive information, including guidance and warnings, to the user when a deviation is detected.

[0102] A "display device" is a device used to visually present generated warnings and guidance information, and its purpose is to provide information intuitively.

[0103] A "navigation system" is a system that assists in safe travel by suggesting the optimal route based on the user's current location and providing guidance to the destination.

[0104] "Mobility information" refers to information that includes variable elements depending on traffic conditions and time of day, and guidance is optimized based on this information.

[0105] The server accesses devices that acquire the location information of children and users. This is done by using the GPS module of a device carried by the user to periodically acquire location information and send it to the server. Based on the received location information, the server uses an information processing device to calculate and detect deviations from the set safety area.

[0106] When a deviation is detected, the server quickly generates an interactive message using a generative model. The generated message, including warnings and guidance, is sent to the user and visualized on a display device. A speech synthesis API is used in this process, and information is conveyed to the user through voice output, enabling the provision of immediate feedback.

[0107] Furthermore, the server generates optimal route guidance based on the user's current location and destination, taking travel information into account. This aims to propose the most efficient route by calculating data including real-time traffic information and in-store occupancy status. The goal is to help users reach their destinations with peace of mind.

[0108] For example, if a child leaves a safe zone while a parent is shopping in a commercial facility, the server generates an interactive message such as, "○○ has entered the designated area. Safety checks are required," and displays a warning on the parent's smartphone and on the facility's digital displays. This allows the parent to quickly understand the situation and take the necessary action.

[0109] An example of a prompt might be: "Generate an interactive warning message for when a child deviates from the designated area. The message should be reassuring to the user." Based on this prompt, the generation model operates and provides appropriate feedback to the user.

[0110] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0111] Step 1:

[0112] The device acquires location information. The device uses its built-in GPS module to periodically measure the user's current location. The acquired location information is temporarily stored in the device's memory in digital format.

[0113] Step 2:

[0114] The device sends location information to the server. The device sends the acquired location information to the server in real time. This transmission is done as data packets over the internet. When the server receives this location information, it proceeds to the next step.

[0115] Step 3:

[0116] The server determines the safe zone. The server compares the received location information with pre-configured safe zone information. To detect deviations from the safe zone, it calculates the Euclidean distance based on the coordinates. If a deviation is detected, the process proceeds to the next step.

[0117] Step 4:

[0118] The server generates an interactive message. The server uses a generation AI model to create an interactive message for the user. The prompt used is "Generate an appropriate warning message if the specified area is deviated from." The generated message is saved to the server in text format.

[0119] Step 5:

[0120] The server converts the message into speech. The generated text message is input into a speech synthesis API and converted into audio data. This audio data is provided to the user and used as a warning or announcement.

[0121] Step 6:

[0122] The server sends an alert to the display devices. The server then sends the generated message to multiple display devices within the commercial facility. This transmission takes place over the facility's network, and the display devices are configured to display the message visually.

[0123] Step 7:

[0124] The user receives and understands generated interactive messages. The user receives audio or visual information provided through the terminal or display device, understands the current situation, and takes steps to act safely. This feedback supports stable movement.

[0125] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0126] This invention is a child safety system designed to prevent children from getting lost, and it enables advanced interactive support in conjunction with an emotion engine that recognizes the user's emotions. This system operates by integrating a terminal, server, generative model, and emotion engine.

[0127] System Configuration

[0128] The device, carried by the child, is responsible for acquiring location information, collecting emotional data, and transmitting instructions. Location information is periodically acquired using GPS and transmitted to a server. The device is also equipped with sensors such as a camera and microphone, which are used to capture the child's facial expressions and voice tone in real time.

[0129] The server receives location and emotion data from the device and continuously monitors the user's state. Based on the location information, it detects deviations from the range and uses a generative model to create conversational messages to send to the child.

[0130] Program processing flow

[0131] If the user's location deviates from the set safety range, the server analyzes the child's emotional state via the emotion engine. Based on the analysis, a generative model adjusts the interactive message and sends it to the child in an appropriate tone.

[0132] The device receives messages from the server and communicates them to the child in a conversational format as voice output. For example, if the child seems anxious, it will speak in a gentle tone, saying, "It's okay, we'll go back to normal slowly."

[0133] The user (child) can listen to instructions from the device and take appropriate action. An emotional engine helps children feel secure and follow instructions.

[0134] Specific example

[0135] Consider a scenario where a child playing in a park after school strays from a safe zone. The device transmits its location information to a server and detects signs of anxiety from the child's facial expressions and voice. Based on the analysis of the emotional data, the server uses a generative model to construct a message that alleviates this anxiety. A message such as, "You'll be home soon. Look right and cross the street," is directly conveyed to the child via the device.

[0136] In this way, the child-prevention system of the present invention minimizes the risk of children getting lost while providing a sense of security, thereby enabling them to be safely guided to their destination. This embodiment is an example of a next-generation support system that utilizes emotion recognition technology to ensure the safety of children.

[0137] The following describes the processing flow.

[0138] Step 1:

[0139] The device uses GPS to obtain the child's location information and transmits it to a server. At the same time, it uses the camera and microphone built into the device to collect emotional data such as the child's facial expressions and tone of voice.

[0140] Step 2:

[0141] The server analyzes the received location information and determines whether it has exceeded the safe range set by the parent. If it determines that it has exceeded the safe range, it proceeds to the next step.

[0142] Step 3:

[0143] The server activates an emotion engine and analyzes facial and audio data received from the device. It identifies whether the child is feeling anxious or frightened and uses a generative model to create a message based on the analysis results.

[0144] Step 4:

[0145] The generative model generates interactive messages with the optimal tone and content based on the emotional state. For example, if a child is feeling anxious, it might create a gentle message such as, "Calm down, it's going to be okay. Let's go back in the direction of your friends."

[0146] Step 5:

[0147] The server sends the generated interactive message to the terminal.

[0148] Step 6:

[0149] The device transmits received messages to the child as voice output. The child follows these instructions and modifies their behavior. For example, they may feel reassured and begin walking the right path to return to their parents.

[0150] Step 7:

[0151] Once it is confirmed that the user (child) has followed the instructions and safely reached their destination (parent or a safe place), the device sends this information to the server. The server then sends a notification to the parent's smartphone to confirm the child's safety. This report completes the entire system process.

[0152] (Example 2)

[0153] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0154] Current child loss prevention systems struggle to respond appropriately when a child deviates from a safe zone. Furthermore, they issue uniform instructions without considering the user's feelings, making it difficult for children to follow them with confidence. There is a need to develop a system that improves this situation and balances child safety and security.

[0155] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0156] In this invention, the server includes means for detecting deviations from a safe range based on the user's location information, means for acquiring and analyzing the user's emotional information, and means for generating and sending interactive messages using a generative model. This makes it possible to provide reassuring instructions so that children are safely guided to their destinations.

[0157] "Device" refers to a device carried by a child to acquire location information.

[0158] An "information processing device" refers to a system that has the function of calculating distance based on location information received from the device and detecting deviations from a safe range.

[0159] "Emotional information" refers to data related to the emotional state obtained from the user's (child's) facial expressions, tone of voice, and other similar information.

[0160] A "generative model" refers to a system that utilizes artificial intelligence technology to generate interactive messages that should be sent to the user.

[0161] A "prompt" refers to the information or conditions that a generative model uses as input to generate an interactive message.

[0162] "Voice output" refers to a format in which generated interactive messages are presented to the user by playing them back as audio.

[0163] This invention is a child safety system for preventing children from getting lost, which operates by integrating a device, an information processing device, a generative model, and an emotion engine. Specific embodiments thereof are described here.

[0164] The device is a portable device carried by children. It is equipped with GPS functionality and can acquire location information. The device uses a built-in camera and microphone to capture emotional information such as the child's facial expressions and voice tone in real time and transmit it to an information processing device.

[0165] The information processing device detects deviations from the safe range based on location information transmitted from the device. When a deviation is detected, it uses an emotion engine to analyze the corresponding emotional information.

[0166] The generative model generates interactive messages suitable for children based on analysis results from the emotion engine. One example of such a prompt is, "Create a message to alleviate anxiety."

[0167] The generated message is transmitted from the information processing device to the device and presented to the child user as an audio output. The device engages in conversation with the child in a gentle tone designed to provide a sense of security.

[0168] For example, if a child playing in a park after school deviates from a safe zone, the device immediately transmits location information to an information processing device and acquires emotional information indicating anxiety. The information processing device generates an appropriate interactive message and conveys it to the child through the device. This allows the child to follow instructions with confidence and be safely guided to their destination. In this way, the present invention ensures the safety of children and provides next-generation reassurance support that takes emotions into consideration.

[0169] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0170] Step 1:

[0171] The device periodically acquires the child's location information using its GPS function. This location information is then sent to the server at regular intervals. The location information is obtained as latitude and longitude coordinate data.

[0172] Step 2:

[0173] The server uses the location information received from the terminal as input to calculate deviations from the safe range. The server compares this to a pre-configured safe range and determines whether a deviation has occurred. As output, it sets a flag indicating whether or not a deviation has occurred.

[0174] Step 3:

[0175] The server uses an emotion engine to analyze the child's facial expressions and voice data, which are emotional information received from the terminal, as input. It infers emotions from the facial expression data and analyzes voice tone and anxiety levels from the voice data. The output of this analysis is the child's emotional state.

[0176] Step 4:

[0177] Based on information about the emotional state and whether or not there is any deviation, the server uses a generative AI model to generate an interactive message. At this time, the prompt "Please create a message to alleviate anxiety" is input. The generative AI model outputs an appropriate message to reassure the child.

[0178] Step 5:

[0179] The server sends the generated interactive message to the device. The device then delivers this message to the child as audio output. Specifically, a gentle tone of voice is played through the device's speaker, providing the child with a sense of security.

[0180] Step 6:

[0181] The child user listens to voice messages from the device and follows the instructions provided. This completes the action, making it easier to safely return to the original location.

[0182] (Application Example 2)

[0183] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0184] In mobile vehicles such as autonomous vehicles, there is a problem in how to ensure and protect the safety and security of passengers, especially children. Currently, there is insufficient development of systems that can grasp the emotional state of passengers in real time and provide them with appropriate reassurance, making it a challenge to deal with situations where passengers feel anxious during their ride.

[0185] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0186] In this invention, the server includes means for receiving information from a device that acquires the user's location information and calculating distance, means for generating and transmitting interactive information using a generative model, and means for analyzing the user's emotional state and generating reassuring messages. This makes it possible to provide optimal instructions by combining the passenger's location information and emotional state, thereby ensuring safety and security.

[0187] "User location information" refers to global coordinates and area information obtained to determine the user's current location.

[0188] "Device" is a general term for equipment or devices used to perform a specified function.

[0189] A "processing device" is a computing device such as a computer or server that analyzes and makes decisions based on input data.

[0190] A "generative model" is an algorithm or software program designed to generate new information based on existing data.

[0191] "Interactive information" refers to dynamic responses generated to convey instructions or messages to the user.

[0192] A "safe zone" is a defined range or area where deviations should be detected when a user physically moves.

[0193] A "protection system" is a general term for technological means and mechanisms designed to protect specific objects from danger or insecurity.

[0194] "Emotional state" refers to an internal state that indicates the user's psychological or emotional response, and is usually inferred from facial expressions, voice, etc.

[0195] A "message" is content expressed in text, audio, or other formats to convey specific information or intentions to a user.

[0196] This invention is a protective system equipped with a child-prevention function to allow users to travel with peace of mind. It is particularly intended to ensure the safety of children in autonomous vehicles. It operates by integrating a server, a device, a generative model, and means for analyzing emotional states.

[0197] The server communicates with a GPS-equipped device to obtain the user's location information. Based on the received location information, the processing unit calculates the distance between the user and the safe area and detects any deviation. This information is processed in real time, and for users in an unstable emotional state, a generative AI model is used to generate appropriate interactive information. The generated information is conveyed to the user as voice output through the device.

[0198] This process incorporates an emotion recognition model using the Hugging Face Transformers library, which analyzes the user's facial expressions and voice tone to identify their emotional state. Furthermore, a generative AI model provides appropriate instructions and messages based on the analysis results.

[0199] For example, if a child is feeling anxious inside an autonomous taxi, the emotion recognition system detects this state and sends a prompt to the generative AI model saying, "The passenger's emotion has been identified as 'anxious.' Please generate a message to reassure the passenger." As a result, a message such as, "We're on our way to our destination. Is there anything you're worried about?" is generated and conveyed to the child as audio.

[0200] In this way, the invention can maintain safety and comfort during travel by providing passengers with a sense of security.

[0201] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0202] Step 1:

[0203] The device collects the user's location information using GPS and transmits this information to a server. The input is the coordinate data of the current location obtained from GPS, and the output is the location information sent to the server.

[0204] Step 2:

[0205] The server calculates the distance between the current location and a defined safe area based on location information received from the terminal. The input is location measurement information transmitted from the terminal, and the output is an indicator showing whether or not a deviation has occurred. In this process, the server also considers the pre-set criteria for the safe area, and if a deviation is detected, it processes that information further.

[0206] Step 3:

[0207] The server acquires audio and camera sensor data from the terminal and analyzes the user's emotional state using an emotion recognition model. The input is audio and facial expression data, and the output is data representing the user's emotional state. Here, emotion recognition is performed using Hugging Face's Transformers.

[0208] Step 4:

[0209] The server uses a generative AI model to generate interactive messages based on emotional state and location information. The generation process takes prompts based on previously analyzed emotional state data and generates appropriate interactive messages. The inputs are emotional state data and location information, and the output is the generated message.

[0210] Step 5:

[0211] The terminal converts the generated message sent from the server into speech and transmits it to the user through the speaker. The input is the generated message, and the output is the message as speech. Specifically, a message designed to alleviate anxiety is played in a gentle tone.

[0212] Step 6:

[0213] The user receives voice messages and makes decisions based on the instructions. The input is the voice messages from the terminal, and the output is the user's actions. The user's actions are monitored again by the server, and the entire system is continuously managed.

[0214] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0215] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0216] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0217] [Second Embodiment]

[0218] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0219] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0220] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0221] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0222] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0223] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0224] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0225] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0226] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0227] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0228] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0229] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0230] This invention is a child-prevention system designed to prevent children from getting lost. This system is primarily constructed through the collaboration of a terminal and a server. The program processing of this invention will be explained below in natural language, and specific examples of how to implement the invention will be provided.

[0231] Overall system configuration

[0232] The device is designed for children and is primarily responsible for obtaining location information and providing guidance to the user. This device periodically uses GPS to obtain the child's current location. The location information is sent to the server in real time.

[0233] The server is the central device that processes information received from the terminal. Based on the received location information, it calculates how far the child is from the parent and determines whether it has deviated from a pre-set safety range.

[0234] Processing of each component

[0235] The server compares the child's location information with the parent's current location or a set range to detect deviations in real time. If a deviation is detected, it uses a generative model to generate an interactive message.

[0236] The device receives interactive messages sent from the server and transmits them to the child as voice output. These messages contain instructions to help the child return safely, encouraging them to act without getting lost.

[0237] The server calculates the optimal route from the current location to a parent or safe place as needed. This route information is sent to the device and then delivered back to the child as voice.

[0238] Specific example

[0239] For example, suppose a child is playing in a park after school. The device detects that the child has left the park and moved more than 500 meters outside the range set by the parent, indicating a departure from the safe zone. At this point, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends an instruction to the device.

[0240] If the user (child) chooses to follow the instructions on the device, the server calculates the optimal route and provides specific instructions such as, "Keep going straight and turn right at the next corner." This ensures the user is reassured while reliably guiding them to a safe location such as their parents or a police station. In this way, the present invention effectively protects the safety of children.

[0241] Thus, the child loss prevention system provides concrete means to prevent the risk of children getting lost by monitoring their current location, providing optimal guidance, and generating interactive messages using generative models.

[0242] The following describes the processing flow.

[0243] Step 1:

[0244] The device periodically (e.g., every minute) acquires the child's location information via GPS. It sends location data, including the current latitude, longitude, and time stamp, to the server.

[0245] Step 2:

[0246] The server analyzes the location information received from the device and compares it with the location information from the parent's smartphone. It then determines whether the child's location has deviated from the set safety zone.

[0247] Step 3:

[0248] If the child goes outside the safe zone, the server activates a generative model and generates an interactive message to send to the child. This message might say something like, "○○, you've gone a little too far. You need to come back."

[0249] Step 4:

[0250] The device receives interactive messages from the server and transmits them to the child via voice output. The user (child) who receives the message can respond to it.

[0251] Step 5:

[0252] If the user indicates their willingness to follow the instructions on the device, the server calculates the optimal route from the child's location to a safe place such as a parent or a police station.

[0253] Step 6:

[0254] The server sends the calculated route guidance to the terminal. Based on this information, the terminal provides voice guidance such as, "Go straight for 200 meters, then turn left." The guidance is updated according to the route conditions to ensure the user is guided appropriately.

[0255] Step 7:

[0256] When the user reaches their destination, the device reports its location to the server. The server verifies the child's safety and sends a notification to the parent's smartphone.

[0257] (Example 1)

[0258] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0259] The risk of children getting lost is always present, especially in public places and areas where many people gather. Conventional technologies have limited means of locating children, making it difficult to quickly and effectively protect them. Furthermore, simple location notifications alone are insufficient for prompt action after a child gets lost, and are not adequately guided to a safe place. Therefore, there is a need to develop more effective systems to ensure children's safety and provide peace of mind to both parents and children.

[0260] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0261] In this invention, the server includes means for calculating distance based on location information received from a location information acquisition device and determining deviation from a set safety area; means having a generative AI model for generating and transmitting interactive information; and means for calculating a route from the current location to a destination point and outputting the received information as voice. This makes it possible to immediately grasp the situation when a child deviates and provide appropriate countermeasures, thereby reducing the risk of getting lost and enabling rapid guidance to a safe place.

[0262] A "location information acquisition device" is hardware that has the function of measuring the user's current location and transmitting that location information to a server in real time.

[0263] An "information processing device" is a computer system that is responsible for determining deviations from a safe area based on data received from a location information acquisition device.

[0264] A "generative AI model" is an artificial intelligence system that analyzes received data and generates interactive messages.

[0265] A "means of guiding a route" refers to a function that calculates the optimal travel route from the current location to the destination and enables the user to see that route via voice or visual means.

[0266] "Means of outputting audio" refers to a device or function that converts text information generated by a device into audio and provides the information to the user audibly.

[0267] "Mobility-related information" refers to time-dependent information related to traffic conditions and locations, and is data used for route optimization.

[0268] This invention is a lost child prevention system constructed using a location information acquisition device (hereinafter referred to as a terminal) carried by the child and an information processing device (hereinafter referred to as a server) that works in conjunction with it.

[0269] The device has the function of obtaining the child's current location using a GPS sensor. The acquired location information is transmitted to a server via wireless communication. This communication typically uses mobile communication technology or Wi-Fi.

[0270] Upon receiving location information, the server first determines whether the user has deviated from the safe zone. This determination uses geofencing technology and a location database, identifying a deviation if the user exceeds a certain distance from the safe zone. Once a deviation is detected, the server generates an interactive message via a generative AI model. This AI model utilizes natural language processing technology to enable flexible, context-aware dialogue. The generated message is then sent to the terminal.

[0271] The device outputs interactive messages received from the server using speech synthesis technology. This allows children to follow the voice guidance and take appropriate actions to return to a safe place.

[0272] As a concrete example, consider a scenario where a user (child) leaves the park after school and goes beyond the safety zone set by their parent. In this case, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends it to the device. The device then converts this message into voice and delivers it to the child. The server also calculates the optimal route from the child's current location back to the parent and provides the child with specific directions.

[0273] An example of a prompt message would be: "Please create an interactive message for when a child deviates from the safety zone set by their parent. Please set the parent's home as the destination."

[0274] In this way, this system provides a concrete means to prevent the risk of getting lost by combining location information acquisition, deviation detection, and the generation of interactive messages and voice guidance.

[0275] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0276] Step 1:

[0277] The terminal periodically measures the current location of the user (child) using the built-in GPS sensor. The input is the GPS signal, and latitude and longitude data are obtained using this. As output, it performs the operation of generating the acquired position information data and transmitting it to the server via wireless communication.

[0278] Step 2:

[0279] The server receives the position information data transmitted from the terminal as input. Based on the received data, using the current position of the user and the coordinates of the pre-set safe range, it determines the deviation from the safe range by means of geofencing technology. As output, it generates the determination result of the deviation and sets a flag to proceed to the next processing step.

[0280] Step 3:

[0281] When the deviation determination flag is set, the server uses the generated AI model to generate an interactive message. The input is the context information regarding the situation of the deviation and the user's position, and based on this, a prompt sentence is input into the generated AI model. As output, there is the generated text message, which is transmitted to the terminal.

[0282] Step 4:

[0283] The terminal receives the interactive message transmitted from the server as input. The input text data is converted into voice by voice synthesis technology and output as voice towards the user. As output, it is a voice message that provides specific instructions for prompting the user to take safe actions.

[0284] Step 5:

[0285] The server calculates the optimal route from the current position to the parent or a safe place as needed. The input uses the current location information of the user and the coordinates of the destination. The optimal route is calculated using map data and a route search algorithm, and as output, it generates the route information and transmits it to the terminal.

[0286] Step 6:

[0287] The terminal receives the transmitted route information as input, converts specific navigation information into voice, and provides it to the user. The output is real-time voice guidance, providing instructions to support the user to safely head towards the destination.

[0288] (Application Example 1)

[0289] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal". <00​​​​​​​​​​​​​​​​​​An "information processing device" is a device that has the function of calculating distance based on received location information and detecting deviations from a set safety area.

[0295] A "generative model" is an algorithm or program that automatically generates and transmits interactive information, including guidance and warnings, to the user when a deviation is detected.

[0296] A "display device" is a device used to visually present generated warnings and guidance information, and its purpose is to provide information intuitively.

[0297] A "navigation system" is a system that assists in safe travel by suggesting the optimal route based on the user's current location and providing guidance to the destination.

[0298] "Mobility information" refers to information that includes variable elements depending on traffic conditions and time of day, and guidance is optimized based on this information.

[0299] The server accesses devices that acquire the location information of children and users. This is done by using the GPS module of a device carried by the user to periodically acquire location information and send it to the server. Based on the received location information, the server uses an information processing device to calculate and detect deviations from the set safety area.

[0300] When a deviation is detected, the server quickly generates an interactive message using a generative model. The generated message, including warnings and guidance, is sent to the user and visualized on a display device. A speech synthesis API is used in this process, and information is conveyed to the user through voice output, enabling the provision of immediate feedback.

[0301] Furthermore, based on the user's current location and destination, the server generates an optimal route guidance considering movement information. This aims to calculate data including real-time traffic information and the usage status within the store, and propose the most efficient route, providing support to ensure that the user can reach the destination safely.

[0302] For example, when a parent is shopping in a commercial facility and a child deviates from the safe area, the server generates an interactive message such as "Child ○○ has exceeded the set area. Safety confirmation is required." and displays a warning on the parent's smartphone and the digital display within the facility. This enables the parent to quickly grasp the situation and take necessary actions.

[0303] As an example of the prompt text, a format like "Please generate an interactive warning message when a child deviates from the designated area. Make the content reassuring to the user." can be considered. Based on this prompt, the generation model operates to provide appropriate feedback to the user.

[0304] The flow of the specific process in Application Example 1 will be described using FIG. 12.

[0305] Step 1:

[0306] The terminal acquires location information. The terminal uses the built-in GPS module to periodically measure the user's current location. The acquired location information is temporarily stored in the terminal's memory in digital form.

[0307] Step 2:

[0308] The terminal transmits the location information to the server. The terminal transmits the acquired location information to the server in real-time. This transmission is carried out as data packets via the Internet. When the server receives this location information, it proceeds to the next process.

[0309] Step 3:

[0310] The server determines the safe zone. The server compares the received location information with pre-configured safe zone information. To detect deviations from the safe zone, it calculates the Euclidean distance based on the coordinates. If a deviation is detected, the process proceeds to the next step.

[0311] Step 4:

[0312] The server generates an interactive message. The server uses a generation AI model to create an interactive message for the user. The prompt used is "Generate an appropriate warning message if the specified area is deviated from." The generated message is saved to the server in text format.

[0313] Step 5:

[0314] The server converts the message into speech. The generated text message is input into a speech synthesis API and converted into audio data. This audio data is provided to the user and used as a warning or announcement.

[0315] Step 6:

[0316] The server sends an alert to the display devices. The server then sends the generated message to multiple display devices within the commercial facility. This transmission takes place over the facility's network, and the display devices are configured to display the message visually.

[0317] Step 7:

[0318] The user receives and understands generated interactive messages. The user receives audio or visual information provided through the terminal or display device, understands the current situation, and takes steps to act safely. This feedback supports stable movement.

[0319] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0320] This invention is a child safety system designed to prevent children from getting lost, and it enables advanced interactive support in conjunction with an emotion engine that recognizes the user's emotions. This system operates by integrating a terminal, server, generative model, and emotion engine.

[0321] System Configuration

[0322] The device, carried by the child, is responsible for acquiring location information, collecting emotional data, and transmitting instructions. Location information is periodically acquired using GPS and transmitted to a server. The device is also equipped with sensors such as a camera and microphone, which are used to capture the child's facial expressions and voice tone in real time.

[0323] The server receives location and emotion data from the device and continuously monitors the user's state. Based on the location information, it detects deviations from the range and uses a generative model to create conversational messages to send to the child.

[0324] Program processing flow

[0325] If the user's location deviates from the set safety range, the server analyzes the child's emotional state via the emotion engine. Based on the analysis, a generative model adjusts the interactive message and sends it to the child in an appropriate tone.

[0326] The device receives messages from the server and communicates them to the child in a conversational format as voice output. For example, if the child seems anxious, it will speak in a gentle tone, saying, "It's okay, we'll go back to normal slowly."

[0327] The user (child) can listen to instructions from the device and take appropriate action. An emotional engine helps children feel secure and follow instructions.

[0328] Specific example

[0329] Consider a scenario where a child playing in a park after school strays from a safe zone. The device transmits its location information to a server and detects signs of anxiety from the child's facial expressions and voice. Based on the analysis of the emotional data, the server uses a generative model to construct a message that alleviates this anxiety. A message such as, "You'll be home soon. Look right and cross the street," is directly conveyed to the child via the device.

[0330] In this way, the child-prevention system of the present invention minimizes the risk of children getting lost while providing a sense of security, thereby enabling them to be safely guided to their destination. This embodiment is an example of a next-generation support system that utilizes emotion recognition technology to ensure the safety of children.

[0331] The following describes the processing flow.

[0332] Step 1:

[0333] The device uses GPS to obtain the child's location information and transmits it to a server. At the same time, it uses the camera and microphone built into the device to collect emotional data such as the child's facial expressions and tone of voice.

[0334] Step 2:

[0335] The server analyzes the received location information and determines whether it has exceeded the safe range set by the parent. If it determines that it has exceeded the safe range, it proceeds to the next step.

[0336] Step 3:

[0337] The server activates an emotion engine and analyzes facial and audio data received from the device. It identifies whether the child is feeling anxious or frightened and uses a generative model to create a message based on the analysis results.

[0338] Step 4:

[0339] The generative model generates interactive messages with the optimal tone and content based on the emotional state. For example, if a child is feeling anxious, it might create a gentle message such as, "Calm down, it's going to be okay. Let's go back in the direction of your friends."

[0340] Step 5:

[0341] The server sends the generated interactive message to the terminal.

[0342] Step 6:

[0343] The device transmits received messages to the child as voice output. The child follows these instructions and modifies their behavior. For example, they may feel reassured and begin walking the right path to return to their parents.

[0344] Step 7:

[0345] Once it is confirmed that the user (child) has followed the instructions and safely reached their destination (parent or a safe place), the device sends this information to the server. The server then sends a notification to the parent's smartphone to confirm the child's safety. This report completes the entire system process.

[0346] (Example 2)

[0347] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0348] Current child loss prevention systems struggle to respond appropriately when a child deviates from a safe zone. Furthermore, they issue uniform instructions without considering the user's feelings, making it difficult for children to follow them with confidence. There is a need to develop a system that improves this situation and balances child safety and security.

[0349] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0350] In this invention, the server includes means for detecting deviations from a safe range based on the user's location information, means for acquiring and analyzing the user's emotional information, and means for generating and sending interactive messages using a generative model. This makes it possible to provide reassuring instructions so that children are safely guided to their destinations.

[0351] "Device" refers to a device carried by a child to acquire location information.

[0352] An "information processing device" refers to a system that has the function of calculating distance based on location information received from the device and detecting deviations from a safe range.

[0353] "Emotional information" refers to data related to the emotional state obtained from the user's (child's) facial expressions, tone of voice, and other similar information.

[0354] A "generative model" refers to a system that utilizes artificial intelligence technology to generate interactive messages that should be sent to the user.

[0355] A "prompt" refers to the information or conditions that a generative model uses as input to generate an interactive message.

[0356] "Voice output" refers to a format in which generated interactive messages are presented to the user by playing them back as audio.

[0357] This invention is a child safety system for preventing children from getting lost, which operates by integrating a device, an information processing device, a generative model, and an emotion engine. Specific embodiments thereof are described here.

[0358] The device is a portable device carried by children. It is equipped with GPS functionality and can acquire location information. The device uses a built-in camera and microphone to capture emotional information such as the child's facial expressions and voice tone in real time and transmit it to an information processing device.

[0359] The information processing device detects deviations from the safe range based on location information transmitted from the device. When a deviation is detected, it uses an emotion engine to analyze the corresponding emotional information.

[0360] The generative model generates interactive messages suitable for children based on analysis results from the emotion engine. One example of such a prompt is, "Create a message to alleviate anxiety."

[0361] The generated message is transmitted from the information processing device to the device and presented to the child user as an audio output. The device engages in conversation with the child in a gentle tone designed to provide a sense of security.

[0362] For example, if a child playing in a park after school deviates from a safe zone, the device immediately transmits location information to an information processing device and acquires emotional information indicating anxiety. The information processing device generates an appropriate interactive message and conveys it to the child through the device. This allows the child to follow instructions with confidence and be safely guided to their destination. In this way, the present invention ensures the safety of children and provides next-generation reassurance support that takes emotions into consideration.

[0363] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0364] Step 1:

[0365] The device periodically acquires the child's location information using its GPS function. This location information is then sent to the server at regular intervals. The location information is obtained as latitude and longitude coordinate data.

[0366] Step 2:

[0367] The server uses the location information received from the terminal as input to calculate deviations from the safe range. The server compares this to a pre-configured safe range and determines whether a deviation has occurred. As output, it sets a flag indicating whether or not a deviation has occurred.

[0368] Step 3:

[0369] The server uses an emotion engine to analyze the child's facial expressions and voice data, which are emotional information received from the terminal, as input. It infers emotions from the facial expression data and analyzes voice tone and anxiety levels from the voice data. The output of this analysis is the child's emotional state.

[0370] Step 4:

[0371] Based on information about the emotional state and whether or not there is any deviation, the server uses a generative AI model to generate an interactive message. At this time, the prompt "Please create a message to alleviate anxiety" is input. The generative AI model outputs an appropriate message to reassure the child.

[0372] Step 5:

[0373] The server sends the generated interactive message to the device. The device then delivers this message to the child as audio output. Specifically, a gentle tone of voice is played through the device's speaker, providing the child with a sense of security.

[0374] Step 6:

[0375] The child user listens to voice messages from the device and follows the instructions provided. This completes the action, making it easier to safely return to the original location.

[0376] (Application Example 2)

[0377] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0378] In mobile vehicles such as autonomous vehicles, there is a problem in how to ensure and protect the safety and security of passengers, especially children. Currently, there is insufficient development of systems that can grasp the emotional state of passengers in real time and provide them with appropriate reassurance, making it a challenge to deal with situations where passengers feel anxious during their ride.

[0379] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0380] In this invention, the server includes means for receiving information from a device that acquires the user's location information and calculating distance, means for generating and transmitting interactive information using a generative model, and means for analyzing the user's emotional state and generating reassuring messages. This makes it possible to provide optimal instructions by combining the passenger's location information and emotional state, thereby ensuring safety and security.

[0381] "User location information" refers to global coordinates and area information obtained to determine the user's current location.

[0382] "Device" is a general term for equipment or devices used to perform a specified function.

[0383] A "processing device" is a computing device such as a computer or server that analyzes and makes decisions based on input data.

[0384] A "generative model" is an algorithm or software program designed to generate new information based on existing data.

[0385] "Interactive information" refers to dynamic responses generated to convey instructions or messages to the user.

[0386] A "safe zone" is a defined range or area where deviations should be detected when a user physically moves.

[0387] A "protection system" is a general term for technological means and mechanisms designed to protect specific objects from danger or insecurity.

[0388] "Emotional state" refers to an internal state that indicates the user's psychological or emotional response, and is usually inferred from facial expressions, voice, etc.

[0389] A "message" is content expressed in text, audio, or other formats to convey specific information or intentions to a user.

[0390] This invention is a protective system equipped with a child-prevention function to allow users to travel with peace of mind. It is particularly intended to ensure the safety of children in autonomous vehicles. It operates by integrating a server, a device, a generative model, and means for analyzing emotional states.

[0391] The server communicates with a GPS-equipped device to obtain the user's location information. Based on the received location information, the processing unit calculates the distance between the user and the safe area and detects any deviation. This information is processed in real time, and for users in an unstable emotional state, a generative AI model is used to generate appropriate interactive information. The generated information is conveyed to the user as voice output through the device.

[0392] This process incorporates an emotion recognition model using the Hugging Face Transformers library, which analyzes the user's facial expressions and voice tone to identify their emotional state. Furthermore, a generative AI model provides appropriate instructions and messages based on the analysis results.

[0393] For example, if a child is feeling anxious inside an autonomous taxi, the emotion recognition system detects this state and sends a prompt to the generative AI model saying, "The passenger's emotion has been identified as 'anxious.' Please generate a message to reassure the passenger." As a result, a message such as, "We're on our way to our destination. Is there anything you're worried about?" is generated and conveyed to the child as audio.

[0394] In this way, the invention can maintain safety and comfort during travel by providing passengers with a sense of security.

[0395] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0396] Step 1:

[0397] The device collects the user's location information using GPS and transmits this information to a server. The input is the coordinate data of the current location obtained from GPS, and the output is the location information sent to the server.

[0398] Step 2:

[0399] The server calculates the distance between the current location and a defined safe area based on location information received from the terminal. The input is location measurement information transmitted from the terminal, and the output is an indicator showing whether or not a deviation has occurred. In this process, the server also considers the pre-set criteria for the safe area, and if a deviation is detected, it processes that information further.

[0400] Step 3:

[0401] The server acquires audio and camera sensor data from the terminal and analyzes the user's emotional state using an emotion recognition model. The input is audio and facial expression data, and the output is data representing the user's emotional state. Here, emotion recognition is performed using Hugging Face's Transformers.

[0402] Step 4:

[0403] The server uses a generative AI model to generate interactive messages based on emotional state and location information. The generation process takes prompts based on previously analyzed emotional state data and generates appropriate interactive messages. The inputs are emotional state data and location information, and the output is the generated message.

[0404] Step 5:

[0405] The terminal converts the generated message sent from the server into speech and transmits it to the user through the speaker. The input is the generated message, and the output is the message as speech. Specifically, a message designed to alleviate anxiety is played in a gentle tone.

[0406] Step 6:

[0407] The user receives voice messages and makes decisions based on the instructions. The input is the voice messages from the terminal, and the output is the user's actions. The user's actions are monitored again by the server, and the entire system is continuously managed.

[0408] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0409] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0410] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0411] [Third Embodiment]

[0412] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0413] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0414] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0415] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0416] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0417] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0418] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0419] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0420] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0421] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0422] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0423] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0424] This invention is a child-prevention system designed to prevent children from getting lost. This system is primarily constructed through the collaboration of a terminal and a server. The program processing of this invention will be explained below in natural language, and specific examples of how to implement the invention will be provided.

[0425] Overall system configuration

[0426] The device is designed for children and is primarily responsible for obtaining location information and providing guidance to the user. This device periodically uses GPS to obtain the child's current location. The location information is sent to the server in real time.

[0427] The server is the central device that processes information received from the terminal. Based on the received location information, it calculates how far the child is from the parent and determines whether it has deviated from a pre-set safety range.

[0428] Processing of each component

[0429] The server compares the child's location information with the parent's current location or a set range to detect deviations in real time. If a deviation is detected, it uses a generative model to generate an interactive message.

[0430] The device receives interactive messages sent from the server and transmits them to the child as voice output. These messages contain instructions to help the child return safely, encouraging them to act without getting lost.

[0431] The server calculates the optimal route from the current location to a parent or safe place as needed. This route information is sent to the device and then delivered back to the child as voice.

[0432] Specific example

[0433] For example, suppose a child is playing in a park after school. The device detects that the child has left the park and moved more than 500 meters outside the range set by the parent, indicating a departure from the safe zone. At this point, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends an instruction to the device.

[0434] If the user (child) chooses to follow the instructions on the device, the server calculates the optimal route and provides specific instructions such as, "Keep going straight and turn right at the next corner." This ensures the user is reassured while reliably guiding them to a safe location such as their parents or a police station. In this way, the present invention effectively protects the safety of children.

[0435] Thus, the child loss prevention system provides concrete means to prevent the risk of children getting lost by monitoring their current location, providing optimal guidance, and generating interactive messages using generative models.

[0436] The following describes the processing flow.

[0437] Step 1:

[0438] The device periodically (e.g., every minute) acquires the child's location information via GPS. It sends location data, including the current latitude, longitude, and time stamp, to the server.

[0439] Step 2:

[0440] The server analyzes the location information received from the device and compares it with the location information from the parent's smartphone. It then determines whether the child's location has deviated from the set safety zone.

[0441] Step 3:

[0442] If the child goes outside the safe zone, the server activates a generative model and generates an interactive message to send to the child. This message might say something like, "○○, you've gone a little too far. You need to come back."

[0443] Step 4:

[0444] The device receives interactive messages from the server and transmits them to the child via voice output. The user (child) who receives the message can respond to it.

[0445] Step 5:

[0446] If the user indicates their willingness to follow the instructions on the device, the server calculates the optimal route from the child's location to a safe place such as a parent or a police station.

[0447] Step 6:

[0448] The server sends the calculated route guidance to the terminal. Based on this information, the terminal provides voice guidance such as, "Go straight for 200 meters, then turn left." The guidance is updated according to the route conditions to ensure the user is guided appropriately.

[0449] Step 7:

[0450] When the user reaches their destination, the device reports its location to the server. The server verifies the child's safety and sends a notification to the parent's smartphone.

[0451] (Example 1)

[0452] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0453] The risk of children getting lost is always present, especially in public places and areas where many people gather. Conventional technologies have limited means of locating children, making it difficult to quickly and effectively protect them. Furthermore, simple location notifications alone are insufficient for prompt action after a child gets lost, and are not adequately guided to a safe place. Therefore, there is a need to develop more effective systems to ensure children's safety and provide peace of mind to both parents and children.

[0454] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0455] In this invention, the server includes means for calculating distance based on location information received from a location information acquisition device and determining deviation from a set safety area; means having a generative AI model for generating and transmitting interactive information; and means for calculating a route from the current location to a destination point and outputting the received information as voice. This makes it possible to immediately grasp the situation when a child deviates and provide appropriate countermeasures, thereby reducing the risk of getting lost and enabling rapid guidance to a safe place.

[0456] A "location information acquisition device" is hardware that has the function of measuring the user's current location and transmitting that location information to a server in real time.

[0457] An "information processing device" is a computer system that is responsible for determining deviations from a safe area based on data received from a location information acquisition device.

[0458] A "generative AI model" is an artificial intelligence system that analyzes received data and generates interactive messages.

[0459] A "means of guiding a route" refers to a function that calculates the optimal travel route from the current location to the destination and enables the user to see that route via voice or visual means.

[0460] "Means of outputting audio" refers to a device or function that converts text information generated by a device into audio and provides the information to the user audibly.

[0461] "Mobility-related information" refers to time-dependent information related to traffic conditions and locations, and is data used for route optimization.

[0462] This invention is a lost child prevention system constructed using a location information acquisition device (hereinafter referred to as a terminal) carried by the child and an information processing device (hereinafter referred to as a server) that works in conjunction with it.

[0463] The device has the function of obtaining the child's current location using a GPS sensor. The acquired location information is transmitted to a server via wireless communication. This communication typically uses mobile communication technology or Wi-Fi.

[0464] Upon receiving location information, the server first determines whether the user has deviated from the safe zone. This determination uses geofencing technology and a location database, identifying a deviation if the user exceeds a certain distance from the safe zone. Once a deviation is detected, the server generates an interactive message via a generative AI model. This AI model utilizes natural language processing technology to enable flexible, context-aware dialogue. The generated message is then sent to the terminal.

[0465] The device outputs interactive messages received from the server using speech synthesis technology. This allows children to follow the voice guidance and take appropriate actions to return to a safe place.

[0466] As a concrete example, consider a scenario where a user (child) leaves the park after school and goes beyond the safety zone set by their parent. In this case, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends it to the device. The device then converts this message into voice and delivers it to the child. The server also calculates the optimal route from the child's current location back to the parent and provides the child with specific directions.

[0467] An example of a prompt message would be: "Please create an interactive message for when a child deviates from the safety zone set by their parent. Please set the parent's home as the destination."

[0468] In this way, this system provides a concrete means to prevent the risk of getting lost by combining location information acquisition, deviation detection, and the generation of interactive messages and voice guidance.

[0469] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0470] Step 1:

[0471] The device periodically measures the user's (child's) current location using its built-in GPS sensor. Its input is a GPS signal, which is used to obtain latitude and longitude data. Its output is the generated location data, which is then transmitted to a server via wireless communication.

[0472] Step 2:

[0473] The server receives location data transmitted from the terminal as input. Based on the received data, it uses geofencing technology to determine deviation from the safe zone, using the user's current location and the coordinates of a pre-set safe zone. The output generates the deviation detection result and sets a flag to proceed to the next processing step.

[0474] Step 3:

[0475] If the deviation detection flag is set, the server uses a generative AI model to generate an interactive message. The input is contextual information about the deviation situation and the user's location, which is then used to input prompts into the generative AI model. The output is the generated text message, which is sent to the terminal.

[0476] Step 4:

[0477] The terminal receives an interactive message sent from the server as input. The input text data is converted into speech using speech synthesis technology and output to the user. The output is a voice message providing specific instructions to encourage safe behavior.

[0478] Step 5:

[0479] The server calculates the optimal route from the user's current location to a parent or safe location as needed. The inputs used are the user's current location and the destination coordinates. The server calculates the optimal route using map data and a route-finding algorithm, and outputs this route information, which is then sent to the terminal.

[0480] Step 6:

[0481] The terminal receives transmitted route information as input and converts specific navigation information into voice to provide to the user. The output is real-time voice guidance, providing instructions to help the user safely reach their destination.

[0482] (Application Example 1)

[0483] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0484] Currently, children and visitors getting lost in designated spaces is a serious problem in many areas. In particular, in public places and commercial facilities, lost children pose significant safety risks and increase parental anxiety. Current lost child prevention systems are limited to warnings from individual devices and lack sufficient speed and accuracy. Therefore, a system capable of a wider range of rapid response is needed.

[0485] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0486] In this invention, the server includes means having a device for acquiring the user's location information, means having an information processing device that calculates distance based on the location information received from the device and detects deviation from a predetermined safety area, and a generation model that generates and transmits interactive information to the user when the deviation is detected. This makes it possible to provide the user with a visible warning by linking the information to multiple display devices.

[0487] "Device" refers to an electronic device carried or used by a user to acquire location information.

[0488] An "information processing device" is a device that has the function of calculating distance based on received location information and detecting deviations from a set safety area.

[0489] A "generative model" is an algorithm or program that automatically generates and transmits interactive information, including guidance and warnings, to the user when a deviation is detected.

[0490] A "display device" is a device used to visually present generated warnings and guidance information, and its purpose is to provide information intuitively.

[0491] A "navigation system" is a system that assists in safe travel by suggesting the optimal route based on the user's current location and providing guidance to the destination.

[0492] "Mobility information" refers to information that includes variable elements depending on traffic conditions and time of day, and guidance is optimized based on this information.

[0493] The server accesses devices that acquire the location information of children and users. This is done by using the GPS module of a device carried by the user to periodically acquire location information and send it to the server. Based on the received location information, the server uses an information processing device to calculate and detect deviations from the set safety area.

[0494] When a deviation is detected, the server quickly generates an interactive message using a generative model. The generated message, including warnings and guidance, is sent to the user and visualized on a display device. A speech synthesis API is used in this process, and information is conveyed to the user through voice output, enabling the provision of immediate feedback.

[0495] Furthermore, the server generates optimal route guidance based on the user's current location and destination, taking travel information into account. This aims to propose the most efficient route by calculating data including real-time traffic information and in-store occupancy status. The goal is to help users reach their destinations with peace of mind.

[0496] For example, if a child leaves a safe zone while a parent is shopping in a commercial facility, the server generates an interactive message such as, "○○ has entered the designated area. Safety checks are required," and displays a warning on the parent's smartphone and on the facility's digital displays. This allows the parent to quickly understand the situation and take the necessary action.

[0497] An example of a prompt might be: "Generate an interactive warning message for when a child deviates from the designated area. The message should be reassuring to the user." Based on this prompt, the generation model operates and provides appropriate feedback to the user.

[0498] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0499] Step 1:

[0500] The device acquires location information. The device uses its built-in GPS module to periodically measure the user's current location. The acquired location information is temporarily stored in the device's memory in digital format.

[0501] Step 2:

[0502] The device sends location information to the server. The device sends the acquired location information to the server in real time. This transmission is done as data packets over the internet. When the server receives this location information, it proceeds to the next step.

[0503] Step 3:

[0504] The server determines the safe zone. The server compares the received location information with pre-configured safe zone information. To detect deviations from the safe zone, it calculates the Euclidean distance based on the coordinates. If a deviation is detected, the process proceeds to the next step.

[0505] Step 4:

[0506] The server generates an interactive message. The server uses a generation AI model to create an interactive message for the user. The prompt used is "Generate an appropriate warning message if the specified area is deviated from." The generated message is saved to the server in text format.

[0507] Step 5:

[0508] The server converts the message into speech. The generated text message is input into a speech synthesis API and converted into audio data. This audio data is provided to the user and used as a warning or announcement.

[0509] Step 6:

[0510] The server sends an alert to the display devices. The server then sends the generated message to multiple display devices within the commercial facility. This transmission takes place over the facility's network, and the display devices are configured to display the message visually.

[0511] Step 7:

[0512] The user receives and understands generated interactive messages. The user receives audio or visual information provided through the terminal or display device, understands the current situation, and takes steps to act safely. This feedback supports stable movement.

[0513] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0514] This invention is a child safety system designed to prevent children from getting lost, and it enables advanced interactive support in conjunction with an emotion engine that recognizes the user's emotions. This system operates by integrating a terminal, server, generative model, and emotion engine.

[0515] System Configuration

[0516] The device, carried by the child, is responsible for acquiring location information, collecting emotional data, and transmitting instructions. Location information is periodically acquired using GPS and transmitted to a server. The device is also equipped with sensors such as a camera and microphone, which are used to capture the child's facial expressions and voice tone in real time.

[0517] The server receives location and emotion data from the device and continuously monitors the user's state. Based on the location information, it detects deviations from the range and uses a generative model to create conversational messages to send to the child.

[0518] Program processing flow

[0519] If the user's location deviates from the set safety range, the server analyzes the child's emotional state via the emotion engine. Based on the analysis, a generative model adjusts the interactive message and sends it to the child in an appropriate tone.

[0520] The device receives messages from the server and communicates them to the child in a conversational format as voice output. For example, if the child seems anxious, it will speak in a gentle tone, saying, "It's okay, we'll go back to normal slowly."

[0521] The user (child) can listen to instructions from the device and take appropriate action. An emotional engine helps children feel secure and follow instructions.

[0522] Specific example

[0523] Consider a scenario where a child playing in a park after school strays from a safe zone. The device transmits its location information to a server and detects signs of anxiety from the child's facial expressions and voice. Based on the analysis of the emotional data, the server uses a generative model to construct a message that alleviates this anxiety. A message such as, "You'll be home soon. Look right and cross the street," is directly conveyed to the child via the device.

[0524] In this way, the child-prevention system of the present invention minimizes the risk of children getting lost while providing a sense of security, thereby enabling them to be safely guided to their destination. This embodiment is an example of a next-generation support system that utilizes emotion recognition technology to ensure the safety of children.

[0525] The following describes the processing flow.

[0526] Step 1:

[0527] The device uses GPS to obtain the child's location information and transmits it to a server. At the same time, it uses the camera and microphone built into the device to collect emotional data such as the child's facial expressions and tone of voice.

[0528] Step 2:

[0529] The server analyzes the received location information and determines whether it has exceeded the safe range set by the parent. If it determines that it has exceeded the safe range, it proceeds to the next step.

[0530] Step 3:

[0531] The server activates an emotion engine and analyzes facial and audio data received from the device. It identifies whether the child is feeling anxious or frightened and uses a generative model to create a message based on the analysis results.

[0532] Step 4:

[0533] The generative model generates interactive messages with the optimal tone and content based on the emotional state. For example, if a child is feeling anxious, it might create a gentle message such as, "Calm down, it's going to be okay. Let's go back in the direction of your friends."

[0534] Step 5:

[0535] The server sends the generated interactive message to the terminal.

[0536] Step 6:

[0537] The device transmits received messages to the child as voice output. The child follows these instructions and modifies their behavior. For example, they may feel reassured and begin walking the right path to return to their parents.

[0538] Step 7:

[0539] Once it is confirmed that the user (child) has followed the instructions and safely reached their destination (parent or a safe place), the device sends this information to the server. The server then sends a notification to the parent's smartphone to confirm the child's safety. This report completes the entire system process.

[0540] (Example 2)

[0541] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0542] Current child loss prevention systems struggle to respond appropriately when a child deviates from a safe zone. Furthermore, they issue uniform instructions without considering the user's feelings, making it difficult for children to follow them with confidence. There is a need to develop a system that improves this situation and balances child safety and security.

[0543] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0544] In this invention, the server includes means for detecting deviations from a safe range based on the user's location information, means for acquiring and analyzing the user's emotional information, and means for generating and sending interactive messages using a generative model. This makes it possible to provide reassuring instructions so that children are safely guided to their destinations.

[0545] "Device" refers to a device carried by a child to acquire location information.

[0546] An "information processing device" refers to a system that has the function of calculating distance based on location information received from the device and detecting deviations from a safe range.

[0547] "Emotional information" refers to data related to the emotional state obtained from the user's (child's) facial expressions, tone of voice, and other similar information.

[0548] A "generative model" refers to a system that utilizes artificial intelligence technology to generate interactive messages that should be sent to the user.

[0549] A "prompt" refers to the information or conditions that a generative model uses as input to generate an interactive message.

[0550] "Voice output" refers to a format in which generated interactive messages are presented to the user by playing them back as audio.

[0551] This invention is a child safety system for preventing children from getting lost, which operates by integrating a device, an information processing device, a generative model, and an emotion engine. Specific embodiments thereof are described here.

[0552] The device is a portable device carried by children. It is equipped with GPS functionality and can acquire location information. The device uses a built-in camera and microphone to capture emotional information such as the child's facial expressions and voice tone in real time and transmit it to an information processing device.

[0553] The information processing device detects deviations from the safe range based on location information transmitted from the device. When a deviation is detected, it uses an emotion engine to analyze the corresponding emotional information.

[0554] The generative model generates interactive messages suitable for children based on analysis results from the emotion engine. One example of such a prompt is, "Create a message to alleviate anxiety."

[0555] The generated message is transmitted from the information processing device to the device and presented to the child user as an audio output. The device engages in conversation with the child in a gentle tone designed to provide a sense of security.

[0556] For example, if a child playing in a park after school deviates from a safe zone, the device immediately transmits location information to an information processing device and acquires emotional information indicating anxiety. The information processing device generates an appropriate interactive message and conveys it to the child through the device. This allows the child to follow instructions with confidence and be safely guided to their destination. In this way, the present invention ensures the safety of children and provides next-generation reassurance support that takes emotions into consideration.

[0557] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0558] Step 1:

[0559] The device periodically acquires the child's location information using its GPS function. This location information is then sent to the server at regular intervals. The location information is obtained as latitude and longitude coordinate data.

[0560] Step 2:

[0561] The server uses the location information received from the terminal as input to calculate deviations from the safe range. The server compares this to a pre-configured safe range and determines whether a deviation has occurred. As output, it sets a flag indicating whether or not a deviation has occurred.

[0562] Step 3:

[0563] The server uses an emotion engine to analyze the child's facial expressions and voice data, which are emotional information received from the terminal, as input. It infers emotions from the facial expression data and analyzes voice tone and anxiety levels from the voice data. The output of this analysis is the child's emotional state.

[0564] Step 4:

[0565] Based on information about the emotional state and whether or not there is any deviation, the server uses a generative AI model to generate an interactive message. At this time, the prompt "Please create a message to alleviate anxiety" is input. The generative AI model outputs an appropriate message to reassure the child.

[0566] Step 5:

[0567] The server sends the generated interactive message to the device. The device then delivers this message to the child as audio output. Specifically, a gentle tone of voice is played through the device's speaker, providing the child with a sense of security.

[0568] Step 6:

[0569] The child user listens to voice messages from the device and follows the instructions provided. This completes the action, making it easier to safely return to the original location.

[0570] (Application Example 2)

[0571] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0572] In mobile vehicles such as autonomous vehicles, there is a problem in how to ensure and protect the safety and security of passengers, especially children. Currently, there is insufficient development of systems that can grasp the emotional state of passengers in real time and provide them with appropriate reassurance, making it a challenge to deal with situations where passengers feel anxious during their ride.

[0573] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0574] In this invention, the server includes means for receiving information from a device that acquires the user's location information and calculating distance, means for generating and transmitting interactive information using a generative model, and means for analyzing the user's emotional state and generating reassuring messages. This makes it possible to provide optimal instructions by combining the passenger's location information and emotional state, thereby ensuring safety and security.

[0575] "User location information" refers to global coordinates and area information obtained to determine the user's current location.

[0576] "Device" is a general term for equipment or devices used to perform a specified function.

[0577] A "processing device" is a computing device such as a computer or server that analyzes and makes decisions based on input data.

[0578] A "generative model" is an algorithm or software program designed to generate new information based on existing data.

[0579] "Interactive information" refers to dynamic responses generated to convey instructions or messages to the user.

[0580] A "safe zone" is a defined range or area where deviations should be detected when a user physically moves.

[0581] A "protection system" is a general term for technological means and mechanisms designed to protect specific objects from danger or insecurity.

[0582] "Emotional state" refers to an internal state that indicates the user's psychological or emotional response, and is usually inferred from facial expressions, voice, etc.

[0583] A "message" is content expressed in text, audio, or other formats to convey specific information or intentions to a user.

[0584] This invention is a protective system equipped with a child-prevention function to allow users to travel with peace of mind. It is particularly intended to ensure the safety of children in autonomous vehicles. It operates by integrating a server, a device, a generative model, and means for analyzing emotional states.

[0585] The server communicates with a GPS-equipped device to obtain the user's location information. Based on the received location information, the processing unit calculates the distance between the user and the safe area and detects any deviation. This information is processed in real time, and for users in an unstable emotional state, a generative AI model is used to generate appropriate interactive information. The generated information is conveyed to the user as voice output through the device.

[0586] This process incorporates an emotion recognition model using the Hugging Face Transformers library, which analyzes the user's facial expressions and voice tone to identify their emotional state. Furthermore, a generative AI model provides appropriate instructions and messages based on the analysis results.

[0587] For example, if a child is feeling anxious inside an autonomous taxi, the emotion recognition system detects this state and sends a prompt to the generative AI model saying, "The passenger's emotion has been identified as 'anxious.' Please generate a message to reassure the passenger." As a result, a message such as, "We're on our way to our destination. Is there anything you're worried about?" is generated and conveyed to the child as audio.

[0588] In this way, the invention can maintain safety and comfort during travel by providing passengers with a sense of security.

[0589] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0590] Step 1:

[0591] The device collects the user's location information using GPS and transmits this information to a server. The input is the coordinate data of the current location obtained from GPS, and the output is the location information sent to the server.

[0592] Step 2:

[0593] The server calculates the distance between the current location and a defined safe area based on location information received from the terminal. The input is location measurement information transmitted from the terminal, and the output is an indicator showing whether or not a deviation has occurred. In this process, the server also considers the pre-set criteria for the safe area, and if a deviation is detected, it processes that information further.

[0594] Step 3:

[0595] The server acquires audio and camera sensor data from the terminal and analyzes the user's emotional state using an emotion recognition model. The input is audio and facial expression data, and the output is data representing the user's emotional state. Here, emotion recognition is performed using Hugging Face's Transformers.

[0596] Step 4:

[0597] The server uses a generative AI model to generate interactive messages based on emotional state and location information. The generation process takes prompts based on previously analyzed emotional state data and generates appropriate interactive messages. The inputs are emotional state data and location information, and the output is the generated message.

[0598] Step 5:

[0599] The terminal converts the generated message sent from the server into speech and transmits it to the user through the speaker. The input is the generated message, and the output is the message as speech. Specifically, a message designed to alleviate anxiety is played in a gentle tone.

[0600] Step 6:

[0601] The user receives voice messages and makes decisions based on the instructions. The input is the voice messages from the terminal, and the output is the user's actions. The user's actions are monitored again by the server, and the entire system is continuously managed.

[0602] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0603] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0604] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0605] [Fourth Embodiment]

[0606] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0607] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0608] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0609] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0610] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0611] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0612] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0613] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0614] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0615] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0616] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0617] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0618] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0619] This invention is a child-prevention system designed to prevent children from getting lost. This system is primarily constructed through the collaboration of a terminal and a server. The program processing of this invention will be explained below in natural language, and specific examples of how to implement the invention will be provided.

[0620] Overall system configuration

[0621] The device is designed for children and is primarily responsible for obtaining location information and providing guidance to the user. This device periodically uses GPS to obtain the child's current location. The location information is sent to the server in real time.

[0622] The server is the central device that processes information received from the terminal. Based on the received location information, it calculates how far the child is from the parent and determines whether it has deviated from a pre-set safety range.

[0623] Processing of each component

[0624] The server compares the child's location information with the parent's current location or a set range to detect deviations in real time. If a deviation is detected, it uses a generative model to generate an interactive message.

[0625] The device receives interactive messages sent from the server and transmits them to the child as voice output. These messages contain instructions to help the child return safely, encouraging them to act without getting lost.

[0626] The server calculates the optimal route from the current location to a parent or safe place as needed. This route information is sent to the device and then delivered back to the child as voice.

[0627] Specific example

[0628] For example, suppose a child is playing in a park after school. The device detects that the child has left the park and moved more than 500 meters outside the range set by the parent, indicating a departure from the safe zone. At this point, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends an instruction to the device.

[0629] If the user (child) chooses to follow the instructions on the device, the server calculates the optimal route and provides specific instructions such as, "Keep going straight and turn right at the next corner." This ensures the user is reassured while reliably guiding them to a safe location such as their parents or a police station. In this way, the present invention effectively protects the safety of children.

[0630] Thus, the child loss prevention system provides concrete means to prevent the risk of children getting lost by monitoring their current location, providing optimal guidance, and generating interactive messages using generative models.

[0631] The following describes the processing flow.

[0632] Step 1:

[0633] The device periodically (e.g., every minute) acquires the child's location information via GPS. It sends location data, including the current latitude, longitude, and time stamp, to the server.

[0634] Step 2:

[0635] The server analyzes the location information received from the device and compares it with the location information from the parent's smartphone. It then determines whether the child's location has deviated from the set safety zone.

[0636] Step 3:

[0637] If the child goes outside the safe zone, the server activates a generative model and generates an interactive message to send to the child. This message might say something like, "○○, you've gone a little too far. You need to come back."

[0638] Step 4:

[0639] The device receives interactive messages from the server and transmits them to the child via voice output. The user (child) who receives the message can respond to it.

[0640] Step 5:

[0641] If the user indicates their willingness to follow the instructions on the device, the server calculates the optimal route from the child's location to a safe place such as a parent or a police station.

[0642] Step 6:

[0643] The server sends the calculated route guidance to the terminal. Based on this information, the terminal provides voice guidance such as, "Go straight for 200 meters, then turn left." The guidance is updated according to the route conditions to ensure the user is guided appropriately.

[0644] Step 7:

[0645] When the user reaches their destination, the device reports its location to the server. The server verifies the child's safety and sends a notification to the parent's smartphone.

[0646] (Example 1)

[0647] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0648] The risk of children getting lost is always present, especially in public places and areas where many people gather. Conventional technologies have limited means of locating children, making it difficult to quickly and effectively protect them. Furthermore, simple location notifications alone are insufficient for prompt action after a child gets lost, and are not adequately guided to a safe place. Therefore, there is a need to develop more effective systems to ensure children's safety and provide peace of mind to both parents and children.

[0649] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0650] In this invention, the server includes means for calculating distance based on location information received from a location information acquisition device and determining deviation from a set safety area; means having a generative AI model for generating and transmitting interactive information; and means for calculating a route from the current location to a destination point and outputting the received information as voice. This makes it possible to immediately grasp the situation when a child deviates and provide appropriate countermeasures, thereby reducing the risk of getting lost and enabling rapid guidance to a safe place.

[0651] A "location information acquisition device" is hardware that has the function of measuring the user's current location and transmitting that location information to a server in real time.

[0652] An "information processing device" is a computer system that is responsible for determining deviations from a safe area based on data received from a location information acquisition device.

[0653] A "generative AI model" is an artificial intelligence system that analyzes received data and generates interactive messages.

[0654] A "means of guiding a route" refers to a function that calculates the optimal travel route from the current location to the destination and enables the user to see that route via voice or visual means.

[0655] "Means of outputting audio" refers to a device or function that converts text information generated by a device into audio and provides the information to the user audibly.

[0656] "Mobility-related information" refers to time-dependent information related to traffic conditions and locations, and is data used for route optimization.

[0657] This invention is a lost child prevention system constructed using a location information acquisition device (hereinafter referred to as a terminal) carried by the child and an information processing device (hereinafter referred to as a server) that works in conjunction with it.

[0658] The device has the function of obtaining the child's current location using a GPS sensor. The acquired location information is transmitted to a server via wireless communication. This communication typically uses mobile communication technology or Wi-Fi.

[0659] Upon receiving location information, the server first determines whether the user has deviated from the safe zone. This determination uses geofencing technology and a location database, identifying a deviation if the user exceeds a certain distance from the safe zone. Once a deviation is detected, the server generates an interactive message via a generative AI model. This AI model utilizes natural language processing technology to enable flexible, context-aware dialogue. The generated message is then sent to the terminal.

[0660] The device outputs interactive messages received from the server using speech synthesis technology. This allows children to follow the voice guidance and take appropriate actions to return to a safe place.

[0661] As a concrete example, consider a scenario where a user (child) leaves the park after school and goes beyond the safety zone set by their parent. In this case, the server generates an interactive message such as, "○○, you've gone a little too far. Shall we go back home?" and sends it to the device. The device then converts this message into voice and delivers it to the child. The server also calculates the optimal route from the child's current location back to the parent and provides the child with specific directions.

[0662] An example of a prompt message would be: "Please create an interactive message for when a child deviates from the safety zone set by their parent. Please set the parent's home as the destination."

[0663] In this way, this system provides a concrete means to prevent the risk of getting lost by combining location information acquisition, deviation detection, and the generation of interactive messages and voice guidance.

[0664] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0665] Step 1:

[0666] The device periodically measures the user's (child's) current location using its built-in GPS sensor. Its input is a GPS signal, which is used to obtain latitude and longitude data. Its output is the generated location data, which is then transmitted to a server via wireless communication.

[0667] Step 2:

[0668] The server receives location data transmitted from the terminal as input. Based on the received data, it uses geofencing technology to determine deviation from the safe zone, using the user's current location and the coordinates of a pre-set safe zone. The output generates the deviation detection result and sets a flag to proceed to the next processing step.

[0669] Step 3:

[0670] If the deviation detection flag is set, the server uses a generative AI model to generate an interactive message. The input is contextual information about the deviation situation and the user's location, which is then used to input prompts into the generative AI model. The output is the generated text message, which is sent to the terminal.

[0671] Step 4:

[0672] The terminal receives an interactive message sent from the server as input. The input text data is converted into speech using speech synthesis technology and output to the user. The output is a voice message providing specific instructions to encourage safe behavior.

[0673] Step 5:

[0674] The server calculates the optimal route from the user's current location to a parent or safe location as needed. The inputs used are the user's current location and the destination coordinates. The server calculates the optimal route using map data and a route-finding algorithm, and outputs this route information, which is then sent to the terminal.

[0675] Step 6:

[0676] The terminal receives transmitted route information as input and converts specific navigation information into voice to provide to the user. The output is real-time voice guidance, providing instructions to help the user safely reach their destination.

[0677] (Application Example 1)

[0678] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0679] Currently, children and visitors getting lost in designated spaces is a serious problem in many areas. In particular, in public places and commercial facilities, lost children pose significant safety risks and increase parental anxiety. Current lost child prevention systems are limited to warnings from individual devices and lack sufficient speed and accuracy. Therefore, a system capable of a wider range of rapid response is needed.

[0680] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0681] In this invention, the server includes means having a device for acquiring the user's location information, means having an information processing device that calculates distance based on the location information received from the device and detects deviation from a predetermined safety area, and a generation model that generates and transmits interactive information to the user when the deviation is detected. This makes it possible to provide the user with a visible warning by linking the information to multiple display devices.

[0682] "Device" refers to an electronic device carried or used by a user to acquire location information.

[0683] An "information processing device" is a device that has the function of calculating distance based on received location information and detecting deviations from a set safety area.

[0684] A "generative model" is an algorithm or program that automatically generates and transmits interactive information, including guidance and warnings, to the user when a deviation is detected.

[0685] A "display device" is a device used to visually present generated warnings and guidance information, and its purpose is to provide information intuitively.

[0686] A "navigation system" is a system that assists in safe travel by suggesting the optimal route based on the user's current location and providing guidance to the destination.

[0687] "Mobility information" refers to information that includes variable elements depending on traffic conditions and time of day, and guidance is optimized based on this information.

[0688] The server accesses devices that acquire the location information of children and users. This is done by using the GPS module of a device carried by the user to periodically acquire location information and send it to the server. Based on the received location information, the server uses an information processing device to calculate and detect deviations from the set safety area.

[0689] When a deviation is detected, the server quickly generates an interactive message using a generative model. The generated message, including warnings and guidance, is sent to the user and visualized on a display device. A speech synthesis API is used in this process, and information is conveyed to the user through voice output, enabling the provision of immediate feedback.

[0690] Furthermore, the server generates optimal route guidance based on the user's current location and destination, taking travel information into account. This aims to propose the most efficient route by calculating data including real-time traffic information and in-store occupancy status. The goal is to help users reach their destinations with peace of mind.

[0691] For example, if a child leaves a safe zone while a parent is shopping in a commercial facility, the server generates an interactive message such as, "○○ has entered the designated area. Safety checks are required," and displays a warning on the parent's smartphone and on the facility's digital displays. This allows the parent to quickly understand the situation and take the necessary action.

[0692] An example of a prompt might be: "Generate an interactive warning message for when a child deviates from the designated area. The message should be reassuring to the user." Based on this prompt, the generation model operates and provides appropriate feedback to the user.

[0693] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0694] Step 1:

[0695] The device acquires location information. The device uses its built-in GPS module to periodically measure the user's current location. The acquired location information is temporarily stored in the device's memory in digital format.

[0696] Step 2:

[0697] The device sends location information to the server. The device sends the acquired location information to the server in real time. This transmission is done as data packets over the internet. When the server receives this location information, it proceeds to the next step.

[0698] Step 3:

[0699] The server determines the safe zone. The server compares the received location information with pre-configured safe zone information. To detect deviations from the safe zone, it calculates the Euclidean distance based on the coordinates. If a deviation is detected, the process proceeds to the next step.

[0700] Step 4:

[0701] The server generates an interactive message. The server uses a generation AI model to create an interactive message for the user. The prompt used is "Generate an appropriate warning message if the specified area is deviated from." The generated message is saved to the server in text format.

[0702] Step 5:

[0703] The server converts the message into speech. The generated text message is input into a speech synthesis API and converted into audio data. This audio data is provided to the user and used as a warning or announcement.

[0704] Step 6:

[0705] The server sends an alert to the display devices. The server then sends the generated message to multiple display devices within the commercial facility. This transmission takes place over the facility's network, and the display devices are configured to display the message visually.

[0706] Step 7:

[0707] The user receives and understands generated interactive messages. The user receives audio or visual information provided through the terminal or display device, understands the current situation, and takes steps to act safely. This feedback supports stable movement.

[0708] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0709] This invention is a child safety system designed to prevent children from getting lost, and it enables advanced interactive support in conjunction with an emotion engine that recognizes the user's emotions. This system operates by integrating a terminal, server, generative model, and emotion engine.

[0710] System Configuration

[0711] The device, carried by the child, is responsible for acquiring location information, collecting emotional data, and transmitting instructions. Location information is periodically acquired using GPS and transmitted to a server. The device is also equipped with sensors such as a camera and microphone, which are used to capture the child's facial expressions and voice tone in real time.

[0712] The server receives location and emotion data from the device and continuously monitors the user's state. Based on the location information, it detects deviations from the range and uses a generative model to create conversational messages to send to the child.

[0713] Program processing flow

[0714] If the user's location deviates from the set safety range, the server analyzes the child's emotional state via the emotion engine. Based on the analysis, a generative model adjusts the interactive message and sends it to the child in an appropriate tone.

[0715] The device receives messages from the server and communicates them to the child in a conversational format as voice output. For example, if the child seems anxious, it will speak in a gentle tone, saying, "It's okay, we'll go back to normal slowly."

[0716] The user (child) can listen to instructions from the device and take appropriate action. An emotional engine helps children feel secure and follow instructions.

[0717] Specific example

[0718] Consider a scenario where a child playing in a park after school strays from a safe zone. The device transmits its location information to a server and detects signs of anxiety from the child's facial expressions and voice. Based on the analysis of the emotional data, the server uses a generative model to construct a message that alleviates this anxiety. A message such as, "You'll be home soon. Look right and cross the street," is directly conveyed to the child via the device.

[0719] In this way, the child-prevention system of the present invention minimizes the risk of children getting lost while providing a sense of security, thereby enabling them to be safely guided to their destination. This embodiment is an example of a next-generation support system that utilizes emotion recognition technology to ensure the safety of children.

[0720] The following describes the processing flow.

[0721] Step 1:

[0722] The device uses GPS to obtain the child's location information and transmits it to a server. At the same time, it uses the camera and microphone built into the device to collect emotional data such as the child's facial expressions and tone of voice.

[0723] Step 2:

[0724] The server analyzes the received location information and determines whether it has exceeded the safe range set by the parent. If it determines that it has exceeded the safe range, it proceeds to the next step.

[0725] Step 3:

[0726] The server activates an emotion engine and analyzes facial and audio data received from the device. It identifies whether the child is feeling anxious or frightened and uses a generative model to create a message based on the analysis results.

[0727] Step 4:

[0728] The generative model generates interactive messages with the optimal tone and content based on the emotional state. For example, if a child is feeling anxious, it might create a gentle message such as, "Calm down, it's going to be okay. Let's go back in the direction of your friends."

[0729] Step 5:

[0730] The server sends the generated interactive message to the terminal.

[0731] Step 6:

[0732] The device transmits received messages to the child as voice output. The child follows these instructions and modifies their behavior. For example, they may feel reassured and begin walking the right path to return to their parents.

[0733] Step 7:

[0734] Once it is confirmed that the user (child) has followed the instructions and safely reached their destination (parent or a safe place), the device sends this information to the server. The server then sends a notification to the parent's smartphone to confirm the child's safety. This report completes the entire system process.

[0735] (Example 2)

[0736] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0737] Current child loss prevention systems struggle to respond appropriately when a child deviates from a safe zone. Furthermore, they issue uniform instructions without considering the user's feelings, making it difficult for children to follow them with confidence. There is a need to develop a system that improves this situation and balances child safety and security.

[0738] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0739] In this invention, the server includes means for detecting deviations from a safe range based on the user's location information, means for acquiring and analyzing the user's emotional information, and means for generating and sending interactive messages using a generative model. This makes it possible to provide reassuring instructions so that children are safely guided to their destinations.

[0740] "Device" refers to a device carried by a child to acquire location information.

[0741] An "information processing device" refers to a system that has the function of calculating distance based on location information received from the device and detecting deviations from a safe range.

[0742] "Emotional information" refers to data related to the emotional state obtained from the user's (child's) facial expressions, tone of voice, and other similar information.

[0743] A "generative model" refers to a system that utilizes artificial intelligence technology to generate interactive messages that should be sent to the user.

[0744] A "prompt" refers to the information or conditions that a generative model uses as input to generate an interactive message.

[0745] "Voice output" refers to a format in which generated interactive messages are presented to the user by playing them back as audio.

[0746] This invention is a child safety system for preventing children from getting lost, which operates by integrating a device, an information processing device, a generative model, and an emotion engine. Specific embodiments thereof are described here.

[0747] The device is a portable device carried by children. It is equipped with GPS functionality and can acquire location information. The device uses a built-in camera and microphone to capture emotional information such as the child's facial expressions and voice tone in real time and transmit it to an information processing device.

[0748] The information processing device detects deviations from the safe range based on location information transmitted from the device. When a deviation is detected, it uses an emotion engine to analyze the corresponding emotional information.

[0749] The generative model generates interactive messages suitable for children based on analysis results from the emotion engine. One example of such a prompt is, "Create a message to alleviate anxiety."

[0750] The generated message is transmitted from the information processing device to the device and presented to the child user as an audio output. The device engages in conversation with the child in a gentle tone designed to provide a sense of security.

[0751] For example, if a child playing in a park after school deviates from a safe zone, the device immediately transmits location information to an information processing device and acquires emotional information indicating anxiety. The information processing device generates an appropriate interactive message and conveys it to the child through the device. This allows the child to follow instructions with confidence and be safely guided to their destination. In this way, the present invention ensures the safety of children and provides next-generation reassurance support that takes emotions into consideration.

[0752] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0753] Step 1:

[0754] The device periodically acquires the child's location information using its GPS function. This location information is then sent to the server at regular intervals. The location information is obtained as latitude and longitude coordinate data.

[0755] Step 2:

[0756] The server uses the location information received from the terminal as input to calculate deviations from the safe range. The server compares this to a pre-configured safe range and determines whether a deviation has occurred. As output, it sets a flag indicating whether or not a deviation has occurred.

[0757] Step 3:

[0758] The server uses an emotion engine to analyze the child's facial expressions and voice data, which are emotional information received from the terminal, as input. It infers emotions from the facial expression data and analyzes voice tone and anxiety levels from the voice data. The output of this analysis is the child's emotional state.

[0759] Step 4:

[0760] Based on information about the emotional state and whether or not there is any deviation, the server uses a generative AI model to generate an interactive message. At this time, the prompt "Please create a message to alleviate anxiety" is input. The generative AI model outputs an appropriate message to reassure the child.

[0761] Step 5:

[0762] The server sends the generated interactive message to the device. The device then delivers this message to the child as audio output. Specifically, a gentle tone of voice is played through the device's speaker, providing the child with a sense of security.

[0763] Step 6:

[0764] The child user listens to voice messages from the device and follows the instructions provided. This completes the action, making it easier to safely return to the original location.

[0765] (Application Example 2)

[0766] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0767] In mobile vehicles such as autonomous vehicles, there is a problem in how to ensure and protect the safety and security of passengers, especially children. Currently, there is insufficient development of systems that can grasp the emotional state of passengers in real time and provide them with appropriate reassurance, making it a challenge to deal with situations where passengers feel anxious during their ride.

[0768] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0769] In this invention, the server includes means for receiving information from a device that acquires the user's location information and calculating distance, means for generating and transmitting interactive information using a generative model, and means for analyzing the user's emotional state and generating reassuring messages. This makes it possible to provide optimal instructions by combining the passenger's location information and emotional state, thereby ensuring safety and security.

[0770] "User location information" refers to global coordinates and area information obtained to determine the user's current location.

[0771] "Device" is a general term for equipment or devices used to perform a specified function.

[0772] A "processing device" is a computing device such as a computer or server that analyzes and makes decisions based on input data.

[0773] A "generative model" is an algorithm or software program designed to generate new information based on existing data.

[0774] "Interactive information" refers to dynamic responses generated to convey instructions or messages to the user.

[0775] A "safe zone" is a defined range or area where deviations should be detected when a user physically moves.

[0776] A "protection system" is a general term for technological means and mechanisms designed to protect specific objects from danger or insecurity.

[0777] "Emotional state" refers to an internal state that indicates the user's psychological or emotional response, and is usually inferred from facial expressions, voice, etc.

[0778] A "message" is content expressed in text, audio, or other formats to convey specific information or intentions to a user.

[0779] This invention is a protective system equipped with a child-prevention function to allow users to travel with peace of mind. It is particularly intended to ensure the safety of children in autonomous vehicles. It operates by integrating a server, a device, a generative model, and means for analyzing emotional states.

[0780] The server communicates with a GPS-equipped device to obtain the user's location information. Based on the received location information, the processing unit calculates the distance between the user and the safe area and detects any deviation. This information is processed in real time, and for users in an unstable emotional state, a generative AI model is used to generate appropriate interactive information. The generated information is conveyed to the user as voice output through the device.

[0781] This process incorporates an emotion recognition model using the Hugging Face Transformers library, which analyzes the user's facial expressions and voice tone to identify their emotional state. Furthermore, a generative AI model provides appropriate instructions and messages based on the analysis results.

[0782] For example, if a child is feeling anxious inside an autonomous taxi, the emotion recognition system detects this state and sends a prompt to the generative AI model saying, "The passenger's emotion has been identified as 'anxious.' Please generate a message to reassure the passenger." As a result, a message such as, "We're on our way to our destination. Is there anything you're worried about?" is generated and conveyed to the child as audio.

[0783] In this way, the invention can maintain safety and comfort during travel by providing passengers with a sense of security.

[0784] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0785] Step 1:

[0786] The device collects the user's location information using GPS and transmits this information to a server. The input is the coordinate data of the current location obtained from GPS, and the output is the location information sent to the server.

[0787] Step 2:

[0788] The server calculates the distance between the current location and a defined safe area based on location information received from the terminal. The input is location measurement information transmitted from the terminal, and the output is an indicator showing whether or not a deviation has occurred. In this process, the server also considers the pre-set criteria for the safe area, and if a deviation is detected, it processes that information further.

[0789] Step 3:

[0790] The server acquires audio and camera sensor data from the terminal and analyzes the user's emotional state using an emotion recognition model. The input is audio and facial expression data, and the output is data representing the user's emotional state. Here, emotion recognition is performed using Hugging Face's Transformers.

[0791] Step 4:

[0792] The server uses a generative AI model to generate interactive messages based on emotional state and location information. The generation process takes prompts based on previously analyzed emotional state data and generates appropriate interactive messages. The inputs are emotional state data and location information, and the output is the generated message.

[0793] Step 5:

[0794] The terminal converts the generated message sent from the server into speech and transmits it to the user through the speaker. The input is the generated message, and the output is the message as speech. Specifically, a message designed to alleviate anxiety is played in a gentle tone.

[0795] Step 6:

[0796] The user receives voice messages and makes decisions based on the instructions. The input is the voice messages from the terminal, and the output is the user's actions. The user's actions are monitored again by the server, and the entire system is continuously managed.

[0797] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0798] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0799] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0800] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0801] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0802] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0803] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0804] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0805] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0806] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0807] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0808] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0809] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0810] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0811] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0812] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0813] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0814] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0815] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0816] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0817] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0818] The following is further disclosed regarding the embodiments described above.

[0819] (Claim 1)

[0820] A device that acquires the user's location information,

[0821] A server that calculates the distance based on the location information received from the aforementioned terminal and detects deviation from a predetermined safety range,

[0822] Means having a generation model that generates and sends an interactive message to the user when the aforementioned deviation is detected,

[0823] A means of calculating the route from the current location to the destination and instructing the user on the route,

[0824] A system to prevent children from getting lost, including a lost child prevention system.

[0825] (Claim 2)

[0826] The system according to claim 1, characterized in that the generation model has means for converting an interactive message to the user into voice output.

[0827] (Claim 3)

[0828] The system according to claim 1, characterized in that it has means for optimizing the calculated route in consideration of time-dependent traffic information.

[0829] "Example 1"

[0830] (Claim 1)

[0831] Location information acquisition device,

[0832] An information processing device that calculates distance based on location information received from the location information acquisition device and determines deviation from a set safety area,

[0833] Means having a generative AI model that generates and transmits interactive information when the aforementioned deviation is detected,

[0834] A means of calculating the route from the current location to the destination and guiding the user along that route,

[0835] A means of outputting the received information as audio,

[0836] A system that includes this.

[0837] (Claim 2)

[0838] The system according to claim 1, characterized in that the generating AI model has means for converting conversational information to the user into voice output.

[0839] (Claim 3)

[0840] The system according to claim 1, characterized in that it has means for optimizing the calculated route in consideration of time-dependent travel-related information.

[0841] "Application Example 1"

[0842] (Claim 1)

[0843] A device that acquires the user's location information,

[0844] An information processing device that calculates distance based on position information received from the aforementioned device and detects deviation from a predetermined safety area,

[0845] A configuration having a generation model that generates and transmits interactive information to the user when the aforementioned deviation is detected,

[0846] A configuration that calculates directions from the current location to the destination and instructs the user on the route,

[0847] A configuration that provides visible warnings to the user by linking information to multiple display devices,

[0848] A navigation system that includes this.

[0849] (Claim 2)

[0850] The system according to claim 1, characterized in that the generation model has a configuration that converts interactive information to the user into voice output.

[0851] (Claim 3)

[0852] The system according to claim 1, characterized in that the calculated guidance is configured to be optimized taking into account time-dependent movement information.

[0853] "Example 2 of combining an emotion engine"

[0854] (Claim 1)

[0855] A device that acquires the user's location information,

[0856] An information processing device that calculates distance based on position information received from the aforementioned device and detects deviation from a preset safety range,

[0857] A means for acquiring and analyzing the user's emotional information when the aforementioned deviation is detected,

[0858] A means having a generation model that generates and sends interactive messages to the user based on the analysis results,

[0859] A means by which the generated interactive message is presented to the user as audio output,

[0860] A system that includes this.

[0861] (Claim 2)

[0862] The system according to claim 1, characterized in that the generation model uses the user's emotional state as a prompt to generate a message corresponding to that emotion.

[0863] (Claim 3)

[0864] The system according to claim 1, characterized in that the generation model has means for calculating a route from the user's current location to the destination and generating a message that safely guides the user to the destination.

[0865] "Application example 2 when combining with an emotional engine"

[0866] (Claim 1)

[0867] A device that acquires the user's location information,

[0868] A processing device that calculates distance based on position measurement information received from the aforementioned device and detects deviation from a predetermined safety area,

[0869] Means having a generation model that generates and transmits interactive information to the user when the aforementioned deviation is detected,

[0870] A means of calculating the route from the current location to the destination and instructing the user on the route,

[0871] A means of analyzing the user's emotional state and generating messages that reassure the user,

[0872] A protection system including this.

[0873] (Claim 2)

[0874] The system according to claim 1, characterized in that the generation model has means for converting interactive information to the user into voice output.

[0875] (Claim 3)

[0876] The system according to claim 1, characterized in that it has means for optimizing the calculated route in consideration of time-dependent travel information. [Explanation of Symbols]

[0877] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A device that acquires the user's location information, A server that calculates the distance based on the location information received from the aforementioned terminal and detects deviation from a predetermined safety range, Means having a generation model that generates and sends an interactive message to the user when the aforementioned deviation is detected, A means of calculating the route from the current location to the destination and instructing the user on the route, A system to prevent children from getting lost, including a lost child prevention system.

2. The system according to claim 1, characterized in that the generation model has means for converting an interactive message to the user into voice output.

3. The system according to claim 1, characterized in that it has means for optimizing the calculated route in consideration of time-dependent traffic information.

Images