system

Abstract

Provide a system. [Solution] A means for acquiring location information; A means for capturing images of the surroundings; A means for transmitting the acquired location information and video to a server; A means for analyzing location information and video in a server and determining compliance with traffic rules; A means of managing the development of your in-game character based on compliance with traffic rules; A system including means for detecting anomalies in location information and sending an alert.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention relates to a monitoring system aimed at ensuring the safe commute of children to and from school and preventing elderly people from wandering. Traffic accidents and troubles caused by wandering have become a social problem, with an increasing number of cases in which children are involved in accidents due to failure to follow traffic rules. Furthermore, the risk of elderly people wandering around and getting lost or causing accidents is also increasing. Effective means for solving these problems and ensuring safety are needed. [Means for solving the problem]

[0005] The present invention employs the following means. First, a device is provided that includes means for acquiring location information and means for capturing video of the surrounding area. Next, a means for transmitting the acquired location information and video to a server is provided. This server analyzes the location information and video and determines the status of compliance with traffic rules. It also has the function of managing the growth of in-game characters based on the status of compliance with traffic rules and issuing warnings if compliance is not achieved. Furthermore, by including means for detecting abnormalities in the location information and immediately sending alerts, it is possible to respond quickly to unforeseen circumstances. In this way, a system is provided that ensures children's safe commute to and from school and elderly people's safe outings.

[0006] "Means for obtaining location information" refers to the function of using GPS or other location information technology to identify the current location of the device and obtain it as data.

[0007] "Means for capturing images of the surroundings" refers to the function of using a camera to record images of the situation around the device.

[0008] "Means for transmitting acquired location information and video to a server" refers to the function of transferring acquired location information data and captured video data from the terminal to a server via a communication line.

[0009] "Means for determining compliance with traffic rules" refers to the function in which the server analyzes the location information and video received and determines whether the subject is correctly complying with traffic rules.

[0010] "Means for managing the growth of in-game characters" refers to a function that updates data so that a virtual character grows based on compliance with traffic rules and provides feedback to the user.

[0011] "Means for detecting abnormalities in location information and sending alerts" refers to a function that detects abnormal movement or stoppage based on the acquired location information and sends a warning notification to designated contacts.

[0012] An "alert" refers to a notification message or warning signal that notifies the user when an abnormality is detected.

[0013] "Server" refers to a computer system that receives, analyzes, stores, and processes location information and video data.

[0014] A "terminal" refers to a device that is attached to the belongings of children or elderly people, and that acquires location information, captures video, and sends the data to a server. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention is a monitoring system for the purpose of ensuring the safe travel of children to and from school and preventing elderly people from wandering away, and is configured and operated as follows.

[0037] System configuration

[0038] This system consists of the following elements:

[0039] Means of obtaining location information (GPS module)

[0040] A means of capturing images of the surrounding area (small camera)

[0041] A communication module that sends data to the server

[0042] A means of determining compliance with traffic rules (analysis software on the server)

[0043] A means of managing in-game character growth (game management software on the server)

[0044] A means of detecting anomalies and sending alerts (server alert system)

[0045] System Operation

[0046] Initial Setup

[0047] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0048] 2. The user registers the "Mamorun Cam" device within the app by scanning the QR code (registered trademark) or serial number to add the device to the system.

[0049] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0050] Real-time monitoring and analysis

[0051] 1. The device (Mamorun Cam) acquires location information while worn, collects current location data using a GPS module, and captures images of the surrounding area in real time using a camera.

[0052] 2. The device compresses the location information and video data at specific intervals and sends them to the server.

[0053] 3. The server analyzes the received data and determines compliance with traffic rules. It uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and evaluates whether children stop correctly at traffic lights and cross only when the pedestrian light is green.

[0054] Managing game elements

[0055] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time, giving users a sense of accomplishment in the game.

[0056] 2. Users (children) can check the character's progress on a smartphone app and enjoy it as an incentive.

[0057] Anomaly detection and alerts

[0058] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[0059] 2. When the server detects an abnormality, it immediately generates an alert message and sends a notification to registered contacts, allowing parents and family members to respond promptly.

[0060] Specific examples

[0061] Example of children going to school

[0062] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[0063] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0064] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[0065] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[0066] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[0067] Examples of elderly people wandering

[0068] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[0069] 2. The device transmits the acquired location information and video data to the server in real time.

[0070] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family member's smartphone.

[0071] 4. Users receive alerts and can respond quickly.

[0072] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away.

[0073] The processing flow will be explained below.

[0074] Step 1:

[0075] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0076] Step 2:

[0077] Users register devices within the app by scanning a QR code or serial number to add the device to the system.

[0078] Step 3:

[0079] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0080] Step 4:

[0081] The device (apparatus) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0082] Step 5:

[0083] The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[0084] Step 6:

[0085] The terminal compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[0086] Step 7:

[0087] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[0088] Step 8:

[0089] Based on the analysis results, the server evaluates whether the child is following traffic rules, checking whether they are stopping at red lights or crossing the street when the light is green.

[0090] Step 9:

[0091] The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and stores the results in a database.

[0092] Step 10:

[0093] The server analyzes the location information fluctuation data and immediately generates an alert message if an abnormality occurs (e.g., no movement for a certain period of time, sudden movement).

[0094] Step 11:

[0095] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[0096] Step 12:

[0097] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[0098] Example 1

[0099] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0100] Conventional monitoring systems only handle location information and video data, and are inadequate in analyzing the data, determining compliance with traffic rules, and providing feedback to users. Emergency response can be delayed, making it difficult to detect wandering or dangerous behavior early. Furthermore, there was a lack of a way to provide attractive incentives for children while ensuring their safety on their way to and from school.

[0101] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0102] In this invention, the server includes: means for acquiring location information; means for capturing surrounding images; means for transmitting the acquired location information and images to the server; means for analyzing the location information and images in the server and determining compliance with traffic rules; means for managing character growth based on compliance with traffic rules; means for detecting abnormalities in the location information and sending alerts; means for creating accounts and registering devices; means for compressing the location information and image data at regular intervals; means for awarding points to characters based on compliance with traffic rules and updating character growth in real time; and means for instantly generating an alert message and sending it to an emergency contact when an abnormality is detected. This solves conventional problems, effectively supports children's commutes to and from school, and prevents elderly people from wandering, thereby improving safety. Furthermore, in-game character growth can be used to motivate children to comply with traffic rules.

[0103] "Location information" is data that indicates the geographic location of a particular object, obtained by GPS or other location information acquisition means.

[0104] "Video data" is data containing visual information of the surroundings captured by the device's camera.

[0105] The "transmission means" is a communication module for transferring the acquired location information and video data to a server via a network.

[0106] The "means for determining compliance with traffic rules" refers to a technology that uses analytical software and AI algorithms stored on a server to determine whether traffic rules such as traffic lights, pedestrian signals, and crosswalks are being properly followed.

[0107] The "means for managing character growth" is a system that awards development points to in-game characters when traffic rules are followed, and updates their growth in real time.

[0108] The "means for detecting abnormalities and sending alerts" is a system that analyzes sudden changes in location information or long periods of stationary motion, and sends a notification to emergency contacts if an abnormality is detected.

[0109] "Means for creating an account and registering a device" refers to a function that allows a user to create an account using a smartphone app and register a monitoring device in the system.

[0110] An "interval" is a time interval set when acquiring or transmitting location information and video data.

[0111] The "compression means" is a technology for compressing the acquired location information and video data in order to reduce the volume and efficiently transmit the data to the server.

[0112] An "alert message" is a notification containing information about a detected abnormality, and is a message that is immediately sent to an emergency contact.

[0113] This invention is a monitoring system aimed at ensuring the safety of children going to and from school and preventing elderly people from wandering away. This system includes a means for acquiring location information (GPS module), a means for capturing surrounding images (small camera), a communication means for sending data to a server (communication module), a means for determining compliance with traffic rules (analysis software in the server), a means for managing in-game character growth (game management software in the server), and a means for detecting abnormalities and sending alerts (server alert system).

[0114] System configuration

[0115] The entire system consists of three components: a user (e.g., parent or family member) terminal (monitoring device), and a server. As a specific example, the following hardware and software are used:

[0116] GPS module: for obtaining location information

[0117] Small camera: for capturing surrounding footage

[0118] Communication module: for data transmission

[0119] Analysis software on the server: Determining whether traffic rules are being followed

[0120] Server game management software: Character growth management

[0121] Server alert system: Anomaly detection and alert sending

[0122] Program Details

[0123] The system works as follows: First, the user installs the smartphone app and creates an account. They create the account by entering their email address and password, then register the device. They add the monitoring device to the system by scanning the QR code or serial number. Then, they enter information about the child or elderly person, emergency contacts, and notification settings in the app.

[0124] Next, while the monitoring device is worn, it acquires location information using a GPS module and captures real-time images of the surrounding area using a small camera. The acquired data is compressed at regular intervals and sent to a server via a communications module. The server analyzes the received data and uses an AI algorithm to determine compliance with traffic rules. Specifically, it recognizes traffic lights, crosswalks, and pedestrian movements and evaluates whether the behavior was correct.

[0125] Additionally, if traffic rules are followed, the game management software will award character development points. Character growth is updated in real time, giving users a sense of accomplishment. If any abnormalities, such as abnormal behavior or prolonged inactivity, are detected, the server will immediately generate an alert message and send a notification to registered contacts.

[0126] Specific examples

[0127] Example of children going to school

[0128] 1. The user (parent) attaches the monitoring device to their child's school bag and activates the device using the app.

[0129] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0130] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[0131] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[0132] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[0133] Examples of elderly people wandering

[0134] 1. The user (family member) attaches the monitoring device to the clothing of the elderly person when they go out.

[0135] 2. The device transmits the acquired location information and video data to the server in real time.

[0136] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family's smartphone.

[0137] 4. Users receive alerts and can respond quickly.

[0138] Prompt Sentence Examples

[0139] "Please explain the system in which a monitoring device attached to a child's school bag compresses and sends GPS-acquired location information and camera footage to a server, and then uses AI to analyze whether traffic rules are being followed."

[0140] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0141] Step 1: The user creates an account.

[0142] Specific operation: The user opens the app on their smartphone and selects "Create a new account." They enter their email address and password and click the "Register" button. Input: Email address, password. Output: A message confirming the creation of a new account.

[0143] Data processing: The user's input information is sent to the server, and a new account is created in the user database.

[0144] Step 2: The user registers the device.

[0145] What happens: The user selects the "Register Device" section in the app and either scans the device's QR code with the camera or manually enters the serial number. Input: QR code or serial number. Output: Device registration confirmation message.

[0146] Data processing: The registered QR code or serial number is sent to the server and stored in the device database.

[0147] Step 3: The user enters the target person's information and emergency contact information.

[0148] Specific operation: The user enters the name, age, emergency contact information, etc. of a child or elderly person into the app and clicks the "Save" button. Input: Information about the person, emergency contact information. Output: A message confirming that the information has been saved.

[0149] Data processing: The entered information is sent to the server and stored in association with the user profile.

[0150] Step 4: The device acquires location information.

[0151] Specific operation: When the device is worn, the GPS module is activated and the current location information is obtained every 5 seconds. Input: GPS signal. Output: Location information data.

[0152] Data processing: Location information is temporarily stored on the device.

[0153] Step 5: The device captures video of the surrounding area.

[0154] Specific operation: The device activates a small camera and captures surrounding images in real time. Input: Camera image. Output: Video data.

[0155] Data processing: Video data is temporarily stored in the cache.

[0156] Step 6: The terminal compresses and transmits the data.

[0157] Specific operation: The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. Input: location information, video data. Output: compressed data.

[0158] Data processing: Data compression is performed within the terminal, and the compressed data is sent to the server.

[0159] Step 7: The server parses the data.

[0160] How it works: The server passes the received data to analysis software, which uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements. Input: Compressed data. Output: Analysis results.

[0161] Data processing: AI algorithms analyze the compressed data and determine compliance with traffic rules.

[0162] Step 8: The server manages the character's progression.

[0163] Specific operation: If traffic rules are followed, the server will award character development points through the game management software and update the character's development status in real time. Input: Analysis results. Output: Development points, development update notification.

[0164] Data processing: Based on the analysis results, the character's growth points are calculated and notified to the user's app.

[0165] Step 9: The server detects the anomaly and sends an alert.

[0166] Specific operation: When the server detects a sudden change in location information or a long period of inactivity, it immediately generates an alert message and notifies the registered emergency contacts. Input: Location information data. Output: Alert message.

[0167] Data processing: Based on the location analysis results, an alert is generated and sent to emergency contacts.

[0168] (Application example 1)

[0169] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0170] Ensuring the safety of children and the elderly has become a critical issue in modern society. There are many cases of children and the elderly getting lost outside designated areas, especially when out shopping or dining in a brick-and-mortar store. Furthermore, conventional systems have difficulty acquiring real-time location information and video footage, detecting abnormalities, and quickly addressing them. As a result, parents are unable to respond quickly, causing anxiety for both the parents and the elderly. In addition, there is a need for a system that combines safety measures with game elements to help users act safely while having fun.

[0171] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0172] In this invention, the server includes a means for acquiring location information, a means for capturing video of the surrounding area, a means for transmitting the acquired location information and video to the server, a means for analyzing the location information and video in the server and determining compliance with traffic rules, a means for managing the development of a character in the game based on compliance with traffic rules, a means for detecting abnormalities in the location information and sending an alert, a means for sending an alert when the user leaves a designated area within the store, a means for compressing the target's location information and video at intervals and sending the compressed video to the server, a means for detecting abnormalities in the server and instantly generating an alert message, and a means for detecting pedestrian signals and evaluating compliance with traffic rules. This allows a prompt warning to be issued when the target leaves the designated area, enabling parents to respond quickly. Furthermore, the game elements can provide the fun of following traffic rules, increasing the incentive to act safely.

[0173] A "means for obtaining location information" is a device or mechanism that uses GPS or other location measurement technology to accurately obtain the subject's current location.

[0174] "Means for capturing images of the surroundings" refers to a device or mechanism that uses a camera or other image capturing device to capture images of a specified area in real time and saves or transmits the data.

[0175] The "means for transmitting the acquired location information and video to a server" refers to a device or mechanism for transmitting the acquired location information and video data to a remote server using a communication module or an internet line.

[0176] "Means for analyzing location information and video on a server and determining compliance with traffic rules" refers to a device or mechanism that uses analysis software or algorithms on a server to analyze received location information and video data and evaluate whether the subject is complying with traffic rules.

[0177] "Means for managing the growth of a character in a game based on compliance with traffic rules" refers to software or a mechanism that controls the growth and evolution of a character in a game when a subject complies with traffic rules.

[0178] "Means for detecting abnormalities in location information and sending alerts" refers to a device or mechanism that monitors fluctuations or abnormalities in location information data and sends a warning or alert to designated contacts when certain conditions are met.

[0179] "Means for sending an alert when a person leaves a designated area within the store" refers to a device or mechanism that issues an alarm and sends a notification to a parent or guardian or manager when a person leaves a designated safe area within the store.

[0180] "Means for compressing the subject's location information and video at intervals and transmitting them to a server" refers to a device or mechanism for compressing the location information and video data at a specified time interval and transmitting them efficiently to a server.

[0181] "Means for detecting abnormalities on the server and immediately generating an alert message" refers to a device or mechanism that analyzes data received on the server side, and immediately creates an alert message when an abnormality is detected, and notifies the specified contacts.

[0182] "Means for detecting pedestrian signals and assessing compliance with traffic rules" refers to software or algorithms that recognize pedestrian signals from video data and assess whether the subject is complying with traffic rules when passing through the signal.

[0183] This invention is a system that supports safe behavior of subjects (children and the elderly). A detailed implementation method of this system is described below.

[0184] System configuration

[0185] This system consists of the following hardware and software:

[0186] Hardware

[0187] GPS module: Used to obtain the subject's current location. An example is the Ublox NEO-6M.

[0188] Small cameras: used to capture video of the subject's surroundings. An example is the Raspberry Pi Camera Module.

[0189] Communication module: Used to send data to the server. An example is a GSM module.

[0190] software

[0191] Location information analysis software: Software for analyzing acquired location information. For example, custom software using Python.

[0192] Video analysis software: AI algorithms for analyzing captured video. Examples include TENSORFLOW (registered trademark) and OpenCV.

[0193] Server: Used for data analysis and management. An example is AWS (registered trademark) EC2.

[0194] Alert system: Software that generates alerts and notifies you when an abnormality is detected.

[0195] Game management software: Software that manages the growth of in-game characters based on compliance with traffic rules.

[0196] System Operation

[0197] The server receives the acquired location information and video data and performs processing in the following procedure.

[0198] 1. Location information acquisition: The device acquires the subject's current location using the GPS module, and the data is sent to the server at specific intervals.

[0199] 2. Video capture and transmission: A small camera captures the surroundings and transmits the captured video synchronously to the server. This process is repeated every interval.

[0200] 3. Data analysis: The server analyzes the received location information and video data. The location analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation.

[0201] 4. Traffic rule compliance assessment: The server assesses compliance with traffic rules based on the analysis results. It recognizes pedestrian signals and determines whether the vehicle is stopping correctly at traffic lights or crossing the street when the light is green.

[0202] 5. Character growth management and incentives: When traffic rules are followed, the game management software will award growth points to the in-game character and update the character's growth in real time. The results will be sent to the user's (parents' or guardians') smartphone, which can be enjoyed as an incentive.

[0203] 6. Anomaly detection and alerts: The server monitors location information for sudden changes or periods of inactivity, and if an anomaly is detected, it immediately generates an alert message and sends a notification to emergency contacts.

[0204] Specific examples

[0205] For example, if a child strays from a designated area within a store, the server-side analysis software will determine this as an abnormality and immediately send an alert to the parent or store staff's smartphone, allowing for a prompt response.

[0206] Example prompt sentence:

[0207] "I want to develop an application that analyzes location information and video data and sends an alert if the user goes outside a specified range."

[0208] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0209] Step 1:

[0210] The device uses a GPS module to obtain the subject's current location. The device sends the obtained location information to the server at regular intervals (e.g., every 30 seconds). In this case, the input is the location data from the GPS module, and the output is the location information sent to the server.

[0211] Step 2:

[0212] The device uses a small camera to capture images of the surrounding area. The device transmits the image data to the server at intervals, similar to the location information. In this case, the input is the image data from the camera, and the output is the image data transmitted to the server.

[0213] Step 3:

[0214] The server analyzes the received location information and video data. The location information analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation from the video data. The inputs are location information and video data, and the output is location evaluation information and video analysis information as the analysis results.

[0215] Step 4:

[0216] The server determines whether or not traffic rules are being followed based on the analysis results. The analysis software recognizes pedestrian signals and determines whether the subject stops correctly at the traffic light or crosses the street when the light is green. The input is the analysis results, and the output is the determination of whether or not the subject is following traffic rules.

[0217] Step 5:

[0218] If traffic rules are followed, the server will award training points to the in-game character through the game management software. The server will then notify the user (parent or guardian) of this result via their smartphone. The input is the result of compliance, and the output is character growth information and a notification to the user.

[0219] Step 6:

[0220] The server monitors location information for sudden changes or stationary periods. If the server detects an abnormality, it immediately generates an alert message and sends a notification to emergency contacts. The input is location information change data, and the output is the generated alert message.

[0221] Step 7:

[0222] The device compresses the location information and video data at intervals and sends them to the server. This improves data transfer efficiency. The input is location information and video data, and the output is compressed data.

[0223] Step 8:

[0224] The server sends an alert if the target person goes outside the specified range. The server monitors the target person's current location based on the received location information, and if the target person goes outside the range, it issues a warning and notifies the parent or administrator. In this case, the input is location information and the output is an alert message.

[0225] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0226] The present invention combines a monitoring system aimed at ensuring children's safety on their way to and from school and preventing elderly people from wandering away with an emotion engine that recognizes the user's emotions, and is configured and operated as follows.

[0227] System configuration

[0228] This system consists of the following elements:

[0229] Means of obtaining location information (GPS module)

[0230] A means of capturing images of the surrounding area (small camera)

[0231] A communication module that sends data to the server

[0232] A means of determining compliance with traffic rules (analysis software on the server)

[0233] A means of managing in-game character growth (game management software on the server)

[0234] A means of detecting anomalies and sending alerts (server alert system)

[0235] Emotion engine that recognizes user emotions

[0236] System Operation

[0237] Initial Setup

[0238] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0239] 2. Users register their Mamorun Cam device within the app by scanning the QR code or serial number to add the device to the system.

[0240] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0241] Real-time monitoring and analysis

[0242] 1. The device (Mamorun Cam) acquires location information while worn and collects current location data using the GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0243] 2. The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[0244] 3. The device compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[0245] Traffic rule compliance and emotion analysis

[0246] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[0247] 2. The server passes the obtained video data to the emotion engine, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[0248] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[0249] Managing game elements

[0250] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[0251] 2. Adjust the training points and incentives based on the emotional data recognized by the emotion engine. For example, if the child seems to be having fun, give them more points to increase their sense of security.

[0252] Anomaly detection and alerts

[0253] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[0254] 2. The server also uses the emotion data recognized by the emotion engine and immediately generates an alert message if it determines that there is an abnormality.

[0255] 3. The server sends an alert message to the designated contacts via smartphone push notification or email.

[0256] Specific examples

[0257] Example of children going to school

[0258] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[0259] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0260] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[0261] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[0262] 5. The server analyzes the video data using an emotion engine to recognize the child's emotional state.

[0263] 6. The server awards points to the in-game character based on whether the rules were followed correctly and the character's emotional state, and notifies the user's app.

[0264] Examples of elderly people wandering

[0265] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[0266] 2. The device transmits the acquired location information and video data to the server in real time.

[0267] 3. The server detects sudden changes in location information and long periods of stillness, and analyzes the video data using an emotion engine.

[0268] 4. The server determines abnormalities based on the elderly person's emotional state and location data, and sends a notification to emergency contacts if an alert is necessary.

[0269] 5. Users receive alerts and can respond quickly.

[0270] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[0271] The processing flow will be explained below.

[0272] Step 1:

[0273] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0274] Step 2:

[0275] Users register their Mamorun Cam device within the app by scanning the QR code or serial number and adding the device to the system.

[0276] Step 3:

[0277] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0278] Step 4:

[0279] The device (Mamorun Cam) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0280] Step 5:

[0281] The device captures images of the surroundings in real time using a camera. The device stores the image data in memory and compresses it at specific intervals (e.g., every 30 seconds).

[0282] Step 6:

[0283] The terminal transmits the compressed location information and video data to the server via the communication module.

[0284] Step 7:

[0285] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[0286] Step 8:

[0287] The server passes the video data to an emotion engine, which analyzes the facial expressions and speech of the user (children or elderly people) to recognize their emotions.

[0288] Step 9:

[0289] The server combines the analyzed emotional data with compliance with traffic rules to increase the probability of detecting abnormal behavior.

[0290] Step 10:

[0291] The server assigns training points to in-game characters based on traffic rule compliance and emotional data. Game management software on the server updates the character's growth in real time and stores the results in a database.

[0292] Step 11:

[0293] The server analyzes location fluctuation data and emotional data to detect abnormalities (e.g., not moving for a certain period of time, or sudden movement).

[0294] Step 12:

[0295] The server also uses emotion data to determine abnormalities and immediately generates an alert message, which includes the specific details of the abnormality, location information, and emotional state.

[0296] Step 13:

[0297] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[0298] Step 14:

[0299] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[0300] Step 15:

[0301] Users (children) can check the progress of their in-game characters on their smartphone app and enjoy it as an incentive to follow traffic rules.

[0302] Example 2

[0303] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0304] Conventional location information acquisition systems and surveillance systems simply acquire and analyze location information and video data, making it difficult to grasp the user's psychological state or more precisely detect abnormal behavior. Furthermore, they lack a mechanism for sending emergency notifications based on accurate information quickly when abnormal behavior occurs. Furthermore, they lack a function for linking the growth of an agent in the system's virtual environment to the user's psychological state, making it difficult to maintain the user's interest and motivation.

[0305] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0306] In this invention, the server includes means for detecting anomalies in location information and sending an alert, means for recognizing the user's psychological state, and means for detecting abnormal behavior by integrating the acquired psychological state with compliance with regulations, thereby enabling precise detection of abnormal behavior that takes the user's psychological state into consideration and rapid transmission of emergency notifications.

[0307] "Means for obtaining location information" refers to a system or device for measuring the subject's current location and obtaining that data.

[0308] "Means for capturing video of the surroundings" refers to a camera or other device that captures video of the subject's surroundings in real time.

[0309] "Server" refers to a computer system that collects, analyzes, stores, and transmits data over a network.

[0310] "Means for transmitting to a server" refers to a communication module or network connection means for transmitting the acquired location information and video data to a server.

[0311] "Means for determining compliance with regulations" refers to analytical software or algorithms that analyze acquired data to determine whether traffic rules or other regulations are being complied with.

[0312] "Means for managing the growth of agents within a virtual environment" refers to software and data management systems for managing the growth and development of agents operating in a virtual environment within the system.

[0313] "Means for detecting location anomalies and sending alerts" refers to a system that detects unusual location changes or inactivity and sends warnings or notifications based on that information.

[0314] "Means for recognizing the user's psychological state" refers to software or algorithms for analyzing and recognizing the user's psychological state from facial expressions, voice, behavior, etc.

[0315] "Means for detecting abnormal behavior" refers to a system that integrates acquired data with perceived psychological states to detect unusual behavioral patterns.

[0316] "Means for sending emergency notifications" means communications systems or software that rapidly send alerts or notifications to designated contacts when abnormal behavior is detected.

[0317] The present invention is a monitoring system for the purpose of ensuring the safety of children going to and from school and preventing elderly people from wandering away, and is also combined with an emotion engine that recognizes the user's psychological state. This system is configured and operated as follows.

[0318] System configuration

[0319] This system consists of the following elements:

[0320] Means of obtaining location information (GPS module)

[0321] A means of capturing images of the surrounding area (small camera)

[0322] A communication module that sends data to the server

[0323] A means of determining compliance with regulations (analysis software on the server)

[0324] A means of managing the growth of agents in the virtual environment (game management software in the server)

[0325] A means of detecting anomalies and sending alerts (server alert system)

[0326] Emotion engine that recognizes the user's mental state

[0327] Initial Setup

[0328] First, users install the smartphone application and create an account by entering their email address and password. Next, they register the device within the app by scanning a QR code or serial number and adding it to the system. Finally, they enter information about the target person (children or elderly), emergency contacts, and notification settings, and then perform AI-based regulatory checks and configure agents in the virtual environment.

[0329] Real-time monitoring and data transmission

[0330] While the device is attached, it uses a GPS module to collect location data. It typically updates its location every five seconds and captures real-time images of the surrounding area with its camera, saving them to memory. This location information and video data is compressed every 30 seconds and sent to a server via a communications module.

[0331] Data analysis by server

[0332] The server passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic lights, sidewalks, and other regulatory objects and determine compliance with regulations. The server also passes the obtained video data to an emotion engine, which analyzes the user's (children or elderly) facial expressions and voice to recognize their psychological state. This analysis combines psychological state with compliance with regulations, enabling more precise detection of abnormal behavior.

[0333] Managing game elements

[0334] If the server complies with the regulations, it will award training points to the agent in the virtual environment. The game management software on the server updates the agent's growth in real time and provides feedback to the user. Furthermore, the emotion engine adjusts training points and incentives based on the agent's psychological state. For example, if a child appears to be having fun, it will be awarded more points, increasing their motivation.

[0335] Anomaly detection and alert sending

[0336] The server analyzes location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement). It also uses the psychological state recognized by the emotion engine and immediately generates an alert message if it determines that an abnormality exists. Finally, the server sends the alert message to designated contacts, and notifications are sent via smartphone push notifications or email, allowing users to respond promptly.

[0337] Specific examples

[0338] Example of children going to school

[0339] The user (parent) attaches the device to their child's school bag and activates it with the app. The device obtains location information every five seconds using a GPS module and captures images of the surrounding area using a camera. Every 30 seconds, the location information and video data are compressed and sent to the server. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light. The server also analyzes the video data using an emotion engine to recognize the child's psychological state. Points are awarded to the agent in the virtual environment depending on whether the rules are followed correctly and the child's psychological state, and a notification is sent to the user's app.

[0340] Examples of elderly people wandering

[0341] The user (family member) attaches the device to the elderly person's clothing when they go out. The device sends location information and video data to a server in real time. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data using an emotion engine. It determines abnormalities based on the elderly person's psychological state and location data, and sends an alert to emergency contacts if necessary. The user receives the alert and can respond quickly.

[0342] Prompt Sentence Examples

[0343] Enter the following prompt into the generative AI model:

[0344] "Please tell me about the system for monitoring children's safety on their way to and from school. I would like to know whether the children cross the street correctly at traffic lights and their psychological state."

[0345] or

[0346] "I would like to know how we can be notified if an elderly person wanders off while out. Please explain how the system works, including psychological analysis."

[0347] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[0348] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0349] Step 1:

[0350] A user installs the app on their smartphone and creates an account by entering their email address and password. The input is an email address and password, and the output is the creation of a new account. Specifically, the user enters the information as instructed by the app and presses the registration button.

[0351] Step 2:

[0352] To register a device within the app, a user scans a QR code or serial number to add the device to the system. The input is the QR code or serial number, and the output is the device registration completion. Specifically, the user scans the QR code attached to the device with the camera.

[0353] Step 3:

[0354] The user inputs information about the target person (children or elderly), emergency contacts, and notification settings, and the AI ​​checks regulations and configures the agent in the virtual environment. The input is target person information, emergency contacts, and notification settings, and the output is setting completion. Specifically, the user inputs the required information into the app form and presses the "Settings Complete" button.

[0355] Step 4:

[0356] While the device is attached, it uses a GPS module to collect location data. The input is a GPS signal, and the output is location data. Specifically, the GPS module updates the location information every 5 seconds and stores it in its internal memory.

[0357] Step 5:

[0358] The device uses a camera to capture images of the surroundings in real time and stores the image data in memory. The input is the surrounding image and the output is the image data. Specifically, the camera captures video images of the surroundings of the device and stores them in memory frame by frame.

[0359] Step 6:

[0360] The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. The input is location information data and video data, and the output is the transmission of compressed data. Specifically, the compression algorithm compresses the data, and the network module sends the data to the server.

[0361] Step 7:

[0362] The server passes the received location information and video data to an analysis program, which uses an AI algorithm to determine compliance with regulations. The input is location information data and video data, and the output is compliance status data. Specifically, the analysis software analyzes the data and recognizes traffic lights and sidewalks.

[0363] Step 8:

[0364] The server passes the video data to the emotion engine, which analyzes the user's facial expressions and voice to recognize their psychological state. The input is video data, and the output is psychological state data. Specifically, the emotion engine uses a facial expression recognition algorithm to analyze the video and generate results.

[0365] Step 9:

[0366] The server integrates regulatory compliance status data and psychological state data to detect abnormal behavior. The inputs are regulatory compliance status data and psychological state data, and the output is abnormal behavior detection data. Specifically, the server uses an integrated algorithm to analyze the data and identify abnormalities.

[0367] Step 10:

[0368] When the server detects abnormal behavior, it immediately generates an alert message and sends it to the specified contacts. The input is the abnormal behavior detection data, and the output is the sending of the alert message. Specifically, the alert system generates a message and sends a notification to the contacts via the communication module.

[0369] Step 11:

[0370] If the agent obeys traffic rules, the server awards training points to the agent in the virtual environment and notifies the user of the feedback. The input is regulatory compliance data and psychological state data, and the output is training points and a notification. Specifically, the game management software calculates the points and sends a notification to the user's app.

[0371] (Application example 2)

[0372] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0373] The present invention relates to a system for ensuring the safe movement of children and the elderly. In particular, conventional systems only detect abnormalities based on location information and video data, and do not take into account the emotional state of the user, which limits their ability to detect abnormalities early and respond to emergencies. As a result, there is a problem of an increased risk of dangerous situations occurring.

[0374] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring location information, means for capturing video of the surroundings, means for transmitting the acquired location information and video to the server, means for analyzing the location information and video in the server and determining compliance with traffic rules, means for managing the growth of characters in the game based on compliance with traffic rules, means for detecting abnormalities in the location information and sending an alert, means for analyzing emotions, means for detecting abnormalities based on the emotion analysis results, and means for sending an alert to an emergency contact when an abnormality is detected. This makes it possible to monitor the user's emotional state in real time, detect abnormalities more quickly and accurately, and improve safety.

[0375] "Means for acquiring location information" refers to technology or devices that use a GPS module or other location information acquisition device to acquire the current location data of a target.

[0376] "Means for capturing images of the surroundings" refers to technology or devices that use a camera such as a small camera or video camera to capture images of the surroundings of a target.

[0377] "Means for transmitting to a server" refers to a technology or device that uses a communication module or an internet line to transmit acquired data to a server.

[0378] "Means for determining compliance with traffic rules" refers to technologies and devices that use analytical software and AI algorithms on a server to analyze acquired video data and location information to check whether traffic rules are being followed.

[0379] "Means for managing the growth of in-game characters" refers to technology or devices that use game management software in the server to update and manage the growth of in-game characters in real time based on user behavior.

[0380] "Means for detecting abnormalities in location information and sending alerts" refers to technology or devices that analyze acquired location information and, if abnormal behavior (e.g., sudden movement or prolonged stationary status) is detected, generate an alert message and send it to an emergency contact.

[0381] "Means for analyzing emotions" refers to technology or equipment that uses emotion analysis software or AI algorithms stored on a server to analyze the subject's emotional state (e.g., happy, sad, anxious, etc.) from the acquired video data.

[0382] "Means for sending an alert to an emergency contact when an abnormality is detected" refers to technology or equipment that immediately sends an alert message to a designated emergency contact when an abnormality is detected as a result of emotion analysis or location information analysis.

[0383] The present invention relates to a security system for ensuring the safe movement of children and the elderly, and in particular to a system that analyzes the user's emotional state to enable earlier and more accurate abnormality detection and emergency response.

[0384] System configuration

[0385] This system consists of the following elements:

[0386] Means for obtaining location information (GPS module): Used to obtain location information with high accuracy.

[0387] A means of capturing images of the surroundings (small cameras): Capture images of the environment in real time as you move and collect that data.

[0388] Means for sending to the server (communication module): A module for compressing location information and video and sending it to the server.

[0389] Means for determining compliance with traffic rules (analysis software on the server): Analysis software running on a server connected to the Internet is used to recognize traffic lights, crosswalks, etc. and determine compliance with traffic rules.

[0390] A means of managing in-game character growth (game management software on the server): updating character growth in real time and providing feedback to the user.

[0391] A means of detecting abnormalities in location information and sending alerts (alert system within the server): Detects abnormalities such as sudden changes in acquired location information or prolonged periods of stationary motion, and sends an alert to emergency contacts.

[0392] Means for analyzing emotions (emotion analysis module): Analyzes the user's emotional state from video data.

[0393] A means of sending an alert to an emergency contact when an abnormality is detected (server alert system): When an abnormality is detected based on the results of emotion analysis, etc., an alert message is sent to the designated emergency contact.

[0394] System Operation

[0395] Initial Setup

[0396] 1. The user (parent or family member) installs the application on their smartphone and creates an account by entering their email address and password.

[0397] 2. The user registers the device within the application, scanning the QR code or serial number to add the device to the system.

[0398] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0399] Real-time monitoring and analysis

[0400] 1. The device acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0401] 2. The device uses a camera to capture images of the surrounding area in real time and stores the image data in memory.

[0402] 3. The device compresses the acquired location information and video data and sends it to the server via the communication module.

[0403] Traffic rule compliance and emotion analysis

[0404] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[0405] 2. The server passes the obtained video data to an emotion analysis module, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[0406] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[0407] Managing game elements

[0408] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[0409] 2. The emotion analysis module adjusts the training points and incentives based on the emotional data it recognizes. For example, if a child seems to be having fun, it will give them more points to increase their sense of security.

[0410] Anomaly detection and alerts

[0411] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[0412] 2. The server also uses the results of emotion analysis and immediately generates an alert message if it determines that there is an abnormality.

[0413] 3. The server sends an alert message to the designated emergency contact via smartphone push notification or email.

[0414] Specific examples

[0415] For children

[0416] 1. The user attaches the device to their child's school bag and starts the device with the application.

[0417] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0418] 3. The device compresses the location information and video data and sends them to the server.

[0419] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping at the correct traffic light.

[0420] 5. The server analyzes the video data to recognize the child's emotional state.

[0421] 6. The server will award points to the character based on whether the rules were followed correctly and depending on the character's emotional state, and notify the user.

[0422] For elderly people

[0423] 1. The user attaches the device to the elderly person's clothing when they go out.

[0424] 2. The device sends location information and video data to the server.

[0425] 3. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data to recognize the emotional state.

[0426] 4. If the server detects an abnormality, it will send an immediate alert to emergency contacts.

[0427] 5. Users receive alerts and can respond quickly.

[0428] Prompt Sentence Examples

[0429] "Please create a program that sends the child's location information and surrounding video data to the API server, analyzes their compliance with traffic rules and emotional state, and detects abnormalities."

[0430] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0431] Step 1:

[0432] A user installs a smartphone application and creates an account. The user enters an email address and password and registers basic information to begin using the service. The input data is user information, and the output is account creation and device initial setup information.

[0433] Step 2:

[0434] Users register their devices within the application, either by scanning a QR code or serial number to add the device to the system. The input data is the device's identity, and the output is the user whose device is registered in the system and will be monitored.

[0435] Step 3:

[0436] Users input information about the target person (children or elderly), emergency contacts, and notification settings, and then configure the AI ​​to check traffic rules and set up in-game characters. The input data is personal information and setting information, and the output is a notification that monitoring is ready to begin and system setting information.

[0437] Step 4:

[0438] The device acquires location information while worn. It uses a GPS module to collect current location data every 5 seconds. The input is a GPS signal, and the output is the coordinate data of the current location.

[0439] Step 5:

[0440] The device captures images of the surrounding area in real time with a camera and stores the image data in memory. The input is visual information from the scene, and the output is image data.

[0441] Step 6:

[0442] The location information and video data acquired by the device are compressed every 30 seconds and sent to the server via the communication module. The input is the location information and video data, and the output is the compressed data sent to the server.

[0443] Step 7:

[0444] The server passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements and determine whether traffic rules are being followed. The input is location information and video data, and the output is data on traffic rule compliance.

[0445] Step 8:

[0446] The server passes the video data to the emotion analysis module, which analyzes the facial expressions and speech of the user (children or elderly) to recognize their emotions. The input is the video data, and the output is the emotion analysis results.

[0447] Step 9:

[0448] The server combines the analyzed emotion data with data on compliance with traffic rules to make it easier to detect abnormal behavior. The input is traffic rule compliance data and emotion analysis results, and the output is anomaly detection data.

[0449] Step 10:

[0450] If the server observes traffic rules, it awards training points to the in-game character. The game management software in the server updates the character's growth in real time and provides feedback to the user. The input is traffic rule compliance data, and the output is character growth data.

[0451] Step 11:

[0452] The emotion analysis module adjusts the training points and incentives based on the emotional data recognized by the module. For example, if a child appears to be having fun, more points are awarded to increase the child's sense of security. The input is emotional data, and the output is the adjusted training points.

[0453] Step 12:

[0454] The server analyzes the fluctuation data of location information and detects anomalies that meet certain conditions (e.g., no movement for a certain period of time, sudden movement). The input is location information data, and the output is anomaly detection data.

[0455] Step 13:

[0456] The server uses the emotion analysis results and immediately generates an alert message if an anomaly is detected. The input is the anomaly detection data and emotion data, and the output is an alert message.

[0457] Step 14:

[0458] The server sends an alert message to the designated emergency contact. The notification is sent via smartphone push notification or email. The input is the alert message, and the output is the alert notification sent to the emergency contact.

[0459] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0460] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0461] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0462] [Second embodiment]

[0463] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0464] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0465] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0466] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0467] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0468] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0469] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0470] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0471] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0472] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0473] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0474] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0475] The present invention is a monitoring system for the purpose of ensuring the safe travel of children to and from school and preventing elderly people from wandering away, and is configured and operated as follows.

[0476] System configuration

[0477] This system consists of the following elements:

[0478] Means of obtaining location information (GPS module)

[0479] A means of capturing images of the surrounding area (small camera)

[0480] A communication module that sends data to the server

[0481] A means of determining compliance with traffic rules (analysis software on the server)

[0482] A means of managing in-game character growth (game management software on the server)

[0483] A means of detecting anomalies and sending alerts (server alert system)

[0484] System Operation

[0485] Initial Setup

[0486] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0487] 2. Users register their Mamorun Cam device within the app by scanning the QR code or serial number to add the device to the system.

[0488] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0489] Real-time monitoring and analysis

[0490] 1. The device (Mamorun Cam) acquires location information while worn, collects current location data using a GPS module, and captures images of the surrounding area in real time using a camera.

[0491] 2. The device compresses the location information and video data at specific intervals and sends them to the server.

[0492] 3. The server analyzes the received data and determines compliance with traffic rules. It uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and evaluates whether children stop correctly at traffic lights and cross only when the pedestrian light is green.

[0493] Managing game elements

[0494] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time, giving users a sense of accomplishment in the game.

[0495] 2. Users (children) can check the character's progress on a smartphone app and enjoy it as an incentive.

[0496] Anomaly detection and alerts

[0497] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[0498] 2. When the server detects an abnormality, it immediately generates an alert message and sends a notification to registered contacts, allowing parents and family members to respond promptly.

[0499] Specific examples

[0500] Example of children going to school

[0501] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[0502] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0503] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[0504] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[0505] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[0506] Examples of elderly people wandering

[0507] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[0508] 2. The device transmits the acquired location information and video data to the server in real time.

[0509] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family member's smartphone.

[0510] 4. Users receive alerts and can respond quickly.

[0511] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away.

[0512] The processing flow will be explained below.

[0513] Step 1:

[0514] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0515] Step 2:

[0516] Users register devices within the app by scanning a QR code or serial number to add the device to the system.

[0517] Step 3:

[0518] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0519] Step 4:

[0520] The device (apparatus) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0521] Step 5:

[0522] The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[0523] Step 6:

[0524] The terminal compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[0525] Step 7:

[0526] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[0527] Step 8:

[0528] Based on the analysis results, the server evaluates whether the child is following traffic rules, checking whether they are stopping at red lights or crossing the street when the light is green.

[0529] Step 9:

[0530] The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and stores the results in a database.

[0531] Step 10:

[0532] The server analyzes the location information fluctuation data and immediately generates an alert message if an abnormality occurs (e.g., no movement for a certain period of time, sudden movement).

[0533] Step 11:

[0534] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[0535] Step 12:

[0536] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[0537] Example 1

[0538] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0539] Conventional monitoring systems only handle location information and video data, and are inadequate in analyzing the data, determining compliance with traffic rules, and providing feedback to users. Emergency response can be delayed, making it difficult to detect wandering or dangerous behavior early. Furthermore, there was a lack of a way to provide attractive incentives for children while ensuring their safety on their way to and from school.

[0540] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0541] In this invention, the server includes: means for acquiring location information; means for capturing surrounding images; means for transmitting the acquired location information and images to the server; means for analyzing the location information and images in the server and determining compliance with traffic rules; means for managing character growth based on compliance with traffic rules; means for detecting abnormalities in the location information and sending alerts; means for creating accounts and registering devices; means for compressing the location information and image data at regular intervals; means for awarding points to characters based on compliance with traffic rules and updating character growth in real time; and means for instantly generating an alert message and sending it to an emergency contact when an abnormality is detected. This solves conventional problems, effectively supports children's commutes to and from school, and prevents elderly people from wandering, thereby improving safety. Furthermore, in-game character growth can be used to motivate children to comply with traffic rules.

[0542] "Location information" is data that indicates the geographic location of a particular object, obtained by GPS or other location information acquisition means.

[0543] "Video data" is data containing visual information of the surroundings captured by the device's camera.

[0544] The "transmission means" is a communication module for transferring the acquired location information and video data to a server via a network.

[0545] The "means for determining compliance with traffic rules" refers to a technology that uses analytical software and AI algorithms stored on a server to determine whether traffic rules such as traffic lights, pedestrian signals, and crosswalks are being properly followed.

[0546] The "means for managing character growth" is a system that awards development points to in-game characters when traffic rules are followed, and updates their growth in real time.

[0547] The "means for detecting abnormalities and sending alerts" is a system that analyzes sudden changes in location information or long periods of stationary motion, and sends a notification to emergency contacts if an abnormality is detected.

[0548] "Means for creating an account and registering a device" refers to a function that allows a user to create an account using a smartphone app and register a monitoring device in the system.

[0549] An "interval" is a time interval set when acquiring or transmitting location information and video data.

[0550] The "compression means" is a technology for compressing the acquired location information and video data in order to reduce the volume and efficiently transmit the data to the server.

[0551] An "alert message" is a notification containing information about a detected abnormality, and is a message that is immediately sent to an emergency contact.

[0552] This invention is a monitoring system aimed at ensuring the safety of children going to and from school and preventing elderly people from wandering away. This system includes a means for acquiring location information (GPS module), a means for capturing surrounding images (small camera), a communication means for sending data to a server (communication module), a means for determining compliance with traffic rules (analysis software in the server), a means for managing in-game character growth (game management software in the server), and a means for detecting abnormalities and sending alerts (server alert system).

[0553] System configuration

[0554] The entire system consists of three components: a user (e.g., parent or family member) terminal (monitoring device), and a server. As a specific example, the following hardware and software are used:

[0555] GPS module: for obtaining location information

[0556] Small camera: for capturing surrounding footage

[0557] Communication module: for data transmission

[0558] Analysis software on the server: Determining whether traffic rules are being followed

[0559] Server game management software: Character growth management

[0560] Server alert system: Anomaly detection and alert sending

[0561] Program Details

[0562] The system works as follows: First, the user installs the smartphone app and creates an account. They create the account by entering their email address and password, then register the device. They add the monitoring device to the system by scanning the QR code or serial number. Then, they enter information about the child or elderly person, emergency contacts, and notification settings in the app.

[0563] Next, while the monitoring device is worn, it acquires location information using a GPS module and captures real-time images of the surrounding area using a small camera. The acquired data is compressed at regular intervals and sent to a server via a communications module. The server analyzes the received data and uses an AI algorithm to determine compliance with traffic rules. Specifically, it recognizes traffic lights, crosswalks, and pedestrian movements and evaluates whether the behavior was correct.

[0564] Additionally, if traffic rules are followed, the game management software will award character development points. Character growth is updated in real time, giving users a sense of accomplishment. If any abnormalities, such as abnormal behavior or prolonged inactivity, are detected, the server will immediately generate an alert message and send a notification to registered contacts.

[0565] Specific examples

[0566] Example of children going to school

[0567] 1. The user (parent) attaches the monitoring device to their child's school bag and activates the device using the app.

[0568] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0569] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[0570] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[0571] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[0572] Examples of elderly people wandering

[0573] 1. The user (family member) attaches the monitoring device to the clothing of the elderly person when they go out.

[0574] 2. The device transmits the acquired location information and video data to the server in real time.

[0575] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family's smartphone.

[0576] 4. Users receive alerts and can respond quickly.

[0577] Prompt Sentence Examples

[0578] "Please explain the system in which a monitoring device attached to a child's school bag compresses and sends GPS-acquired location information and camera footage to a server, and then uses AI to analyze whether traffic rules are being followed."

[0579] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0580] Step 1: The user creates an account.

[0581] Specific operation: The user opens the app on their smartphone and selects "Create a new account." They enter their email address and password and click the "Register" button. Input: Email address, password. Output: A message confirming the creation of a new account.

[0582] Data processing: The user's input information is sent to the server, and a new account is created in the user database.

[0583] Step 2: The user registers the device.

[0584] What happens: The user selects the "Register Device" section in the app and either scans the device's QR code with the camera or manually enters the serial number. Input: QR code or serial number. Output: Device registration confirmation message.

[0585] Data processing: The registered QR code or serial number is sent to the server and stored in the device database.

[0586] Step 3: The user enters the target person's information and emergency contact information.

[0587] Specific operation: The user enters the name, age, emergency contact information, etc. of a child or elderly person into the app and clicks the "Save" button. Input: Information about the person, emergency contact information. Output: A message confirming that the information has been saved.

[0588] Data processing: The entered information is sent to the server and stored in association with the user profile.

[0589] Step 4: The device acquires location information.

[0590] Specific operation: When the device is worn, the GPS module is activated and the current location information is obtained every 5 seconds. Input: GPS signal. Output: Location information data.

[0591] Data processing: Location information is temporarily stored on the device.

[0592] Step 5: The device captures video of the surrounding area.

[0593] Specific operation: The device activates a small camera and captures surrounding images in real time. Input: Camera image. Output: Video data.

[0594] Data processing: Video data is temporarily stored in the cache.

[0595] Step 6: The terminal compresses and transmits the data.

[0596] Specific operation: The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. Input: location information, video data. Output: compressed data.

[0597] Data processing: Data compression is performed within the terminal, and the compressed data is sent to the server.

[0598] Step 7: The server parses the data.

[0599] How it works: The server passes the received data to analysis software, which uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements. Input: Compressed data. Output: Analysis results.

[0600] Data processing: AI algorithms analyze the compressed data and determine compliance with traffic rules.

[0601] Step 8: The server manages the character's progression.

[0602] Specific operation: If traffic rules are followed, the server will award character development points through the game management software and update the character's development status in real time. Input: Analysis results. Output: Development points, development update notification.

[0603] Data processing: Based on the analysis results, the character's growth points are calculated and notified to the user's app.

[0604] Step 9: The server detects the anomaly and sends an alert.

[0605] Specific operation: When the server detects a sudden change in location information or a long period of inactivity, it immediately generates an alert message and notifies the registered emergency contacts. Input: Location information data. Output: Alert message.

[0606] Data processing: Based on the location analysis results, an alert is generated and sent to emergency contacts.

[0607] (Application example 1)

[0608] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0609] Ensuring the safety of children and the elderly has become a critical issue in modern society. There are many cases of children and the elderly getting lost outside designated areas, especially when out shopping or dining in a brick-and-mortar store. Furthermore, conventional systems have difficulty acquiring real-time location information and video footage, detecting abnormalities, and quickly addressing them. As a result, parents are unable to respond quickly, causing anxiety for both the parents and the elderly. In addition, there is a need for a system that combines safety measures with game elements to help users act safely while having fun.

[0610] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0611] In this invention, the server includes a means for acquiring location information, a means for capturing video of the surrounding area, a means for transmitting the acquired location information and video to the server, a means for analyzing the location information and video in the server and determining compliance with traffic rules, a means for managing the development of a character in the game based on compliance with traffic rules, a means for detecting abnormalities in the location information and sending an alert, a means for sending an alert when the user leaves a designated area within the store, a means for compressing the target's location information and video at intervals and sending the compressed video to the server, a means for detecting abnormalities in the server and instantly generating an alert message, and a means for detecting pedestrian signals and evaluating compliance with traffic rules. This allows a prompt warning to be issued when the target leaves the designated area, enabling parents to respond quickly. Furthermore, the game elements can provide the fun of following traffic rules, increasing the incentive to act safely.

[0612] A "means for obtaining location information" is a device or mechanism that uses GPS or other location measurement technology to accurately obtain the subject's current location.

[0613] "Means for capturing images of the surroundings" refers to a device or mechanism that uses a camera or other image capturing device to capture images of a specified area in real time and saves or transmits the data.

[0614] The "means for transmitting the acquired location information and video to a server" refers to a device or mechanism for transmitting the acquired location information and video data to a remote server using a communication module or an internet line.

[0615] "Means for analyzing location information and video on a server and determining compliance with traffic rules" refers to a device or mechanism that uses analysis software or algorithms on a server to analyze received location information and video data and evaluate whether the subject is complying with traffic rules.

[0616] "Means for managing the growth of a character in a game based on compliance with traffic rules" refers to software or a mechanism that controls the growth and evolution of a character in a game when a subject complies with traffic rules.

[0617] "Means for detecting abnormalities in location information and sending alerts" refers to a device or mechanism that monitors fluctuations or abnormalities in location information data and sends a warning or alert to designated contacts when certain conditions are met.

[0618] "Means for sending an alert when a person leaves a designated area within the store" refers to a device or mechanism that issues an alarm and sends a notification to a parent or guardian or manager when a person leaves a designated safe area within the store.

[0619] "Means for compressing the subject's location information and video at intervals and transmitting them to a server" refers to a device or mechanism for compressing the location information and video data at a specified time interval and transmitting them efficiently to a server.

[0620] "Means for detecting abnormalities on the server and immediately generating an alert message" refers to a device or mechanism that analyzes data received on the server side, and immediately creates an alert message when an abnormality is detected, and notifies the specified contacts.

[0621] "Means for detecting pedestrian signals and assessing compliance with traffic rules" refers to software or algorithms that recognize pedestrian signals from video data and assess whether the subject is complying with traffic rules when passing through the signal.

[0622] This invention is a system that supports safe behavior of subjects (children and the elderly). A detailed implementation method of this system is described below.

[0623] System configuration

[0624] This system consists of the following hardware and software:

[0625] Hardware

[0626] GPS module: Used to obtain the subject's current location. An example is the Ublox NEO-6M.

[0627] Small cameras: used to capture video of the subject's surroundings. An example is the Raspberry Pi Camera Module.

[0628] Communication module: Used to send data to the server. An example is a GSM module.

[0629] software

[0630] Location information analysis software: Software for analyzing acquired location information. For example, custom software using Python.

[0631] Video analysis software: AI algorithms for analyzing captured video. Examples include TensorFlow and OpenCV.

[0632] Server: Used for data analysis and management. An example is AWS EC2.

[0633] Alert system: Software that generates alerts and notifies you when an abnormality is detected.

[0634] Game management software: Software that manages the growth of in-game characters based on compliance with traffic rules.

[0635] System Operation

[0636] The server receives the acquired location information and video data and performs processing in the following procedure.

[0637] 1. Location information acquisition: The device acquires the subject's current location using the GPS module, and the data is sent to the server at specific intervals.

[0638] 2. Video capture and transmission: A small camera captures the surroundings and transmits the captured video synchronously to the server. This process is repeated every interval.

[0639] 3. Data analysis: The server analyzes the received location information and video data. The location analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation.

[0640] 4. Traffic rule compliance assessment: The server assesses compliance with traffic rules based on the analysis results. It recognizes pedestrian signals and determines whether the vehicle is stopping correctly at traffic lights or crossing the street when the light is green.

[0641] 5. Character growth management and incentives: When traffic rules are followed, the game management software will award growth points to the in-game character and update the character's growth in real time. The results will be sent to the user's (parents' or guardians') smartphone, which can be enjoyed as an incentive.

[0642] 6. Anomaly detection and alerts: The server monitors location information for sudden changes or periods of inactivity, and if an anomaly is detected, it immediately generates an alert message and sends a notification to emergency contacts.

[0643] Specific examples

[0644] For example, if a child strays from a designated area within a store, the server-side analysis software will determine this as an abnormality and immediately send an alert to the parent or store staff's smartphone, allowing for a prompt response.

[0645] Example prompt sentence:

[0646] "I want to develop an application that analyzes location information and video data and sends an alert if the user goes outside a specified range."

[0647] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0648] Step 1:

[0649] The device uses a GPS module to obtain the subject's current location. The device sends the obtained location information to the server at regular intervals (e.g., every 30 seconds). In this case, the input is the location data from the GPS module, and the output is the location information sent to the server.

[0650] Step 2:

[0651] The device uses a small camera to capture images of the surrounding area. The device transmits the image data to the server at intervals, similar to the location information. In this case, the input is the image data from the camera, and the output is the image data transmitted to the server.

[0652] Step 3:

[0653] The server analyzes the received location information and video data. The location information analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation from the video data. The inputs are location information and video data, and the output is location evaluation information and video analysis information as the analysis results.

[0654] Step 4:

[0655] The server determines whether or not traffic rules are being followed based on the analysis results. The analysis software recognizes pedestrian signals and determines whether the subject stops correctly at the traffic light or crosses the street when the light is green. The input is the analysis results, and the output is the determination of whether or not the subject is following traffic rules.

[0656] Step 5:

[0657] If traffic rules are followed, the server will award training points to the in-game character through the game management software. The server will then notify the user (parent or guardian) of this result via their smartphone. The input is the result of compliance, and the output is character growth information and a notification to the user.

[0658] Step 6:

[0659] The server monitors location information for sudden changes or stationary periods. If the server detects an abnormality, it immediately generates an alert message and sends a notification to emergency contacts. The input is location information change data, and the output is the generated alert message.

[0660] Step 7:

[0661] The device compresses the location information and video data at intervals and sends them to the server. This improves data transfer efficiency. The input is location information and video data, and the output is compressed data.

[0662] Step 8:

[0663] The server sends an alert if the target person goes outside the specified range. The server monitors the target person's current location based on the received location information, and if the target person goes outside the range, it issues a warning and notifies the parent or administrator. In this case, the input is location information and the output is an alert message.

[0664] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0665] The present invention combines a monitoring system aimed at ensuring children's safety on their way to and from school and preventing elderly people from wandering away with an emotion engine that recognizes the user's emotions, and is configured and operated as follows.

[0666] System configuration

[0667] This system consists of the following elements:

[0668] Means of obtaining location information (GPS module)

[0669] A means of capturing images of the surrounding area (small camera)

[0670] A communication module that sends data to the server

[0671] A means of determining compliance with traffic rules (analysis software on the server)

[0672] A means of managing in-game character growth (game management software on the server)

[0673] A means of detecting anomalies and sending alerts (server alert system)

[0674] Emotion engine that recognizes user emotions

[0675] System Operation

[0676] Initial Setup

[0677] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0678] 2. Users register their Mamorun Cam device within the app by scanning the QR code or serial number to add the device to the system.

[0679] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0680] Real-time monitoring and analysis

[0681] 1. The device (Mamorun Cam) acquires location information while worn and collects current location data using the GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0682] 2. The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[0683] 3. The device compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[0684] Traffic rule compliance and emotion analysis

[0685] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[0686] 2. The server passes the obtained video data to the emotion engine, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[0687] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[0688] Managing game elements

[0689] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[0690] 2. Adjust the training points and incentives based on the emotional data recognized by the emotion engine. For example, if the child seems to be having fun, give them more points to increase their sense of security.

[0691] Anomaly detection and alerts

[0692] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[0693] 2. The server also uses the emotion data recognized by the emotion engine and immediately generates an alert message if it determines that there is an abnormality.

[0694] 3. The server sends an alert message to the designated contacts via smartphone push notification or email.

[0695] Specific examples

[0696] Example of children going to school

[0697] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[0698] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0699] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[0700] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[0701] 5. The server analyzes the video data using an emotion engine to recognize the child's emotional state.

[0702] 6. The server awards points to the in-game character based on whether the rules were followed correctly and the character's emotional state, and notifies the user's app.

[0703] Examples of elderly people wandering

[0704] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[0705] 2. The device transmits the acquired location information and video data to the server in real time.

[0706] 3. The server detects sudden changes in location information and long periods of stillness, and analyzes the video data using an emotion engine.

[0707] 4. The server determines abnormalities based on the elderly person's emotional state and location data, and sends a notification to emergency contacts if an alert is necessary.

[0708] 5. Users receive alerts and can respond quickly.

[0709] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[0710] The processing flow will be explained below.

[0711] Step 1:

[0712] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0713] Step 2:

[0714] Users register their Mamorun Cam device within the app by scanning the QR code or serial number and adding the device to the system.

[0715] Step 3:

[0716] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0717] Step 4:

[0718] The device (Mamorun Cam) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0719] Step 5:

[0720] The device captures images of the surroundings in real time using a camera. The device stores the image data in memory and compresses it at specific intervals (e.g., every 30 seconds).

[0721] Step 6:

[0722] The terminal transmits the compressed location information and video data to the server via the communication module.

[0723] Step 7:

[0724] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[0725] Step 8:

[0726] The server passes the video data to an emotion engine, which analyzes the facial expressions and speech of the user (children or elderly people) to recognize their emotions.

[0727] Step 9:

[0728] The server combines the analyzed emotional data with compliance with traffic rules to increase the probability of detecting abnormal behavior.

[0729] Step 10:

[0730] The server assigns training points to in-game characters based on traffic rule compliance and emotional data. Game management software on the server updates the character's growth in real time and stores the results in a database.

[0731] Step 11:

[0732] The server analyzes location fluctuation data and emotional data to detect abnormalities (e.g., not moving for a certain period of time, or sudden movement).

[0733] Step 12:

[0734] The server also uses emotion data to determine abnormalities and immediately generates an alert message, which includes the specific details of the abnormality, location information, and emotional state.

[0735] Step 13:

[0736] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[0737] Step 14:

[0738] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[0739] Step 15:

[0740] Users (children) can check the progress of their in-game characters on their smartphone app and enjoy it as an incentive to follow traffic rules.

[0741] Example 2

[0742] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0743] Conventional location information acquisition systems and surveillance systems simply acquire and analyze location information and video data, making it difficult to grasp the user's psychological state or more precisely detect abnormal behavior. Furthermore, they lack a mechanism for sending emergency notifications based on accurate information quickly when abnormal behavior occurs. Furthermore, they lack a function for linking the growth of an agent in the system's virtual environment to the user's psychological state, making it difficult to maintain the user's interest and motivation.

[0744] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0745] In this invention, the server includes means for detecting anomalies in location information and sending an alert, means for recognizing the user's psychological state, and means for detecting abnormal behavior by integrating the acquired psychological state with compliance with regulations, thereby enabling precise detection of abnormal behavior that takes the user's psychological state into consideration and rapid transmission of emergency notifications.

[0746] "Means for obtaining location information" refers to a system or device for measuring the subject's current location and obtaining that data.

[0747] "Means for capturing video of the surroundings" refers to a camera or other device that captures video of the subject's surroundings in real time.

[0748] "Server" refers to a computer system that collects, analyzes, stores, and transmits data over a network.

[0749] "Means for transmitting to a server" refers to a communication module or network connection means for transmitting the acquired location information and video data to a server.

[0750] "Means for determining compliance with regulations" refers to analytical software or algorithms that analyze acquired data to determine whether traffic rules or other regulations are being complied with.

[0751] "Means for managing the growth of agents within a virtual environment" refers to software and data management systems for managing the growth and development of agents operating in a virtual environment within the system.

[0752] "Means for detecting location anomalies and sending alerts" refers to a system that detects unusual location changes or inactivity and sends warnings or notifications based on that information.

[0753] "Means for recognizing the user's psychological state" refers to software or algorithms for analyzing and recognizing the user's psychological state from facial expressions, voice, behavior, etc.

[0754] "Means for detecting abnormal behavior" refers to a system that integrates acquired data with perceived psychological states to detect unusual behavioral patterns.

[0755] "Means for sending emergency notifications" means communications systems or software that rapidly send alerts or notifications to designated contacts when abnormal behavior is detected.

[0756] The present invention is a monitoring system for the purpose of ensuring the safety of children going to and from school and preventing elderly people from wandering away, and is also combined with an emotion engine that recognizes the user's psychological state. This system is configured and operated as follows.

[0757] System configuration

[0758] This system consists of the following elements:

[0759] Means of obtaining location information (GPS module)

[0760] A means of capturing images of the surrounding area (small camera)

[0761] A communication module that sends data to the server

[0762] A means of determining compliance with regulations (analysis software on the server)

[0763] A means of managing the growth of agents in the virtual environment (game management software in the server)

[0764] A means of detecting anomalies and sending alerts (server alert system)

[0765] Emotion engine that recognizes the user's mental state

[0766] Initial Setup

[0767] First, users install the smartphone application and create an account by entering their email address and password. Next, they register the device within the app by scanning a QR code or serial number and adding it to the system. Finally, they enter information about the target person (children or elderly), emergency contacts, and notification settings, and then perform AI-based regulatory checks and configure agents in the virtual environment.

[0768] Real-time monitoring and data transmission

[0769] While the device is attached, it uses a GPS module to collect location data. It typically updates its location every five seconds and captures real-time images of the surrounding area with its camera, saving them to memory. This location information and video data is compressed every 30 seconds and sent to a server via a communications module.

[0770] Data analysis by server

[0771] The server passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic lights, sidewalks, and other regulatory objects and determine compliance with regulations. The server also passes the obtained video data to an emotion engine, which analyzes the user's (children or elderly) facial expressions and voice to recognize their psychological state. This analysis combines psychological state with compliance with regulations, enabling more precise detection of abnormal behavior.

[0772] Managing game elements

[0773] If the server complies with the regulations, it will award training points to the agent in the virtual environment. The game management software on the server updates the agent's growth in real time and provides feedback to the user. Furthermore, the emotion engine adjusts training points and incentives based on the agent's psychological state. For example, if a child appears to be having fun, it will be awarded more points, increasing their motivation.

[0774] Anomaly detection and alert sending

[0775] The server analyzes location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement). It also uses the psychological state recognized by the emotion engine and immediately generates an alert message if it determines that an abnormality exists. Finally, the server sends the alert message to designated contacts, and notifications are sent via smartphone push notifications or email, allowing users to respond promptly.

[0776] Specific examples

[0777] Example of children going to school

[0778] The user (parent) attaches the device to their child's school bag and activates it with the app. The device obtains location information every five seconds using a GPS module and captures images of the surrounding area using a camera. Every 30 seconds, the location information and video data are compressed and sent to the server. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light. The server also analyzes the video data using an emotion engine to recognize the child's psychological state. Points are awarded to the agent in the virtual environment depending on whether the rules are followed correctly and the child's psychological state, and a notification is sent to the user's app.

[0779] Examples of elderly people wandering

[0780] The user (family member) attaches the device to the elderly person's clothing when they go out. The device sends location information and video data to a server in real time. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data using an emotion engine. It determines abnormalities based on the elderly person's psychological state and location data, and sends an alert to emergency contacts if necessary. The user receives the alert and can respond quickly.

[0781] Prompt Sentence Examples

[0782] Enter the following prompt into the generative AI model:

[0783] "Please tell me about the system for monitoring children's safety on their way to and from school. I would like to know whether the children cross the street correctly at traffic lights and their psychological state."

[0784] or

[0785] "I would like to know how we can be notified if an elderly person wanders off while out. Please explain how the system works, including psychological analysis."

[0786] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[0787] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0788] Step 1:

[0789] A user installs the app on their smartphone and creates an account by entering their email address and password. The input is an email address and password, and the output is the creation of a new account. Specifically, the user enters the information as instructed by the app and presses the registration button.

[0790] Step 2:

[0791] To register a device within the app, a user scans a QR code or serial number to add the device to the system. The input is the QR code or serial number, and the output is the device registration completion. Specifically, the user scans the QR code attached to the device with the camera.

[0792] Step 3:

[0793] The user inputs information about the target person (children or elderly), emergency contacts, and notification settings, and the AI ​​checks regulations and configures the agent in the virtual environment. The input is target person information, emergency contacts, and notification settings, and the output is setting completion. Specifically, the user inputs the required information into the app form and presses the "Settings Complete" button.

[0794] Step 4:

[0795] While the device is attached, it uses a GPS module to collect location data. The input is a GPS signal, and the output is location data. Specifically, the GPS module updates the location information every 5 seconds and stores it in its internal memory.

[0796] Step 5:

[0797] The device uses a camera to capture images of the surroundings in real time and stores the image data in memory. The input is the surrounding image and the output is the image data. Specifically, the camera captures video images of the surroundings of the device and stores them in memory frame by frame.

[0798] Step 6:

[0799] The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. The input is location information data and video data, and the output is the transmission of compressed data. Specifically, the compression algorithm compresses the data, and the network module sends the data to the server.

[0800] Step 7:

[0801] The server passes the received location information and video data to an analysis program, which uses an AI algorithm to determine compliance with regulations. The input is location information data and video data, and the output is compliance status data. Specifically, the analysis software analyzes the data and recognizes traffic lights and sidewalks.

[0802] Step 8:

[0803] The server passes the video data to the emotion engine, which analyzes the user's facial expressions and voice to recognize their psychological state. The input is video data, and the output is psychological state data. Specifically, the emotion engine uses a facial expression recognition algorithm to analyze the video and generate results.

[0804] Step 9:

[0805] The server integrates regulatory compliance status data and psychological state data to detect abnormal behavior. The inputs are regulatory compliance status data and psychological state data, and the output is abnormal behavior detection data. Specifically, the server uses an integrated algorithm to analyze the data and identify abnormalities.

[0806] Step 10:

[0807] When the server detects abnormal behavior, it immediately generates an alert message and sends it to the specified contacts. The input is the abnormal behavior detection data, and the output is the sending of the alert message. Specifically, the alert system generates a message and sends a notification to the contacts via the communication module.

[0808] Step 11:

[0809] If the agent obeys traffic rules, the server awards training points to the agent in the virtual environment and notifies the user of the feedback. The input is regulatory compliance data and psychological state data, and the output is training points and a notification. Specifically, the game management software calculates the points and sends a notification to the user's app.

[0810] (Application example 2)

[0811] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0812] The present invention relates to a system for ensuring the safe movement of children and the elderly. In particular, conventional systems only detect abnormalities based on location information and video data, and do not take into account the emotional state of the user, which limits their ability to detect abnormalities early and respond to emergencies. As a result, there is a problem of an increased risk of dangerous situations occurring.

[0813] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring location information, means for capturing video of the surroundings, means for transmitting the acquired location information and video to the server, means for analyzing the location information and video in the server and determining compliance with traffic rules, means for managing the growth of characters in the game based on compliance with traffic rules, means for detecting abnormalities in the location information and sending an alert, means for analyzing emotions, means for detecting abnormalities based on the emotion analysis results, and means for sending an alert to an emergency contact when an abnormality is detected. This makes it possible to monitor the user's emotional state in real time, detect abnormalities more quickly and accurately, and improve safety.

[0814] "Means for acquiring location information" refers to technology or devices that use a GPS module or other location information acquisition device to acquire the current location data of a target.

[0815] "Means for capturing images of the surroundings" refers to technology or devices that use a camera such as a small camera or video camera to capture images of the surroundings of a target.

[0816] "Means for transmitting to a server" refers to a technology or device that uses a communication module or an internet line to transmit acquired data to a server.

[0817] "Means for determining compliance with traffic rules" refers to technologies and devices that use analytical software and AI algorithms on a server to analyze acquired video data and location information to check whether traffic rules are being followed.

[0818] "Means for managing the growth of in-game characters" refers to technology or devices that use game management software in the server to update and manage the growth of in-game characters in real time based on user behavior.

[0819] "Means for detecting abnormalities in location information and sending alerts" refers to technology or devices that analyze acquired location information and, if abnormal behavior (e.g., sudden movement or prolonged stationary status) is detected, generate an alert message and send it to an emergency contact.

[0820] "Means for analyzing emotions" refers to technology or equipment that uses emotion analysis software or AI algorithms stored on a server to analyze the subject's emotional state (e.g., happy, sad, anxious, etc.) from the acquired video data.

[0821] "Means for sending an alert to an emergency contact when an abnormality is detected" refers to technology or equipment that immediately sends an alert message to a designated emergency contact when an abnormality is detected as a result of emotion analysis or location information analysis.

[0822] The present invention relates to a security system for ensuring the safe movement of children and the elderly, and in particular to a system that analyzes the user's emotional state to enable earlier and more accurate abnormality detection and emergency response.

[0823] System configuration

[0824] This system consists of the following elements:

[0825] Means for obtaining location information (GPS module): Used to obtain location information with high accuracy.

[0826] A means of capturing images of the surroundings (small cameras): Capture images of the environment in real time as you move and collect that data.

[0827] Means for sending to the server (communication module): A module for compressing location information and video and sending it to the server.

[0828] Means for determining compliance with traffic rules (analysis software on the server): Analysis software running on a server connected to the Internet is used to recognize traffic lights, crosswalks, etc. and determine compliance with traffic rules.

[0829] A means of managing in-game character growth (game management software on the server): updating character growth in real time and providing feedback to the user.

[0830] A means of detecting abnormalities in location information and sending alerts (alert system within the server): Detects abnormalities such as sudden changes in acquired location information or prolonged periods of stationary motion, and sends an alert to emergency contacts.

[0831] Means for analyzing emotions (emotion analysis module): Analyzes the user's emotional state from video data.

[0832] A means of sending an alert to an emergency contact when an abnormality is detected (server alert system): When an abnormality is detected based on the results of emotion analysis, etc., an alert message is sent to the designated emergency contact.

[0833] System Operation

[0834] Initial Setup

[0835] 1. The user (parent or family member) installs the application on their smartphone and creates an account by entering their email address and password.

[0836] 2. The user registers the device within the application, scanning the QR code or serial number to add the device to the system.

[0837] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0838] Real-time monitoring and analysis

[0839] 1. The device acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0840] 2. The device uses a camera to capture images of the surrounding area in real time and stores the image data in memory.

[0841] 3. The device compresses the acquired location information and video data and sends it to the server via the communication module.

[0842] Traffic rule compliance and emotion analysis

[0843] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[0844] 2. The server passes the obtained video data to an emotion analysis module, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[0845] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[0846] Managing game elements

[0847] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[0848] 2. The emotion analysis module adjusts the training points and incentives based on the emotional data it recognizes. For example, if a child seems to be having fun, it will give them more points to increase their sense of security.

[0849] Anomaly detection and alerts

[0850] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[0851] 2. The server also uses the results of emotion analysis and immediately generates an alert message if it determines that there is an abnormality.

[0852] 3. The server sends an alert message to the designated emergency contact via smartphone push notification or email.

[0853] Specific examples

[0854] For children

[0855] 1. The user attaches the device to their child's school bag and starts the device with the application.

[0856] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0857] 3. The device compresses the location information and video data and sends them to the server.

[0858] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping at the correct traffic light.

[0859] 5. The server analyzes the video data to recognize the child's emotional state.

[0860] 6. The server will award points to the character based on whether the rules were followed correctly and depending on the character's emotional state, and notify the user.

[0861] For elderly people

[0862] 1. The user attaches the device to the elderly person's clothing when they go out.

[0863] 2. The device sends location information and video data to the server.

[0864] 3. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data to recognize the emotional state.

[0865] 4. If the server detects an abnormality, it will send an immediate alert to emergency contacts.

[0866] 5. Users receive alerts and can respond quickly.

[0867] Prompt Sentence Examples

[0868] "Please create a program that sends the child's location information and surrounding video data to the API server, analyzes their compliance with traffic rules and emotional state, and detects abnormalities."

[0869] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0870] Step 1:

[0871] A user installs a smartphone application and creates an account. The user enters an email address and password and registers basic information to begin using the service. The input data is user information, and the output is account creation and device initial setup information.

[0872] Step 2:

[0873] Users register their devices within the application, either by scanning a QR code or serial number to add the device to the system. The input data is the device's identity, and the output is the user whose device is registered in the system and will be monitored.

[0874] Step 3:

[0875] Users input information about the target person (children or elderly), emergency contacts, and notification settings, and then configure the AI ​​to check traffic rules and set up in-game characters. The input data is personal information and setting information, and the output is a notification that monitoring is ready to begin and system setting information.

[0876] Step 4:

[0877] The device acquires location information while worn. It uses a GPS module to collect current location data every 5 seconds. The input is a GPS signal, and the output is the coordinate data of the current location.

[0878] Step 5:

[0879] The device captures images of the surrounding area in real time with a camera and stores the image data in memory. The input is visual information from the scene, and the output is image data.

[0880] Step 6:

[0881] The location information and video data acquired by the device are compressed every 30 seconds and sent to the server via the communication module. The input is the location information and video data, and the output is the compressed data sent to the server.

[0882] Step 7:

[0883] The server passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements and determine whether traffic rules are being followed. The input is location information and video data, and the output is data on traffic rule compliance.

[0884] Step 8:

[0885] The server passes the video data to the emotion analysis module, which analyzes the facial expressions and speech of the user (children or elderly) to recognize their emotions. The input is the video data, and the output is the emotion analysis results.

[0886] Step 9:

[0887] The server combines the analyzed emotion data with data on compliance with traffic rules to make it easier to detect abnormal behavior. The input is traffic rule compliance data and emotion analysis results, and the output is anomaly detection data.

[0888] Step 10:

[0889] If the server observes traffic rules, it awards training points to the in-game character. The game management software in the server updates the character's growth in real time and provides feedback to the user. The input is traffic rule compliance data, and the output is character growth data.

[0890] Step 11:

[0891] The emotion analysis module adjusts the training points and incentives based on the emotional data recognized by the module. For example, if a child appears to be having fun, more points are awarded to increase the child's sense of security. The input is emotional data, and the output is the adjusted training points.

[0892] Step 12:

[0893] The server analyzes the fluctuation data of location information and detects anomalies that meet certain conditions (e.g., no movement for a certain period of time, sudden movement). The input is location information data, and the output is anomaly detection data.

[0894] Step 13:

[0895] The server uses the emotion analysis results and immediately generates an alert message if an anomaly is detected. The input is the anomaly detection data and emotion data, and the output is an alert message.

[0896] Step 14:

[0897] The server sends an alert message to the designated emergency contact. The notification is sent via smartphone push notification or email. The input is the alert message, and the output is the alert notification sent to the emergency contact.

[0898] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0899] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0900] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0901] [Third embodiment]

[0902] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0903] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0904] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0905] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0906] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0907] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0908] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0909] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0910] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0911] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0912] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0913] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0914] The present invention is a monitoring system for the purpose of ensuring the safe travel of children to and from school and preventing elderly people from wandering away, and is configured and operated as follows.

[0915] System configuration

[0916] This system consists of the following elements:

[0917] Means of obtaining location information (GPS module)

[0918] A means of capturing images of the surrounding area (small camera)

[0919] A communication module that sends data to the server

[0920] A means of determining compliance with traffic rules (analysis software on the server)

[0921] A means of managing in-game character growth (game management software on the server)

[0922] A means of detecting anomalies and sending alerts (server alert system)

[0923] System Operation

[0924] Initial Setup

[0925] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0926] 2. Users register their Mamorun Cam device within the app by scanning the QR code or serial number to add the device to the system.

[0927] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0928] Real-time monitoring and analysis

[0929] 1. The device (Mamorun Cam) acquires location information while worn, collects current location data using a GPS module, and captures images of the surrounding area in real time using a camera.

[0930] 2. The device compresses the location information and video data at specific intervals and sends them to the server.

[0931] 3. The server analyzes the received data and determines compliance with traffic rules. It uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and evaluates whether children stop correctly at traffic lights and cross only when the pedestrian light is green.

[0932] Managing game elements

[0933] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time, giving users a sense of accomplishment in the game.

[0934] 2. Users (children) can check the character's progress on a smartphone app and enjoy it as an incentive.

[0935] Anomaly detection and alerts

[0936] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[0937] 2. When the server detects an abnormality, it immediately generates an alert message and sends a notification to registered contacts, allowing parents and family members to respond promptly.

[0938] Specific examples

[0939] Example of children going to school

[0940] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[0941] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[0942] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[0943] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[0944] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[0945] Examples of elderly people wandering

[0946] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[0947] 2. The device transmits the acquired location information and video data to the server in real time.

[0948] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family member's smartphone.

[0949] 4. Users receive alerts and can respond quickly.

[0950] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away.

[0951] The processing flow will be explained below.

[0952] Step 1:

[0953] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[0954] Step 2:

[0955] Users register devices within the app by scanning a QR code or serial number to add the device to the system.

[0956] Step 3:

[0957] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[0958] Step 4:

[0959] The device (apparatus) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[0960] Step 5:

[0961] The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[0962] Step 6:

[0963] The terminal compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[0964] Step 7:

[0965] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[0966] Step 8:

[0967] Based on the analysis results, the server evaluates whether the child is following traffic rules, checking whether they are stopping at red lights or crossing the street when the light is green.

[0968] Step 9:

[0969] The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and stores the results in a database.

[0970] Step 10:

[0971] The server analyzes the location information fluctuation data and immediately generates an alert message if an abnormality occurs (e.g., no movement for a certain period of time, sudden movement).

[0972] Step 11:

[0973] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[0974] Step 12:

[0975] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[0976] Example 1

[0977] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0978] Conventional monitoring systems only handle location information and video data, and are inadequate in analyzing the data, determining compliance with traffic rules, and providing feedback to users. Emergency response can be delayed, making it difficult to detect wandering or dangerous behavior early. Furthermore, there was a lack of a way to provide attractive incentives for children while ensuring their safety on their way to and from school.

[0979] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0980] In this invention, the server includes: means for acquiring location information; means for capturing surrounding images; means for transmitting the acquired location information and images to the server; means for analyzing the location information and images in the server and determining compliance with traffic rules; means for managing character growth based on compliance with traffic rules; means for detecting abnormalities in the location information and sending alerts; means for creating accounts and registering devices; means for compressing the location information and image data at regular intervals; means for awarding points to characters based on compliance with traffic rules and updating character growth in real time; and means for instantly generating an alert message and sending it to an emergency contact when an abnormality is detected. This solves conventional problems, effectively supports children's commutes to and from school, and prevents elderly people from wandering, thereby improving safety. Furthermore, in-game character growth can be used to motivate children to comply with traffic rules.

[0981] "Location information" is data that indicates the geographic location of a particular object, obtained by GPS or other location information acquisition means.

[0982] "Video data" is data containing visual information of the surroundings captured by the device's camera.

[0983] The "transmission means" is a communication module for transferring the acquired location information and video data to a server via a network.

[0984] The "means for determining compliance with traffic rules" refers to a technology that uses analytical software and AI algorithms stored on a server to determine whether traffic rules such as traffic lights, pedestrian signals, and crosswalks are being properly followed.

[0985] The "means for managing character growth" is a system that awards development points to in-game characters when traffic rules are followed, and updates their growth in real time.

[0986] The "means for detecting abnormalities and sending alerts" is a system that analyzes sudden changes in location information or long periods of stationary motion, and sends a notification to emergency contacts if an abnormality is detected.

[0987] "Means for creating an account and registering a device" refers to a function that allows a user to create an account using a smartphone app and register a monitoring device in the system.

[0988] An "interval" is a time interval set when acquiring or transmitting location information and video data.

[0989] The "compression means" is a technology for compressing the acquired location information and video data in order to reduce the volume and efficiently transmit the data to the server.

[0990] An "alert message" is a notification containing information about a detected abnormality, and is a message that is immediately sent to an emergency contact.

[0991] This invention is a monitoring system aimed at ensuring the safety of children going to and from school and preventing elderly people from wandering away. This system includes a means for acquiring location information (GPS module), a means for capturing surrounding images (small camera), a communication means for sending data to a server (communication module), a means for determining compliance with traffic rules (analysis software in the server), a means for managing in-game character growth (game management software in the server), and a means for detecting abnormalities and sending alerts (server alert system).

[0992] System configuration

[0993] The entire system consists of three components: a user (e.g., parent or family member) terminal (monitoring device), and a server. As a specific example, the following hardware and software are used:

[0994] GPS module: for obtaining location information

[0995] Small camera: for capturing surrounding footage

[0996] Communication module: for data transmission

[0997] Analysis software on the server: Determining whether traffic rules are being followed

[0998] Server game management software: Character growth management

[0999] Server alert system: Anomaly detection and alert sending

[1000] Program Details

[1001] The system works as follows: First, the user installs the smartphone app and creates an account. They create the account by entering their email address and password, then register the device. They add the monitoring device to the system by scanning the QR code or serial number. Then, they enter information about the child or elderly person, emergency contacts, and notification settings in the app.

[1002] Next, while the monitoring device is worn, it acquires location information using a GPS module and captures real-time images of the surrounding area using a small camera. The acquired data is compressed at regular intervals and sent to a server via a communications module. The server analyzes the received data and uses an AI algorithm to determine compliance with traffic rules. Specifically, it recognizes traffic lights, crosswalks, and pedestrian movements and evaluates whether the behavior was correct.

[1003] Additionally, if traffic rules are followed, the game management software will award character development points. Character growth is updated in real time, giving users a sense of accomplishment. If any abnormalities, such as abnormal behavior or prolonged inactivity, are detected, the server will immediately generate an alert message and send a notification to registered contacts.

[1004] Specific examples

[1005] Example of children going to school

[1006] 1. The user (parent) attaches the monitoring device to their child's school bag and activates the device using the app.

[1007] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[1008] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[1009] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[1010] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[1011] Examples of elderly people wandering

[1012] 1. The user (family member) attaches the monitoring device to the clothing of the elderly person when they go out.

[1013] 2. The device transmits the acquired location information and video data to the server in real time.

[1014] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family's smartphone.

[1015] 4. Users receive alerts and can respond quickly.

[1016] Prompt Sentence Examples

[1017] "Please explain the system in which a monitoring device attached to a child's school bag compresses and sends GPS-acquired location information and camera footage to a server, and then uses AI to analyze whether traffic rules are being followed."

[1018] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1019] Step 1: The user creates an account.

[1020] Specific operation: The user opens the app on their smartphone and selects "Create a new account." They enter their email address and password and click the "Register" button. Input: Email address, password. Output: A message confirming the creation of a new account.

[1021] Data processing: The user's input information is sent to the server, and a new account is created in the user database.

[1022] Step 2: The user registers the device.

[1023] What happens: The user selects the "Register Device" section in the app and either scans the device's QR code with the camera or manually enters the serial number. Input: QR code or serial number. Output: Device registration confirmation message.

[1024] Data processing: The registered QR code or serial number is sent to the server and stored in the device database.

[1025] Step 3: The user enters the target person's information and emergency contact information.

[1026] Specific operation: The user enters the name, age, emergency contact information, etc. of a child or elderly person into the app and clicks the "Save" button. Input: Information about the person, emergency contact information. Output: A message confirming that the information has been saved.

[1027] Data processing: The entered information is sent to the server and stored in association with the user profile.

[1028] Step 4: The device acquires location information.

[1029] Specific operation: When the device is worn, the GPS module is activated and the current location information is obtained every 5 seconds. Input: GPS signal. Output: Location information data.

[1030] Data processing: Location information is temporarily stored on the device.

[1031] Step 5: The device captures video of the surrounding area.

[1032] Specific operation: The device activates a small camera and captures surrounding images in real time. Input: Camera image. Output: Video data.

[1033] Data processing: Video data is temporarily stored in the cache.

[1034] Step 6: The terminal compresses and transmits the data.

[1035] Specific operation: The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. Input: location information, video data. Output: compressed data.

[1036] Data processing: Data compression is performed within the terminal, and the compressed data is sent to the server.

[1037] Step 7: The server parses the data.

[1038] How it works: The server passes the received data to analysis software, which uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements. Input: Compressed data. Output: Analysis results.

[1039] Data processing: AI algorithms analyze the compressed data and determine compliance with traffic rules.

[1040] Step 8: The server manages the character's progression.

[1041] Specific operation: If traffic rules are followed, the server will award character development points through the game management software and update the character's development status in real time. Input: Analysis results. Output: Development points, development update notification.

[1042] Data processing: Based on the analysis results, the character's growth points are calculated and notified to the user's app.

[1043] Step 9: The server detects the anomaly and sends an alert.

[1044] Specific operation: When the server detects a sudden change in location information or a long period of inactivity, it immediately generates an alert message and notifies the registered emergency contacts. Input: Location information data. Output: Alert message.

[1045] Data processing: Based on the location analysis results, an alert is generated and sent to emergency contacts.

[1046] (Application example 1)

[1047] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1048] Ensuring the safety of children and the elderly has become a critical issue in modern society. There are many cases of children and the elderly getting lost outside designated areas, especially when out shopping or dining in a brick-and-mortar store. Furthermore, conventional systems have difficulty acquiring real-time location information and video footage, detecting abnormalities, and quickly addressing them. As a result, parents are unable to respond quickly, causing anxiety for both the parents and the elderly. In addition, there is a need for a system that combines safety measures with game elements to help users act safely while having fun.

[1049] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1050] In this invention, the server includes a means for acquiring location information, a means for capturing video of the surrounding area, a means for transmitting the acquired location information and video to the server, a means for analyzing the location information and video in the server and determining compliance with traffic rules, a means for managing the development of a character in the game based on compliance with traffic rules, a means for detecting abnormalities in the location information and sending an alert, a means for sending an alert when the user leaves a designated area within the store, a means for compressing the target's location information and video at intervals and sending the compressed video to the server, a means for detecting abnormalities in the server and instantly generating an alert message, and a means for detecting pedestrian signals and evaluating compliance with traffic rules. This allows a prompt warning to be issued when the target leaves the designated area, enabling parents to respond quickly. Furthermore, the game elements can provide the fun of following traffic rules, increasing the incentive to act safely.

[1051] A "means for obtaining location information" is a device or mechanism that uses GPS or other location measurement technology to accurately obtain the subject's current location.

[1052] "Means for capturing images of the surroundings" refers to a device or mechanism that uses a camera or other image capturing device to capture images of a specified area in real time and saves or transmits the data.

[1053] The "means for transmitting the acquired location information and video to a server" refers to a device or mechanism for transmitting the acquired location information and video data to a remote server using a communication module or an internet line.

[1054] "Means for analyzing location information and video on a server and determining compliance with traffic rules" refers to a device or mechanism that uses analysis software or algorithms on a server to analyze received location information and video data and evaluate whether the subject is complying with traffic rules.

[1055] "Means for managing the growth of a character in a game based on compliance with traffic rules" refers to software or a mechanism that controls the growth and evolution of a character in a game when a subject complies with traffic rules.

[1056] "Means for detecting abnormalities in location information and sending alerts" refers to a device or mechanism that monitors fluctuations or abnormalities in location information data and sends a warning or alert to designated contacts when certain conditions are met.

[1057] "Means for sending an alert when a person leaves a designated area within the store" refers to a device or mechanism that issues an alarm and sends a notification to a parent or guardian or manager when a person leaves a designated safe area within the store.

[1058] "Means for compressing the subject's location information and video at intervals and transmitting them to a server" refers to a device or mechanism for compressing the location information and video data at a specified time interval and transmitting them efficiently to a server.

[1059] "Means for detecting abnormalities on the server and immediately generating an alert message" refers to a device or mechanism that analyzes data received on the server side, and immediately creates an alert message when an abnormality is detected, and notifies the specified contacts.

[1060] "Means for detecting pedestrian signals and assessing compliance with traffic rules" refers to software or algorithms that recognize pedestrian signals from video data and assess whether the subject is complying with traffic rules when passing through the signal.

[1061] This invention is a system that supports safe behavior of subjects (children and the elderly). A detailed implementation method of this system is described below.

[1062] System configuration

[1063] This system consists of the following hardware and software:

[1064] Hardware

[1065] GPS module: Used to obtain the subject's current location. An example is the Ublox NEO-6M.

[1066] Small cameras: used to capture video of the subject's surroundings. An example is the Raspberry Pi Camera Module.

[1067] Communication module: Used to send data to the server. An example is a GSM module.

[1068] software

[1069] Location information analysis software: Software for analyzing acquired location information. For example, custom software using Python.

[1070] Video analysis software: AI algorithms for analyzing captured video. Examples include TensorFlow and OpenCV.

[1071] Server: Used for data analysis and management. An example is AWS EC2.

[1072] Alert system: Software that generates alerts and notifies you when an abnormality is detected.

[1073] Game management software: Software that manages the growth of in-game characters based on compliance with traffic rules.

[1074] System Operation

[1075] The server receives the acquired location information and video data and performs processing in the following procedure.

[1076] 1. Location information acquisition: The device acquires the subject's current location using the GPS module, and the data is sent to the server at specific intervals.

[1077] 2. Video capture and transmission: A small camera captures the surroundings and transmits the captured video synchronously to the server. This process is repeated every interval.

[1078] 3. Data analysis: The server analyzes the received location information and video data. The location analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation.

[1079] 4. Traffic rule compliance assessment: The server assesses compliance with traffic rules based on the analysis results. It recognizes pedestrian signals and determines whether the vehicle is stopping correctly at traffic lights or crossing the street when the light is green.

[1080] 5. Character growth management and incentives: When traffic rules are followed, the game management software will award growth points to the in-game character and update the character's growth in real time. The results will be sent to the user's (parents' or guardians') smartphone, which can be enjoyed as an incentive.

[1081] 6. Anomaly detection and alerts: The server monitors location information for sudden changes or periods of inactivity, and if an anomaly is detected, it immediately generates an alert message and sends a notification to emergency contacts.

[1082] Specific examples

[1083] For example, if a child strays from a designated area within a store, the server-side analysis software will determine this as an abnormality and immediately send an alert to the parent or store staff's smartphone, allowing for a prompt response.

[1084] Example prompt sentence:

[1085] "I want to develop an application that analyzes location information and video data and sends an alert if the user goes outside a specified range."

[1086] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1087] Step 1:

[1088] The device uses a GPS module to obtain the subject's current location. The device sends the obtained location information to the server at regular intervals (e.g., every 30 seconds). In this case, the input is the location data from the GPS module, and the output is the location information sent to the server.

[1089] Step 2:

[1090] The device uses a small camera to capture images of the surrounding area. The device transmits the image data to the server at intervals, similar to the location information. In this case, the input is the image data from the camera, and the output is the image data transmitted to the server.

[1091] Step 3:

[1092] The server analyzes the received location information and video data. The location information analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation from the video data. The inputs are location information and video data, and the output is location evaluation information and video analysis information as the analysis results.

[1093] Step 4:

[1094] The server determines whether or not traffic rules are being followed based on the analysis results. The analysis software recognizes pedestrian signals and determines whether the subject stops correctly at the traffic light or crosses the street when the light is green. The input is the analysis results, and the output is the determination of whether or not the subject is following traffic rules.

[1095] Step 5:

[1096] If traffic rules are followed, the server will award training points to the in-game character through the game management software. The server will then notify the user (parent or guardian) of this result via their smartphone. The input is the result of compliance, and the output is character growth information and a notification to the user.

[1097] Step 6:

[1098] The server monitors location information for sudden changes or stationary periods. If the server detects an abnormality, it immediately generates an alert message and sends a notification to emergency contacts. The input is location information change data, and the output is the generated alert message.

[1099] Step 7:

[1100] The device compresses the location information and video data at intervals and sends them to the server. This improves data transfer efficiency. The input is location information and video data, and the output is compressed data.

[1101] Step 8:

[1102] The server sends an alert if the target person goes outside the specified range. The server monitors the target person's current location based on the received location information, and if the target person goes outside the range, it issues a warning and notifies the parent or administrator. In this case, the input is location information and the output is an alert message.

[1103] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1104] The present invention combines a monitoring system aimed at ensuring children's safety on their way to and from school and preventing elderly people from wandering away with an emotion engine that recognizes the user's emotions, and is configured and operated as follows.

[1105] System configuration

[1106] This system consists of the following elements:

[1107] Means of obtaining location information (GPS module)

[1108] A means of capturing images of the surrounding area (small camera)

[1109] A communication module that sends data to the server

[1110] A means of determining compliance with traffic rules (analysis software on the server)

[1111] A means of managing in-game character growth (game management software on the server)

[1112] A means of detecting anomalies and sending alerts (server alert system)

[1113] Emotion engine that recognizes user emotions

[1114] System Operation

[1115] Initial Setup

[1116] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[1117] 2. Users register their Mamorun Cam device within the app by scanning the QR code or serial number to add the device to the system.

[1118] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1119] Real-time monitoring and analysis

[1120] 1. The device (Mamorun Cam) acquires location information while worn and collects current location data using the GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[1121] 2. The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[1122] 3. The device compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[1123] Traffic rule compliance and emotion analysis

[1124] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[1125] 2. The server passes the obtained video data to the emotion engine, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[1126] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[1127] Managing game elements

[1128] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[1129] 2. Adjust the training points and incentives based on the emotional data recognized by the emotion engine. For example, if the child seems to be having fun, give them more points to increase their sense of security.

[1130] Anomaly detection and alerts

[1131] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[1132] 2. The server also uses the emotion data recognized by the emotion engine and immediately generates an alert message if it determines that there is an abnormality.

[1133] 3. The server sends an alert message to the designated contacts via smartphone push notification or email.

[1134] Specific examples

[1135] Example of children going to school

[1136] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[1137] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[1138] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[1139] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[1140] 5. The server analyzes the video data using an emotion engine to recognize the child's emotional state.

[1141] 6. The server awards points to the in-game character based on whether the rules were followed correctly and the character's emotional state, and notifies the user's app.

[1142] Examples of elderly people wandering

[1143] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[1144] 2. The device transmits the acquired location information and video data to the server in real time.

[1145] 3. The server detects sudden changes in location information and long periods of stillness, and analyzes the video data using an emotion engine.

[1146] 4. The server determines abnormalities based on the elderly person's emotional state and location data, and sends a notification to emergency contacts if an alert is necessary.

[1147] 5. Users receive alerts and can respond quickly.

[1148] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[1149] The processing flow will be explained below.

[1150] Step 1:

[1151] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[1152] Step 2:

[1153] Users register their Mamorun Cam device within the app by scanning the QR code or serial number and adding the device to the system.

[1154] Step 3:

[1155] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1156] Step 4:

[1157] The device (Mamorun Cam) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[1158] Step 5:

[1159] The device captures images of the surroundings in real time using a camera. The device stores the image data in memory and compresses it at specific intervals (e.g., every 30 seconds).

[1160] Step 6:

[1161] The terminal transmits the compressed location information and video data to the server via the communication module.

[1162] Step 7:

[1163] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[1164] Step 8:

[1165] The server passes the video data to an emotion engine, which analyzes the facial expressions and speech of the user (children or elderly people) to recognize their emotions.

[1166] Step 9:

[1167] The server combines the analyzed emotional data with compliance with traffic rules to increase the probability of detecting abnormal behavior.

[1168] Step 10:

[1169] The server assigns training points to in-game characters based on traffic rule compliance and emotional data. Game management software on the server updates the character's growth in real time and stores the results in a database.

[1170] Step 11:

[1171] The server analyzes location fluctuation data and emotional data to detect abnormalities (e.g., not moving for a certain period of time, or sudden movement).

[1172] Step 12:

[1173] The server also uses emotion data to determine abnormalities and immediately generates an alert message, which includes the specific details of the abnormality, location information, and emotional state.

[1174] Step 13:

[1175] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[1176] Step 14:

[1177] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[1178] Step 15:

[1179] Users (children) can check the progress of their in-game characters on their smartphone app and enjoy it as an incentive to follow traffic rules.

[1180] Example 2

[1181] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1182] Conventional location information acquisition systems and surveillance systems simply acquire and analyze location information and video data, making it difficult to grasp the user's psychological state or more precisely detect abnormal behavior. Furthermore, they lack a mechanism for sending emergency notifications based on accurate information quickly when abnormal behavior occurs. Furthermore, they lack a function for linking the growth of an agent in the system's virtual environment to the user's psychological state, making it difficult to maintain the user's interest and motivation.

[1183] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1184] In this invention, the server includes means for detecting anomalies in location information and sending an alert, means for recognizing the user's psychological state, and means for detecting abnormal behavior by integrating the acquired psychological state with compliance with regulations, thereby enabling precise detection of abnormal behavior that takes the user's psychological state into consideration and rapid transmission of emergency notifications.

[1185] "Means for obtaining location information" refers to a system or device for measuring the subject's current location and obtaining that data.

[1186] "Means for capturing video of the surroundings" refers to a camera or other device that captures video of the subject's surroundings in real time.

[1187] "Server" refers to a computer system that collects, analyzes, stores, and transmits data over a network.

[1188] "Means for transmitting to a server" refers to a communication module or network connection means for transmitting the acquired location information and video data to a server.

[1189] "Means for determining compliance with regulations" refers to analytical software or algorithms that analyze acquired data to determine whether traffic rules or other regulations are being complied with.

[1190] "Means for managing the growth of agents within a virtual environment" refers to software and data management systems for managing the growth and development of agents operating in a virtual environment within the system.

[1191] "Means for detecting location anomalies and sending alerts" refers to a system that detects unusual location changes or inactivity and sends warnings or notifications based on that information.

[1192] "Means for recognizing the user's psychological state" refers to software or algorithms for analyzing and recognizing the user's psychological state from facial expressions, voice, behavior, etc.

[1193] "Means for detecting abnormal behavior" refers to a system that integrates acquired data with perceived psychological states to detect unusual behavioral patterns.

[1194] "Means for sending emergency notifications" means communications systems or software that rapidly send alerts or notifications to designated contacts when abnormal behavior is detected.

[1195] The present invention is a monitoring system for the purpose of ensuring the safety of children going to and from school and preventing elderly people from wandering away, and is also combined with an emotion engine that recognizes the user's psychological state. This system is configured and operated as follows.

[1196] System configuration

[1197] This system consists of the following elements:

[1198] Means of obtaining location information (GPS module)

[1199] A means of capturing images of the surrounding area (small camera)

[1200] A communication module that sends data to the server

[1201] A means of determining compliance with regulations (analysis software on the server)

[1202] A means of managing the growth of agents in the virtual environment (game management software in the server)

[1203] A means of detecting anomalies and sending alerts (server alert system)

[1204] Emotion engine that recognizes the user's mental state

[1205] Initial Setup

[1206] First, users install the smartphone application and create an account by entering their email address and password. Next, they register the device within the app by scanning a QR code or serial number and adding it to the system. Finally, they enter information about the target person (children or elderly), emergency contacts, and notification settings, and then perform AI-based regulatory checks and configure agents in the virtual environment.

[1207] Real-time monitoring and data transmission

[1208] While the device is attached, it uses a GPS module to collect location data. It typically updates its location every five seconds and captures real-time images of the surrounding area with its camera, saving them to memory. This location information and video data is compressed every 30 seconds and sent to a server via a communications module.

[1209] Data analysis by server

[1210] The server passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic lights, sidewalks, and other regulatory objects and determine compliance with regulations. The server also passes the obtained video data to an emotion engine, which analyzes the user's (children or elderly) facial expressions and voice to recognize their psychological state. This analysis combines psychological state with compliance with regulations, enabling more precise detection of abnormal behavior.

[1211] Managing game elements

[1212] If the server complies with the regulations, it will award training points to the agent in the virtual environment. The game management software on the server updates the agent's growth in real time and provides feedback to the user. Furthermore, the emotion engine adjusts training points and incentives based on the agent's psychological state. For example, if a child appears to be having fun, it will be awarded more points, increasing their motivation.

[1213] Anomaly detection and alert sending

[1214] The server analyzes location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement). It also uses the psychological state recognized by the emotion engine and immediately generates an alert message if it determines that an abnormality exists. Finally, the server sends the alert message to designated contacts, and notifications are sent via smartphone push notifications or email, allowing users to respond promptly.

[1215] Specific examples

[1216] Example of children going to school

[1217] The user (parent) attaches the device to their child's school bag and activates it with the app. The device obtains location information every five seconds using a GPS module and captures images of the surrounding area using a camera. Every 30 seconds, the location information and video data are compressed and sent to the server. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light. The server also analyzes the video data using an emotion engine to recognize the child's psychological state. Points are awarded to the agent in the virtual environment depending on whether the rules are followed correctly and the child's psychological state, and a notification is sent to the user's app.

[1218] Examples of elderly people wandering

[1219] The user (family member) attaches the device to the elderly person's clothing when they go out. The device sends location information and video data to a server in real time. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data using an emotion engine. It determines abnormalities based on the elderly person's psychological state and location data, and sends an alert to emergency contacts if necessary. The user receives the alert and can respond quickly.

[1220] Prompt Sentence Examples

[1221] Enter the following prompt into the generative AI model:

[1222] "Please tell me about the system for monitoring children's safety on their way to and from school. I would like to know whether the children cross the street correctly at traffic lights and their psychological state."

[1223] or

[1224] "I would like to know how we can be notified if an elderly person wanders off while out. Please explain how the system works, including psychological analysis."

[1225] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[1226] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1227] Step 1:

[1228] A user installs the app on their smartphone and creates an account by entering their email address and password. The input is an email address and password, and the output is the creation of a new account. Specifically, the user enters the information as instructed by the app and presses the registration button.

[1229] Step 2:

[1230] To register a device within the app, a user scans a QR code or serial number to add the device to the system. The input is the QR code or serial number, and the output is the device registration completion. Specifically, the user scans the QR code attached to the device with the camera.

[1231] Step 3:

[1232] The user inputs information about the target person (children or elderly), emergency contacts, and notification settings, and the AI ​​checks regulations and configures the agent in the virtual environment. The input is target person information, emergency contacts, and notification settings, and the output is setting completion. Specifically, the user inputs the required information into the app form and presses the "Settings Complete" button.

[1233] Step 4:

[1234] While the device is attached, it uses a GPS module to collect location data. The input is a GPS signal, and the output is location data. Specifically, the GPS module updates the location information every 5 seconds and stores it in its internal memory.

[1235] Step 5:

[1236] The device uses a camera to capture images of the surroundings in real time and stores the image data in memory. The input is the surrounding image and the output is the image data. Specifically, the camera captures video images of the surroundings of the device and stores them in memory frame by frame.

[1237] Step 6:

[1238] The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. The input is location information data and video data, and the output is the transmission of compressed data. Specifically, the compression algorithm compresses the data, and the network module sends the data to the server.

[1239] Step 7:

[1240] The server passes the received location information and video data to an analysis program, which uses an AI algorithm to determine compliance with regulations. The input is location information data and video data, and the output is compliance status data. Specifically, the analysis software analyzes the data and recognizes traffic lights and sidewalks.

[1241] Step 8:

[1242] The server passes the video data to the emotion engine, which analyzes the user's facial expressions and voice to recognize their psychological state. The input is video data, and the output is psychological state data. Specifically, the emotion engine uses a facial expression recognition algorithm to analyze the video and generate results.

[1243] Step 9:

[1244] The server integrates regulatory compliance status data and psychological state data to detect abnormal behavior. The inputs are regulatory compliance status data and psychological state data, and the output is abnormal behavior detection data. Specifically, the server uses an integrated algorithm to analyze the data and identify abnormalities.

[1245] Step 10:

[1246] When the server detects abnormal behavior, it immediately generates an alert message and sends it to the specified contacts. The input is the abnormal behavior detection data, and the output is the sending of the alert message. Specifically, the alert system generates a message and sends a notification to the contacts via the communication module.

[1247] Step 11:

[1248] If the agent obeys traffic rules, the server awards training points to the agent in the virtual environment and notifies the user of the feedback. The input is regulatory compliance data and psychological state data, and the output is training points and a notification. Specifically, the game management software calculates the points and sends a notification to the user's app.

[1249] (Application example 2)

[1250] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1251] The present invention relates to a system for ensuring the safe movement of children and the elderly. In particular, conventional systems only detect abnormalities based on location information and video data, and do not take into account the emotional state of the user, which limits their ability to detect abnormalities early and respond to emergencies. As a result, there is a problem of an increased risk of dangerous situations occurring.

[1252] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring location information, means for capturing video of the surroundings, means for transmitting the acquired location information and video to the server, means for analyzing the location information and video in the server and determining compliance with traffic rules, means for managing the growth of characters in the game based on compliance with traffic rules, means for detecting abnormalities in the location information and sending an alert, means for analyzing emotions, means for detecting abnormalities based on the emotion analysis results, and means for sending an alert to an emergency contact when an abnormality is detected. This makes it possible to monitor the user's emotional state in real time, detect abnormalities more quickly and accurately, and improve safety.

[1253] "Means for acquiring location information" refers to technology or devices that use a GPS module or other location information acquisition device to acquire the current location data of a target.

[1254] "Means for capturing images of the surroundings" refers to technology or devices that use a camera such as a small camera or video camera to capture images of the surroundings of a target.

[1255] "Means for transmitting to a server" refers to a technology or device that uses a communication module or an internet line to transmit acquired data to a server.

[1256] "Means for determining compliance with traffic rules" refers to technologies and devices that use analytical software and AI algorithms on a server to analyze acquired video data and location information to check whether traffic rules are being followed.

[1257] "Means for managing the growth of in-game characters" refers to technology or devices that use game management software in the server to update and manage the growth of in-game characters in real time based on user behavior.

[1258] "Means for detecting abnormalities in location information and sending alerts" refers to technology or devices that analyze acquired location information and, if abnormal behavior (e.g., sudden movement or prolonged stationary status) is detected, generate an alert message and send it to an emergency contact.

[1259] "Means for analyzing emotions" refers to technology or equipment that uses emotion analysis software or AI algorithms stored on a server to analyze the subject's emotional state (e.g., happy, sad, anxious, etc.) from the acquired video data.

[1260] "Means for sending an alert to an emergency contact when an abnormality is detected" refers to technology or equipment that immediately sends an alert message to a designated emergency contact when an abnormality is detected as a result of emotion analysis or location information analysis.

[1261] The present invention relates to a security system for ensuring the safe movement of children and the elderly, and in particular to a system that analyzes the user's emotional state to enable earlier and more accurate abnormality detection and emergency response.

[1262] System configuration

[1263] This system consists of the following elements:

[1264] Means for obtaining location information (GPS module): Used to obtain location information with high accuracy.

[1265] A means of capturing images of the surroundings (small cameras): Capture images of the environment in real time as you move and collect that data.

[1266] Means for sending to the server (communication module): A module for compressing location information and video and sending it to the server.

[1267] Means for determining compliance with traffic rules (analysis software on the server): Analysis software running on a server connected to the Internet is used to recognize traffic lights, crosswalks, etc. and determine compliance with traffic rules.

[1268] A means of managing in-game character growth (game management software on the server): updating character growth in real time and providing feedback to the user.

[1269] A means of detecting abnormalities in location information and sending alerts (alert system within the server): Detects abnormalities such as sudden changes in acquired location information or prolonged periods of stationary motion, and sends an alert to emergency contacts.

[1270] Means for analyzing emotions (emotion analysis module): Analyzes the user's emotional state from video data.

[1271] A means of sending an alert to an emergency contact when an abnormality is detected (server alert system): When an abnormality is detected based on the results of emotion analysis, etc., an alert message is sent to the designated emergency contact.

[1272] System Operation

[1273] Initial Setup

[1274] 1. The user (parent or family member) installs the application on their smartphone and creates an account by entering their email address and password.

[1275] 2. The user registers the device within the application, scanning the QR code or serial number to add the device to the system.

[1276] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1277] Real-time monitoring and analysis

[1278] 1. The device acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[1279] 2. The device uses a camera to capture images of the surrounding area in real time and stores the image data in memory.

[1280] 3. The device compresses the acquired location information and video data and sends it to the server via the communication module.

[1281] Traffic rule compliance and emotion analysis

[1282] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[1283] 2. The server passes the obtained video data to an emotion analysis module, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[1284] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[1285] Managing game elements

[1286] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[1287] 2. The emotion analysis module adjusts the training points and incentives based on the emotional data it recognizes. For example, if a child seems to be having fun, it will give them more points to increase their sense of security.

[1288] Anomaly detection and alerts

[1289] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[1290] 2. The server also uses the results of emotion analysis and immediately generates an alert message if it determines that there is an abnormality.

[1291] 3. The server sends an alert message to the designated emergency contact via smartphone push notification or email.

[1292] Specific examples

[1293] For children

[1294] 1. The user attaches the device to their child's school bag and starts the device with the application.

[1295] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[1296] 3. The device compresses the location information and video data and sends them to the server.

[1297] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping at the correct traffic light.

[1298] 5. The server analyzes the video data to recognize the child's emotional state.

[1299] 6. The server will award points to the character based on whether the rules were followed correctly and depending on the character's emotional state, and notify the user.

[1300] For elderly people

[1301] 1. The user attaches the device to the elderly person's clothing when they go out.

[1302] 2. The device sends location information and video data to the server.

[1303] 3. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data to recognize the emotional state.

[1304] 4. If the server detects an abnormality, it will send an immediate alert to emergency contacts.

[1305] 5. Users receive alerts and can respond quickly.

[1306] Prompt Sentence Examples

[1307] "Please create a program that sends the child's location information and surrounding video data to the API server, analyzes their compliance with traffic rules and emotional state, and detects abnormalities."

[1308] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1309] Step 1:

[1310] A user installs a smartphone application and creates an account. The user enters an email address and password and registers basic information to begin using the service. The input data is user information, and the output is account creation and device initial setup information.

[1311] Step 2:

[1312] Users register their devices within the application, either by scanning a QR code or serial number to add the device to the system. The input data is the device's identity, and the output is the user whose device is registered in the system and will be monitored.

[1313] Step 3:

[1314] Users input information about the target person (children or elderly), emergency contacts, and notification settings, and then configure the AI ​​to check traffic rules and set up in-game characters. The input data is personal information and setting information, and the output is a notification that monitoring is ready to begin and system setting information.

[1315] Step 4:

[1316] The device acquires location information while worn. It uses a GPS module to collect current location data every 5 seconds. The input is a GPS signal, and the output is the coordinate data of the current location.

[1317] Step 5:

[1318] The device captures images of the surrounding area in real time with a camera and stores the image data in memory. The input is visual information from the scene, and the output is image data.

[1319] Step 6:

[1320] The location information and video data acquired by the device are compressed every 30 seconds and sent to the server via the communication module. The input is the location information and video data, and the output is the compressed data sent to the server.

[1321] Step 7:

[1322] The server passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements and determine whether traffic rules are being followed. The input is location information and video data, and the output is data on traffic rule compliance.

[1323] Step 8:

[1324] The server passes the video data to the emotion analysis module, which analyzes the facial expressions and speech of the user (children or elderly) to recognize their emotions. The input is the video data, and the output is the emotion analysis results.

[1325] Step 9:

[1326] The server combines the analyzed emotion data with data on compliance with traffic rules to make it easier to detect abnormal behavior. The input is traffic rule compliance data and emotion analysis results, and the output is anomaly detection data.

[1327] Step 10:

[1328] If the server observes traffic rules, it awards training points to the in-game character. The game management software in the server updates the character's growth in real time and provides feedback to the user. The input is traffic rule compliance data, and the output is character growth data.

[1329] Step 11:

[1330] The emotion analysis module adjusts the training points and incentives based on the emotional data recognized by the module. For example, if a child appears to be having fun, more points are awarded to increase the child's sense of security. The input is emotional data, and the output is the adjusted training points.

[1331] Step 12:

[1332] The server analyzes the fluctuation data of location information and detects anomalies that meet certain conditions (e.g., no movement for a certain period of time, sudden movement). The input is location information data, and the output is anomaly detection data.

[1333] Step 13:

[1334] The server uses the emotion analysis results and immediately generates an alert message if an anomaly is detected. The input is the anomaly detection data and emotion data, and the output is an alert message.

[1335] Step 14:

[1336] The server sends an alert message to the designated emergency contact. The notification is sent via smartphone push notification or email. The input is the alert message, and the output is the alert notification sent to the emergency contact.

[1337] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1338] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1339] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1340] [Fourth embodiment]

[1341] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1342] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1343] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1344] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1345] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1346] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1347] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1348] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1349] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1350] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1351] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1352] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1353] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1354] The present invention is a monitoring system for the purpose of ensuring the safe travel of children to and from school and preventing elderly people from wandering away, and is configured and operated as follows.

[1355] System configuration

[1356] This system consists of the following elements:

[1357] Means of obtaining location information (GPS module)

[1358] A means of capturing images of the surrounding area (small camera)

[1359] A communication module that sends data to the server

[1360] A means of determining compliance with traffic rules (analysis software on the server)

[1361] A means of managing in-game character growth (game management software on the server)

[1362] A means of detecting anomalies and sending alerts (server alert system)

[1363] System Operation

[1364] Initial Setup

[1365] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[1366] 2. Users register their Mamorun Cam device within the app by scanning the QR code or serial number to add the device to the system.

[1367] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1368] Real-time monitoring and analysis

[1369] 1. The device (Mamorun Cam) acquires location information while worn, collects current location data using a GPS module, and captures images of the surrounding area in real time using a camera.

[1370] 2. The device compresses the location information and video data at specific intervals and sends them to the server.

[1371] 3. The server analyzes the received data and determines compliance with traffic rules. It uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and evaluates whether children stop correctly at traffic lights and cross only when the pedestrian light is green.

[1372] Managing game elements

[1373] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time, giving users a sense of accomplishment in the game.

[1374] 2. Users (children) can check the character's progress on a smartphone app and enjoy it as an incentive.

[1375] Anomaly detection and alerts

[1376] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[1377] 2. When the server detects an abnormality, it immediately generates an alert message and sends a notification to registered contacts, allowing parents and family members to respond promptly.

[1378] Specific examples

[1379] Example of children going to school

[1380] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[1381] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[1382] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[1383] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[1384] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[1385] Examples of elderly people wandering

[1386] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[1387] 2. The device transmits the acquired location information and video data to the server in real time.

[1388] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family member's smartphone.

[1389] 4. Users receive alerts and can respond quickly.

[1390] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away.

[1391] The processing flow will be explained below.

[1392] Step 1:

[1393] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[1394] Step 2:

[1395] Users register devices within the app by scanning a QR code or serial number to add the device to the system.

[1396] Step 3:

[1397] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1398] Step 4:

[1399] The device (apparatus) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[1400] Step 5:

[1401] The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[1402] Step 6:

[1403] The terminal compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[1404] Step 7:

[1405] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[1406] Step 8:

[1407] Based on the analysis results, the server evaluates whether the child is following traffic rules, checking whether they are stopping at red lights or crossing the street when the light is green.

[1408] Step 9:

[1409] The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and stores the results in a database.

[1410] Step 10:

[1411] The server analyzes the location information fluctuation data and immediately generates an alert message if an abnormality occurs (e.g., no movement for a certain period of time, sudden movement).

[1412] Step 11:

[1413] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[1414] Step 12:

[1415] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[1416] Example 1

[1417] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1418] Conventional monitoring systems only handle location information and video data, and are inadequate in analyzing the data, determining compliance with traffic rules, and providing feedback to users. Emergency response can be delayed, making it difficult to detect wandering or dangerous behavior early. Furthermore, there was a lack of a way to provide attractive incentives for children while ensuring their safety on their way to and from school.

[1419] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1420] In this invention, the server includes: means for acquiring location information; means for capturing surrounding images; means for transmitting the acquired location information and images to the server; means for analyzing the location information and images in the server and determining compliance with traffic rules; means for managing character growth based on compliance with traffic rules; means for detecting abnormalities in the location information and sending alerts; means for creating accounts and registering devices; means for compressing the location information and image data at regular intervals; means for awarding points to characters based on compliance with traffic rules and updating character growth in real time; and means for instantly generating an alert message and sending it to an emergency contact when an abnormality is detected. This solves conventional problems, effectively supports children's commutes to and from school, and prevents elderly people from wandering, thereby improving safety. Furthermore, in-game character growth can be used to motivate children to comply with traffic rules.

[1421] "Location information" is data that indicates the geographic location of a particular object, obtained by GPS or other location information acquisition means.

[1422] "Video data" is data containing visual information of the surroundings captured by the device's camera.

[1423] The "transmission means" is a communication module for transferring the acquired location information and video data to a server via a network.

[1424] The "means for determining compliance with traffic rules" refers to a technology that uses analytical software and AI algorithms stored on a server to determine whether traffic rules such as traffic lights, pedestrian signals, and crosswalks are being properly followed.

[1425] The "means for managing character growth" is a system that awards development points to in-game characters when traffic rules are followed, and updates their growth in real time.

[1426] The "means for detecting abnormalities and sending alerts" is a system that analyzes sudden changes in location information or long periods of stationary motion, and sends a notification to emergency contacts if an abnormality is detected.

[1427] "Means for creating an account and registering a device" refers to a function that allows a user to create an account using a smartphone app and register a monitoring device in the system.

[1428] An "interval" is a time interval set when acquiring or transmitting location information and video data.

[1429] The "compression means" is a technology for compressing the acquired location information and video data in order to reduce the volume and efficiently transmit the data to the server.

[1430] An "alert message" is a notification containing information about a detected abnormality, and is a message that is immediately sent to an emergency contact.

[1431] This invention is a monitoring system aimed at ensuring the safety of children going to and from school and preventing elderly people from wandering away. This system includes a means for acquiring location information (GPS module), a means for capturing surrounding images (small camera), a communication means for sending data to a server (communication module), a means for determining compliance with traffic rules (analysis software in the server), a means for managing in-game character growth (game management software in the server), and a means for detecting abnormalities and sending alerts (server alert system).

[1432] System configuration

[1433] The entire system consists of three components: a user (e.g., parent or family member) terminal (monitoring device), and a server. As a specific example, the following hardware and software are used:

[1434] GPS module: for obtaining location information

[1435] Small camera: for capturing surrounding footage

[1436] Communication module: for data transmission

[1437] Analysis software on the server: Determining whether traffic rules are being followed

[1438] Server game management software: Character growth management

[1439] Server alert system: Anomaly detection and alert sending

[1440] Program Details

[1441] The system works as follows: First, the user installs the smartphone app and creates an account. They create the account by entering their email address and password, then register the device. They add the monitoring device to the system by scanning the QR code or serial number. Then, they enter information about the child or elderly person, emergency contacts, and notification settings in the app.

[1442] Next, while the monitoring device is worn, it acquires location information using a GPS module and captures real-time images of the surrounding area using a small camera. The acquired data is compressed at regular intervals and sent to a server via a communications module. The server analyzes the received data and uses an AI algorithm to determine compliance with traffic rules. Specifically, it recognizes traffic lights, crosswalks, and pedestrian movements and evaluates whether the behavior was correct.

[1443] Additionally, if traffic rules are followed, the game management software will award character development points. Character growth is updated in real time, giving users a sense of accomplishment. If any abnormalities, such as abnormal behavior or prolonged inactivity, are detected, the server will immediately generate an alert message and send a notification to registered contacts.

[1444] Specific examples

[1445] Example of children going to school

[1446] 1. The user (parent) attaches the monitoring device to their child's school bag and activates the device using the app.

[1447] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[1448] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[1449] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[1450] 5. If the rules are followed correctly, the server will award points to the in-game character and notify the user's app.

[1451] Examples of elderly people wandering

[1452] 1. The user (family member) attaches the monitoring device to the clothing of the elderly person when they go out.

[1453] 2. The device transmits the acquired location information and video data to the server in real time.

[1454] 3. The server detects sudden changes in location information or long periods of inactivity, and if there is an abnormality, it immediately sends an alert to the family's smartphone.

[1455] 4. Users receive alerts and can respond quickly.

[1456] Prompt Sentence Examples

[1457] "Please explain the system in which a monitoring device attached to a child's school bag compresses and sends GPS-acquired location information and camera footage to a server, and then uses AI to analyze whether traffic rules are being followed."

[1458] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1459] Step 1: The user creates an account.

[1460] Specific operation: The user opens the app on their smartphone and selects "Create a new account." They enter their email address and password and click the "Register" button. Input: Email address, password. Output: A message confirming the creation of a new account.

[1461] Data processing: The user's input information is sent to the server, and a new account is created in the user database.

[1462] Step 2: The user registers the device.

[1463] What happens: The user selects the "Register Device" section in the app and either scans the device's QR code with the camera or manually enters the serial number. Input: QR code or serial number. Output: Device registration confirmation message.

[1464] Data processing: The registered QR code or serial number is sent to the server and stored in the device database.

[1465] Step 3: The user enters the target person's information and emergency contact information.

[1466] Specific operation: The user enters the name, age, emergency contact information, etc. of a child or elderly person into the app and clicks the "Save" button. Input: Information about the person, emergency contact information. Output: A message confirming that the information has been saved.

[1467] Data processing: The entered information is sent to the server and stored in association with the user profile.

[1468] Step 4: The device acquires location information.

[1469] Specific operation: When the device is worn, the GPS module is activated and the current location information is obtained every 5 seconds. Input: GPS signal. Output: Location information data.

[1470] Data processing: Location information is temporarily stored on the device.

[1471] Step 5: The device captures video of the surrounding area.

[1472] Specific operation: The device activates a small camera and captures surrounding images in real time. Input: Camera image. Output: Video data.

[1473] Data processing: Video data is temporarily stored in the cache.

[1474] Step 6: The terminal compresses and transmits the data.

[1475] Specific operation: The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. Input: location information, video data. Output: compressed data.

[1476] Data processing: Data compression is performed within the terminal, and the compressed data is sent to the server.

[1477] Step 7: The server parses the data.

[1478] How it works: The server passes the received data to analysis software, which uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements. Input: Compressed data. Output: Analysis results.

[1479] Data processing: AI algorithms analyze the compressed data and determine compliance with traffic rules.

[1480] Step 8: The server manages the character's progression.

[1481] Specific operation: If traffic rules are followed, the server will award character development points through the game management software and update the character's development status in real time. Input: Analysis results. Output: Development points, development update notification.

[1482] Data processing: Based on the analysis results, the character's growth points are calculated and notified to the user's app.

[1483] Step 9: The server detects the anomaly and sends an alert.

[1484] Specific operation: When the server detects a sudden change in location information or a long period of inactivity, it immediately generates an alert message and notifies the registered emergency contacts. Input: Location information data. Output: Alert message.

[1485] Data processing: Based on the location analysis results, an alert is generated and sent to emergency contacts.

[1486] (Application example 1)

[1487] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1488] Ensuring the safety of children and the elderly has become a critical issue in modern society. There are many cases of children and the elderly getting lost outside designated areas, especially when out shopping or dining in a brick-and-mortar store. Furthermore, conventional systems have difficulty acquiring real-time location information and video footage, detecting abnormalities, and quickly addressing them. As a result, parents are unable to respond quickly, causing anxiety for both the parents and the elderly. In addition, there is a need for a system that combines safety measures with game elements to help users act safely while having fun.

[1489] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1490] In this invention, the server includes a means for acquiring location information, a means for capturing video of the surrounding area, a means for transmitting the acquired location information and video to the server, a means for analyzing the location information and video in the server and determining compliance with traffic rules, a means for managing the development of a character in the game based on compliance with traffic rules, a means for detecting abnormalities in the location information and sending an alert, a means for sending an alert when the user leaves a designated area within the store, a means for compressing the target's location information and video at intervals and sending the compressed video to the server, a means for detecting abnormalities in the server and instantly generating an alert message, and a means for detecting pedestrian signals and evaluating compliance with traffic rules. This allows a prompt warning to be issued when the target leaves the designated area, enabling parents to respond quickly. Furthermore, the game elements can provide the fun of following traffic rules, increasing the incentive to act safely.

[1491] A "means for obtaining location information" is a device or mechanism that uses GPS or other location measurement technology to accurately obtain the subject's current location.

[1492] "Means for capturing images of the surroundings" refers to a device or mechanism that uses a camera or other image capturing device to capture images of a specified area in real time and saves or transmits the data.

[1493] The "means for transmitting the acquired location information and video to a server" refers to a device or mechanism for transmitting the acquired location information and video data to a remote server using a communication module or an internet line.

[1494] "Means for analyzing location information and video on a server and determining compliance with traffic rules" refers to a device or mechanism that uses analysis software or algorithms on a server to analyze received location information and video data and evaluate whether the subject is complying with traffic rules.

[1495] "Means for managing the growth of a character in a game based on compliance with traffic rules" refers to software or a mechanism that controls the growth and evolution of a character in a game when a subject complies with traffic rules.

[1496] "Means for detecting abnormalities in location information and sending alerts" refers to a device or mechanism that monitors fluctuations or abnormalities in location information data and sends a warning or alert to designated contacts when certain conditions are met.

[1497] "Means for sending an alert when a person leaves a designated area within the store" refers to a device or mechanism that issues an alarm and sends a notification to a parent or guardian or manager when a person leaves a designated safe area within the store.

[1498] "Means for compressing the subject's location information and video at intervals and transmitting them to a server" refers to a device or mechanism for compressing the location information and video data at a specified time interval and transmitting them efficiently to a server.

[1499] "Means for detecting abnormalities on the server and immediately generating an alert message" refers to a device or mechanism that analyzes data received on the server side, and immediately creates an alert message when an abnormality is detected, and notifies the specified contacts.

[1500] "Means for detecting pedestrian signals and assessing compliance with traffic rules" refers to software or algorithms that recognize pedestrian signals from video data and assess whether the subject is complying with traffic rules when passing through the signal.

[1501] This invention is a system that supports safe behavior of subjects (children and the elderly). A detailed implementation method of this system is described below.

[1502] System configuration

[1503] This system consists of the following hardware and software:

[1504] Hardware

[1505] GPS module: Used to obtain the subject's current location. An example is the Ublox NEO-6M.

[1506] Small cameras: used to capture video of the subject's surroundings. An example is the Raspberry Pi Camera Module.

[1507] Communication module: Used to send data to the server. An example is a GSM module.

[1508] software

[1509] Location information analysis software: Software for analyzing acquired location information. For example, custom software using Python.

[1510] Video analysis software: AI algorithms for analyzing captured video. Examples include TensorFlow and OpenCV.

[1511] Server: Used for data analysis and management. An example is AWS EC2.

[1512] Alert system: Software that generates alerts and notifies you when an abnormality is detected.

[1513] Game management software: Software that manages the growth of in-game characters based on compliance with traffic rules.

[1514] System Operation

[1515] The server receives the acquired location information and video data and performs processing in the following procedure.

[1516] 1. Location information acquisition: The device acquires the subject's current location using the GPS module, and the data is sent to the server at specific intervals.

[1517] 2. Video capture and transmission: A small camera captures the surroundings and transmits the captured video synchronously to the server. This process is repeated every interval.

[1518] 3. Data analysis: The server analyzes the received location information and video data. The location analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation.

[1519] 4. Traffic rule compliance assessment: The server assesses compliance with traffic rules based on the analysis results. It recognizes pedestrian signals and determines whether the vehicle is stopping correctly at traffic lights or crossing the street when the light is green.

[1520] 5. Character growth management and incentives: When traffic rules are followed, the game management software will award growth points to the in-game character and update the character's growth in real time. The results will be sent to the user's (parents' or guardians') smartphone, which can be enjoyed as an incentive.

[1521] 6. Anomaly detection and alerts: The server monitors location information for sudden changes or periods of inactivity, and if an anomaly is detected, it immediately generates an alert message and sends a notification to emergency contacts.

[1522] Specific examples

[1523] For example, if a child strays from a designated area within a store, the server-side analysis software will determine this as an abnormality and immediately send an alert to the parent or store staff's smartphone, allowing for a prompt response.

[1524] Example prompt sentence:

[1525] "I want to develop an application that analyzes location information and video data and sends an alert if the user goes outside a specified range."

[1526] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1527] Step 1:

[1528] The device uses a GPS module to obtain the subject's current location. The device sends the obtained location information to the server at regular intervals (e.g., every 30 seconds). In this case, the input is the location data from the GPS module, and the output is the location information sent to the server.

[1529] Step 2:

[1530] The device uses a small camera to capture images of the surrounding area. The device transmits the image data to the server at intervals, similar to the location information. In this case, the input is the image data from the camera, and the output is the image data transmitted to the server.

[1531] Step 3:

[1532] The server analyzes the received location information and video data. The location information analysis software evaluates the current location, and the video analysis software recognizes pedestrian signals and the surrounding situation from the video data. The inputs are location information and video data, and the output is location evaluation information and video analysis information as the analysis results.

[1533] Step 4:

[1534] The server determines whether or not traffic rules are being followed based on the analysis results. The analysis software recognizes pedestrian signals and determines whether the subject stops correctly at the traffic light or crosses the street when the light is green. The input is the analysis results, and the output is the determination of whether or not the subject is following traffic rules.

[1535] Step 5:

[1536] If traffic rules are followed, the server will award training points to the in-game character through the game management software. The server will then notify the user (parent or guardian) of this result via their smartphone. The input is the result of compliance, and the output is character growth information and a notification to the user.

[1537] Step 6:

[1538] The server monitors location information for sudden changes or stationary periods. If the server detects an abnormality, it immediately generates an alert message and sends a notification to emergency contacts. The input is location information change data, and the output is the generated alert message.

[1539] Step 7:

[1540] The device compresses the location information and video data at intervals and sends them to the server. This improves data transfer efficiency. The input is location information and video data, and the output is compressed data.

[1541] Step 8:

[1542] The server sends an alert if the target person goes outside the specified range. The server monitors the target person's current location based on the received location information, and if the target person goes outside the range, it issues a warning and notifies the parent or administrator. In this case, the input is location information and the output is an alert message.

[1543] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1544] The present invention combines a monitoring system aimed at ensuring children's safety on their way to and from school and preventing elderly people from wandering away with an emotion engine that recognizes the user's emotions, and is configured and operated as follows.

[1545] System configuration

[1546] This system consists of the following elements:

[1547] Means of obtaining location information (GPS module)

[1548] A means of capturing images of the surrounding area (small camera)

[1549] A communication module that sends data to the server

[1550] A means of determining compliance with traffic rules (analysis software on the server)

[1551] A means of managing in-game character growth (game management software on the server)

[1552] A means of detecting anomalies and sending alerts (server alert system)

[1553] Emotion engine that recognizes user emotions

[1554] System Operation

[1555] Initial Setup

[1556] 1. The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[1557] 2. Users register their Mamorun Cam device within the app by scanning the QR code or serial number to add the device to the system.

[1558] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1559] Real-time monitoring and analysis

[1560] 1. The device (Mamorun Cam) acquires location information while worn and collects current location data using the GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[1561] 2. The device captures images of the surroundings in real time using a camera, and stores the image data in memory.

[1562] 3. The device compresses the acquired location information and video data at specific intervals (e.g., every 30 seconds) and sends it to the server via the communication module.

[1563] Traffic rule compliance and emotion analysis

[1564] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[1565] 2. The server passes the obtained video data to the emotion engine, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[1566] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[1567] Managing game elements

[1568] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[1569] 2. Adjust the training points and incentives based on the emotional data recognized by the emotion engine. For example, if the child seems to be having fun, give them more points to increase their sense of security.

[1570] Anomaly detection and alerts

[1571] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[1572] 2. The server also uses the emotion data recognized by the emotion engine and immediately generates an alert message if it determines that there is an abnormality.

[1573] 3. The server sends an alert message to the designated contacts via smartphone push notification or email.

[1574] Specific examples

[1575] Example of children going to school

[1576] 1. The user (parent) attaches the Mamorun Cam to their child's school bag and activates the device using the app.

[1577] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[1578] 3. The device compresses the location information and video data every 30 seconds and sends it to the server.

[1579] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light.

[1580] 5. The server analyzes the video data using an emotion engine to recognize the child's emotional state.

[1581] 6. The server awards points to the in-game character based on whether the rules were followed correctly and the character's emotional state, and notifies the user's app.

[1582] Examples of elderly people wandering

[1583] 1. The user (family member) attaches the "Mamorun Cam" to the clothing of the elderly person when they go out.

[1584] 2. The device transmits the acquired location information and video data to the server in real time.

[1585] 3. The server detects sudden changes in location information and long periods of stillness, and analyzes the video data using an emotion engine.

[1586] 4. The server determines abnormalities based on the elderly person's emotional state and location data, and sends a notification to emergency contacts if an alert is necessary.

[1587] 5. Users receive alerts and can respond quickly.

[1588] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[1589] The processing flow will be explained below.

[1590] Step 1:

[1591] The user (parent or family member) installs the app on their smartphone and creates an account by entering their email address and password.

[1592] Step 2:

[1593] Users register their Mamorun Cam device within the app by scanning the QR code or serial number and adding the device to the system.

[1594] Step 3:

[1595] Users enter information about the target person (children or elderly people), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1596] Step 4:

[1597] The device (Mamorun Cam) acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[1598] Step 5:

[1599] The device captures images of the surroundings in real time using a camera. The device stores the image data in memory and compresses it at specific intervals (e.g., every 30 seconds).

[1600] Step 6:

[1601] The terminal transmits the compressed location information and video data to the server via the communication module.

[1602] Step 7:

[1603] The server then passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic signals, crosswalks, and pedestrian movements to determine whether traffic rules are being followed.

[1604] Step 8:

[1605] The server passes the video data to an emotion engine, which analyzes the facial expressions and speech of the user (children or elderly people) to recognize their emotions.

[1606] Step 9:

[1607] The server combines the analyzed emotional data with compliance with traffic rules to increase the probability of detecting abnormal behavior.

[1608] Step 10:

[1609] The server assigns training points to in-game characters based on traffic rule compliance and emotional data. Game management software on the server updates the character's growth in real time and stores the results in a database.

[1610] Step 11:

[1611] The server analyzes location fluctuation data and emotional data to detect abnormalities (e.g., not moving for a certain period of time, or sudden movement).

[1612] Step 12:

[1613] The server also uses emotion data to determine abnormalities and immediately generates an alert message, which includes the specific details of the abnormality, location information, and emotional state.

[1614] Step 13:

[1615] The server will then send an alert message to the designated contacts, either via smartphone push notification or email.

[1616] Step 14:

[1617] Users (parents and family members) receive an alert notification, check the situation through the app, and take action to respond quickly if necessary.

[1618] Step 15:

[1619] Users (children) can check the progress of their in-game characters on their smartphone app and enjoy it as an incentive to follow traffic rules.

[1620] Example 2

[1621] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1622] Conventional location information acquisition systems and surveillance systems simply acquire and analyze location information and video data, making it difficult to grasp the user's psychological state or more precisely detect abnormal behavior. Furthermore, they lack a mechanism for sending emergency notifications based on accurate information quickly when abnormal behavior occurs. Furthermore, they lack a function for linking the growth of an agent in the system's virtual environment to the user's psychological state, making it difficult to maintain the user's interest and motivation.

[1623] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1624] In this invention, the server includes means for detecting anomalies in location information and sending an alert, means for recognizing the user's psychological state, and means for detecting abnormal behavior by integrating the acquired psychological state with compliance with regulations, thereby enabling precise detection of abnormal behavior that takes the user's psychological state into consideration and rapid transmission of emergency notifications.

[1625] "Means for obtaining location information" refers to a system or device for measuring the subject's current location and obtaining that data.

[1626] "Means for capturing video of the surroundings" refers to a camera or other device that captures video of the subject's surroundings in real time.

[1627] "Server" refers to a computer system that collects, analyzes, stores, and transmits data over a network.

[1628] "Means for transmitting to a server" refers to a communication module or network connection means for transmitting the acquired location information and video data to a server.

[1629] "Means for determining compliance with regulations" refers to analytical software or algorithms that analyze acquired data to determine whether traffic rules or other regulations are being complied with.

[1630] "Means for managing the growth of agents within a virtual environment" refers to software and data management systems for managing the growth and development of agents operating in a virtual environment within the system.

[1631] "Means for detecting location anomalies and sending alerts" refers to a system that detects unusual location changes or inactivity and sends warnings or notifications based on that information.

[1632] "Means for recognizing the user's psychological state" refers to software or algorithms for analyzing and recognizing the user's psychological state from facial expressions, voice, behavior, etc.

[1633] "Means for detecting abnormal behavior" refers to a system that integrates acquired data with perceived psychological states to detect unusual behavioral patterns.

[1634] "Means for sending emergency notifications" means communications systems or software that rapidly send alerts or notifications to designated contacts when abnormal behavior is detected.

[1635] The present invention is a monitoring system for the purpose of ensuring the safety of children going to and from school and preventing elderly people from wandering away, and is also combined with an emotion engine that recognizes the user's psychological state. This system is configured and operated as follows.

[1636] System configuration

[1637] This system consists of the following elements:

[1638] Means of obtaining location information (GPS module)

[1639] A means of capturing images of the surrounding area (small camera)

[1640] A communication module that sends data to the server

[1641] A means of determining compliance with regulations (analysis software on the server)

[1642] A means of managing the growth of agents in the virtual environment (game management software in the server)

[1643] A means of detecting anomalies and sending alerts (server alert system)

[1644] Emotion engine that recognizes the user's mental state

[1645] Initial Setup

[1646] First, users install the smartphone application and create an account by entering their email address and password. Next, they register the device within the app by scanning a QR code or serial number and adding it to the system. Finally, they enter information about the target person (children or elderly), emergency contacts, and notification settings, and then perform AI-based regulatory checks and configure agents in the virtual environment.

[1647] Real-time monitoring and data transmission

[1648] While the device is attached, it uses a GPS module to collect location data. It typically updates its location every five seconds and captures real-time images of the surrounding area with its camera, saving them to memory. This location information and video data is compressed every 30 seconds and sent to a server via a communications module.

[1649] Data analysis by server

[1650] The server passes the received location information and video data to an analysis program, which uses AI algorithms to recognize traffic lights, sidewalks, and other regulatory objects and determine compliance with regulations. The server also passes the obtained video data to an emotion engine, which analyzes the user's (children or elderly) facial expressions and voice to recognize their psychological state. This analysis combines psychological state with compliance with regulations, enabling more precise detection of abnormal behavior.

[1651] Managing game elements

[1652] If the server complies with the regulations, it will award training points to the agent in the virtual environment. The game management software on the server updates the agent's growth in real time and provides feedback to the user. Furthermore, the emotion engine adjusts training points and incentives based on the agent's psychological state. For example, if a child appears to be having fun, it will be awarded more points, increasing their motivation.

[1653] Anomaly detection and alert sending

[1654] The server analyzes location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement). It also uses the psychological state recognized by the emotion engine and immediately generates an alert message if it determines that an abnormality exists. Finally, the server sends the alert message to designated contacts, and notifications are sent via smartphone push notifications or email, allowing users to respond promptly.

[1655] Specific examples

[1656] Example of children going to school

[1657] The user (parent) attaches the device to their child's school bag and activates it with the app. The device obtains location information every five seconds using a GPS module and captures images of the surrounding area using a camera. Every 30 seconds, the location information and video data are compressed and sent to the server. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping correctly at the traffic light. The server also analyzes the video data using an emotion engine to recognize the child's psychological state. Points are awarded to the agent in the virtual environment depending on whether the rules are followed correctly and the child's psychological state, and a notification is sent to the user's app.

[1658] Examples of elderly people wandering

[1659] The user (family member) attaches the device to the elderly person's clothing when they go out. The device sends location information and video data to a server in real time. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data using an emotion engine. It determines abnormalities based on the elderly person's psychological state and location data, and sends an alert to emergency contacts if necessary. The user receives the alert and can respond quickly.

[1660] Prompt Sentence Examples

[1661] Enter the following prompt into the generative AI model:

[1662] "Please tell me about the system for monitoring children's safety on their way to and from school. I would like to know whether the children cross the street correctly at traffic lights and their psychological state."

[1663] or

[1664] "I would like to know how we can be notified if an elderly person wanders off while out. Please explain how the system works, including psychological analysis."

[1665] As described above, the present invention provides an effective system that supports children's safe commute to and from school and prevents elderly people from wandering away, and by combining it with an emotion engine, it achieves a higher level of safety and a sense of security for the user.

[1666] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1667] Step 1:

[1668] A user installs the app on their smartphone and creates an account by entering their email address and password. The input is an email address and password, and the output is the creation of a new account. Specifically, the user enters the information as instructed by the app and presses the registration button.

[1669] Step 2:

[1670] To register a device within the app, a user scans a QR code or serial number to add the device to the system. The input is the QR code or serial number, and the output is the device registration completion. Specifically, the user scans the QR code attached to the device with the camera.

[1671] Step 3:

[1672] The user inputs information about the target person (children or elderly), emergency contacts, and notification settings, and the AI ​​checks regulations and configures the agent in the virtual environment. The input is target person information, emergency contacts, and notification settings, and the output is setting completion. Specifically, the user inputs the required information into the app form and presses the "Settings Complete" button.

[1673] Step 4:

[1674] While the device is attached, it uses a GPS module to collect location data. The input is a GPS signal, and the output is location data. Specifically, the GPS module updates the location information every 5 seconds and stores it in its internal memory.

[1675] Step 5:

[1676] The device uses a camera to capture images of the surroundings in real time and stores the image data in memory. The input is the surrounding image and the output is the image data. Specifically, the camera captures video images of the surroundings of the device and stores them in memory frame by frame.

[1677] Step 6:

[1678] The device compresses location information and video data every 30 seconds and sends it to the server via the communication module. The input is location information data and video data, and the output is the transmission of compressed data. Specifically, the compression algorithm compresses the data, and the network module sends the data to the server.

[1679] Step 7:

[1680] The server passes the received location information and video data to an analysis program, which uses an AI algorithm to determine compliance with regulations. The input is location information data and video data, and the output is compliance status data. Specifically, the analysis software analyzes the data and recognizes traffic lights and sidewalks.

[1681] Step 8:

[1682] The server passes the video data to the emotion engine, which analyzes the user's facial expressions and voice to recognize their psychological state. The input is video data, and the output is psychological state data. Specifically, the emotion engine uses a facial expression recognition algorithm to analyze the video and generate results.

[1683] Step 9:

[1684] The server integrates regulatory compliance status data and psychological state data to detect abnormal behavior. The inputs are regulatory compliance status data and psychological state data, and the output is abnormal behavior detection data. Specifically, the server uses an integrated algorithm to analyze the data and identify abnormalities.

[1685] Step 10:

[1686] When the server detects abnormal behavior, it immediately generates an alert message and sends it to the specified contacts. The input is the abnormal behavior detection data, and the output is the sending of the alert message. Specifically, the alert system generates a message and sends a notification to the contacts via the communication module.

[1687] Step 11:

[1688] If the agent obeys traffic rules, the server awards training points to the agent in the virtual environment and notifies the user of the feedback. The input is regulatory compliance data and psychological state data, and the output is training points and a notification. Specifically, the game management software calculates the points and sends a notification to the user's app.

[1689] (Application example 2)

[1690] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1691] The present invention relates to a system for ensuring the safe movement of children and the elderly. In particular, conventional systems only detect abnormalities based on location information and video data, and do not take into account the emotional state of the user, which limits their ability to detect abnormalities early and respond to emergencies. As a result, there is a problem of an increased risk of dangerous situations occurring.

[1692] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring location information, means for capturing video of the surroundings, means for transmitting the acquired location information and video to the server, means for analyzing the location information and video in the server and determining compliance with traffic rules, means for managing the growth of characters in the game based on compliance with traffic rules, means for detecting abnormalities in the location information and sending an alert, means for analyzing emotions, means for detecting abnormalities based on the emotion analysis results, and means for sending an alert to an emergency contact when an abnormality is detected. This makes it possible to monitor the user's emotional state in real time, detect abnormalities more quickly and accurately, and improve safety.

[1693] "Means for acquiring location information" refers to technology or devices that use a GPS module or other location information acquisition device to acquire the current location data of a target.

[1694] "Means for capturing images of the surroundings" refers to technology or devices that use a camera such as a small camera or video camera to capture images of the surroundings of a target.

[1695] "Means for transmitting to a server" refers to a technology or device that uses a communication module or an internet line to transmit acquired data to a server.

[1696] "Means for determining compliance with traffic rules" refers to technologies and devices that use analytical software and AI algorithms on a server to analyze acquired video data and location information to check whether traffic rules are being followed.

[1697] "Means for managing the growth of in-game characters" refers to technology or devices that use game management software in the server to update and manage the growth of in-game characters in real time based on user behavior.

[1698] "Means for detecting abnormalities in location information and sending alerts" refers to technology or devices that analyze acquired location information and, if abnormal behavior (e.g., sudden movement or prolonged stationary status) is detected, generate an alert message and send it to an emergency contact.

[1699] "Means for analyzing emotions" refers to technology or equipment that uses emotion analysis software or AI algorithms stored on a server to analyze the subject's emotional state (e.g., happy, sad, anxious, etc.) from the acquired video data.

[1700] "Means for sending an alert to an emergency contact when an abnormality is detected" refers to technology or equipment that immediately sends an alert message to a designated emergency contact when an abnormality is detected as a result of emotion analysis or location information analysis.

[1701] The present invention relates to a security system for ensuring the safe movement of children and the elderly, and in particular to a system that analyzes the user's emotional state to enable earlier and more accurate abnormality detection and emergency response.

[1702] System configuration

[1703] This system consists of the following elements:

[1704] Means for obtaining location information (GPS module): Used to obtain location information with high accuracy.

[1705] A means of capturing images of the surroundings (small cameras): Capture images of the environment in real time as you move and collect that data.

[1706] Means for sending to the server (communication module): A module for compressing location information and video and sending it to the server.

[1707] Means for determining compliance with traffic rules (analysis software on the server): Analysis software running on a server connected to the Internet is used to recognize traffic lights, crosswalks, etc. and determine compliance with traffic rules.

[1708] A means of managing in-game character growth (game management software on the server): updating character growth in real time and providing feedback to the user.

[1709] A means of detecting abnormalities in location information and sending alerts (alert system within the server): Detects abnormalities such as sudden changes in acquired location information or prolonged periods of stationary motion, and sends an alert to emergency contacts.

[1710] Means for analyzing emotions (emotion analysis module): Analyzes the user's emotional state from video data.

[1711] A means of sending an alert to an emergency contact when an abnormality is detected (server alert system): When an abnormality is detected based on the results of emotion analysis, etc., an alert message is sent to the designated emergency contact.

[1712] System Operation

[1713] Initial Setup

[1714] 1. The user (parent or family member) installs the application on their smartphone and creates an account by entering their email address and password.

[1715] 2. The user registers the device within the application, scanning the QR code or serial number to add the device to the system.

[1716] 3. The user enters information about the target person (children or elderly), emergency contact information, and notification settings, and the AI ​​checks traffic rules and sets up in-game characters.

[1717] Real-time monitoring and analysis

[1718] 1. The device acquires location information while worn and collects current location data using a GPS module. The device updates its location information at regular intervals (e.g., every 5 seconds).

[1719] 2. The device uses a camera to capture images of the surrounding area in real time and stores the image data in memory.

[1720] 3. The device compresses the acquired location information and video data and sends it to the server via the communication module.

[1721] Traffic rule compliance and emotion analysis

[1722] 1. The server passes the received location information and video data to an analysis program. The analysis software on the server uses AI algorithms to recognize traffic lights, crosswalks, and pedestrian movements, and determines whether traffic rules are being followed.

[1723] 2. The server passes the obtained video data to an emotion analysis module, which analyzes the user's (children or elderly) facial expressions and speech to recognize their emotions.

[1724] 3. The server combines the analyzed emotional data with compliance with traffic rules to make it easier to detect abnormal behavior.

[1725] Managing game elements

[1726] 1. The server awards training points to in-game characters when traffic rules are followed. The game management software on the server updates the character's growth in real time and provides feedback to the user.

[1727] 2. The emotion analysis module adjusts the training points and incentives based on the emotional data it recognizes. For example, if a child seems to be having fun, it will give them more points to increase their sense of security.

[1728] Anomaly detection and alerts

[1729] 1. The server analyzes the location information fluctuation data and detects abnormalities that meet certain conditions (e.g., no movement for a certain period of time, sudden movement).

[1730] 2. The server also uses the results of emotion analysis and immediately generates an alert message if it determines that there is an abnormality.

[1731] 3. The server sends an alert message to the designated emergency contact via smartphone push notification or email.

[1732] Specific examples

[1733] For children

[1734] 1. The user attaches the device to their child's school bag and starts the device with the application.

[1735] 2. The device obtains location information every 5 seconds using the GPS module and takes photos of the surrounding area using the camera.

[1736] 3. The device compresses the location information and video data and sends them to the server.

[1737] 4. The server analyzes the data, checks the traffic light conditions, and evaluates whether the child is stopping at the correct traffic light.

[1738] 5. The server analyzes the video data to recognize the child's emotional state.

[1739] 6. The server will award points to the character based on whether the rules were followed correctly and depending on the character's emotional state, and notify the user.

[1740] For elderly people

[1741] 1. The user attaches the device to the elderly person's clothing when they go out.

[1742] 2. The device sends location information and video data to the server.

[1743] 3. The server detects sudden changes in location information or long periods of stillness, and analyzes the video data to recognize the emotional state.

[1744] 4. If the server detects an abnormality, it will send an immediate alert to emergency contacts. 【1...

Claims

1. A means for acquiring location information; A means for capturing images of the surroundings; A means for transmitting the acquired location information and video to a server; A means for analyzing location information and video in a server and determining compliance with traffic rules; A means of managing the development of your in-game character based on compliance with traffic rules; A system including means for detecting anomalies in location information and sending an alert.

2. The system of claim 1 , further comprising a game element that provides an incentive for character development.

3. The system of claim 1 , further comprising a function for sending an alert to an emergency contact when an abnormality is detected.

Images