system

Abstract

Provide a system. A means for acquiring current location information; means for transmitting the acquired current location information; means for receiving audio input; means for transmitting audio input; A means for analyzing voice data to obtain destination information; A method for calculating the optimal route based on current location information and destination information, A means for converting the optimal route into audio data; means for transmitting audio data to a terminal; means for playing the transmitted audio data; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The objective of this invention is to provide technology that allows elementary school children to return home safely when they are out alone and allows parents to check on their children's status remotely. Specifically, the current problem is solved by developing multifunctional kids' glasses that aim to prevent children from getting lost and to check their safety. [Means for solving the problem]

[0005] The present invention is a system including means for acquiring current location information, means for transmitting the acquired current location information, means for receiving voice input, means for transmitting voice input, means for analyzing voice data to acquire destination information, means for calculating an optimal route based on the current location information and the destination information, means for converting the optimal route into voice data, means for transmitting the voice data to a terminal, means for playing the transmitted voice data, means for photographing the current scenery, means for compressing the photographed image data, means for transmitting the compressed image data to a server, means for receiving and saving the image data, means for measuring the amount of ultraviolet rays, and means for adjusting a UV cut filter based on the measured amount of ultraviolet rays.

[0006] This allows parents to keep an eye on their children while they are out and about, even if they get lost or lost their way, and it also helps protect their children's health by protecting their eyes from UV rays.

[0007] "Means for obtaining current location information" refers to a device or system that uses a GPS sensor or other location measurement technology to obtain the current latitude and longitude information of a terminal.

[0008] The "means for transmitting the acquired current location information" refers to a technique or device for transmitting the acquired current location information to a server or other receiving device via a communication module.

[0009] "Means for receiving voice input" refers to devices or technologies for obtaining voice instructions from the user (child) using a microphone or voice recognition technology.

[0010] The "means for transmitting voice input" refers to a technique or device for transmitting captured voice data to a server or other processing device via a communication module.

[0011] The "means for analyzing voice data to obtain destination information" is a system that uses voice recognition technology on the server side to convert received voice data into text and extract destination information therefrom.

[0012] "Means for calculating the optimal route based on current location information and destination information" refers to a system that uses navigation algorithms and AI technology to derive the optimal route from the current location to the destination.

[0013] The "means for converting the optimal route into voice data" is a system that uses voice synthesis technology to convert calculated route information into voice guidance that is easy for the user to understand.

[0014] The "means for transmitting audio data to the terminal" refers to a technique or device for transmitting audio data to the terminal via the communication module.

[0015] The "means for reproducing the transmitted audio data" refers to a technique or device for reproducing the received audio data as audio guidance to the user using a speaker or earphones.

[0016] The "means for capturing a current view" refers to a technique or device for capturing a view of the user's field of vision using a camera module.

[0017] The "means for compressing captured image data" refers to software or hardware technology for efficiently compressing captured high-resolution image data.

[0018] The "means for transmitting compressed image data to a server" refers to a technique or device for transmitting compressed image data to a server via a communication module.

[0019] The "means for receiving and storing image data" refers to a technique or device for storing image data received on the server side in a storage system.

[0020] "Means for measuring the amount of ultraviolet light" refers to technology or equipment that uses an ultraviolet sensor to measure the intensity of ultraviolet light in the environment.

[0021] "Means for adjusting the UV cut filter based on the measured amount of UV rays" refers to technology or devices for dynamically adjusting the UV cut function of the lens based on the measured amount of UV rays. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] This invention provides multifunctional children's glasses equipped with GPS and AI navigation, camera, video recording, and UV protection. The program processing of this system is explained in natural language below, and is also described in detail with specific examples.

[0044] GPS and AI-powered route guidance

[0045] Device (kids' glasses)

[0046] The device periodically acquires its current location using a built-in GPS sensor and sends that information to the server. When the user (child) gets lost, they can input a command into the device by voice, such as "I want to go home." The device then sends that voice data to the server.

[0047] server

[0048] The server receives the current location information and voice data sent from the device. It converts the received voice data into text using voice recognition technology and analyzes the question. It then retrieves destination information (e.g., "home") from a database. The server uses an AI algorithm to calculate the optimal route from the current location to the destination and converts the result into voice data. The voice data of the optimal route is sent to the device.

[0049] Device (kids' glasses)

[0050] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to reach their destination by following the voice guidance.

[0051] Examples:

[0052] When a user voice-inputs "I want to go home," Kids Glasses sends the voice to the server. The server calculates the optimal route and sends voice data saying "Turn right and go 100 meters" to the device. The device plays back the voice and guides the user to their destination.

[0053] Camera function / recording function

[0054] Device (kids' glasses)

[0055] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[0056] server

[0057] The server receives and stores image data sent from the device, allowing parents to view the images through the app.

[0058] User (Parent)

[0059] Parents can use the app to review the images and send instructional messages to their children if needed.

[0060] Examples:

[0061] If a user gets lost, they can press the share button to take a picture of the current view and send the image data to the server. The parent can then check the image received in the app and send a text message with instructions such as "Go left from that location."

[0062] UV protection

[0063] Device (kids' glasses)

[0064] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes.

[0065] Examples:

[0066] When the user goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[0067] This will enable the realization of multi-functional kids' glasses that prevent children from getting lost, allow parents to check on their children's situation remotely, and protect their eyes from UV rays. This system is an embodiment that ensures children's safety and provides peace of mind to parents.

[0068] The processing flow will be explained below.

[0069] GPS and AI-powered route guidance

[0070] Step 1: Obtain and send location data

[0071] Terminal

[0072] 1. The device obtains its current location information (latitude and longitude) from the built-in GPS sensor.

[0073] 2. The acquired current location information is sent to the server via the communication module.

[0074] Specific actions

[0075] The GPS sensor measures your current location and passes the results to the GPS data acquisition module.

[0076] The GPS data acquisition module formats the data and sends it to the server through the communication module.

[0077] Step 2: Enter and submit your voice question

[0078] User (child)

[0079] 1. If your child gets lost, they can ask a voice message saying, "I want to go home."

[0080] Terminal

[0081] 1. The voice input module acquires voice data and sends it to the server through the communication module.

[0082] Specific actions

[0083] The voice input module captures voice data and sends it to the server through the communication module.

[0084] Step 3: Analyze voice data and obtain destination information

[0085] server

[0086] 1. The server receives the voice data sent from the device.

[0087] 2. The voice data is converted into text using a voice recognition module, and the question content is analyzed.

[0088] 3. Retrieve destination information from the database.

[0089] Specific actions

[0090] The voice recognition module converts the voice data into text, and the text analysis module extracts destination information.

[0091] The corresponding destination information is obtained from the destination database.

[0092] Step 4: Route calculation and voice data generation

[0093] server

[0094] 1. The AI ​​algorithm calculates the optimal route based on current location and destination information.

[0095] 2. The calculation results are converted into audio data and sent to the device.

[0096] Specific actions

[0097] The route calculation module calculates the optimal route using the current location and destination as input.

[0098] The speech synthesis module converts the calculation results into speech data and sends it to the terminal via the communication module.

[0099] Step 5: Play audio prompts

[0100] Terminal

[0101] 1. The device receives the audio data sent from the server and plays it back to the user.

[0102] Specific actions

[0103] The communication module receives audio data from the server and passes it to the audio playback module for playback.

[0104] Camera function / recording function

[0105] Step 1: Press the share button and take a picture

[0106] User (child)

[0107] 1. When you get lost or in trouble, just press the share button.

[0108] Terminal

[0109] 1. When the button is pressed, the camera will take a picture of the current view.

[0110] 2. Compress the captured image data.

[0111] Specific actions

[0112] The button input module detects user presses and sends a trigger to the camera module.

[0113] The camera module takes images and passes the data to the image compression module.

[0114] Step 2: Send and save image data

[0115] Terminal

[0116] 1. The compressed image data is sent to the server via the communication module.

[0117] server

[0118] 1. The server receives and stores the image data sent from the device.

[0119] Specific actions

[0120] The communication module sends the image data to the server, and the server's image storage module stores it in a database.

[0121] Step 3: Parents review images and send messages

[0122] User (Parent)

[0123] 1. Parents can use the app to check the received image data.

[0124] 2. Send texts or voice messages to your child as needed.

[0125] Specific actions

[0126] The application interface displays image data and sends instructions through the message input module.

[0127] UV protection

[0128] Step 1: Measure UV levels and adjust filters

[0129] Terminal

[0130] 1. The UV sensor measures the amount of UV light in the environment.

[0131] 2. If a certain level of UV rays is detected, the UV cut filter will automatically adjust.

[0132] Specific actions

[0133] The UV sensor module measures the amount of UV rays and passes the results to the filter control module.

[0134] The filter control module adjusts the effect of the UV cut filter to protect your eyes from ultraviolet rays.

[0135] In this way, the operations at each processing step are specified, and the user, terminal, and server cooperate to realize the functions of the multifunctional kids' glasses.

[0136] Example 1

[0137] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0138] In modern society, it is necessary to reduce the risk of children getting lost when they are out and help them return home safely. However, conventional devices with GPS functions lack supportive route guidance and communication with parents, making it difficult to provide multifunctional support. Protecting children from UV rays when outdoors is also important, but inadequate protection can have a negative impact on their health. To effectively solve these issues, a multifunctional system that integrates route guidance, camera functions, UV protection, and other functions is required.

[0139] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0140] In this invention, the server includes means for acquiring current location information, means for analyzing voice data and converting it into text, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, means for converting the optimal route into voice data, means for receiving and saving image data, means for the user to check the received image data, means for measuring the amount of ultraviolet light, and means for adjusting the UV-cut filter based on the measured amount of ultraviolet light. This makes it possible for the server to provide appropriate voice guidance when a child gets lost, to remotely share the current scenery, and to protect the child's eyes from ultraviolet light.

[0141] "Current location information" is latitude and longitude data relating to the current location of the terminal obtained using a GPS sensor.

[0142] "Means for acquiring" refers to means including sensors and modules for collecting or detecting specific information.

[0143] The "transmitting means" is a means for transmitting the acquired data to another device or system via wireless or wired communication.

[0144] "Voice input" refers to data that receives a user's voice commands or instructions through a voice input device such as a microphone.

[0145] "Voice data" refers to data in which voice information input by a user is recorded in digital format.

[0146] "Means for analyzing" refers to means for analyzing information such as voice data or text data and extracting specific meanings or instructions.

[0147] "Destination information" is location information such as latitude and longitude relating to the location the user is heading for.

[0148] The "calculating means" is a processing device that includes an algorithm for deriving the optimal route based on current location information and destination information.

[0149] A "means for converting" is a means for converting data of a particular format into another format, such as a means for converting text to speech.

[0150] The "means for reproducing audio data" refers to an output device such as a speaker or headphones that allows the user to hear the audio data.

[0151] The "means for photographing scenery" is a means for acquiring the current scenery as image data using a camera.

[0152] The "means for compressing" refers to a means for using image compression technology to reduce the volume of acquired image data.

[0153] The "means for receiving and storing" is a means for receiving data sent from other terminals and storing it in a database or file system.

[0154] "Means for user confirmation" refers to devices or applications that allow users to view or confirm stored data.

[0155] The "means for measuring the amount of ultraviolet light" refers to a means including an ultraviolet sensor for measuring the intensity of ultraviolet light in the environment.

[0156] A "UV cut filter" is a special filter used to block or reduce ultraviolet rays.

[0157] A "means for adjusting" is a means for changing or configuring a device or function based on a particular parameter or condition.

[0158] This invention relates to a multi-function kids' glasses system equipped with GPS and AI navigation, camera, video recording, and UV protection functions. The system consists of a server, a terminal (kids' glasses), and users (children and parents).

[0159] GPS and AI-powered route guidance

[0160] Device (kids' glasses)

[0161] The device has a built-in GPS sensor that periodically acquires its current location information. This information is sent to the server via a communication module. When the user (child) gets lost, they press a button and input voice commands such as "I want to go home" into the device. The device records this voice data and sends it to the server.

[0162] server

[0163] The server receives the current location information and voice data sent from the device. It converts the voice data into text using a voice recognition engine (e.g., Google (registered trademark) Speech-to-Text API) and analyzes the instructions. It then retrieves destination information (e.g., home address and latitude and longitude) from a database. The server uses an AI algorithm (e.g., A algorithm) to calculate the optimal route from the current location to the destination. The result of this calculation is converted into voice data using a voice synthesis engine (e.g., Amazon Polly) and sent to the device.

[0164] Device (kids' glasses)

[0165] The device receives the voice data sent from the server and plays it back to the user through the speaker, allowing the user to follow the voice guidance to reach their destination.

[0166] Examples:

[0167] When a user voice-inputs "I want to go home," the device sends that voice to the server. The server calculates the optimal route and sends the guidance "Turn right and go 100 meters" to the device as voice data. The device plays back that voice and guides the user to their destination.

[0168] Camera function / recording function

[0169] Device (kids' glasses)

[0170] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[0171] server

[0172] The server receives and stores image data sent from the device, which parents can then view via a smartphone app.

[0173] User (Parent)

[0174] Parents can use the app to view image data and send instructional messages to their children if necessary.

[0175] Examples:

[0176] If a user gets lost, they can press the share button to take a picture of the current view and send the image to the server. The parent can then check the image in the app and send a text message with instructions such as "Go left from that location."

[0177] UV protection

[0178] Device (kids' glasses)

[0179] The device has a built-in UV sensor that continuously measures the amount of UV rays in the environment, and when the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes from UV rays.

[0180] Examples:

[0181] When the user goes outside on a sunny day, if the UV sensor detects high levels of UV rays, the UV cut filter will automatically adjust to protect children's eyes.

[0182] Example prompts for generative AI models

[0183] 1. Example prompt (directions function):

[0184] "Please explain the process of a program that uses GPS and AI to provide voice guidance on the route home if a child gets lost."

[0185] 2. Example prompts (camera function):

[0186] "Explain the process of how a child takes a picture of the current view with their camera and then a parent reviews the image in the app."

[0187] 3. Example prompt (UV protection):

[0188] "Please explain the process of UV protection using an ultraviolet sensor to protect children's eyes."

[0189] This makes it possible to provide multifunctional kids' glasses that reduce the risk of children getting lost when out and about, allow parents to check on the situation remotely, and also protect the eyes from ultraviolet rays.

[0190] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0191] GPS and AI-powered route guidance

[0192] Step 1:

[0193] Device (kids' glasses)

[0194] Obtaining current location information

[0195] Input: None

[0196] Data processing / calculation: The device's built-in GPS sensor periodically measures the current latitude and longitude information.

[0197] Output: Current location information (latitude and longitude)

[0198] Specific operation: The GPS sensor measures the latitude and longitude of the current location and stores the data in the device's memory.

[0199] Step 2:

[0200] Device (kids' glasses)

[0201] Sending current location information

[0202] Input: Current location information (latitude and longitude)

[0203] Data processing / calculation: None

[0204] Output: Current location information (latitude and longitude) is sent to the server

[0205] Specific operation: Use the communication module to send current location information to the server.

[0206] Step 3:

[0207] Device (kids' glasses)

[0208] Acquiring voice input

[0209] Input: User's voice

[0210] Data processing / calculation: Record voice input and convert it into voice data

[0211] Output: Audio data

[0212] Specific operation: The microphone receives the user's voice, and the recording module converts the voice into digital audio data.

[0213] Step 4:

[0214] Device (kids' glasses)

[0215] Sending audio data

[0216] Input: Audio data

[0217] Data processing / calculation: None

[0218] Output: Audio data is sent to the server

[0219] Specific operation: Use the communication module to send audio data to the server.

[0220] Step 5:

[0221] server

[0222] Receiving and analyzing audio data

[0223] Input: Audio data

[0224] Data processing / calculation: Converting voice data into text using a voice recognition engine and analyzing the text data

[0225] Output: Text data (user instructions)

[0226] Specific operation: The server receives the voice data, the speech recognition engine converts the voice into text, and the analysis module extracts the command content.

[0227] Step 6:

[0228] server

[0229] Obtaining destination information

[0230] Input: Text data (user instructions)

[0231] Data processing / calculation: Obtain destination information (latitude and longitude) registered by the user from the database

[0232] Output: Destination information

[0233] Specific operation: The server executes a database query to retrieve destination information using the user ID as a key.

[0234] Step 7:

[0235] server

[0236] Calculating the best route

[0237] Input: Current location information, destination information

[0238] Data processing / calculation: Calculate the optimal route using AI algorithms

[0239] Output: Optimal route information

[0240] Specific operation: The server's route calculation module calculates the optimal route from the current location to the destination.

[0241] Step 8:

[0242] server

[0243] Generate voice guidance

[0244] Input: Optimal route information

[0245] Data processing / calculation: Generates voice guidance messages and converts them into voice data using a voice synthesis engine

[0246] Output: Voice guidance data

[0247] Specific operation: The message generation module creates a text message, and the speech synthesis engine converts it into voice data.

[0248] Step 9:

[0249] server

[0250] Sending audio data

[0251] Input: Voice guidance data

[0252] Data processing / calculation: None

[0253] Output: Voice guidance data is sent to the device.

[0254] Specific operation: The server sends the generated voice guidance data to the terminal.

[0255] Step 10:

[0256] Device (kids' glasses)

[0257] Playing voice guidance

[0258] Input: Voice guidance data

[0259] Data processing / calculation: Decode and play audio data

[0260] Output: A voice prompt that the user hears

[0261] Specific operation: The device receives the audio data, decodes it, and then plays it on the speaker.

[0262] Camera function / recording function

[0263] Step 1:

[0264] Device (kids' glasses)

[0265] Taking an image

[0266] Input: Press the Share button

[0267] Data processing / calculation: The camera captures the image data

[0268] Output: Image data

[0269] Specific operation: When the share button is pressed, the camera module takes a picture and captures image data.

[0270] Step 2:

[0271] Device (kids' glasses)

[0272] Image data compression

[0273] Input: Image data

[0274] Data processing / calculation: Compressed in JPEG format etc.

[0275] Output: Compressed image data

[0276] Specific operation: The image compression module compresses the original image into the specified format.

[0277] Step 3:

[0278] Device (kids' glasses)

[0279] Sending image data

[0280] Input: Compressed image data

[0281] Data processing / calculation: None

[0282] Output: Compressed image data is sent to the server

[0283] Specific operation: The communication module sends the compressed image data to the server.

[0284] Step 4:

[0285] server

[0286] Receiving and storing image data

[0287] Input: Compressed image data

[0288] Data processing / calculation: Save image data

[0289] Output: Saved image data

[0290] Specific operation: The server receives the image data and stores it in a database or file system.

[0291] Step 5:

[0292] User (Parent)

[0293] Image confirmation and instructions

[0294] Input: Image data

[0295] Data processing / calculation: Display image data in the app and create instruction messages

[0296] Output: prompt message

[0297] Specific operations: The parent opens the app, checks the image, creates a prompt message, and sends it to the child's device via the server.

[0298] UV protection

[0299] Step 1:

[0300] Device (kids' glasses)

[0301] Measurement of UV levels

[0302] Input: None

[0303] Data processing / calculation: UV sensor measures the amount of UV light in the environment

[0304] Output: UV data

[0305] How it works: The UV sensor samples the amount of UV light in the environment and sends that data to the device's processor.

[0306] Step 2:

[0307] Device (kids' glasses)

[0308] UV cut filter adjustment

[0309] Input: UV radiation data

[0310] Data processing / calculation: If the amount of UV rays is above a certain level, the transmittance of the UV cut filter is adjusted.

[0311] Output: Adjusted UV cut filter

[0312] Specific operation: The filter control module appropriately adjusts the filter transmittance based on UV intensity data.

[0313] This clearly explains the specific processing steps for each function of the system, as well as the specific operations, inputs, and outputs performed at each step.

[0314] (Application example 1)

[0315] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0316] Currently, it is not easy for customers to find specific product shelves in physical stores, or for parents to remotely monitor their children's locations and behavior. Furthermore, UV protection measures must be taken separately while shopping, creating multiple challenges. A single system is needed to solve these challenges.

[0317] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0318] In this invention, the server includes means for acquiring current location information, means for transmitting the acquired current location information, means for receiving voice input, means for transmitting voice input, means for analyzing voice data to acquire destination information, means for calculating an optimal route based on the current location information and destination information, means for converting the optimal route into voice data, means for transmitting the voice data to the terminal, means for playing the transmitted voice data, means for periodically taking and transmitting images and videos, means for saving the transmitted images and videos so that parents can review them, and means for measuring the amount of ultraviolet light and automatically applying a filter. This enables navigation within physical stores, remote monitoring of children, and ultraviolet light protection.

[0319] "Means for obtaining current location information" refers to the ability to determine the current location of a device using GPS or other location information technology.

[0320] The "means for transmitting acquired current location information" refers to a communication function for transmitting the current location information acquired by the terminal to a server.

[0321] "Means for receiving voice input" refers to functionality including a microphone and voice recognition technology that allows a user to input voice instructions into the device.

[0322] "Means for transmitting voice input" refers to a communication function that transmits received voice input data to a server.

[0323] "Means for analyzing voice data to obtain destination information" refers to technology that enables a server to analyze voice data and identify the user's intended destination.

[0324] "Means for calculating the optimal route based on current location information and destination information" refers to an algorithm that calculates the most efficient travel route using the current location and destination as input.

[0325] "Means for converting the optimal route into voice data" refers to technology that converts the calculated route into a voice message that is easy for the user to understand.

[0326] "Means for transmitting voice data to a terminal" refers to a communication function for transmitting the generated voice data to a terminal.

[0327] "Means for playing back transmitted audio data" refers to a speaker or playback device that allows the user to hear the audio data transmitted to the terminal.

[0328] "Means for periodically taking and transmitting images and videos" refers to a function that takes images and videos at regular intervals using the camera installed on the device and transmits them to a server.

[0329] "Means for storing transmitted images and videos so that parents can view them" refers to technology that stores received image and video data on a server and allows parents to view them remotely.

[0330] "Means for measuring the amount of UV rays and automatically applying a filter" refers to a function that uses a UV sensor built into the device to measure the amount of UV rays in the surrounding area and automatically applies a UV-cut filter as needed.

[0331] This invention provides a multi-function glasses system using GPS and AI, which integrates multiple functions such as customer navigation in physical stores, remote parental monitoring of children, and UV protection.

[0332] System Overview

[0333] Hardware Configuration

[0334] 1. Device (smart glasses)

[0335] The built-in GPS sensor is used to obtain current location information and send that information to the server.

[0336] Use a microphone to receive audio input.

[0337] Use the camera to take pictures and videos.

[0338] The amount of UV rays is measured using a UV sensor and the UV cut filter is automatically adjusted.

[0339] Play audio data through a speaker.

[0340] 2. Server

[0341] A high-performance computer that analyzes voice data and calculates routes.

[0342] Manages data transmission and reception and real-time database.

[0343] 3. Parental Smartphone

[0344] A device for reviewing images and videos and sending instructions to children.

[0345] Software Configuration

[0346] Google Cloud AI / ML services: Used for voice and image analysis.

[0347] Firebase: Used to send, receive, and store data in real time.

[0348] TENSORFLOW®: Used for speech recognition and route optimization algorithms.

[0349] Operation explanation

[0350] 1. Directions function

[0351] The device periodically obtains its current location information using its built-in GPS sensor and sends that information to the server.

[0352] When the user inputs a voice command such as "I want to go to shelf A," the device sends the voice data to the server.

[0353] The server analyzes the voice data, obtains destination information, and calculates the optimal route based on the current location and destination information.

[0354] The calculated route is converted into audio data and sent to the device, which then plays the audio data to guide the user.

[0355] 2. Monitoring function

[0356] The device's camera periodically takes images and videos and sends them to the server.

[0357] The server stores the received data and allows parents to check it in real time via a smartphone app.

[0358] Based on the verification results, parents can send necessary instructions to their children, which will then be played back on the device.

[0359] 3. UV protection

[0360] The device's built-in UV sensor measures the amount of UV rays in the environment and automatically adjusts the UV cut filter if the amount of UV rays exceeds a certain level.

[0361] This protects the user's eyes from UV rays.

[0362] Specific examples

[0363] Example 1: In-store navigation

[0364] A customer uses the smart glasses to voice-input, "I want to go to shelf A." The server analyzes the voice data, calculates the optimal route, and sends instructions to the smart glasses, such as "Turn right and go 10 meters." The smart glasses then play back the instructions aloud, guiding the customer to their destination.

[0365] Example 2: In-store monitoring

[0366] Children wear smart glasses in the store and periodically send images and videos to a server. Parents can check in real time via a smartphone app to understand their child's location and situation. Instructions such as "Go left from that location" are sent via text message, and the child receives the instructions through the smart glasses.

[0367] Example 3: UV protection function

[0368] When shopping outside the store, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[0369] Prompt Sentence Examples

[0370] "Please help me design a smart glasses application for a brick-and-mortar store. Please print out the application specifications that provide the following functionality:

[0371] 1. Real-time in-store navigation

[0372] 2. Parental monitoring of children's location and behavior

[0373] 3. UV cut function when high levels of UV rays are detected

[0374] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0375] Step 1:

[0376] The device acquires its current location information using the built-in GPS sensor. The input is the location data from the GPS sensor, and the output is the current location information. This data is sent to the next processing step.

[0377] Step 2:

[0378] The device sends the current location information it has acquired to the server. The input is the current location information, and the output is the current location information sent to the server. Transmission is via Wi-Fi or mobile communication networks.

[0379] Step 3:

[0380] The user inputs voice data into the terminal. For example, the user may say, "I want to go to shelf A," and the terminal receives this data through the microphone. The input is voice data, and the output is also voice data.

[0381] Step 4:

[0382] The device sends the received voice data to the server. The input is the voice data, and the output is the voice data sent to the server. Transmission is via Wi-Fi or mobile communication network.

[0383] Step 5:

[0384] The server analyzes the voice data and obtains the destination information. The input is the voice data, and the output is the analyzed destination information. The analysis uses Google Cloud's voice recognition service to identify the destination.

[0385] Step 6:

[0386] The server calculates the optimal route based on the current location and destination information. The input is the current location and destination information, and the output is the optimal route information. This calculation is done using TensorFlow.

[0387] Step 7:

[0388] The server converts the calculated optimal route into voice data. The input is the optimal route information, and the output is the voice data. Google Cloud's voice synthesis service is used for voice synthesis.

[0389] Step 8:

[0390] The server sends the audio data to the device. The input is the audio data, and the output is the audio data sent to the device. The transmission is via Wi-Fi or a mobile communication network.

[0391] Step 9:

[0392] The device plays the received voice data and guides the user from their current location to their destination. The input is the voice data, and the output is the played voice guidance.

[0393] Step 10:

[0394] The device's camera periodically captures images and videos. The input is the current view, and the output is the captured image or video data.

[0395] Step 11:

[0396] The device compresses the captured images and video data and sends it to the server. The input is the image or video data, and the output is the compressed data. Image and video compression algorithms are used for compression.

[0397] Step 12:

[0398] The server stores the received image and video data, allowing parents to view them in real time on their smartphones. The input is compressed image and video data, and the output is the stored data.

[0399] Step 13:

[0400] Parents can view images and videos via a smartphone app and send instructions to their children as needed. The input is the parent's instructions, and the output is the instruction data sent to the device.

[0401] Step 14:

[0402] The UV sensor on the device measures the amount of UV light in the surrounding area. The input is the amount of UV light, and the output is the measured UV light data.

[0403] Step 15:

[0404] When the amount of UV rays exceeds a certain standard, the terminal will automatically adjust the UV cut filter. The input is UV data, and the output is the adjusted UV cut filter.

[0405] As described above, each processing step works together to create a system that provides multifunctional support to users.

[0406] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0407] This invention provides multifunctional children's glasses equipped with GPS and AI-based route guidance, a camera, a recording function, UV protection, and an emotion engine that recognizes the user's emotions. The program processing of this system is explained in natural language below, and will be described in detail with concrete examples.

[0408] GPS and AI-powered route guidance

[0409] Device (kids' glasses)

[0410] The device periodically acquires its current location using its built-in GPS sensor and sends that information to the server. If the user (child) gets lost, they can voice-instruct, "I want to go home." The device then sends that voice data to the server.

[0411] server

[0412] The server receives the current location information and voice data sent from the device, converts it into text using voice recognition technology, and analyzes the question. It then retrieves destination information (e.g., home) from a database. It uses an AI algorithm to calculate the optimal route from the current location to the destination, converts the result into voice data, and sends it to the device.

[0413] Device (kids' glasses)

[0414] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to follow the voice guidance to reach their destination.

[0415] Examples:

[0416] When a user says "I want to go home," the Kids Glasses sends that voice to the server. The server calculates the optimal route and sends voice data such as "Turn right and go 100 meters" to the device. The device then plays back the voice and guides the user to their destination.

[0417] Camera function / recording function

[0418] Device (kids' glasses)

[0419] When a user presses the share button, the device's camera captures the current view, compresses the captured image data, and sends it to the server.

[0420] server

[0421] The server receives and stores image data sent from the device, allowing parents to view the images through the app.

[0422] User (Parent)

[0423] Parents use the app to review the images and send instructions to their child via text or voice message if needed.

[0424] Examples:

[0425] If a child gets lost, they can press the share button to take a picture of the current view and send the image data to the server. The parent can then check the image received in the app and send a text message with instructions such as "Go left from that location."

[0426] UV protection

[0427] Device (kids' glasses)

[0428] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust, protecting children's eyes from UV rays.

[0429] Examples:

[0430] When your child goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect your child's eyes.

[0431] Emotion recognition and response with emotion engine

[0432] Device (kids' glasses)

[0433] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice to recognize their emotions, and sends this information to the server.

[0434] server

[0435] The server generates appropriate support messages and responses based on the emotion information sent from the emotion engine, converts the responses into voice data, and sends them to the device.

[0436] User (Parent)

[0437] Parents can also receive emotional information through the app and take appropriate measures based on their child's psychological state and emotions.

[0438] Examples:

[0439] If a user becomes lost and anxious, the emotion engine will recognize that emotion and play a comforting voice message through the device, such as, "Don't worry, we'll help you soon." Parents can also view this information in the app and send encouragement or instructions as needed.

[0440] The above process flow enables the implementation of multi-function kids' glasses, including lost child prevention, remote parental tracking, UV protection, and emotion recognition. This explains how the system specifically works to ensure children's safety and provide peace of mind for parents.

[0441] The processing flow will be explained below.

[0442] GPS and AI-powered route guidance

[0443] Step 1: Obtain and send location data

[0444] Terminal

[0445] 1. The device periodically obtains its current location information (latitude and longitude) from the built-in GPS sensor.

[0446] 2. The acquired location information is sent to the server.

[0447] Specific actions

[0448] The GPS sensor measures the current location information and passes the results to the GPS data acquisition module.

[0449] The GPS data acquisition module formats the acquired data and sends it to the server via the communication module.

[0450] Step 2: Enter and submit your voice question

[0451] User (child)

[0452] 1. When you get lost, ask a voice question such as "I want to go home."

[0453] Terminal

[0454] 1. The voice input module acquires the voice data and sends it to the server.

[0455] Specific actions

[0456] The voice input module captures the voice data and sends it to the server through the communication module.

[0457] Step 3: Analyze voice data and obtain destination information

[0458] server

[0459] 1. Receive the audio data sent from the device.

[0460] 2. The voice data is converted into text using a voice recognition module, and the question content is analyzed.

[0461] 3. Retrieve destination information from the database.

[0462] Specific actions

[0463] The speech recognition module converts the speech data into text, which is then processed by the destination analysis module.

[0464] The destination analysis module retrieves destination information from the database.

[0465] Step 4: Route calculation and voice data generation

[0466] server

[0467] 1. The AI ​​algorithm calculates the optimal route based on current location and destination information.

[0468] 2. The calculation results are converted into audio data and sent to the device.

[0469] Specific actions

[0470] The route calculation module takes your current location and destination as input and calculates the optimal route.

[0471] The speech synthesis module converts the calculation results into speech data and sends it to the terminal via the communication module.

[0472] Step 5: Play audio prompts

[0473] Terminal

[0474] 1. Receives audio data sent from the server and plays it back to the user.

[0475] Specific actions

[0476] The communication module receives the audio data from the server and passes it to the audio playback module for playback.

[0477] Camera function / recording function

[0478] Step 1: Press the share button and take a picture

[0479] User (child)

[0480] 1. When you get lost or in trouble, just press the share button.

[0481] Terminal

[0482] 1. When the button is pressed, the camera will take a picture of the current view.

[0483] 2. Compress the captured image data.

[0484] Specific actions

[0485] The button input module detects user presses and sends a trigger to the camera module.

[0486] The camera module takes images and passes the data to the image compression module.

[0487] Step 2: Send and save image data

[0488] Terminal

[0489] 1. Send the compressed image data to the server.

[0490] server

[0491] 1. Receive and save image data sent from the device.

[0492] Specific actions

[0493] The communication module sends the image data to the server, and the server's image storage module stores the data in a database.

[0494] Step 3: Parents review images and send messages

[0495] User (Parent)

[0496] 1. Parents can use the app to check the received image data.

[0497] 2. Send text or voice messages to your child as needed.

[0498] Specific actions

[0499] The app interface displays the image data, and parents send instructions using the message input module.

[0500] UV protection

[0501] Step 1: Measure UV levels and adjust filters

[0502] Terminal

[0503] 1. The UV sensor measures the amount of UV light in the environment.

[0504] 2. If a certain level of UV rays is detected, the UV cut filter will automatically adjust.

[0505] Specific actions

[0506] The UV sensor module measures the amount of UV rays and passes the results to the filter control module.

[0507] The filter control module adjusts the UV cut filter to protect your eyes from ultraviolet rays.

[0508] Emotion recognition and response with emotion engine

[0509] Step 1: Acquiring and analyzing emotional information

[0510] Terminal

[0511] 1. The device's built-in emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional information.

[0512] Specific actions

[0513] The emotion engine analyzes facial expression recognition data and voice tone in real time to generate emotional information.

[0514] Step 2: Sending emotional information and generating support messages

[0515] Terminal

[0516] 1. Send emotional information to the server.

[0517] server

[0518] 1. Receive emotional information and generate appropriate support messages.

[0519] 2. The generated message is converted into audio data and sent to the device.

[0520] Specific actions

[0521] The communication module sends the emotional information to the server, and the support message generation module generates an appropriate message.

[0522] The speech synthesis module converts the message into voice data and sends it to the terminal via the communication module.

[0523] Step 3: Playing assistance audio to the user

[0524] Terminal

[0525] 1. Receives audio data from the server and plays it back to the user.

[0526] Specific actions

[0527] The communication module receives the audio data from the server and passes it to the audio playback module for playback.

[0528] In this way, the operations at each processing step are specified, and the user, terminal, and server cooperate to realize the functions of the multifunctional kids' glasses.

[0529] Example 2

[0530] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0531] While existing devices with location-based navigation systems, camera functions, and UV protection functions exist as separate functions, there was no system that integrated these functions and could recognize the user's emotions and respond appropriately. This made it difficult to provide comprehensive support for children who got lost, protect them from UV rays, and provide a sense of mental security. In particular, due to the lack of emotion recognition capabilities, existing systems were unable to recognize and respond to children's psychological anxieties and difficulties in real time.

[0532] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0533] In this invention, the server includes a means for acquiring current location information, a means for analyzing voice input to acquire destination information, a means for calculating the optimal route based on the current location information and destination information, a means for recognizing the user's emotions, a means for generating a response message based on the recognized emotion information, and a means for converting the generated response message into voice data and transmitting it to the terminal. This not only enables appropriate route guidance based on the child's location information and real-time safety assurance, but also appropriately recognizes the user's emotions and provides a sense of mental security. In addition, the camera function and UV protection function make it easy for parents to remotely monitor their child's situation, give appropriate instructions, and protect their child's eyes from UV rays.

[0534] "Current location information" is the location information of a device obtained using the GPS sensor built into the device, and is data indicating the geographical location of the device.

[0535] "Voice input" is a function that receives a user's voice instructions through the terminal's microphone.

[0536] "Destination information" is geographical location information of the user's destination that the server obtains from the database after analyzing the voice input.

[0537] The "optimal route" is the optimal route to the destination calculated based on the current location information and the destination information.

[0538] "Voice data" is data in a format that the server converts voice input or calculation results into a voice message and sends to the terminal.

[0539] The term "terminal" refers to the multi-function kids' glasses of the present invention, which is a hardware device with multiple built-in functions.

[0540] A "server" is a computer system that processes data sent from a terminal, generates voice data and response messages, and sends them to the terminal.

[0541] "Emotion recognition" is a technology that analyzes a user's facial expressions and tone of voice to identify their emotions.

[0542] A "response message" is voice data or a text message that is generated by the server based on emotional information to provide the user with psychological relief.

[0543] The "camera function" is a function that uses the camera built into the terminal to capture a current view and process the image data.

[0544] A "UV cut filter" is a filter that protects the eyes from ultraviolet rays and automatically adjusts based on the amount of ultraviolet rays detected by the ultraviolet sensor.

[0545] An "ultraviolet sensor" is a sensor that measures the amount of ultraviolet light in the environment and is built into the device.

[0546] The "share button" is an operation button that the user uses to take a picture of the current view and send the image data to the server.

[0547] The present invention provides multifunctional children's glasses equipped with GPS and AI navigation functions, a camera function, a recording function, UV protection functions, and an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described in detail below.

[0548] Directions function

[0549] Device (kids' glasses)

[0550] The device periodically obtains its current location information using a built-in GPS sensor (e.g., u-blox M8). This location information is packaged as a JSON packet and sent to the server using the HTTPS protocol. When the user gets lost, they press the voice input button and give a voice command such as "I want to go home." This voice data is captured by the device's microphone and also sent to the server.

[0551] server

[0552] The server converts the received voice data into text using a speech recognition API (e.g., Google Cloud Speech-to-Text). It then analyzes the converted text and retrieves destination information from a database (e.g., PostgreSQL). It then uses an AI algorithm (e.g., Dijkstra's Algorithm) to calculate the optimal route from the current location to the destination, converts the result into voice data, and sends it to the device.

[0553] Device (kids' glasses)

[0554] The device receives the voice data sent from the server and plays it as a guide voice from the built-in speaker. The user can follow this voice guidance to reach their destination.

[0555] Examples:

[0556] If the user says "I want to go home," the device sends that speech to the server. The server generates a voice guidance message such as "Turn right and go 100 meters" and sends it to the device. The device then plays back that voice message and guides the user to their destination.

[0557] Camera function / recording function

[0558] Device (kids' glasses)

[0559] When a user presses the share button, the device's camera (e.g., Sony IMX219) captures the current view, compresses the captured image data into JPEG format, and then sends the compressed image data to the server using the HTTPS protocol.

[0560] server

[0561] The server stores the received image data in a database and provides it to the app used by the parent for display.

[0562] User (Parent)

[0563] Parents can use the app to review the image and, if necessary, send their child instructions via text message, such as "Go left from that location."

[0564] Examples:

[0565] A child presses the share button to take a picture of the current view and sends the image data to the server. A parent can then view the image in the app and send instructions via text message, such as "Go left from that location."

[0566] UV protection

[0567] Device (kids' glasses)

[0568] The device's built-in UV sensor (e.g., VEML6070) periodically measures the amount of UV radiation in the environment. If the measured value exceeds a certain level, the device automatically adjusts the UV-blocking filter (e.g., photochromic lenses) to protect children's eyes from UV rays.

[0569] Examples:

[0570] When your child goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV-blocking filter to protect your child's eyes from UV rays.

[0571] Emotion recognition and response with emotion engine

[0572] Device (kids' glasses)

[0573] The device's built-in emotion engine (e.g., Affectiva SDK) analyzes the user's facial expressions and tone of voice to recognize their emotions, and sends this information to the server.

[0574] server

[0575] The server generates appropriate support messages and responses based on the emotion information sent from the emotion engine, and the generated voice data is sent to the terminal and played back to the user.

[0576] User (Parent)

[0577] Parents can also receive emotional information through the app and take appropriate measures based on their child's psychological state and emotions.

[0578] Examples:

[0579] If a user becomes lost and anxious, the emotion engine will recognize that emotion and play a comforting voice message such as, "It's okay, we'll help you soon." Parents can also view this information in the app and send encouragement or instructions as needed.

[0580] Example of an input prompt for a generative AI model:

[0581] 1. "Describe how kids' glasses with a built-in GPS sensor work to periodically obtain location information."

[0582] 2. "Please explain the processing flow when a lost child voice-inputs the command, 'I want to go home.'"

[0583] 3. "Please explain the process of the camera function, where the user takes a picture of the current scene and sends the image data to the server."

[0584] 4. "Please explain how the UV sensor automatically adjusts the UV cut filter when it detects high levels of UV."

[0585] 5. "Explain how the emotion engine recognizes a child's emotions and generates an appropriate response."

[0586] The system of the present invention integrates these multiple functions to ensure the safety and security of children.

[0587] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0588] Step 1:

[0589] Obtaining and sending location information

[0590] Device (kids' glasses)

[0591] The device periodically obtains its location using a GPS sensor (e.g., u-blox M8), which is then converted into JSON format and sent to the server using the HTTPS protocol.

[0592] Input: Location information from the GPS sensor

[0593] Data processing: Convert location information into JSON format

[0594] Output: Location information in JSON format sent to the server

[0595] Step 2:

[0596] Acquiring and sending voice input

[0597] User (child)

[0598] The user presses the voice input button and gives a voice command such as "I want to go home." The device's microphone captures this voice data and sends it to the server.

[0599] Input: User's voice commands

[0600] Data processing: Capture audio data

[0601] Output: Audio data sent to the server

[0602] Step 3:

[0603] Voice data analysis and route calculation

[0604] server

[0605] The server receives the voice data and converts it into text using speech recognition technology (e.g., Google Cloud Speech-to-Text). It then analyzes the text data and retrieves destination information from a database (e.g., PostgreSQL). It then uses an AI algorithm (e.g., Dijkstra's Algorithm) to calculate the optimal route from the current location to the destination.

[0606] Input: Audio data sent from the device

[0607] Data processing: Converts voice data into text, obtains destination information, and calculates the optimal route

[0608] Output: Data calculated as the optimal route

[0609] Step 4:

[0610] Generate and transmit route guidance voice

[0611] server

[0612] The server converts the calculated optimal route data into voice data, generates voice guidance, and sends the voice data to the terminal.

[0613] Input: Calculated optimal route data

[0614] Data processing: Convert optimal route data into audio data

[0615] Output: Audio data sent to the device

[0616] Step 5:

[0617] Providing audio guidance

[0618] Device (kids' glasses)

[0619] The device plays the received audio data through its built-in speaker and provides route guidance to the user.

[0620] Input: Audio data sent from the server

[0621] Data processing: Audio data playback

[0622] Output: Audio instructions to the user

[0623] Step 6:

[0624] Camera image capture and transmission

[0625] Device (kids' glasses)

[0626] When a user presses the share button, the device's camera (e.g., Sony IMX219) captures the current view, and the captured image data is compressed into JPEG format and then sent to the server.

[0627] Input: Image data captured by a camera

[0628] Data processing: Compression of image data into JPEG format

[0629] Output: Compressed image data sent to the server

[0630] Step 7:

[0631] Image data storage and display

[0632] server

[0633] The server stores the received image data in a database and provides it to the app used by the parent for display.

[0634] Input: Compressed image data sent from the terminal

[0635] Data processing: saving and displaying image data

[0636] Output: Image data displayed in the parent app

[0637] Step 8:

[0638] UV sensor measurement and filter adjustment

[0639] Device (kids' glasses)

[0640] The device's built-in UV sensor (e.g., VEML6070) periodically measures the amount of UV radiation in the environment. If the measured value exceeds a certain level, the device automatically adjusts the UV-blocking filter (e.g., photochromic lenses) to protect children's eyes from UV rays.

[0641] Input: Measurement data from UV sensor

[0642] Data processing: Adjusting the filter according to the amount of UV rays

[0643] Output: Adjusted UV cut filter

[0644] Step 9:

[0645] Emotion recognition and response generation

[0646] Device (kids' glasses)

[0647] The device's built-in emotion engine (e.g., Affectiva SDK) analyzes the user's facial expressions and tone of voice to recognize their emotions. The recognized emotion information is sent to the server.

[0648] Input: User facial and voice data

[0649] Data processing: sentiment analysis and recognition

[0650] Output: Emotion information sent to the server

[0651] Step 10:

[0652] Generating and sending response messages based on emotion information

[0653] server

[0654] The server generates an appropriate support message or response based on the received emotional information. The generated response message is converted into voice data and sent to the device.

[0655] Input: Emotion information sent from the device

[0656] Data processing: Generating response messages based on emotional information and converting them into voice data

[0657] Output: Audio data sent to the device

[0658] Step 11:

[0659] Playing greetings

[0660] Device (kids' glasses)

[0661] The terminal plays the audio data sent from the server on its built-in speaker and provides a response message to the user.

[0662] Input: Audio data sent from the server

[0663] Data processing: Audio data playback

[0664] Output: Response message to the user

[0665] (Application example 2)

[0666] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0667] There are limitations to ensuring children's safety and the methods parents can use to remotely check on their children's status, making it difficult to respond quickly and appropriately when children become lost or anxious. It is also necessary to comprehensively improve daily safety by integrating multifunctional protective devices, such as those that recognize children's emotions and block UV rays. It is also important to understand children's psychological state in real time and provide appropriate support based on that information.

[0668] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0669] In this invention, the server includes means for receiving and analyzing emotion information from the terminal, means for generating a support message based on the analysis results, and means for converting the support message into voice data and transmitting it to the terminal. This makes it possible to quickly provide optimal route guidance and support messages based on emotion recognition when a child gets lost or feels anxious.

[0670] "Current location information" is data indicating the location information of the terminal, and is information acquired by a location information acquisition means such as a GPS.

[0671] "Destination information" is data indicating the location information of a place where the user wants to go.

[0672] The "optimal route" is the most logical route to the destination calculated based on the current location information and destination information.

[0673] "Voice input" means voice commands given by a user to a terminal.

[0674] "Audio data" is data obtained by converting audio input into digital form.

[0675] "Emotion information" is data that indicates the user's emotional state as analyzed by an emotion recognition engine built into the terminal.

[0676] A "support message" is a response message to the user that is generated based on emotional information, current location information, and the like, and includes content such as comfort, instructions, and guidance.

[0677] A "UV cut filter" is a filter that adjusts the amount of ultraviolet rays and is built into the device.

[0678] "Image data" refers to photographs and videos taken with the device's camera that have been converted into digital format.

[0679] "Server" refers to a computer system that receives, analyzes, and stores data sent from a terminal, and generates the necessary response data.

[0680] This invention is a system for ensuring the safety and remote monitoring of children using multifunctional kids' glasses. The system consists of a device (multifunctional kids' glasses) equipped with GPS, AI, a camera, recording function, UV protection function, and emotion recognition function, a server, and a smartphone app used by parents.

[0681] Hardware and Software Use:

[0682] Hardware: Multi-function kids' glasses (GPS sensor, camera, UV sensor, emotion recognition engine), smartphone

[0683] Software: Server (AWS (registered trademark)), AI algorithm (TensorFlow), voice recognition (Google Cloud Speech-to-Text API), map service (Google Maps API)

[0684] System behavior:

[0685] 1. Location Tracking:

[0686] The device periodically obtains its current location using its built-in GPS sensor and sends it to a server. The server receives and stores the location information and displays it in real time on the parent's smartphone app, allowing parents to always know where their child is.

[0687] 2. Directions:

[0688] The device receives voice input. For example, if a child says, "I want to go home," the voice data is sent to the server. The server uses the Google Cloud Speech-to-Text API to convert the voice into text and obtain the destination information. It then uses the Google Maps API to calculate the optimal route from the current location to the destination. The result is converted into voice data and sent to the device. The device then plays the voice data and guides the child to the destination.

[0689] 3. Camera Function:

[0690] When a child presses the share button on their device, the camera takes a photo of the current scene, compresses the image data, and sends it to the server. The server receives and stores the image data, and displays the image on the parent's smartphone app. The parent can then view the image through the app and send instructions to their child via text or voice message if necessary.

[0691] 4. UV protection:

[0692] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust, protecting children's eyes from UV rays.

[0693] 5. Emotion recognition:

[0694] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice and sends emotional information to a server. The server analyzes the emotional information, generates a comforting or encouraging message as needed, converts it into audio data, and sends it to the device. The device then plays the audio data to reassure the child. The emotional information is also displayed on the parent's smartphone app, allowing parents to understand their child's psychological state.

[0695] Examples:

[0696] For example, if a child gets lost and feels anxious, they can voice-instruct, "I want to go home." The device sends this voice to the server, which then calculates the optimal route and sends voice data such as, "Turn right and go 100 meters." If the emotion engine detects anxiety, it will play a comforting message through the device, such as, "It's okay, we'll help you right away."

[0697] Example prompt sentence:

[0698] "I want to go home."

[0699] This allows the invention to automatically provide optimal support to ensure the safety of children when they get lost or feel anxious.

[0700] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0701] Step 1:

[0702] The device obtains location information

[0703] The device periodically obtains location information using the built-in GPS sensor.

[0704] input:

[0705] Location data from GPS sensors.

[0706] output:

[0707] Current location information.

[0708] Specific behavior:

[0709] The device receives a GPS signal, calculates latitude and longitude information, and generates current location information.

[0710] Step 2:

[0711] The device sends its current location information to the server.

[0712] The terminal transmits the acquired current location information to the server.

[0713] input:

[0714] Current location information.

[0715] output:

[0716] Send data to the server.

[0717] Specific behavior:

[0718] The terminal compresses the current location information and communicates using a protocol (for example, HTTP) for transmitting it to the server.

[0719] Step 3:

[0720] The user provides voice input

[0721] The user (child) inputs voice commands into the device.

[0722] input:

[0723] Voice commands (e.g., "I want to go home").

[0724] output:

[0725] Audio data.

[0726] Specific behavior:

[0727] The device's microphone receives the user's voice waves and converts them into digital voice data.

[0728] Step 4:

[0729] The device sends the audio data to the server.

[0730] The terminal transmits the acquired voice data to the server.

[0731] input:

[0732] Audio data.

[0733] output:

[0734] Send data to the server.

[0735] Specific behavior:

[0736] The terminal communicates using a protocol for compressing the voice data and transmitting it to the server.

[0737] Step 5:

[0738] The server analyzes the audio data

[0739] The server receives the voice data and converts it into text using voice recognition technology.

[0740] input:

[0741] Audio data.

[0742] output:

[0743] Text data.

[0744] Specific behavior:

[0745] The server uses the Google Cloud Speech-to-Text API to analyze the audio data and generate text data.

[0746] Step 6:

[0747] The server obtains destination information

[0748] The server analyzes the voice recognition results and obtains destination information.

[0749] input:

[0750] Text data (e.g., "I want to go home").

[0751] output:

[0752] Destination information.

[0753] Specific behavior:

[0754] The server extracts keywords from the speech recognition results and acquires destination information by referring to a destination database.

[0755] Step 7:

[0756] The server calculates the optimal route

[0757] The server calculates the optimal route based on the current location information and destination information.

[0758] input:

[0759] Current location information, destination information.

[0760] output:

[0761] The best route.

[0762] Specific behavior:

[0763] The server uses the Google Maps API to calculate the optimal route from your current location to your destination.

[0764] Step 8:

[0765] The server converts the optimal route into audio data.

[0766] The server converts the calculated optimal route into audio data.

[0767] input:

[0768] The best route.

[0769] output:

[0770] Audio data.

[0771] Specific behavior:

[0772] The server generates the voice data using text-to-speech (TTS) technology.

[0773] Step 9:

[0774] The server sends the audio data to the device.

[0775] The server transmits the generated voice data to the terminal.

[0776] input:

[0777] Audio data.

[0778] output:

[0779] Send data to the device.

[0780] Specific behavior:

[0781] The server communicates using a protocol to compress the audio data and transmit it to the terminal.

[0782] Step 10:

[0783] The device plays the audio data.

[0784] The terminal receives the transmitted audio data and plays it back to the user.

[0785] input:

[0786] Audio data.

[0787] output:

[0788] Audio guidance.

[0789] Specific behavior:

[0790] The device decodes the audio data and plays it through its built-in speaker.

[0791] Step 11:

[0792] The device receives and analyzes emotional information

[0793] The device analyzes the user's facial expressions and tone of voice to obtain emotional information.

[0794] input:

[0795] User's facial expression data, voice data.

[0796] output:

[0797] emotional information.

[0798] Specific behavior:

[0799] The device's emotion recognition engine analyzes the user's facial expressions and tone of voice to recognize specific emotional states (e.g., anxiety, joy).

[0800] Step 12:

[0801] The device sends emotional information to the server.

[0802] The device transmits the analyzed emotion information to the server.

[0803] input:

[0804] emotional information.

[0805] output:

[0806] Send data to the server.

[0807] Specific behavior:

[0808] The terminal communicates using a protocol for compressing emotion information and transmitting it to the server.

[0809] Step 13:

[0810] The server generates a support message based on the emotional information.

[0811] The server generates an appropriate support message based on the received emotion information.

[0812] input:

[0813] emotional information.

[0814] output:

[0815] Supportive message.

[0816] Specific behavior:

[0817] The server refers to an emotion database and generates an appropriate support message (e.g., "Don't worry, we'll help you right away").

[0818] Step 14:

[0819] The server converts the assistance message into audio data.

[0820] The server converts the generated assistance message into voice data.

[0821] input:

[0822] Supportive message.

[0823] output:

[0824] Audio data.

[0825] Specific behavior:

[0826] The server converts the assistance message into voice data using TTS technology.

[0827] Step 15:

[0828] The server sends the audio data to the device.

[0829] The server transmits the generated voice data to the terminal.

[0830] input:

[0831] Audio data.

[0832] output:

[0833] Send data to the device.

[0834] Specific behavior:

[0835] The server communicates using a protocol to compress the audio data and transmit it to the terminal.

[0836] Step 16:

[0837] The device plays the audio data of the support message.

[0838] The terminal receives the transmitted audio data and plays it back to the user.

[0839] input:

[0840] Audio data.

[0841] output:

[0842] Audio guide for support messages.

[0843] Specific behavior:

[0844] The device decodes the audio data and plays it through its built-in speaker.

[0845] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0846] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0847] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0848] [Second embodiment]

[0849] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0850] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0851] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0852] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0853] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0854] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0855] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0856] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0857] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0858] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0859] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0860] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0861] This invention provides multifunctional children's glasses equipped with GPS and AI navigation, camera, video recording, and UV protection. The program processing of this system is explained in natural language below, and is also described in detail with specific examples.

[0862] GPS and AI-powered route guidance

[0863] Device (kids' glasses)

[0864] The device periodically acquires its current location using a built-in GPS sensor and sends that information to the server. When the user (child) gets lost, they can input a command into the device by voice, such as "I want to go home." The device then sends that voice data to the server.

[0865] server

[0866] The server receives the current location information and voice data sent from the device. It converts the received voice data into text using voice recognition technology and analyzes the question. It then retrieves destination information (e.g., "home") from a database. The server uses an AI algorithm to calculate the optimal route from the current location to the destination and converts the result into voice data. The voice data of the optimal route is sent to the device.

[0867] Device (kids' glasses)

[0868] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to reach their destination by following the voice guidance.

[0869] Examples:

[0870] When a user voice-inputs "I want to go home," Kids Glasses sends the voice to the server. The server calculates the optimal route and sends voice data saying "Turn right and go 100 meters" to the device. The device plays back the voice and guides the user to their destination.

[0871] Camera function / recording function

[0872] Device (kids' glasses)

[0873] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[0874] server

[0875] The server receives and stores image data sent from the device, allowing parents to view the images through the app.

[0876] User (Parent)

[0877] Parents can use the app to review the images and send instructional messages to their children if needed.

[0878] Examples:

[0879] If a user gets lost, they can press the share button to take a picture of the current view and send the image data to the server. The parent can then check the image received in the app and send a text message with instructions such as "Go left from that location."

[0880] UV protection

[0881] Device (kids' glasses)

[0882] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes.

[0883] Examples:

[0884] When the user goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[0885] This will enable the realization of multi-functional kids' glasses that prevent children from getting lost, allow parents to check on their children's situation remotely, and protect their eyes from UV rays. This system is an embodiment that ensures children's safety and provides peace of mind to parents.

[0886] The processing flow will be explained below.

[0887] GPS and AI-powered route guidance

[0888] Step 1: Obtain and send location data

[0889] Terminal

[0890] 1. The device obtains its current location information (latitude and longitude) from the built-in GPS sensor.

[0891] 2. The acquired current location information is sent to the server via the communication module.

[0892] Specific actions

[0893] The GPS sensor measures your current location and passes the results to the GPS data acquisition module.

[0894] The GPS data acquisition module formats the data and sends it to the server through the communication module.

[0895] Step 2: Enter and submit your voice question

[0896] User (child)

[0897] 1. If your child gets lost, they can ask a voice message saying, "I want to go home."

[0898] Terminal

[0899] 1. The voice input module acquires voice data and sends it to the server through the communication module.

[0900] Specific actions

[0901] The voice input module captures voice data and sends it to the server through the communication module.

[0902] Step 3: Analyze voice data and obtain destination information

[0903] server

[0904] 1. The server receives the voice data sent from the device.

[0905] 2. The voice data is converted into text using a voice recognition module, and the question content is analyzed.

[0906] 3. Retrieve destination information from the database.

[0907] Specific actions

[0908] The voice recognition module converts the voice data into text, and the text analysis module extracts destination information.

[0909] The corresponding destination information is obtained from the destination database.

[0910] Step 4: Route calculation and voice data generation

[0911] server

[0912] 1. The AI ​​algorithm calculates the optimal route based on current location and destination information.

[0913] 2. The calculation results are converted into audio data and sent to the device.

[0914] Specific actions

[0915] The route calculation module calculates the optimal route using the current location and destination as input.

[0916] The speech synthesis module converts the calculation results into speech data and sends it to the terminal via the communication module.

[0917] Step 5: Play audio prompts

[0918] Terminal

[0919] 1. The device receives the audio data sent from the server and plays it back to the user.

[0920] Specific actions

[0921] The communication module receives audio data from the server and passes it to the audio playback module for playback.

[0922] Camera function / recording function

[0923] Step 1: Press the share button and take a picture

[0924] User (child)

[0925] 1. When you get lost or in trouble, just press the share button.

[0926] Terminal

[0927] 1. When the button is pressed, the camera will take a picture of the current view.

[0928] 2. Compress the captured image data.

[0929] Specific actions

[0930] The button input module detects user presses and sends a trigger to the camera module.

[0931] The camera module takes images and passes the data to the image compression module.

[0932] Step 2: Send and save image data

[0933] Terminal

[0934] 1. The compressed image data is sent to the server via the communication module.

[0935] server

[0936] 1. The server receives and stores the image data sent from the device.

[0937] Specific actions

[0938] The communication module sends the image data to the server, and the server's image storage module stores it in a database.

[0939] Step 3: Parents review images and send messages

[0940] User (Parent)

[0941] 1. Parents can use the app to check the received image data.

[0942] 2. Send texts or voice messages to your child as needed.

[0943] Specific actions

[0944] The application interface displays image data and sends instructions through the message input module.

[0945] UV protection

[0946] Step 1: Measure UV levels and adjust filters

[0947] Terminal

[0948] 1. The UV sensor measures the amount of UV light in the environment.

[0949] 2. If a certain level of UV rays is detected, the UV cut filter will automatically adjust.

[0950] Specific actions

[0951] The UV sensor module measures the amount of UV rays and passes the results to the filter control module.

[0952] The filter control module adjusts the effect of the UV cut filter to protect your eyes from ultraviolet rays.

[0953] In this way, the operations at each processing step are specified, and the user, terminal, and server cooperate to realize the functions of the multifunctional kids' glasses.

[0954] Example 1

[0955] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0956] In modern society, it is necessary to reduce the risk of children getting lost when they are out and help them return home safely. However, conventional devices with GPS functions lack supportive route guidance and communication with parents, making it difficult to provide multifunctional support. Protecting children from UV rays when outdoors is also important, but inadequate protection can have a negative impact on their health. To effectively solve these issues, a multifunctional system that integrates route guidance, camera functions, UV protection, and other functions is required.

[0957] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0958] In this invention, the server includes means for acquiring current location information, means for analyzing voice data and converting it into text, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, means for converting the optimal route into voice data, means for receiving and saving image data, means for the user to check the received image data, means for measuring the amount of ultraviolet light, and means for adjusting the UV-cut filter based on the measured amount of ultraviolet light. This makes it possible for the server to provide appropriate voice guidance when a child gets lost, to remotely share the current scenery, and to protect the child's eyes from ultraviolet light.

[0959] "Current location information" is latitude and longitude data relating to the current location of the terminal obtained using a GPS sensor.

[0960] "Means for acquiring" refers to means including sensors and modules for collecting or detecting specific information.

[0961] The "transmitting means" is a means for transmitting the acquired data to another device or system via wireless or wired communication.

[0962] "Voice input" refers to data that receives a user's voice commands or instructions through a voice input device such as a microphone.

[0963] "Voice data" refers to data in which voice information input by a user is recorded in digital format.

[0964] "Means for analyzing" refers to means for analyzing information such as voice data or text data and extracting specific meanings or instructions.

[0965] "Destination information" is location information such as latitude and longitude relating to the location the user is heading for.

[0966] The "calculating means" is a processing device that includes an algorithm for deriving the optimal route based on current location information and destination information.

[0967] A "means for converting" is a means for converting data of a particular format into another format, such as a means for converting text to speech.

[0968] The "means for reproducing audio data" refers to an output device such as a speaker or headphones that allows the user to hear the audio data.

[0969] The "means for photographing scenery" is a means for acquiring the current scenery as image data using a camera.

[0970] The "means for compressing" refers to a means for using image compression technology to reduce the volume of acquired image data.

[0971] The "means for receiving and storing" is a means for receiving data sent from other terminals and storing it in a database or file system.

[0972] "Means for user confirmation" refers to devices or applications that allow users to view or confirm stored data.

[0973] The "means for measuring the amount of ultraviolet light" refers to a means including an ultraviolet sensor for measuring the intensity of ultraviolet light in the environment.

[0974] A "UV cut filter" is a special filter used to block or reduce ultraviolet rays.

[0975] A "means for adjusting" is a means for changing or configuring a device or function based on a particular parameter or condition.

[0976] This invention relates to a multi-function kids' glasses system equipped with GPS and AI navigation, camera, video recording, and UV protection functions. The system consists of a server, a terminal (kids' glasses), and users (children and parents).

[0977] GPS and AI-powered route guidance

[0978] Device (kids' glasses)

[0979] The device has a built-in GPS sensor that periodically acquires its current location information. This information is sent to the server via a communication module. When the user (child) gets lost, they press a button and input voice commands such as "I want to go home" into the device. The device records this voice data and sends it to the server.

[0980] server

[0981] The server receives the current location information and voice data sent from the device. It uses a voice recognition engine (e.g., Google Speech-to-Text API) to convert the voice data into text and analyzes the instructions. It then retrieves destination information (e.g., home address and latitude and longitude) from a database. The server uses an AI algorithm (e.g., A algorithm) to calculate the optimal route from the current location to the destination. The result of this calculation is converted into voice data using a voice synthesis engine (e.g., Amazon Polly) and sent to the device.

[0982] Device (kids' glasses)

[0983] The device receives the voice data sent from the server and plays it back to the user through the speaker, allowing the user to follow the voice guidance to reach their destination.

[0984] Examples:

[0985] When a user voice-inputs "I want to go home," the device sends that voice to the server. The server calculates the optimal route and sends the guidance "Turn right and go 100 meters" to the device as voice data. The device plays back that voice and guides the user to their destination.

[0986] Camera function / recording function

[0987] Device (kids' glasses)

[0988] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[0989] server

[0990] The server receives and stores image data sent from the device, which parents can then view via a smartphone app.

[0991] User (Parent)

[0992] Parents can use the app to view image data and send instructional messages to their children if necessary.

[0993] Examples:

[0994] If a user gets lost, they can press the share button to take a picture of the current view and send the image to the server. The parent can then check the image in the app and send a text message with instructions such as "Go left from that location."

[0995] UV protection

[0996] Device (kids' glasses)

[0997] The device has a built-in UV sensor that continuously measures the amount of UV rays in the environment, and when the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes from UV rays.

[0998] Examples:

[0999] When the user goes outside on a sunny day, if the UV sensor detects high levels of UV rays, the UV cut filter will automatically adjust to protect children's eyes.

[1000] Example prompts for generative AI models

[1001] 1. Example prompt (directions function):

[1002] "Please explain the process of a program that uses GPS and AI to provide voice guidance on the route home if a child gets lost."

[1003] 2. Example prompts (camera function):

[1004] "Explain the process of how a child takes a picture of the current view with their camera and then a parent reviews the image in the app."

[1005] 3. Example prompt (UV protection):

[1006] "Please explain the process of UV protection using an ultraviolet sensor to protect children's eyes."

[1007] This makes it possible to provide multifunctional kids' glasses that reduce the risk of children getting lost when out and about, allow parents to check on the situation remotely, and also protect the eyes from ultraviolet rays.

[1008] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1009] GPS and AI-powered route guidance

[1010] Step 1:

[1011] Device (kids' glasses)

[1012] Obtaining current location information

[1013] Input: None

[1014] Data processing / calculation: The device's built-in GPS sensor periodically measures the current latitude and longitude information.

[1015] Output: Current location information (latitude and longitude)

[1016] Specific operation: The GPS sensor measures the latitude and longitude of the current location and stores the data in the device's memory.

[1017] Step 2:

[1018] Device (kids' glasses)

[1019] Sending current location information

[1020] Input: Current location information (latitude and longitude)

[1021] Data processing / calculation: None

[1022] Output: Current location information (latitude and longitude) is sent to the server

[1023] Specific operation: Use the communication module to send current location information to the server.

[1024] Step 3:

[1025] Device (kids' glasses)

[1026] Acquiring voice input

[1027] Input: User's voice

[1028] Data processing / calculation: Record voice input and convert it into voice data

[1029] Output: Audio data

[1030] Specific operation: The microphone receives the user's voice, and the recording module converts the voice into digital audio data.

[1031] Step 4:

[1032] Device (kids' glasses)

[1033] Sending audio data

[1034] Input: Audio data

[1035] Data processing / calculation: None

[1036] Output: Audio data is sent to the server

[1037] Specific operation: Use the communication module to send audio data to the server.

[1038] Step 5:

[1039] server

[1040] Receiving and analyzing audio data

[1041] Input: Audio data

[1042] Data processing / calculation: Converting voice data into text using a voice recognition engine and analyzing the text data

[1043] Output: Text data (user instructions)

[1044] Specific operation: The server receives the voice data, the speech recognition engine converts the voice into text, and the analysis module extracts the command content.

[1045] Step 6:

[1046] server

[1047] Obtaining destination information

[1048] Input: Text data (user instructions)

[1049] Data processing / calculation: Obtain destination information (latitude and longitude) registered by the user from the database

[1050] Output: Destination information

[1051] Specific operation: The server executes a database query to retrieve destination information using the user ID as a key.

[1052] Step 7:

[1053] server

[1054] Calculating the best route

[1055] Input: Current location information, destination information

[1056] Data processing / calculation: Calculate the optimal route using AI algorithms

[1057] Output: Optimal route information

[1058] Specific operation: The server's route calculation module calculates the optimal route from the current location to the destination.

[1059] Step 8:

[1060] server

[1061] Generate voice guidance

[1062] Input: Optimal route information

[1063] Data processing / calculation: Generates voice guidance messages and converts them into voice data using a voice synthesis engine

[1064] Output: Voice guidance data

[1065] Specific operation: The message generation module creates a text message, and the speech synthesis engine converts it into voice data.

[1066] Step 9:

[1067] server

[1068] Sending audio data

[1069] Input: Voice guidance data

[1070] Data processing / calculation: None

[1071] Output: Voice guidance data is sent to the device.

[1072] Specific operation: The server sends the generated voice guidance data to the terminal.

[1073] Step 10:

[1074] Device (kids' glasses)

[1075] Playing voice guidance

[1076] Input: Voice guidance data

[1077] Data processing / calculation: Decode and play audio data

[1078] Output: A voice prompt that the user hears

[1079] Specific operation: The device receives the audio data, decodes it, and then plays it on the speaker.

[1080] Camera function / recording function

[1081] Step 1:

[1082] Device (kids' glasses)

[1083] Taking an image

[1084] Input: Press the Share button

[1085] Data processing / calculation: The camera captures the image data

[1086] Output: Image data

[1087] Specific operation: When the share button is pressed, the camera module takes a picture and captures image data.

[1088] Step 2:

[1089] Device (kids' glasses)

[1090] Image data compression

[1091] Input: Image data

[1092] Data processing / calculation: Compressed in JPEG format etc.

[1093] Output: Compressed image data

[1094] Specific operation: The image compression module compresses the original image into the specified format.

[1095] Step 3:

[1096] Device (kids' glasses)

[1097] Sending image data

[1098] Input: Compressed image data

[1099] Data processing / calculation: None

[1100] Output: Compressed image data is sent to the server

[1101] Specific operation: The communication module sends the compressed image data to the server.

[1102] Step 4:

[1103] server

[1104] Receiving and storing image data

[1105] Input: Compressed image data

[1106] Data processing / calculation: Save image data

[1107] Output: Saved image data

[1108] Specific operation: The server receives the image data and stores it in a database or file system.

[1109] Step 5:

[1110] User (Parent)

[1111] Image confirmation and instructions

[1112] Input: Image data

[1113] Data processing / calculation: Display image data in the app and create instruction messages

[1114] Output: prompt message

[1115] Specific operations: The parent opens the app, checks the image, creates a prompt message, and sends it to the child's device via the server.

[1116] UV protection

[1117] Step 1:

[1118] Device (kids' glasses)

[1119] Measurement of UV levels

[1120] Input: None

[1121] Data processing / calculation: UV sensor measures the amount of UV light in the environment

[1122] Output: UV data

[1123] How it works: The UV sensor samples the amount of UV light in the environment and sends that data to the device's processor.

[1124] Step 2:

[1125] Device (kids' glasses)

[1126] UV cut filter adjustment

[1127] Input: UV radiation data

[1128] Data processing / calculation: If the amount of UV rays is above a certain level, the transmittance of the UV cut filter is adjusted.

[1129] Output: Adjusted UV cut filter

[1130] Specific operation: The filter control module appropriately adjusts the filter transmittance based on UV intensity data.

[1131] This clearly explains the specific processing steps for each function of the system, as well as the specific operations, inputs, and outputs performed at each step.

[1132] (Application example 1)

[1133] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1134] Currently, it is not easy for customers to find specific product shelves in physical stores, or for parents to remotely monitor their children's locations and behavior. Furthermore, UV protection measures must be taken separately while shopping, creating multiple challenges. A single system is needed to solve these challenges.

[1135] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1136] In this invention, the server includes means for acquiring current location information, means for transmitting the acquired current location information, means for receiving voice input, means for transmitting voice input, means for analyzing voice data to acquire destination information, means for calculating an optimal route based on the current location information and destination information, means for converting the optimal route into voice data, means for transmitting the voice data to the terminal, means for playing the transmitted voice data, means for periodically taking and transmitting images and videos, means for saving the transmitted images and videos so that parents can review them, and means for measuring the amount of ultraviolet light and automatically applying a filter. This enables navigation within physical stores, remote monitoring of children, and ultraviolet light protection.

[1137] "Means for obtaining current location information" refers to the ability to determine the current location of a device using GPS or other location information technology.

[1138] The "means for transmitting acquired current location information" refers to a communication function for transmitting the current location information acquired by the terminal to a server.

[1139] "Means for receiving voice input" refers to functionality including a microphone and voice recognition technology that allows a user to input voice instructions into the device.

[1140] "Means for transmitting voice input" refers to a communication function that transmits received voice input data to a server.

[1141] "Means for analyzing voice data to obtain destination information" refers to technology that enables a server to analyze voice data and identify the user's intended destination.

[1142] "Means for calculating the optimal route based on current location information and destination information" refers to an algorithm that calculates the most efficient travel route using the current location and destination as input.

[1143] "Means for converting the optimal route into voice data" refers to technology that converts the calculated route into a voice message that is easy for the user to understand.

[1144] "Means for transmitting voice data to a terminal" refers to a communication function for transmitting the generated voice data to a terminal.

[1145] "Means for playing back transmitted audio data" refers to a speaker or playback device that allows the user to hear the audio data transmitted to the terminal.

[1146] "Means for periodically taking and transmitting images and videos" refers to a function that takes images and videos at regular intervals using the camera installed on the device and transmits them to a server.

[1147] "Means for storing transmitted images and videos so that parents can view them" refers to technology that stores received image and video data on a server and allows parents to view them remotely.

[1148] "Means for measuring the amount of UV rays and automatically applying a filter" refers to a function that uses a UV sensor built into the device to measure the amount of UV rays in the surrounding area and automatically applies a UV-cut filter as needed.

[1149] This invention provides a multi-function glasses system using GPS and AI, which integrates multiple functions such as customer navigation in physical stores, remote parental monitoring of children, and UV protection.

[1150] System Overview

[1151] Hardware Configuration

[1152] 1. Device (smart glasses)

[1153] The built-in GPS sensor is used to obtain current location information and send that information to the server.

[1154] Use a microphone to receive audio input.

[1155] Use the camera to take pictures and videos.

[1156] The amount of UV rays is measured using a UV sensor and the UV cut filter is automatically adjusted.

[1157] Play audio data through a speaker.

[1158] 2. Server

[1159] A high-performance computer that analyzes voice data and calculates routes.

[1160] Manages data transmission and reception and real-time database.

[1161] 3. Parental Smartphone

[1162] A device for reviewing images and videos and sending instructions to children.

[1163] Software Configuration

[1164] Google Cloud AI / ML services: Used for voice and image analysis.

[1165] Firebase: Used to send, receive, and store data in real time.

[1166] TensorFlow: Used for speech recognition and route optimization algorithms.

[1167] Operation explanation

[1168] 1. Directions function

[1169] The device periodically obtains its current location information using its built-in GPS sensor and sends that information to the server.

[1170] When the user inputs a voice command such as "I want to go to shelf A," the device sends the voice data to the server.

[1171] The server analyzes the voice data, obtains destination information, and calculates the optimal route based on the current location and destination information.

[1172] The calculated route is converted into audio data and sent to the device, which then plays the audio data to guide the user.

[1173] 2. Monitoring function

[1174] The device's camera periodically takes images and videos and sends them to the server.

[1175] The server stores the received data and allows parents to check it in real time via a smartphone app.

[1176] Based on the verification results, parents can send necessary instructions to their children, which will then be played back on the device.

[1177] 3. UV protection

[1178] The device's built-in UV sensor measures the amount of UV rays in the environment and automatically adjusts the UV cut filter if the amount of UV rays exceeds a certain level.

[1179] This protects the user's eyes from UV rays.

[1180] Specific examples

[1181] Example 1: In-store navigation

[1182] A customer uses the smart glasses to voice-input, "I want to go to shelf A." The server analyzes the voice data, calculates the optimal route, and sends instructions to the smart glasses, such as "Turn right and go 10 meters." The smart glasses then play back the instructions aloud, guiding the customer to their destination.

[1183] Example 2: In-store monitoring

[1184] Children wear smart glasses in the store and periodically send images and videos to a server. Parents can check in real time via a smartphone app to understand their child's location and situation. Instructions such as "Go left from that location" are sent via text message, and the child receives the instructions through the smart glasses.

[1185] Example 3: UV protection function

[1186] When shopping outside the store, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[1187] Prompt Sentence Examples

[1188] "Please help me design a smart glasses application for a brick-and-mortar store. Please print out the application specifications that provide the following functionality:

[1189] 1. Real-time in-store navigation

[1190] 2. Parental monitoring of children's location and behavior

[1191] 3. UV cut function when high levels of UV rays are detected

[1192] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1193] Step 1:

[1194] The device acquires its current location information using the built-in GPS sensor. The input is the location data from the GPS sensor, and the output is the current location information. This data is sent to the next processing step.

[1195] Step 2:

[1196] The device sends the current location information it has acquired to the server. The input is the current location information, and the output is the current location information sent to the server. Transmission is via Wi-Fi or mobile communication networks.

[1197] Step 3:

[1198] The user inputs voice data into the terminal. For example, the user may say, "I want to go to shelf A," and the terminal receives this data through the microphone. The input is voice data, and the output is also voice data.

[1199] Step 4:

[1200] The device sends the received voice data to the server. The input is the voice data, and the output is the voice data sent to the server. Transmission is via Wi-Fi or mobile communication network.

[1201] Step 5:

[1202] The server analyzes the voice data and obtains the destination information. The input is the voice data, and the output is the analyzed destination information. The analysis uses Google Cloud's voice recognition service to identify the destination.

[1203] Step 6:

[1204] The server calculates the optimal route based on the current location and destination information. The input is the current location and destination information, and the output is the optimal route information. This calculation is done using TensorFlow.

[1205] Step 7:

[1206] The server converts the calculated optimal route into voice data. The input is the optimal route information, and the output is the voice data. Google Cloud's voice synthesis service is used for voice synthesis.

[1207] Step 8:

[1208] The server sends the audio data to the device. The input is the audio data, and the output is the audio data sent to the device. The transmission is via Wi-Fi or a mobile communication network.

[1209] Step 9:

[1210] The device plays the received voice data and guides the user from their current location to their destination. The input is the voice data, and the output is the played voice guidance.

[1211] Step 10:

[1212] The device's camera periodically captures images and videos. The input is the current view, and the output is the captured image or video data.

[1213] Step 11:

[1214] The device compresses the captured images and video data and sends it to the server. The input is the image or video data, and the output is the compressed data. Image and video compression algorithms are used for compression.

[1215] Step 12:

[1216] The server stores the received image and video data, allowing parents to view them in real time on their smartphones. The input is compressed image and video data, and the output is the stored data.

[1217] Step 13:

[1218] Parents can view images and videos via a smartphone app and send instructions to their children as needed. The input is the parent's instructions, and the output is the instruction data sent to the device.

[1219] Step 14:

[1220] The UV sensor on the device measures the amount of UV light in the surrounding area. The input is the amount of UV light, and the output is the measured UV light data.

[1221] Step 15:

[1222] When the amount of UV rays exceeds a certain standard, the terminal will automatically adjust the UV cut filter. The input is UV data, and the output is the adjusted UV cut filter.

[1223] As described above, each processing step works together to create a system that provides multifunctional support to users.

[1224] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1225] This invention provides multifunctional children's glasses equipped with GPS and AI-based route guidance, a camera, a recording function, UV protection, and an emotion engine that recognizes the user's emotions. The program processing of this system is explained in natural language below, and will be described in detail with concrete examples.

[1226] GPS and AI-powered route guidance

[1227] Device (kids' glasses)

[1228] The device periodically acquires its current location using its built-in GPS sensor and sends that information to the server. If the user (child) gets lost, they can voice-instruct, "I want to go home." The device then sends that voice data to the server.

[1229] server

[1230] The server receives the current location information and voice data sent from the device, converts it into text using voice recognition technology, and analyzes the question. It then retrieves destination information (e.g., home) from a database. It uses an AI algorithm to calculate the optimal route from the current location to the destination, converts the result into voice data, and sends it to the device.

[1231] Device (kids' glasses)

[1232] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to follow the voice guidance to reach their destination.

[1233] Examples:

[1234] When a user says "I want to go home," the Kids Glasses sends that voice to the server. The server calculates the optimal route and sends voice data such as "Turn right and go 100 meters" to the device. The device then plays back the voice and guides the user to their destination.

[1235] Camera function / recording function

[1236] Device (kids' glasses)

[1237] When a user presses the share button, the device's camera captures the current view, compresses the captured image data, and sends it to the server.

[1238] server

[1239] The server receives and stores image data sent from the device, allowing parents to view the images through the app.

[1240] User (Parent)

[1241] Parents use the app to review the images and send instructions to their child via text or voice message if needed.

[1242] Examples:

[1243] If a child gets lost, they can press the share button to take a picture of the current view and send the image data to the server. The parent can then check the image received in the app and send a text message with instructions such as "Go left from that location."

[1244] UV protection

[1245] Device (kids' glasses)

[1246] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust, protecting children's eyes from UV rays.

[1247] Examples:

[1248] When your child goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect your child's eyes.

[1249] Emotion recognition and response with emotion engine

[1250] Device (kids' glasses)

[1251] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice to recognize their emotions, and sends this information to the server.

[1252] server

[1253] The server generates appropriate support messages and responses based on the emotion information sent from the emotion engine, converts the responses into voice data, and sends them to the device.

[1254] User (Parent)

[1255] Parents can also receive emotional information through the app and take appropriate measures based on their child's psychological state and emotions.

[1256] Examples:

[1257] If a user becomes lost and anxious, the emotion engine will recognize that emotion and play a comforting voice message through the device, such as, "Don't worry, we'll help you soon." Parents can also view this information in the app and send encouragement or instructions as needed.

[1258] The above process flow enables the implementation of multi-function kids' glasses, including lost child prevention, remote parental tracking, UV protection, and emotion recognition. This explains how the system specifically works to ensure children's safety and provide peace of mind for parents.

[1259] The processing flow will be explained below.

[1260] GPS and AI-powered route guidance

[1261] Step 1: Obtain and send location data

[1262] Terminal

[1263] 1. The device periodically obtains its current location information (latitude and longitude) from the built-in GPS sensor.

[1264] 2. The acquired location information is sent to the server.

[1265] Specific actions

[1266] The GPS sensor measures the current location information and passes the results to the GPS data acquisition module.

[1267] The GPS data acquisition module formats the acquired data and sends it to the server via the communication module.

[1268] Step 2: Enter and submit your voice question

[1269] User (child)

[1270] 1. When you get lost, ask a voice question such as "I want to go home."

[1271] Terminal

[1272] 1. The voice input module acquires the voice data and sends it to the server.

[1273] Specific actions

[1274] The voice input module captures the voice data and sends it to the server through the communication module.

[1275] Step 3: Analyze voice data and obtain destination information

[1276] server

[1277] 1. Receive the audio data sent from the device.

[1278] 2. The voice data is converted into text using a voice recognition module, and the question content is analyzed.

[1279] 3. Retrieve destination information from the database.

[1280] Specific actions

[1281] The speech recognition module converts the speech data into text, which is then processed by the destination analysis module.

[1282] The destination analysis module retrieves destination information from the database.

[1283] Step 4: Route calculation and voice data generation

[1284] server

[1285] 1. The AI ​​algorithm calculates the optimal route based on current location and destination information.

[1286] 2. The calculation results are converted into audio data and sent to the device.

[1287] Specific actions

[1288] The route calculation module takes your current location and destination as input and calculates the optimal route.

[1289] The speech synthesis module converts the calculation results into speech data and sends it to the terminal via the communication module.

[1290] Step 5: Play audio prompts

[1291] Terminal

[1292] 1. Receives audio data sent from the server and plays it back to the user.

[1293] Specific actions

[1294] The communication module receives the audio data from the server and passes it to the audio playback module for playback.

[1295] Camera function / recording function

[1296] Step 1: Press the share button and take a picture

[1297] User (child)

[1298] 1. When you get lost or in trouble, just press the share button.

[1299] Terminal

[1300] 1. When the button is pressed, the camera will take a picture of the current view.

[1301] 2. Compress the captured image data.

[1302] Specific actions

[1303] The button input module detects user presses and sends a trigger to the camera module.

[1304] The camera module takes images and passes the data to the image compression module.

[1305] Step 2: Send and save image data

[1306] Terminal

[1307] 1. Send the compressed image data to the server.

[1308] server

[1309] 1. Receive and save image data sent from the device.

[1310] Specific actions

[1311] The communication module sends the image data to the server, and the server's image storage module stores the data in a database.

[1312] Step 3: Parents review images and send messages

[1313] User (Parent)

[1314] 1. Parents can use the app to check the received image data.

[1315] 2. Send text or voice messages to your child as needed.

[1316] Specific actions

[1317] The app interface displays the image data, and parents send instructions using the message input module.

[1318] UV protection

[1319] Step 1: Measure UV levels and adjust filters

[1320] Terminal

[1321] 1. The UV sensor measures the amount of UV light in the environment.

[1322] 2. If a certain level of UV rays is detected, the UV cut filter will automatically adjust.

[1323] Specific actions

[1324] The UV sensor module measures the amount of UV rays and passes the results to the filter control module.

[1325] The filter control module adjusts the UV cut filter to protect your eyes from ultraviolet rays.

[1326] Emotion recognition and response with emotion engine

[1327] Step 1: Acquiring and analyzing emotional information

[1328] Terminal

[1329] 1. The device's built-in emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional information.

[1330] Specific actions

[1331] The emotion engine analyzes facial expression recognition data and voice tone in real time to generate emotional information.

[1332] Step 2: Sending emotional information and generating support messages

[1333] Terminal

[1334] 1. Send emotional information to the server.

[1335] server

[1336] 1. Receive emotional information and generate appropriate support messages.

[1337] 2. The generated message is converted into audio data and sent to the device.

[1338] Specific actions

[1339] The communication module sends the emotional information to the server, and the support message generation module generates an appropriate message.

[1340] The speech synthesis module converts the message into voice data and sends it to the terminal via the communication module.

[1341] Step 3: Playing assistance audio to the user

[1342] Terminal

[1343] 1. Receives audio data from the server and plays it back to the user.

[1344] Specific actions

[1345] The communication module receives the audio data from the server and passes it to the audio playback module for playback.

[1346] In this way, the operations at each processing step are specified, and the user, terminal, and server cooperate to realize the functions of the multifunctional kids' glasses.

[1347] Example 2

[1348] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1349] While existing devices with location-based navigation systems, camera functions, and UV protection functions exist as separate functions, there was no system that integrated these functions and could recognize the user's emotions and respond appropriately. This made it difficult to provide comprehensive support for children who got lost, protect them from UV rays, and provide a sense of mental security. In particular, due to the lack of emotion recognition capabilities, existing systems were unable to recognize and respond to children's psychological anxieties and difficulties in real time.

[1350] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1351] In this invention, the server includes a means for acquiring current location information, a means for analyzing voice input to acquire destination information, a means for calculating the optimal route based on the current location information and destination information, a means for recognizing the user's emotions, a means for generating a response message based on the recognized emotion information, and a means for converting the generated response message into voice data and transmitting it to the terminal. This not only enables appropriate route guidance based on the child's location information and real-time safety assurance, but also appropriately recognizes the user's emotions and provides a sense of mental security. In addition, the camera function and UV protection function make it easy for parents to remotely monitor their child's situation, give appropriate instructions, and protect their child's eyes from UV rays.

[1352] "Current location information" is the location information of a device obtained using the GPS sensor built into the device, and is data indicating the geographical location of the device.

[1353] "Voice input" is a function that receives a user's voice instructions through the terminal's microphone.

[1354] "Destination information" is geographical location information of the user's destination that the server obtains from the database after analyzing the voice input.

[1355] The "optimal route" is the optimal route to the destination calculated based on the current location information and the destination information.

[1356] "Voice data" is data in a format that the server converts voice input or calculation results into a voice message and sends to the terminal.

[1357] The term "terminal" refers to the multi-function kids' glasses of the present invention, which is a hardware device with multiple built-in functions.

[1358] A "server" is a computer system that processes data sent from a terminal, generates voice data and response messages, and sends them to the terminal.

[1359] "Emotion recognition" is a technology that analyzes a user's facial expressions and tone of voice to identify their emotions.

[1360] A "response message" is voice data or a text message that is generated by the server based on emotional information to provide the user with psychological relief.

[1361] The "camera function" is a function that uses the camera built into the terminal to capture a current view and process the image data.

[1362] A "UV cut filter" is a filter that protects the eyes from ultraviolet rays and automatically adjusts based on the amount of ultraviolet rays detected by the ultraviolet sensor.

[1363] An "ultraviolet sensor" is a sensor that measures the amount of ultraviolet light in the environment and is built into the device.

[1364] The "share button" is an operation button that the user uses to take a picture of the current view and send the image data to the server.

[1365] The present invention provides multifunctional children's glasses equipped with GPS and AI navigation functions, a camera function, a recording function, UV protection functions, and an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described in detail below.

[1366] Directions function

[1367] Device (kids' glasses)

[1368] The device periodically obtains its current location information using a built-in GPS sensor (e.g., u-blox M8). This location information is packaged as a JSON packet and sent to the server using the HTTPS protocol. When the user gets lost, they press the voice input button and give a voice command such as "I want to go home." This voice data is captured by the device's microphone and also sent to the server.

[1369] server

[1370] The server converts the received voice data into text using a speech recognition API (e.g., Google Cloud Speech-to-Text). It then analyzes the converted text and retrieves destination information from a database (e.g., PostgreSQL). It then uses an AI algorithm (e.g., Dijkstra's Algorithm) to calculate the optimal route from the current location to the destination, converts the result into voice data, and sends it to the device.

[1371] Device (kids' glasses)

[1372] The device receives the voice data sent from the server and plays it as a guide voice from the built-in speaker. The user can follow this voice guidance to reach their destination.

[1373] Examples:

[1374] If the user says "I want to go home," the device sends that speech to the server. The server generates a voice guidance message such as "Turn right and go 100 meters" and sends it to the device. The device then plays back that voice message and guides the user to their destination.

[1375] Camera function / recording function

[1376] Device (kids' glasses)

[1377] When a user presses the share button, the device's camera (e.g., Sony IMX219) captures the current view, compresses the captured image data into JPEG format, and then sends the compressed image data to the server using the HTTPS protocol.

[1378] server

[1379] The server stores the received image data in a database and provides it to the app used by the parent for display.

[1380] User (Parent)

[1381] Parents can use the app to review the image and, if necessary, send their child instructions via text message, such as "Go left from that location."

[1382] Examples:

[1383] A child presses the share button to take a picture of the current view and sends the image data to the server. A parent can then view the image in the app and send instructions via text message, such as "Go left from that location."

[1384] UV protection

[1385] Device (kids' glasses)

[1386] The device's built-in UV sensor (e.g., VEML6070) periodically measures the amount of UV radiation in the environment. If the measured value exceeds a certain level, the device automatically adjusts the UV-blocking filter (e.g., photochromic lenses) to protect children's eyes from UV rays.

[1387] Examples:

[1388] When your child goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV-blocking filter to protect your child's eyes from UV rays.

[1389] Emotion recognition and response with emotion engine

[1390] Device (kids' glasses)

[1391] The device's built-in emotion engine (e.g., Affectiva SDK) analyzes the user's facial expressions and tone of voice to recognize their emotions, and sends this information to the server.

[1392] server

[1393] The server generates appropriate support messages and responses based on the emotion information sent from the emotion engine, and the generated voice data is sent to the terminal and played back to the user.

[1394] User (Parent)

[1395] Parents can also receive emotional information through the app and take appropriate measures based on their child's psychological state and emotions.

[1396] Examples:

[1397] If a user becomes lost and anxious, the emotion engine will recognize that emotion and play a comforting voice message such as, "It's okay, we'll help you soon." Parents can also view this information in the app and send encouragement or instructions as needed.

[1398] Example of an input prompt for a generative AI model:

[1399] 1. "Describe how kids' glasses with a built-in GPS sensor work to periodically obtain location information."

[1400] 2. "Please explain the processing flow when a lost child voice-inputs the command, 'I want to go home.'"

[1401] 3. "Please explain the process of the camera function, where the user takes a picture of the current scene and sends the image data to the server."

[1402] 4. "Please explain how the UV sensor automatically adjusts the UV cut filter when it detects high levels of UV."

[1403] 5. "Explain how the emotion engine recognizes a child's emotions and generates an appropriate response."

[1404] The system of the present invention integrates these multiple functions to ensure the safety and security of children.

[1405] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1406] Step 1:

[1407] Obtaining and sending location information

[1408] Device (kids' glasses)

[1409] The device periodically obtains its location using a GPS sensor (e.g., u-blox M8), which is then converted into JSON format and sent to the server using the HTTPS protocol.

[1410] Input: Location information from the GPS sensor

[1411] Data processing: Convert location information into JSON format

[1412] Output: Location information in JSON format sent to the server

[1413] Step 2:

[1414] Acquiring and sending voice input

[1415] User (child)

[1416] The user presses the voice input button and gives a voice command such as "I want to go home." The device's microphone captures this voice data and sends it to the server.

[1417] Input: User's voice commands

[1418] Data processing: Capture audio data

[1419] Output: Audio data sent to the server

[1420] Step 3:

[1421] Voice data analysis and route calculation

[1422] server

[1423] The server receives the voice data and converts it into text using speech recognition technology (e.g., Google Cloud Speech-to-Text). It then analyzes the text data and retrieves destination information from a database (e.g., PostgreSQL). It then uses an AI algorithm (e.g., Dijkstra's Algorithm) to calculate the optimal route from the current location to the destination.

[1424] Input: Audio data sent from the device

[1425] Data processing: Converts voice data into text, obtains destination information, and calculates the optimal route

[1426] Output: Data calculated as the optimal route

[1427] Step 4:

[1428] Generate and transmit route guidance voice

[1429] server

[1430] The server converts the calculated optimal route data into voice data, generates voice guidance, and sends the voice data to the terminal.

[1431] Input: Calculated optimal route data

[1432] Data processing: Convert optimal route data into audio data

[1433] Output: Audio data sent to the device

[1434] Step 5:

[1435] Providing audio guidance

[1436] Device (kids' glasses)

[1437] The device plays the received audio data through its built-in speaker and provides route guidance to the user.

[1438] Input: Audio data sent from the server

[1439] Data processing: Audio data playback

[1440] Output: Audio instructions to the user

[1441] Step 6:

[1442] Camera image capture and transmission

[1443] Device (kids' glasses)

[1444] When a user presses the share button, the device's camera (e.g., Sony IMX219) captures the current view, and the captured image data is compressed into JPEG format and then sent to the server.

[1445] Input: Image data captured by a camera

[1446] Data processing: Compression of image data into JPEG format

[1447] Output: Compressed image data sent to the server

[1448] Step 7:

[1449] Image data storage and display

[1450] server

[1451] The server stores the received image data in a database and provides it to the app used by the parent for display.

[1452] Input: Compressed image data sent from the terminal

[1453] Data processing: saving and displaying image data

[1454] Output: Image data displayed in the parent app

[1455] Step 8:

[1456] UV sensor measurement and filter adjustment

[1457] Device (kids' glasses)

[1458] The device's built-in UV sensor (e.g., VEML6070) periodically measures the amount of UV radiation in the environment. If the measured value exceeds a certain level, the device automatically adjusts the UV-blocking filter (e.g., photochromic lenses) to protect children's eyes from UV rays.

[1459] Input: Measurement data from UV sensor

[1460] Data processing: Adjusting the filter according to the amount of UV rays

[1461] Output: Adjusted UV cut filter

[1462] Step 9:

[1463] Emotion recognition and response generation

[1464] Device (kids' glasses)

[1465] The device's built-in emotion engine (e.g., Affectiva SDK) analyzes the user's facial expressions and tone of voice to recognize their emotions. The recognized emotion information is sent to the server.

[1466] Input: User facial and voice data

[1467] Data processing: sentiment analysis and recognition

[1468] Output: Emotion information sent to the server

[1469] Step 10:

[1470] Generating and sending response messages based on emotion information

[1471] server

[1472] The server generates an appropriate support message or response based on the received emotional information. The generated response message is converted into voice data and sent to the device.

[1473] Input: Emotion information sent from the device

[1474] Data processing: Generating response messages based on emotional information and converting them into voice data

[1475] Output: Audio data sent to the device

[1476] Step 11:

[1477] Playing greetings

[1478] Device (kids' glasses)

[1479] The terminal plays the audio data sent from the server on its built-in speaker and provides a response message to the user.

[1480] Input: Audio data sent from the server

[1481] Data processing: Audio data playback

[1482] Output: Response message to the user

[1483] (Application example 2)

[1484] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1485] There are limitations to ensuring children's safety and the methods parents can use to remotely check on their children's status, making it difficult to respond quickly and appropriately when children become lost or anxious. It is also necessary to comprehensively improve daily safety by integrating multifunctional protective devices, such as those that recognize children's emotions and block UV rays. It is also important to understand children's psychological state in real time and provide appropriate support based on that information.

[1486] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1487] In this invention, the server includes means for receiving and analyzing emotion information from the terminal, means for generating a support message based on the analysis results, and means for converting the support message into voice data and transmitting it to the terminal. This makes it possible to quickly provide optimal route guidance and support messages based on emotion recognition when a child gets lost or feels anxious.

[1488] "Current location information" is data indicating the location information of the terminal, and is information acquired by a location information acquisition means such as a GPS.

[1489] "Destination information" is data indicating the location information of a place where the user wants to go.

[1490] The "optimal route" is the most logical route to the destination calculated based on the current location information and destination information.

[1491] "Voice input" means voice commands given by a user to a terminal.

[1492] "Audio data" is data obtained by converting audio input into digital form.

[1493] "Emotion information" is data that indicates the user's emotional state as analyzed by an emotion recognition engine built into the terminal.

[1494] A "support message" is a response message to the user that is generated based on emotional information, current location information, and the like, and includes content such as comfort, instructions, and guidance.

[1495] A "UV cut filter" is a filter that adjusts the amount of ultraviolet rays and is built into the device.

[1496] "Image data" refers to photographs and videos taken with the device's camera that have been converted into digital format.

[1497] "Server" refers to a computer system that receives, analyzes, and stores data sent from a terminal, and generates the necessary response data.

[1498] This invention is a system for ensuring the safety and remote monitoring of children using multifunctional kids' glasses. The system consists of a device (multifunctional kids' glasses) equipped with GPS, AI, a camera, recording function, UV protection function, and emotion recognition function, a server, and a smartphone app used by parents.

[1499] Hardware and Software Use:

[1500] Hardware: Multi-function kids' glasses (GPS sensor, camera, UV sensor, emotion recognition engine), smartphone

[1501] Software: Server (AWS), AI algorithm (TensorFlow), speech recognition (Google Cloud Speech-to-Text API), map service (Google Maps API)

[1502] System behavior:

[1503] 1. Location Tracking:

[1504] The device periodically obtains its current location using its built-in GPS sensor and sends it to a server. The server receives and stores the location information and displays it in real time on the parent's smartphone app, allowing parents to always know where their child is.

[1505] 2. Directions:

[1506] The device receives voice input. For example, if a child says, "I want to go home," the voice data is sent to the server. The server uses the Google Cloud Speech-to-Text API to convert the voice into text and obtain the destination information. It then uses the Google Maps API to calculate the optimal route from the current location to the destination. The result is converted into voice data and sent to the device. The device then plays the voice data and guides the child to the destination.

[1507] 3. Camera Function:

[1508] When a child presses the share button on their device, the camera takes a photo of the current scene, compresses the image data, and sends it to the server. The server receives and stores the image data, and displays the image on the parent's smartphone app. The parent can then view the image through the app and send instructions to their child via text or voice message if necessary.

[1509] 4. UV protection:

[1510] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust, protecting children's eyes from UV rays.

[1511] 5. Emotion recognition:

[1512] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice and sends emotional information to a server. The server analyzes the emotional information, generates a comforting or encouraging message as needed, converts it into audio data, and sends it to the device. The device then plays the audio data to reassure the child. The emotional information is also displayed on the parent's smartphone app, allowing parents to understand their child's psychological state.

[1513] Examples:

[1514] For example, if a child gets lost and feels anxious, they can voice-instruct, "I want to go home." The device sends this voice to the server, which then calculates the optimal route and sends voice data such as, "Turn right and go 100 meters." If the emotion engine detects anxiety, it will play a comforting message through the device, such as, "It's okay, we'll help you right away."

[1515] Example prompt sentence:

[1516] "I want to go home."

[1517] This allows the invention to automatically provide optimal support to ensure the safety of children when they get lost or feel anxious.

[1518] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1519] Step 1:

[1520] The device obtains location information

[1521] The device periodically obtains location information using the built-in GPS sensor.

[1522] input:

[1523] Location data from GPS sensors.

[1524] output:

[1525] Current location information.

[1526] Specific behavior:

[1527] The device receives a GPS signal, calculates latitude and longitude information, and generates current location information.

[1528] Step 2:

[1529] The device sends its current location information to the server.

[1530] The terminal transmits the acquired current location information to the server.

[1531] input:

[1532] Current location information.

[1533] output:

[1534] Send data to the server.

[1535] Specific behavior:

[1536] The terminal compresses the current location information and communicates using a protocol (for example, HTTP) for transmitting it to the server.

[1537] Step 3:

[1538] The user provides voice input

[1539] The user (child) inputs voice commands into the device.

[1540] input:

[1541] Voice commands (e.g., "I want to go home").

[1542] output:

[1543] Audio data.

[1544] Specific behavior:

[1545] The device's microphone receives the user's voice waves and converts them into digital voice data.

[1546] Step 4:

[1547] The device sends the audio data to the server.

[1548] The terminal transmits the acquired voice data to the server.

[1549] input:

[1550] Audio data.

[1551] output:

[1552] Send data to the server.

[1553] Specific behavior:

[1554] The terminal communicates using a protocol for compressing the voice data and transmitting it to the server.

[1555] Step 5:

[1556] The server analyzes the audio data

[1557] The server receives the voice data and converts it into text using voice recognition technology.

[1558] input:

[1559] Audio data.

[1560] output:

[1561] Text data.

[1562] Specific behavior:

[1563] The server uses the Google Cloud Speech-to-Text API to analyze the audio data and generate text data.

[1564] Step 6:

[1565] The server obtains destination information

[1566] The server analyzes the voice recognition results and obtains destination information.

[1567] input:

[1568] Text data (e.g., "I want to go home").

[1569] output:

[1570] Destination information.

[1571] Specific behavior:

[1572] The server extracts keywords from the speech recognition results and acquires destination information by referring to a destination database.

[1573] Step 7:

[1574] The server calculates the optimal route

[1575] The server calculates the optimal route based on the current location information and destination information.

[1576] input:

[1577] Current location information, destination information.

[1578] output:

[1579] The best route.

[1580] Specific behavior:

[1581] The server uses the Google Maps API to calculate the optimal route from your current location to your destination.

[1582] Step 8:

[1583] The server converts the optimal route into audio data.

[1584] The server converts the calculated optimal route into audio data.

[1585] input:

[1586] The best route.

[1587] output:

[1588] Audio data.

[1589] Specific behavior:

[1590] The server generates the voice data using text-to-speech (TTS) technology.

[1591] Step 9:

[1592] The server sends the audio data to the device.

[1593] The server transmits the generated voice data to the terminal.

[1594] input:

[1595] Audio data.

[1596] output:

[1597] Send data to the device.

[1598] Specific behavior:

[1599] The server communicates using a protocol to compress the audio data and transmit it to the terminal.

[1600] Step 10:

[1601] The device plays the audio data.

[1602] The terminal receives the transmitted audio data and plays it back to the user.

[1603] input:

[1604] Audio data.

[1605] output:

[1606] Audio guidance.

[1607] Specific behavior:

[1608] The device decodes the audio data and plays it through its built-in speaker.

[1609] Step 11:

[1610] The device receives and analyzes emotional information

[1611] The device analyzes the user's facial expressions and tone of voice to obtain emotional information.

[1612] input:

[1613] User's facial expression data, voice data.

[1614] output:

[1615] emotional information.

[1616] Specific behavior:

[1617] The device's emotion recognition engine analyzes the user's facial expressions and tone of voice to recognize specific emotional states (e.g., anxiety, joy).

[1618] Step 12:

[1619] The device sends emotional information to the server.

[1620] The device transmits the analyzed emotion information to the server.

[1621] input:

[1622] emotional information.

[1623] output:

[1624] Send data to the server.

[1625] Specific behavior:

[1626] The terminal communicates using a protocol for compressing emotion information and transmitting it to the server.

[1627] Step 13:

[1628] The server generates a support message based on the emotional information.

[1629] The server generates an appropriate support message based on the received emotion information.

[1630] input:

[1631] emotional information.

[1632] output:

[1633] Supportive message.

[1634] Specific behavior:

[1635] The server refers to an emotion database and generates an appropriate support message (e.g., "Don't worry, we'll help you right away").

[1636] Step 14:

[1637] The server converts the assistance message into audio data.

[1638] The server converts the generated assistance message into voice data.

[1639] input:

[1640] Supportive message.

[1641] output:

[1642] Audio data.

[1643] Specific behavior:

[1644] The server converts the assistance message into voice data using TTS technology.

[1645] Step 15:

[1646] The server sends the audio data to the device.

[1647] The server transmits the generated voice data to the terminal.

[1648] input:

[1649] Audio data.

[1650] output:

[1651] Send data to the device.

[1652] Specific behavior:

[1653] The server communicates using a protocol to compress the audio data and transmit it to the terminal.

[1654] Step 16:

[1655] The device plays the audio data of the support message.

[1656] The terminal receives the transmitted audio data and plays it back to the user.

[1657] input:

[1658] Audio data.

[1659] output:

[1660] Audio guide for support messages.

[1661] Specific behavior:

[1662] The device decodes the audio data and plays it through its built-in speaker.

[1663] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1664] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1665] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1666] [Third embodiment]

[1667] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1668] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1669] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1670] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1671] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1672] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1673] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1674] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1675] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1676] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1677] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1678] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1679] This invention provides multifunctional children's glasses equipped with GPS and AI navigation, camera, video recording, and UV protection. The program processing of this system is explained in natural language below, and is also described in detail with specific examples.

[1680] GPS and AI-powered route guidance

[1681] Device (kids' glasses)

[1682] The device periodically acquires its current location using a built-in GPS sensor and sends that information to the server. When the user (child) gets lost, they can input a command into the device by voice, such as "I want to go home." The device then sends that voice data to the server.

[1683] server

[1684] The server receives the current location information and voice data sent from the device. It converts the received voice data into text using voice recognition technology and analyzes the question. It then retrieves destination information (e.g., "home") from a database. The server uses an AI algorithm to calculate the optimal route from the current location to the destination and converts the result into voice data. The voice data of the optimal route is sent to the device.

[1685] Device (kids' glasses)

[1686] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to reach their destination by following the voice guidance.

[1687] Examples:

[1688] When a user voice-inputs "I want to go home," Kids Glasses sends the voice to the server. The server calculates the optimal route and sends voice data saying "Turn right and go 100 meters" to the device. The device plays back the voice and guides the user to their destination.

[1689] Camera function / recording function

[1690] Device (kids' glasses)

[1691] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[1692] server

[1693] The server receives and stores image data sent from the device, allowing parents to view the images through the app.

[1694] User (Parent)

[1695] Parents can use the app to review the images and send instructional messages to their children if needed.

[1696] Examples:

[1697] If a user gets lost, they can press the share button to take a picture of the current view and send the image data to the server. The parent can then check the image received in the app and send a text message with instructions such as "Go left from that location."

[1698] UV protection

[1699] Device (kids' glasses)

[1700] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes.

[1701] Examples:

[1702] When the user goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[1703] This will enable the realization of multi-functional kids' glasses that prevent children from getting lost, allow parents to check on their children's situation remotely, and protect their eyes from UV rays. This system is an embodiment that ensures children's safety and provides peace of mind to parents.

[1704] The processing flow will be explained below.

[1705] GPS and AI-powered route guidance

[1706] Step 1: Obtain and send location data

[1707] Terminal

[1708] 1. The device obtains its current location information (latitude and longitude) from the built-in GPS sensor.

[1709] 2. The acquired current location information is sent to the server via the communication module.

[1710] Specific actions

[1711] The GPS sensor measures your current location and passes the results to the GPS data acquisition module.

[1712] The GPS data acquisition module formats the data and sends it to the server through the communication module.

[1713] Step 2: Enter and submit your voice question

[1714] User (child)

[1715] 1. If your child gets lost, they can ask a voice message saying, "I want to go home."

[1716] Terminal

[1717] 1. The voice input module acquires voice data and sends it to the server through the communication module.

[1718] Specific actions

[1719] The voice input module captures voice data and sends it to the server through the communication module.

[1720] Step 3: Analyze voice data and obtain destination information

[1721] server

[1722] 1. The server receives the voice data sent from the device.

[1723] 2. The voice data is converted into text using a voice recognition module, and the question content is analyzed.

[1724] 3. Retrieve destination information from the database.

[1725] Specific actions

[1726] The voice recognition module converts the voice data into text, and the text analysis module extracts destination information.

[1727] The corresponding destination information is obtained from the destination database.

[1728] Step 4: Route calculation and voice data generation

[1729] server

[1730] 1. The AI ​​algorithm calculates the optimal route based on current location and destination information.

[1731] 2. The calculation results are converted into audio data and sent to the device.

[1732] Specific actions

[1733] The route calculation module calculates the optimal route using the current location and destination as input.

[1734] The speech synthesis module converts the calculation results into speech data and sends it to the terminal via the communication module.

[1735] Step 5: Play audio prompts

[1736] Terminal

[1737] 1. The device receives the audio data sent from the server and plays it back to the user.

[1738] Specific actions

[1739] The communication module receives audio data from the server and passes it to the audio playback module for playback.

[1740] Camera function / recording function

[1741] Step 1: Press the share button and take a picture

[1742] User (child)

[1743] 1. When you get lost or in trouble, just press the share button.

[1744] Terminal

[1745] 1. When the button is pressed, the camera will take a picture of the current view.

[1746] 2. Compress the captured image data.

[1747] Specific actions

[1748] The button input module detects user presses and sends a trigger to the camera module.

[1749] The camera module takes images and passes the data to the image compression module.

[1750] Step 2: Send and save image data

[1751] Terminal

[1752] 1. The compressed image data is sent to the server via the communication module.

[1753] server

[1754] 1. The server receives and stores the image data sent from the device.

[1755] Specific actions

[1756] The communication module sends the image data to the server, and the server's image storage module stores it in a database.

[1757] Step 3: Parents review images and send messages

[1758] User (Parent)

[1759] 1. Parents can use the app to check the received image data.

[1760] 2. Send texts or voice messages to your child as needed.

[1761] Specific actions

[1762] The application interface displays image data and sends instructions through the message input module.

[1763] UV protection

[1764] Step 1: Measure UV levels and adjust filters

[1765] Terminal

[1766] 1. The UV sensor measures the amount of UV light in the environment.

[1767] 2. If a certain level of UV rays is detected, the UV cut filter will automatically adjust.

[1768] Specific actions

[1769] The UV sensor module measures the amount of UV rays and passes the results to the filter control module.

[1770] The filter control module adjusts the effect of the UV cut filter to protect your eyes from ultraviolet rays.

[1771] In this way, the operations at each processing step are specified, and the user, terminal, and server cooperate to realize the functions of the multifunctional kids' glasses.

[1772] Example 1

[1773] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1774] In modern society, it is necessary to reduce the risk of children getting lost when they are out and help them return home safely. However, conventional devices with GPS functions lack supportive route guidance and communication with parents, making it difficult to provide multifunctional support. Protecting children from UV rays when outdoors is also important, but inadequate protection can have a negative impact on their health. To effectively solve these issues, a multifunctional system that integrates route guidance, camera functions, UV protection, and other functions is required.

[1775] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1776] In this invention, the server includes means for acquiring current location information, means for analyzing voice data and converting it into text, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, means for converting the optimal route into voice data, means for receiving and saving image data, means for the user to check the received image data, means for measuring the amount of ultraviolet light, and means for adjusting the UV-cut filter based on the measured amount of ultraviolet light. This makes it possible for the server to provide appropriate voice guidance when a child gets lost, to remotely share the current scenery, and to protect the child's eyes from ultraviolet light.

[1777] "Current location information" is latitude and longitude data relating to the current location of the terminal obtained using a GPS sensor.

[1778] "Means for acquiring" refers to means including sensors and modules for collecting or detecting specific information.

[1779] The "transmitting means" is a means for transmitting the acquired data to another device or system via wireless or wired communication.

[1780] "Voice input" refers to data that receives a user's voice commands or instructions through a voice input device such as a microphone.

[1781] "Voice data" refers to data in which voice information input by a user is recorded in digital format.

[1782] "Means for analyzing" refers to means for analyzing information such as voice data or text data and extracting specific meanings or instructions.

[1783] "Destination information" is location information such as latitude and longitude relating to the location the user is heading for.

[1784] The "calculating means" is a processing device that includes an algorithm for deriving the optimal route based on current location information and destination information.

[1785] A "means for converting" is a means for converting data of a particular format into another format, such as a means for converting text to speech.

[1786] The "means for reproducing audio data" refers to an output device such as a speaker or headphones that allows the user to hear the audio data.

[1787] The "means for photographing scenery" is a means for acquiring the current scenery as image data using a camera.

[1788] The "means for compressing" refers to a means for using image compression technology to reduce the volume of acquired image data.

[1789] The "means for receiving and storing" is a means for receiving data sent from other terminals and storing it in a database or file system.

[1790] "Means for user confirmation" refers to devices or applications that allow users to view or confirm stored data.

[1791] The "means for measuring the amount of ultraviolet light" refers to a means including an ultraviolet sensor for measuring the intensity of ultraviolet light in the environment.

[1792] A "UV cut filter" is a special filter used to block or reduce ultraviolet rays.

[1793] A "means for adjusting" is a means for changing or configuring a device or function based on a particular parameter or condition.

[1794] This invention relates to a multi-function kids' glasses system equipped with GPS and AI navigation, camera, video recording, and UV protection functions. The system consists of a server, a terminal (kids' glasses), and users (children and parents).

[1795] GPS and AI-powered route guidance

[1796] Device (kids' glasses)

[1797] The device has a built-in GPS sensor that periodically acquires its current location information. This information is sent to the server via a communication module. When the user (child) gets lost, they press a button and input voice commands such as "I want to go home" into the device. The device records this voice data and sends it to the server.

[1798] server

[1799] The server receives the current location information and voice data sent from the device. It uses a voice recognition engine (e.g., Google Speech-to-Text API) to convert the voice data into text and analyzes the instructions. It then retrieves destination information (e.g., home address and latitude and longitude) from a database. The server uses an AI algorithm (e.g., A algorithm) to calculate the optimal route from the current location to the destination. The result of this calculation is converted into voice data using a voice synthesis engine (e.g., Amazon Polly) and sent to the device.

[1800] Device (kids' glasses)

[1801] The device receives the voice data sent from the server and plays it back to the user through the speaker, allowing the user to follow the voice guidance to reach their destination.

[1802] Examples:

[1803] When a user voice-inputs "I want to go home," the device sends that voice to the server. The server calculates the optimal route and sends the guidance "Turn right and go 100 meters" to the device as voice data. The device plays back that voice and guides the user to their destination.

[1804] Camera function / recording function

[1805] Device (kids' glasses)

[1806] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[1807] server

[1808] The server receives and stores image data sent from the device, which parents can then view via a smartphone app.

[1809] User (Parent)

[1810] Parents can use the app to view image data and send instructional messages to their children if necessary.

[1811] Examples:

[1812] If a user gets lost, they can press the share button to take a picture of the current view and send the image to the server. The parent can then check the image in the app and send a text message with instructions such as "Go left from that location."

[1813] UV protection

[1814] Device (kids' glasses)

[1815] The device has a built-in UV sensor that continuously measures the amount of UV rays in the environment, and when the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes from UV rays.

[1816] Examples:

[1817] When the user goes outside on a sunny day, if the UV sensor detects high levels of UV rays, the UV cut filter will automatically adjust to protect children's eyes.

[1818] Example prompts for generative AI models

[1819] 1. Example prompt (directions function):

[1820] "Please explain the process of a program that uses GPS and AI to provide voice guidance on the route home if a child gets lost."

[1821] 2. Example prompts (camera function):

[1822] "Explain the process of how a child takes a picture of the current view with their camera and then a parent reviews the image in the app."

[1823] 3. Example prompt (UV protection):

[1824] "Please explain the process of UV protection using an ultraviolet sensor to protect children's eyes."

[1825] This makes it possible to provide multifunctional kids' glasses that reduce the risk of children getting lost when out and about, allow parents to check on the situation remotely, and also protect the eyes from ultraviolet rays.

[1826] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1827] GPS and AI-powered route guidance

[1828] Step 1:

[1829] Device (kids' glasses)

[1830] Obtaining current location information

[1831] Input: None

[1832] Data processing / calculation: The device's built-in GPS sensor periodically measures the current latitude and longitude information.

[1833] Output: Current location information (latitude and longitude)

[1834] Specific operation: The GPS sensor measures the latitude and longitude of the current location and stores the data in the device's memory.

[1835] Step 2:

[1836] Device (kids' glasses)

[1837] Sending current location information

[1838] Input: Current location information (latitude and longitude)

[1839] Data processing / calculation: None

[1840] Output: Current location information (latitude and longitude) is sent to the server

[1841] Specific operation: Use the communication module to send current location information to the server.

[1842] Step 3:

[1843] Device (kids' glasses)

[1844] Acquiring voice input

[1845] Input: User's voice

[1846] Data processing / calculation: Record voice input and convert it into voice data

[1847] Output: Audio data

[1848] Specific operation: The microphone receives the user's voice, and the recording module converts the voice into digital audio data.

[1849] Step 4:

[1850] Device (kids' glasses)

[1851] Sending audio data

[1852] Input: Audio data

[1853] Data processing / calculation: None

[1854] Output: Audio data is sent to the server

[1855] Specific operation: Use the communication module to send audio data to the server.

[1856] Step 5:

[1857] server

[1858] Receiving and analyzing audio data

[1859] Input: Audio data

[1860] Data processing / calculation: Converting voice data into text using a voice recognition engine and analyzing the text data

[1861] Output: Text data (user instructions)

[1862] Specific operation: The server receives the voice data, the speech recognition engine converts the voice into text, and the analysis module extracts the command content.

[1863] Step 6:

[1864] server

[1865] Obtaining destination information

[1866] Input: Text data (user instructions)

[1867] Data processing / calculation: Obtain destination information (latitude and longitude) registered by the user from the database

[1868] Output: Destination information

[1869] Specific operation: The server executes a database query to retrieve destination information using the user ID as a key.

[1870] Step 7:

[1871] server

[1872] Calculating the best route

[1873] Input: Current location information, destination information

[1874] Data processing / calculation: Calculate the optimal route using AI algorithms

[1875] Output: Optimal route information

[1876] Specific operation: The server's route calculation module calculates the optimal route from the current location to the destination.

[1877] Step 8:

[1878] server

[1879] Generate voice guidance

[1880] Input: Optimal route information

[1881] Data processing / calculation: Generates voice guidance messages and converts them into voice data using a voice synthesis engine

[1882] Output: Voice guidance data

[1883] Specific operation: The message generation module creates a text message, and the speech synthesis engine converts it into voice data.

[1884] Step 9:

[1885] server

[1886] Sending audio data

[1887] Input: Voice guidance data

[1888] Data processing / calculation: None

[1889] Output: Voice guidance data is sent to the device.

[1890] Specific operation: The server sends the generated voice guidance data to the terminal.

[1891] Step 10:

[1892] Device (kids' glasses)

[1893] Playing voice guidance

[1894] Input: Voice guidance data

[1895] Data processing / calculation: Decode and play audio data

[1896] Output: A voice prompt that the user hears

[1897] Specific operation: The device receives the audio data, decodes it, and then plays it on the speaker.

[1898] Camera function / recording function

[1899] Step 1:

[1900] Device (kids' glasses)

[1901] Taking an image

[1902] Input: Press the Share button

[1903] Data processing / calculation: The camera captures the image data

[1904] Output: Image data

[1905] Specific operation: When the share button is pressed, the camera module takes a picture and captures image data.

[1906] Step 2:

[1907] Device (kids' glasses)

[1908] Image data compression

[1909] Input: Image data

[1910] Data processing / calculation: Compressed in JPEG format etc.

[1911] Output: Compressed image data

[1912] Specific operation: The image compression module compresses the original image into the specified format.

[1913] Step 3:

[1914] Device (kids' glasses)

[1915] Sending image data

[1916] Input: Compressed image data

[1917] Data processing / calculation: None

[1918] Output: Compressed image data is sent to the server

[1919] Specific operation: The communication module sends the compressed image data to the server.

[1920] Step 4:

[1921] server

[1922] Receiving and storing image data

[1923] Input: Compressed image data

[1924] Data processing / calculation: Save image data

[1925] Output: Saved image data

[1926] Specific operation: The server receives the image data and stores it in a database or file system.

[1927] Step 5:

[1928] User (Parent)

[1929] Image confirmation and instructions

[1930] Input: Image data

[1931] Data processing / calculation: Display image data in the app and create instruction messages

[1932] Output: prompt message

[1933] Specific operations: The parent opens the app, checks the image, creates a prompt message, and sends it to the child's device via the server.

[1934] UV protection

[1935] Step 1:

[1936] Device (kids' glasses)

[1937] Measurement of UV levels

[1938] Input: None

[1939] Data processing / calculation: UV sensor measures the amount of UV light in the environment

[1940] Output: UV data

[1941] How it works: The UV sensor samples the amount of UV light in the environment and sends that data to the device's processor.

[1942] Step 2:

[1943] Device (kids' glasses)

[1944] UV cut filter adjustment

[1945] Input: UV radiation data

[1946] Data processing / calculation: If the amount of UV rays is above a certain level, the transmittance of the UV cut filter is adjusted.

[1947] Output: Adjusted UV cut filter

[1948] Specific operation: The filter control module appropriately adjusts the filter transmittance based on UV intensity data.

[1949] This clearly explains the specific processing steps for each function of the system, as well as the specific operations, inputs, and outputs performed at each step.

[1950] (Application example 1)

[1951] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1952] Currently, it is not easy for customers to find specific product shelves in physical stores, or for parents to remotely monitor their children's locations and behavior. Furthermore, UV protection measures must be taken separately while shopping, creating multiple challenges. A single system is needed to solve these challenges.

[1953] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1954] In this invention, the server includes means for acquiring current location information, means for transmitting the acquired current location information, means for receiving voice input, means for transmitting voice input, means for analyzing voice data to acquire destination information, means for calculating an optimal route based on the current location information and destination information, means for converting the optimal route into voice data, means for transmitting the voice data to the terminal, means for playing the transmitted voice data, means for periodically taking and transmitting images and videos, means for saving the transmitted images and videos so that parents can review them, and means for measuring the amount of ultraviolet light and automatically applying a filter. This enables navigation within physical stores, remote monitoring of children, and ultraviolet light protection.

[1955] "Means for obtaining current location information" refers to the ability to determine the current location of a device using GPS or other location information technology.

[1956] The "means for transmitting acquired current location information" refers to a communication function for transmitting the current location information acquired by the terminal to a server.

[1957] "Means for receiving voice input" refers to functionality including a microphone and voice recognition technology that allows a user to input voice instructions into the device.

[1958] "Means for transmitting voice input" refers to a communication function that transmits received voice input data to a server.

[1959] "Means for analyzing voice data to obtain destination information" refers to technology that enables a server to analyze voice data and identify the user's intended destination.

[1960] "Means for calculating the optimal route based on current location information and destination information" refers to an algorithm that calculates the most efficient travel route using the current location and destination as input.

[1961] "Means for converting the optimal route into voice data" refers to technology that converts the calculated route into a voice message that is easy for the user to understand.

[1962] "Means for transmitting voice data to a terminal" refers to a communication function for transmitting the generated voice data to a terminal.

[1963] "Means for playing back transmitted audio data" refers to a speaker or playback device that allows the user to hear the audio data transmitted to the terminal.

[1964] "Means for periodically taking and transmitting images and videos" refers to a function that takes images and videos at regular intervals using the camera installed on the device and transmits them to a server.

[1965] "Means for storing transmitted images and videos so that parents can view them" refers to technology that stores received image and video data on a server and allows parents to view them remotely.

[1966] "Means for measuring the amount of UV rays and automatically applying a filter" refers to a function that uses a UV sensor built into the device to measure the amount of UV rays in the surrounding area and automatically applies a UV-cut filter as needed.

[1967] This invention provides a multi-function glasses system using GPS and AI, which integrates multiple functions such as customer navigation in physical stores, remote parental monitoring of children, and UV protection.

[1968] System Overview

[1969] Hardware Configuration

[1970] 1. Device (smart glasses)

[1971] The built-in GPS sensor is used to obtain current location information and send that information to the server.

[1972] Use a microphone to receive audio input.

[1973] Use the camera to take pictures and videos.

[1974] The amount of UV rays is measured using a UV sensor and the UV cut filter is automatically adjusted.

[1975] Play audio data through a speaker.

[1976] 2. Server

[1977] A high-performance computer that analyzes voice data and calculates routes.

[1978] Manages data transmission and reception and real-time database.

[1979] 3. Parental Smartphone

[1980] A device for reviewing images and videos and sending instructions to children.

[1981] Software Configuration

[1982] Google Cloud AI / ML services: Used for voice and image analysis.

[1983] Firebase: Used to send, receive, and store data in real time.

[1984] TensorFlow: Used for speech recognition and route optimization algorithms.

[1985] Operation explanation

[1986] 1. Directions function

[1987] The device periodically obtains its current location information using its built-in GPS sensor and sends that information to the server.

[1988] When the user inputs a voice command such as "I want to go to shelf A," the device sends the voice data to the server.

[1989] The server analyzes the voice data, obtains destination information, and calculates the optimal route based on the current location and destination information.

[1990] The calculated route is converted into audio data and sent to the device, which then plays the audio data to guide the user.

[1991] 2. Monitoring function

[1992] The device's camera periodically takes images and videos and sends them to the server.

[1993] The server stores the received data and allows parents to check it in real time via a smartphone app.

[1994] Based on the verification results, parents can send necessary instructions to their children, which will then be played back on the device.

[1995] 3. UV protection

[1996] The device's built-in UV sensor measures the amount of UV rays in the environment and automatically adjusts the UV cut filter if the amount of UV rays exceeds a certain level.

[1997] This protects the user's eyes from UV rays.

[1998] Specific examples

[1999] Example 1: In-store navigation

[2000] A customer uses the smart glasses to voice-input, "I want to go to shelf A." The server analyzes the voice data, calculates the optimal route, and sends instructions to the smart glasses, such as "Turn right and go 10 meters." The smart glasses then play back the instructions aloud, guiding the customer to their destination.

[2001] Example 2: In-store monitoring

[2002] Children wear smart glasses in the store and periodically send images and videos to a server. Parents can check in real time via a smartphone app to understand their child's location and situation. Instructions such as "Go left from that location" are sent via text message, and the child receives the instructions through the smart glasses.

[2003] Example 3: UV protection function

[2004] When shopping outside the store, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[2005] Prompt Sentence Examples

[2006] "Please help me design a smart glasses application for a brick-and-mortar store. Please print out the application specifications that provide the following functionality:

[2007] 1. Real-time in-store navigation

[2008] 2. Parental monitoring of children's location and behavior

[2009] 3. UV cut function when high levels of UV rays are detected

[2010] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2011] Step 1:

[2012] The device acquires its current location information using the built-in GPS sensor. The input is the location data from the GPS sensor, and the output is the current location information. This data is sent to the next processing step.

[2013] Step 2:

[2014] The device sends the current location information it has acquired to the server. The input is the current location information, and the output is the current location information sent to the server. Transmission is via Wi-Fi or mobile communication networks.

[2015] Step 3:

[2016] The user inputs voice data into the terminal. For example, the user may say, "I want to go to shelf A," and the terminal receives this data through the microphone. The input is voice data, and the output is also voice data.

[2017] Step 4:

[2018] The device sends the received voice data to the server. The input is the voice data, and the output is the voice data sent to the server. Transmission is via Wi-Fi or mobile communication network.

[2019] Step 5:

[2020] The server analyzes the voice data and obtains the destination information. The input is the voice data, and the output is the analyzed destination information. The analysis uses Google Cloud's voice recognition service to identify the destination.

[2021] Step 6:

[2022] The server calculates the optimal route based on the current location and destination information. The input is the current location and destination information, and the output is the optimal route information. This calculation is done using TensorFlow.

[2023] Step 7:

[2024] The server converts the calculated optimal route into voice data. The input is the optimal route information, and the output is the voice data. Google Cloud's voice synthesis service is used for voice synthesis.

[2025] Step 8:

[2026] The server sends the audio data to the device. The input is the audio data, and the output is the audio data sent to the device. The transmission is via Wi-Fi or a mobile communication network.

[2027] Step 9:

[2028] The device plays the received voice data and guides the user from their current location to their destination. The input is the voice data, and the output is the played voice guidance.

[2029] Step 10:

[2030] The device's camera periodically captures images and videos. The input is the current view, and the output is the captured image or video data.

[2031] Step 11:

[2032] The device compresses the captured images and video data and sends it to the server. The input is the image or video data, and the output is the compressed data. Image and video compression algorithms are used for compression.

[2033] Step 12:

[2034] The server stores the received image and video data, allowing parents to view them in real time on their smartphones. The input is compressed image and video data, and the output is the stored data.

[2035] Step 13:

[2036] Parents can view images and videos via a smartphone app and send instructions to their children as needed. The input is the parent's instructions, and the output is the instruction data sent to the device.

[2037] Step 14:

[2038] The UV sensor on the device measures the amount of UV light in the surrounding area. The input is the amount of UV light, and the output is the measured UV light data.

[2039] Step 15:

[2040] When the amount of UV rays exceeds a certain standard, the terminal will automatically adjust the UV cut filter. The input is UV data, and the output is the adjusted UV cut filter.

[2041] As described above, each processing step works together to create a system that provides multifunctional support to users.

[2042] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2043] This invention provides multifunctional children's glasses equipped with GPS and AI-based route guidance, a camera, a recording function, UV protection, and an emotion engine that recognizes the user's emotions. The program processing of this system is explained in natural language below, and will be described in detail with concrete examples.

[2044] GPS and AI-powered route guidance

[2045] Device (kids' glasses)

[2046] The device periodically acquires its current location using its built-in GPS sensor and sends that information to the server. If the user (child) gets lost, they can voice-instruct, "I want to go home." The device then sends that voice data to the server.

[2047] server

[2048] The server receives the current location information and voice data sent from the device, converts it into text using voice recognition technology, and analyzes the question. It then retrieves destination information (e.g., home) from a database. It uses an AI algorithm to calculate the optimal route from the current location to the destination, converts the result into voice data, and sends it to the device.

[2049] Device (kids' glasses)

[2050] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to follow the voice guidance to reach their destination.

[2051] Examples:

[2052] When a user says "I want to go home," the Kids Glasses sends that voice to the server. The server calculates the optimal route and sends voice data such as "Turn right and go 100 meters" to the device. The device then plays back the voice and guides the user to their destination.

[2053] Camera function / recording function

[2054] Device (kids' glasses)

[2055] When a user presses the share button, the device's camera captures the current view, compresses the captured image data, and sends it to the server.

[2056] server

[2057] The server receives and stores image data sent from the device, allowing parents to view the images through the app.

[2058] User (Parent)

[2059] Parents use the app to review the images and send instructions to their child via text or voice message if needed.

[2060] Examples:

[2061] If a child gets lost, they can press the share button to take a picture of the current view and send the image data to the server. The parent can then check the image received in the app and send a text message with instructions such as "Go left from that location."

[2062] UV protection

[2063] Device (kids' glasses)

[2064] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust, protecting children's eyes from UV rays.

[2065] Examples:

[2066] When your child goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect your child's eyes.

[2067] Emotion recognition and response with emotion engine

[2068] Device (kids' glasses)

[2069] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice to recognize their emotions, and sends this information to the server.

[2070] server

[2071] The server generates appropriate support messages and responses based on the emotion information sent from the emotion engine, converts the responses into voice data, and sends them to the device.

[2072] User (Parent)

[2073] Parents can also receive emotional information through the app and take appropriate measures based on their child's psychological state and emotions.

[2074] Examples:

[2075] If a user becomes lost and anxious, the emotion engine will recognize that emotion and play a comforting voice message through the device, such as, "Don't worry, we'll help you soon." Parents can also view this information in the app and send encouragement or instructions as needed.

[2076] The above process flow enables the implementation of multi-function kids' glasses, including lost child prevention, remote parental tracking, UV protection, and emotion recognition. This explains how the system specifically works to ensure children's safety and provide peace of mind for parents.

[2077] The processing flow will be explained below.

[2078] GPS and AI-powered route guidance

[2079] Step 1: Obtain and send location data

[2080] Terminal

[2081] 1. The device periodically obtains its current location information (latitude and longitude) from the built-in GPS sensor.

[2082] 2. The acquired location information is sent to the server.

[2083] Specific actions

[2084] The GPS sensor measures the current location information and passes the results to the GPS data acquisition module.

[2085] The GPS data acquisition module formats the acquired data and sends it to the server via the communication module.

[2086] Step 2: Enter and submit your voice question

[2087] User (child)

[2088] 1. When you get lost, ask a voice question such as "I want to go home."

[2089] Terminal

[2090] 1. The voice input module acquires the voice data and sends it to the server.

[2091] Specific actions

[2092] The voice input module captures the voice data and sends it to the server through the communication module.

[2093] Step 3: Analyze voice data and obtain destination information

[2094] server

[2095] 1. Receive the audio data sent from the device.

[2096] 2. The voice data is converted into text using a voice recognition module, and the question content is analyzed.

[2097] 3. Retrieve destination information from the database.

[2098] Specific actions

[2099] The speech recognition module converts the speech data into text, which is then processed by the destination analysis module.

[2100] The destination analysis module retrieves destination information from the database.

[2101] Step 4: Route calculation and voice data generation

[2102] server

[2103] 1. The AI ​​algorithm calculates the optimal route based on current location and destination information.

[2104] 2. The calculation results are converted into audio data and sent to the device.

[2105] Specific actions

[2106] The route calculation module takes your current location and destination as input and calculates the optimal route.

[2107] The speech synthesis module converts the calculation results into speech data and sends it to the terminal via the communication module.

[2108] Step 5: Play audio prompts

[2109] Terminal

[2110] 1. Receives audio data sent from the server and plays it back to the user.

[2111] Specific actions

[2112] The communication module receives the audio data from the server and passes it to the audio playback module for playback.

[2113] Camera function / recording function

[2114] Step 1: Press the share button and take a picture

[2115] User (child)

[2116] 1. When you get lost or in trouble, just press the share button.

[2117] Terminal

[2118] 1. When the button is pressed, the camera will take a picture of the current view.

[2119] 2. Compress the captured image data.

[2120] Specific actions

[2121] The button input module detects user presses and sends a trigger to the camera module.

[2122] The camera module takes images and passes the data to the image compression module.

[2123] Step 2: Send and save image data

[2124] Terminal

[2125] 1. Send the compressed image data to the server.

[2126] server

[2127] 1. Receive and save image data sent from the device.

[2128] Specific actions

[2129] The communication module sends the image data to the server, and the server's image storage module stores the data in a database.

[2130] Step 3: Parents review images and send messages

[2131] User (Parent)

[2132] 1. Parents can use the app to check the received image data.

[2133] 2. Send text or voice messages to your child as needed.

[2134] Specific actions

[2135] The app interface displays the image data, and parents send instructions using the message input module.

[2136] UV protection

[2137] Step 1: Measure UV levels and adjust filters

[2138] Terminal

[2139] 1. The UV sensor measures the amount of UV light in the environment.

[2140] 2. If a certain level of UV rays is detected, the UV cut filter will automatically adjust.

[2141] Specific actions

[2142] The UV sensor module measures the amount of UV rays and passes the results to the filter control module.

[2143] The filter control module adjusts the UV cut filter to protect your eyes from ultraviolet rays.

[2144] Emotion recognition and response with emotion engine

[2145] Step 1: Acquiring and analyzing emotional information

[2146] Terminal

[2147] 1. The device's built-in emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional information.

[2148] Specific actions

[2149] The emotion engine analyzes facial expression recognition data and voice tone in real time to generate emotional information.

[2150] Step 2: Sending emotional information and generating support messages

[2151] Terminal

[2152] 1. Send emotional information to the server.

[2153] server

[2154] 1. Receive emotional information and generate appropriate support messages.

[2155] 2. The generated message is converted into audio data and sent to the device.

[2156] Specific actions

[2157] The communication module sends the emotional information to the server, and the support message generation module generates an appropriate message.

[2158] The speech synthesis module converts the message into voice data and sends it to the terminal via the communication module.

[2159] Step 3: Playing assistance audio to the user

[2160] Terminal

[2161] 1. Receives audio data from the server and plays it back to the user.

[2162] Specific actions

[2163] The communication module receives the audio data from the server and passes it to the audio playback module for playback.

[2164] In this way, the operations at each processing step are specified, and the user, terminal, and server cooperate to realize the functions of the multifunctional kids' glasses.

[2165] Example 2

[2166] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2167] While existing devices with location-based navigation systems, camera functions, and UV protection functions exist as separate functions, there was no system that integrated these functions and could recognize the user's emotions and respond appropriately. This made it difficult to provide comprehensive support for children who got lost, protect them from UV rays, and provide a sense of mental security. In particular, due to the lack of emotion recognition capabilities, existing systems were unable to recognize and respond to children's psychological anxieties and difficulties in real time.

[2168] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2169] In this invention, the server includes a means for acquiring current location information, a means for analyzing voice input to acquire destination information, a means for calculating the optimal route based on the current location information and destination information, a means for recognizing the user's emotions, a means for generating a response message based on the recognized emotion information, and a means for converting the generated response message into voice data and transmitting it to the terminal. This not only enables appropriate route guidance based on the child's location information and real-time safety assurance, but also appropriately recognizes the user's emotions and provides a sense of mental security. In addition, the camera function and UV protection function make it easy for parents to remotely monitor their child's situation, give appropriate instructions, and protect their child's eyes from UV rays.

[2170] "Current location information" is the location information of a device obtained using the GPS sensor built into the device, and is data indicating the geographical location of the device.

[2171] "Voice input" is a function that receives a user's voice instructions through the terminal's microphone.

[2172] "Destination information" is geographical location information of the user's destination that the server obtains from the database after analyzing the voice input.

[2173] The "optimal route" is the optimal route to the destination calculated based on the current location information and the destination information.

[2174] "Voice data" is data in a format that the server converts voice input or calculation results into a voice message and sends to the terminal.

[2175] The term "terminal" refers to the multi-function kids' glasses of the present invention, which is a hardware device with multiple built-in functions.

[2176] A "server" is a computer system that processes data sent from a terminal, generates voice data and response messages, and sends them to the terminal.

[2177] "Emotion recognition" is a technology that analyzes a user's facial expressions and tone of voice to identify their emotions.

[2178] A "response message" is voice data or a text message that is generated by the server based on emotional information to provide the user with psychological relief.

[2179] The "camera function" is a function that uses the camera built into the terminal to capture a current view and process the image data.

[2180] A "UV cut filter" is a filter that protects the eyes from ultraviolet rays and automatically adjusts based on the amount of ultraviolet rays detected by the ultraviolet sensor.

[2181] An "ultraviolet sensor" is a sensor that measures the amount of ultraviolet light in the environment and is built into the device.

[2182] The "share button" is an operation button that the user uses to take a picture of the current view and send the image data to the server.

[2183] The present invention provides multifunctional children's glasses equipped with GPS and AI navigation functions, a camera function, a recording function, UV protection functions, and an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described in detail below.

[2184] Directions function

[2185] Device (kids' glasses)

[2186] The device periodically obtains its current location information using a built-in GPS sensor (e.g., u-blox M8). This location information is packaged as a JSON packet and sent to the server using the HTTPS protocol. When the user gets lost, they press the voice input button and give a voice command such as "I want to go home." This voice data is captured by the device's microphone and also sent to the server.

[2187] server

[2188] The server converts the received voice data into text using a speech recognition API (e.g., Google Cloud Speech-to-Text). It then analyzes the converted text and retrieves destination information from a database (e.g., PostgreSQL). It then uses an AI algorithm (e.g., Dijkstra's Algorithm) to calculate the optimal route from the current location to the destination, converts the result into voice data, and sends it to the device.

[2189] Device (kids' glasses)

[2190] The device receives the voice data sent from the server and plays it as a guide voice from the built-in speaker. The user can follow this voice guidance to reach their destination.

[2191] Examples:

[2192] If the user says "I want to go home," the device sends that speech to the server. The server generates a voice guidance message such as "Turn right and go 100 meters" and sends it to the device. The device then plays back that voice message and guides the user to their destination.

[2193] Camera function / recording function

[2194] Device (kids' glasses)

[2195] When a user presses the share button, the device's camera (e.g., Sony IMX219) captures the current view, compresses the captured image data into JPEG format, and then sends the compressed image data to the server using the HTTPS protocol.

[2196] server

[2197] The server stores the received image data in a database and provides it to the app used by the parent for display.

[2198] User (Parent)

[2199] Parents can use the app to review the image and, if necessary, send their child instructions via text message, such as "Go left from that location."

[2200] Examples:

[2201] A child presses the share button to take a picture of the current view and sends the image data to the server. A parent can then view the image in the app and send instructions via text message, such as "Go left from that location."

[2202] UV protection

[2203] Device (kids' glasses)

[2204] The device's built-in UV sensor (e.g., VEML6070) periodically measures the amount of UV radiation in the environment. If the measured value exceeds a certain level, the device automatically adjusts the UV-blocking filter (e.g., photochromic lenses) to protect children's eyes from UV rays.

[2205] Examples:

[2206] When your child goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV-blocking filter to protect your child's eyes from UV rays.

[2207] Emotion recognition and response with emotion engine

[2208] Device (kids' glasses)

[2209] The device's built-in emotion engine (e.g., Affectiva SDK) analyzes the user's facial expressions and tone of voice to recognize their emotions, and sends this information to the server.

[2210] server

[2211] The server generates appropriate support messages and responses based on the emotion information sent from the emotion engine, and the generated voice data is sent to the terminal and played back to the user.

[2212] User (Parent)

[2213] Parents can also receive emotional information through the app and take appropriate measures based on their child's psychological state and emotions.

[2214] Examples:

[2215] If a user becomes lost and anxious, the emotion engine will recognize that emotion and play a comforting voice message such as, "It's okay, we'll help you soon." Parents can also view this information in the app and send encouragement or instructions as needed.

[2216] Example of an input prompt for a generative AI model:

[2217] 1. "Describe how kids' glasses with a built-in GPS sensor work to periodically obtain location information."

[2218] 2. "Please explain the processing flow when a lost child voice-inputs the command, 'I want to go home.'"

[2219] 3. "Please explain the process of the camera function, where the user takes a picture of the current scene and sends the image data to the server."

[2220] 4. "Please explain how the UV sensor automatically adjusts the UV cut filter when it detects high levels of UV."

[2221] 5. "Explain how the emotion engine recognizes a child's emotions and generates an appropriate response."

[2222] The system of the present invention integrates these multiple functions to ensure the safety and security of children.

[2223] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2224] Step 1:

[2225] Obtaining and sending location information

[2226] Device (kids' glasses)

[2227] The device periodically obtains its location using a GPS sensor (e.g., u-blox M8), which is then converted into JSON format and sent to the server using the HTTPS protocol.

[2228] Input: Location information from the GPS sensor

[2229] Data processing: Convert location information into JSON format

[2230] Output: Location information in JSON format sent to the server

[2231] Step 2:

[2232] Acquiring and sending voice input

[2233] User (child)

[2234] The user presses the voice input button and gives a voice command such as "I want to go home." The device's microphone captures this voice data and sends it to the server.

[2235] Input: User's voice commands

[2236] Data processing: Capture audio data

[2237] Output: Audio data sent to the server

[2238] Step 3:

[2239] Voice data analysis and route calculation

[2240] server

[2241] The server receives the voice data and converts it into text using speech recognition technology (e.g., Google Cloud Speech-to-Text). It then analyzes the text data and retrieves destination information from a database (e.g., PostgreSQL). It then uses an AI algorithm (e.g., Dijkstra's Algorithm) to calculate the optimal route from the current location to the destination.

[2242] Input: Audio data sent from the device

[2243] Data processing: Converts voice data into text, obtains destination information, and calculates the optimal route

[2244] Output: Data calculated as the optimal route

[2245] Step 4:

[2246] Generate and transmit route guidance voice

[2247] server

[2248] The server converts the calculated optimal route data into voice data, generates voice guidance, and sends the voice data to the terminal.

[2249] Input: Calculated optimal route data

[2250] Data processing: Convert optimal route data into audio data

[2251] Output: Audio data sent to the device

[2252] Step 5:

[2253] Providing audio guidance

[2254] Device (kids' glasses)

[2255] The device plays the received audio data through its built-in speaker and provides route guidance to the user.

[2256] Input: Audio data sent from the server

[2257] Data processing: Audio data playback

[2258] Output: Audio instructions to the user

[2259] Step 6:

[2260] Camera image capture and transmission

[2261] Device (kids' glasses)

[2262] When a user presses the share button, the device's camera (e.g., Sony IMX219) captures the current view, and the captured image data is compressed into JPEG format and then sent to the server.

[2263] Input: Image data captured by a camera

[2264] Data processing: Compression of image data into JPEG format

[2265] Output: Compressed image data sent to the server

[2266] Step 7:

[2267] Image data storage and display

[2268] server

[2269] The server stores the received image data in a database and provides it to the app used by the parent for display.

[2270] Input: Compressed image data sent from the terminal

[2271] Data processing: saving and displaying image data

[2272] Output: Image data displayed in the parent app

[2273] Step 8:

[2274] UV sensor measurement and filter adjustment

[2275] Device (kids' glasses)

[2276] The device's built-in UV sensor (e.g., VEML6070) periodically measures the amount of UV radiation in the environment. If the measured value exceeds a certain level, the device automatically adjusts the UV-blocking filter (e.g., photochromic lenses) to protect children's eyes from UV rays.

[2277] Input: Measurement data from UV sensor

[2278] Data processing: Adjusting the filter according to the amount of UV rays

[2279] Output: Adjusted UV cut filter

[2280] Step 9:

[2281] Emotion recognition and response generation

[2282] Device (kids' glasses)

[2283] The device's built-in emotion engine (e.g., Affectiva SDK) analyzes the user's facial expressions and tone of voice to recognize their emotions. The recognized emotion information is sent to the server.

[2284] Input: User facial and voice data

[2285] Data processing: sentiment analysis and recognition

[2286] Output: Emotion information sent to the server

[2287] Step 10:

[2288] Generating and sending response messages based on emotion information

[2289] server

[2290] The server generates an appropriate support message or response based on the received emotional information. The generated response message is converted into voice data and sent to the device.

[2291] Input: Emotion information sent from the device

[2292] Data processing: Generating response messages based on emotional information and converting them into voice data

[2293] Output: Audio data sent to the device

[2294] Step 11:

[2295] Playing greetings

[2296] Device (kids' glasses)

[2297] The terminal plays the audio data sent from the server on its built-in speaker and provides a response message to the user.

[2298] Input: Audio data sent from the server

[2299] Data processing: Audio data playback

[2300] Output: Response message to the user

[2301] (Application example 2)

[2302] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2303] There are limitations to ensuring children's safety and the methods parents can use to remotely check on their children's status, making it difficult to respond quickly and appropriately when children become lost or anxious. It is also necessary to comprehensively improve daily safety by integrating multifunctional protective devices, such as those that recognize children's emotions and block UV rays. It is also important to understand children's psychological state in real time and provide appropriate support based on that information.

[2304] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2305] In this invention, the server includes means for receiving and analyzing emotion information from the terminal, means for generating a support message based on the analysis results, and means for converting the support message into voice data and transmitting it to the terminal. This makes it possible to quickly provide optimal route guidance and support messages based on emotion recognition when a child gets lost or feels anxious.

[2306] "Current location information" is data indicating the location information of the terminal, and is information acquired by a location information acquisition means such as a GPS.

[2307] "Destination information" is data indicating the location information of a place where the user wants to go.

[2308] The "optimal route" is the most logical route to the destination calculated based on the current location information and destination information.

[2309] "Voice input" means voice commands given by a user to a terminal.

[2310] "Audio data" is data obtained by converting audio input into digital form.

[2311] "Emotion information" is data that indicates the user's emotional state as analyzed by an emotion recognition engine built into the terminal.

[2312] A "support message" is a response message to the user that is generated based on emotional information, current location information, and the like, and includes content such as comfort, instructions, and guidance.

[2313] A "UV cut filter" is a filter that adjusts the amount of ultraviolet rays and is built into the device.

[2314] "Image data" refers to photographs and videos taken with the device's camera that have been converted into digital format.

[2315] "Server" refers to a computer system that receives, analyzes, and stores data sent from a terminal, and generates the necessary response data.

[2316] This invention is a system for ensuring the safety and remote monitoring of children using multifunctional kids' glasses. The system consists of a device (multifunctional kids' glasses) equipped with GPS, AI, a camera, recording function, UV protection function, and emotion recognition function, a server, and a smartphone app used by parents.

[2317] Hardware and Software Use:

[2318] Hardware: Multi-function kids' glasses (GPS sensor, camera, UV sensor, emotion recognition engine), smartphone

[2319] Software: Server (AWS), AI algorithm (TensorFlow), speech recognition (Google Cloud Speech-to-Text API), map service (Google Maps API)

[2320] System behavior:

[2321] 1. Location Tracking:

[2322] The device periodically obtains its current location using its built-in GPS sensor and sends it to a server. The server receives and stores the location information and displays it in real time on the parent's smartphone app, allowing parents to always know where their child is.

[2323] 2. Directions:

[2324] The device receives voice input. For example, if a child says, "I want to go home," the voice data is sent to the server. The server uses the Google Cloud Speech-to-Text API to convert the voice into text and obtain the destination information. It then uses the Google Maps API to calculate the optimal route from the current location to the destination. The result is converted into voice data and sent to the device. The device then plays the voice data and guides the child to the destination.

[2325] 3. Camera Function:

[2326] When a child presses the share button on their device, the camera takes a photo of the current scene, compresses the image data, and sends it to the server. The server receives and stores the image data, and displays the image on the parent's smartphone app. The parent can then view the image through the app and send instructions to their child via text or voice message if necessary.

[2327] 4. UV protection:

[2328] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust, protecting children's eyes from UV rays.

[2329] 5. Emotion recognition:

[2330] The device's built-in emotion engine analyzes the user's facial expressions and tone of voice and sends emotional information to a server. The server analyzes the emotional information, generates a comforting or encouraging message as needed, converts it into audio data, and sends it to the device. The device then plays the audio data to reassure the child. The emotional information is also displayed on the parent's smartphone app, allowing parents to understand their child's psychological state.

[2331] Examples:

[2332] For example, if a child gets lost and feels anxious, they can voice-instruct, "I want to go home." The device sends this voice to the server, which then calculates the optimal route and sends voice data such as, "Turn right and go 100 meters." If the emotion engine detects anxiety, it will play a comforting message through the device, such as, "It's okay, we'll help you right away."

[2333] Example prompt sentence:

[2334] "I want to go home."

[2335] This allows the invention to automatically provide optimal support to ensure the safety of children when they get lost or feel anxious.

[2336] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2337] Step 1:

[2338] The device obtains location information

[2339] The device periodically obtains location information using the built-in GPS sensor.

[2340] input:

[2341] Location data from GPS sensors.

[2342] output:

[2343] Current location information.

[2344] Specific behavior:

[2345] The device receives a GPS signal, calculates latitude and longitude information, and generates current location information.

[2346] Step 2:

[2347] The device sends its current location information to the server.

[2348] The terminal transmits the acquired current location information to the server.

[2349] input:

[2350] Current location information.

[2351] output:

[2352] Send data to the server.

[2353] Specific behavior:

[2354] The terminal compresses the current location information and communicates using a protocol (for example, HTTP) for transmitting it to the server.

[2355] Step 3:

[2356] The user provides voice input

[2357] The user (child) inputs voice commands into the device.

[2358] input:

[2359] Voice commands (e.g., "I want to go home").

[2360] output:

[2361] Audio data.

[2362] Specific behavior:

[2363] The device's microphone receives the user's voice waves and converts them into digital voice data.

[2364] Step 4:

[2365] The device sends the audio data to the server.

[2366] The terminal transmits the acquired voice data to the server.

[2367] input:

[2368] Audio data.

[2369] output:

[2370] Send data to the server.

[2371] Specific behavior:

[2372] The terminal communicates using a protocol for compressing the voice data and transmitting it to the server.

[2373] Step 5:

[2374] The server analyzes the audio data

[2375] The server receives the voice data and converts it into text using voice recognition technology.

[2376] input:

[2377] Audio data.

[2378] output:

[2379] Text data.

[2380] Specific behavior:

[2381] The server uses the Google Cloud Speech-to-Text API to analyze the audio data and generate text data.

[2382] Step 6:

[2383] The server obtains destination information

[2384] The server analyzes the voice recognition results and obtains destination information.

[2385] input:

[2386] Text data (e.g., "I want to go home").

[2387] output:

[2388] Destination information.

[2389] Specific behavior:

[2390] The server extracts keywords from the speech recognition results and acquires destination information by referring to a destination database.

[2391] Step 7:

[2392] The server calculates the optimal route

[2393] The server calculates the optimal route based on the current location information and destination information.

[2394] input:

[2395] Current location information, destination information.

[2396] output:

[2397] The best route.

[2398] Specific behavior:

[2399] The server uses the Google Maps API to calculate the optimal route from your current location to your destination.

[2400] Step 8:

[2401] The server converts the optimal route into audio data.

[2402] The server converts the calculated optimal route into audio data.

[2403] input:

[2404] The best route.

[2405] output:

[2406] Audio data.

[2407] Specific behavior:

[2408] The server generates the voice data using text-to-speech (TTS) technology.

[2409] Step 9:

[2410] The server sends the audio data to the device.

[2411] The server transmits the generated voice data to the terminal.

[2412] input:

[2413] Audio data.

[2414] output:

[2415] Send data to the device.

[2416] Specific behavior:

[2417] The server communicates using a protocol to compress the audio data and transmit it to the terminal.

[2418] Step 10:

[2419] The device plays the audio data.

[2420] The terminal receives the transmitted audio data and plays it back to the user.

[2421] input:

[2422] Audio data.

[2423] output:

[2424] Audio guidance.

[2425] Specific behavior:

[2426] The device decodes the audio data and plays it through its built-in speaker.

[2427] Step 11:

[2428] The device receives and analyzes emotional information

[2429] The device analyzes the user's facial expressions and tone of voice to obtain emotional information.

[2430] input:

[2431] User's facial expression data, voice data.

[2432] output:

[2433] emotional information.

[2434] Specific behavior:

[2435] The device's emotion recognition engine analyzes the user's facial expressions and tone of voice to recognize specific emotional states (e.g., anxiety, joy).

[2436] Step 12:

[2437] The device sends emotional information to the server.

[2438] The device transmits the analyzed emotion information to the server.

[2439] input:

[2440] emotional information.

[2441] output:

[2442] Send data to the server.

[2443] Specific behavior:

[2444] The terminal communicates using a protocol for compressing emotion information and transmitting it to the server.

[2445] Step 13:

[2446] The server generates a support message based on the emotional information.

[2447] The server generates an appropriate support message based on the received emotion information.

[2448] input:

[2449] emotional information.

[2450] output:

[2451] Supportive message.

[2452] Specific behavior:

[2453] The server refers to an emotion database and generates an appropriate support message (e.g., "Don't worry, we'll help you right away").

[2454] Step 14:

[2455] The server converts the assistance message into audio data.

[2456] The server converts the generated assistance message into voice data.

[2457] input:

[2458] Supportive message.

[2459] output:

[2460] Audio data.

[2461] Specific behavior:

[2462] The server converts the assistance message into voice data using TTS technology.

[2463] Step 15:

[2464] The server sends the audio data to the device.

[2465] The server transmits the generated voice data to the terminal.

[2466] input:

[2467] Audio data.

[2468] output:

[2469] Send data to the device.

[2470] Specific behavior:

[2471] The server communicates using a protocol to compress the audio data and transmit it to the terminal.

[2472] Step 16:

[2473] The device plays the audio data of the support message.

[2474] The terminal receives the transmitted audio data and plays it back to the user.

[2475] input:

[2476] Audio data.

[2477] output:

[2478] Audio guide for support messages.

[2479] Specific behavior:

[2480] The device decodes the audio data and plays it through its built-in speaker.

[2481] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2482] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2483] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2484] [Fourth embodiment]

[2485] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2486] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2487] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2488] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2489] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2490] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2491] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2492] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2493] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2494] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2495] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2496] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2497] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2498] This invention provides multifunctional children's glasses equipped with GPS and AI navigation, camera, video recording, and UV protection. The program processing of this system is explained in natural language below, and is also described in detail with specific examples.

[2499] GPS and AI-powered route guidance

[2500] Device (kids' glasses)

[2501] The device periodically acquires its current location using a built-in GPS sensor and sends that information to the server. When the user (child) gets lost, they can input a command into the device by voice, such as "I want to go home." The device then sends that voice data to the server.

[2502] server

[2503] The server receives the current location information and voice data sent from the device. It converts the received voice data into text using voice recognition technology and analyzes the question. It then retrieves destination information (e.g., "home") from a database. The server uses an AI algorithm to calculate the optimal route from the current location to the destination and converts the result into voice data. The voice data of the optimal route is sent to the device.

[2504] Device (kids' glasses)

[2505] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to reach their destination by following the voice guidance.

[2506] Examples:

[2507] When a user voice-inputs "I want to go home," Kids Glasses sends the voice to the server. The server calculates the optimal route and sends voice data saying "Turn right and go 100 meters" to the device. The device plays back the voice and guides the user to their destination.

[2508] Camera function / recording function

[2509] Device (kids' glasses)

[2510] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[2511] server

[2512] The server receives and stores image data sent from the device, allowing parents to view the images through the app.

[2513] User (Parent)

[2514] Parents can use the app to review the images and send instructional messages to their children if needed.

[2515] Examples:

[2516] If a user gets lost, they can press the share button to take a picture of the current view and send the image data to the server. The parent can then check the image received in the app and send a text message with instructions such as "Go left from that location."

[2517] UV protection

[2518] Device (kids' glasses)

[2519] The device's built-in UV sensor measures the amount of UV rays in the environment, and if the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes.

[2520] Examples:

[2521] When the user goes outside on a sunny day, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[2522] This will enable the realization of multi-functional kids' glasses that prevent children from getting lost, allow parents to check on their children's situation remotely, and protect their eyes from UV rays. This system is an embodiment that ensures children's safety and provides peace of mind to parents.

[2523] The processing flow will be explained below.

[2524] GPS and AI-powered route guidance

[2525] Step 1: Obtain and send location data

[2526] Terminal

[2527] 1. The device obtains its current location information (latitude and longitude) from the built-in GPS sensor.

[2528] 2. The acquired current location information is sent to the server via the communication module.

[2529] Specific actions

[2530] The GPS sensor measures your current location and passes the results to the GPS data acquisition module.

[2531] The GPS data acquisition module formats the data and sends it to the server through the communication module.

[2532] Step 2: Enter and submit your voice question

[2533] User (child)

[2534] 1. If your child gets lost, they can ask a voice message saying, "I want to go home."

[2535] Terminal

[2536] 1. The voice input module acquires voice data and sends it to the server through the communication module.

[2537] Specific actions

[2538] The voice input module captures voice data and sends it to the server through the communication module.

[2539] Step 3: Analyze voice data and obtain destination information

[2540] server

[2541] 1. The server receives the voice data sent from the device.

[2542] 2. The voice data is converted into text using a voice recognition module, and the question content is analyzed.

[2543] 3. Retrieve destination information from the database.

[2544] Specific actions

[2545] The voice recognition module converts the voice data into text, and the text analysis module extracts destination information.

[2546] The corresponding destination information is obtained from the destination database.

[2547] Step 4: Route calculation and voice data generation

[2548] server

[2549] 1. The AI ​​algorithm calculates the optimal route based on current location and destination information.

[2550] 2. The calculation results are converted into audio data and sent to the device.

[2551] Specific actions

[2552] The route calculation module calculates the optimal route using the current location and destination as input.

[2553] The speech synthesis module converts the calculation results into speech data and sends it to the terminal via the communication module.

[2554] Step 5: Play audio prompts

[2555] Terminal

[2556] 1. The device receives the audio data sent from the server and plays it back to the user.

[2557] Specific actions

[2558] The communication module receives audio data from the server and passes it to the audio playback module for playback.

[2559] Camera function / recording function

[2560] Step 1: Press the share button and take a picture

[2561] User (child)

[2562] 1. When you get lost or in trouble, just press the share button.

[2563] Terminal

[2564] 1. When the button is pressed, the camera will take a picture of the current view.

[2565] 2. Compress the captured image data.

[2566] Specific actions

[2567] The button input module detects user presses and sends a trigger to the camera module.

[2568] The camera module takes images and passes the data to the image compression module.

[2569] Step 2: Send and save image data

[2570] Terminal

[2571] 1. The compressed image data is sent to the server via the communication module.

[2572] server

[2573] 1. The server receives and stores the image data sent from the device.

[2574] Specific actions

[2575] The communication module sends the image data to the server, and the server's image storage module stores it in a database.

[2576] Step 3: Parents review images and send messages

[2577] User (Parent)

[2578] 1. Parents can use the app to check the received image data.

[2579] 2. Send texts or voice messages to your child as needed.

[2580] Specific actions

[2581] The application interface displays image data and sends instructions through the message input module.

[2582] UV protection

[2583] Step 1: Measure UV levels and adjust filters

[2584] Terminal

[2585] 1. The UV sensor measures the amount of UV light in the environment.

[2586] 2. If a certain level of UV rays is detected, the UV cut filter will automatically adjust.

[2587] Specific actions

[2588] The UV sensor module measures the amount of UV rays and passes the results to the filter control module.

[2589] The filter control module adjusts the effect of the UV cut filter to protect your eyes from ultraviolet rays.

[2590] In this way, the operations at each processing step are specified, and the user, terminal, and server cooperate to realize the functions of the multifunctional kids' glasses.

[2591] Example 1

[2592] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2593] In modern society, it is necessary to reduce the risk of children getting lost when they are out and help them return home safely. However, conventional devices with GPS functions lack supportive route guidance and communication with parents, making it difficult to provide multifunctional support. Protecting children from UV rays when outdoors is also important, but inadequate protection can have a negative impact on their health. To effectively solve these issues, a multifunctional system that integrates route guidance, camera functions, UV protection, and other functions is required.

[2594] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2595] In this invention, the server includes means for acquiring current location information, means for analyzing voice data and converting it into text, means for acquiring destination information, means for calculating an optimal route based on the current location information and the destination information, means for converting the optimal route into voice data, means for receiving and saving image data, means for the user to check the received image data, means for measuring the amount of ultraviolet light, and means for adjusting the UV-cut filter based on the measured amount of ultraviolet light. This makes it possible for the server to provide appropriate voice guidance when a child gets lost, to remotely share the current scenery, and to protect the child's eyes from ultraviolet light.

[2596] "Current location information" is latitude and longitude data relating to the current location of the terminal obtained using a GPS sensor.

[2597] "Means for acquiring" refers to means including sensors and modules for collecting or detecting specific information.

[2598] The "transmitting means" is a means for transmitting the acquired data to another device or system via wireless or wired communication.

[2599] "Voice input" refers to data that receives a user's voice commands or instructions through a voice input device such as a microphone.

[2600] "Voice data" refers to data in which voice information input by a user is recorded in digital format.

[2601] "Means for analyzing" refers to means for analyzing information such as voice data or text data and extracting specific meanings or instructions.

[2602] "Destination information" is location information such as latitude and longitude relating to the location the user is heading for.

[2603] The "calculating means" is a processing device that includes an algorithm for deriving the optimal route based on current location information and destination information.

[2604] A "means for converting" is a means for converting data of a particular format into another format, such as a means for converting text to speech.

[2605] The "means for reproducing audio data" refers to an output device such as a speaker or headphones that allows the user to hear the audio data.

[2606] The "means for photographing scenery" is a means for acquiring the current scenery as image data using a camera.

[2607] The "means for compressing" refers to a means for using image compression technology to reduce the volume of acquired image data.

[2608] The "means for receiving and storing" is a means for receiving data sent from other terminals and storing it in a database or file system.

[2609] "Means for user confirmation" refers to devices or applications that allow users to view or confirm stored data.

[2610] The "means for measuring the amount of ultraviolet light" refers to a means including an ultraviolet sensor for measuring the intensity of ultraviolet light in the environment.

[2611] A "UV cut filter" is a special filter used to block or reduce ultraviolet rays.

[2612] A "means for adjusting" is a means for changing or configuring a device or function based on a particular parameter or condition.

[2613] This invention relates to a multi-function kids' glasses system equipped with GPS and AI navigation, camera, video recording, and UV protection functions. The system consists of a server, a terminal (kids' glasses), and users (children and parents).

[2614] GPS and AI-powered route guidance

[2615] Device (kids' glasses)

[2616] The device has a built-in GPS sensor that periodically acquires its current location information. This information is sent to the server via a communication module. When the user (child) gets lost, they press a button and input voice commands such as "I want to go home" into the device. The device records this voice data and sends it to the server.

[2617] server

[2618] The server receives the current location information and voice data sent from the device. It uses a voice recognition engine (e.g., Google Speech-to-Text API) to convert the voice data into text and analyzes the instructions. It then retrieves destination information (e.g., home address and latitude and longitude) from a database. The server uses an AI algorithm (e.g., A algorithm) to calculate the optimal route from the current location to the destination. The result of this calculation is converted into voice data using a voice synthesis engine (e.g., Amazon Polly) and sent to the device.

[2619] Device (kids' glasses)

[2620] The device receives the voice data sent from the server and plays it back to the user through the speaker, allowing the user to follow the voice guidance to reach their destination.

[2621] Examples:

[2622] When a user voice-inputs "I want to go home," the device sends that voice to the server. The server calculates the optimal route and sends the guidance "Turn right and go 100 meters" to the device as voice data. The device plays back that voice and guides the user to their destination.

[2623] Camera function / recording function

[2624] Device (kids' glasses)

[2625] When a user presses the share button, the device's camera captures the current view, and the captured image data is compressed and sent to the server.

[2626] server

[2627] The server receives and stores image data sent from the device, which parents can then view via a smartphone app.

[2628] User (Parent)

[2629] Parents can use the app to view image data and send instructional messages to their children if necessary.

[2630] Examples:

[2631] If a user gets lost, they can press the share button to take a picture of the current view and send the image to the server. The parent can then check the image in the app and send a text message with instructions such as "Go left from that location."

[2632] UV protection

[2633] Device (kids' glasses)

[2634] The device has a built-in UV sensor that continuously measures the amount of UV rays in the environment, and when the amount of UV rays exceeds a certain level, the UV cut filter will automatically adjust to protect children's eyes from UV rays.

[2635] Examples:

[2636] When the user goes outside on a sunny day, if the UV sensor detects high levels of UV rays, the UV cut filter will automatically adjust to protect children's eyes.

[2637] Example prompts for generative AI models

[2638] 1. Example prompt (directions function):

[2639] "Please explain the process of a program that uses GPS and AI to provide voice guidance on the route home if a child gets lost."

[2640] 2. Example prompts (camera function):

[2641] "Explain the process of how a child takes a picture of the current view with their camera and then a parent reviews the image in the app."

[2642] 3. Example prompt (UV protection):

[2643] "Please explain the process of UV protection using an ultraviolet sensor to protect children's eyes."

[2644] This makes it possible to provide multifunctional kids' glasses that reduce the risk of children getting lost when out and about, allow parents to check on the situation remotely, and also protect the eyes from ultraviolet rays.

[2645] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2646] GPS and AI-powered route guidance

[2647] Step 1:

[2648] Device (kids' glasses)

[2649] Obtaining current location information

[2650] Input: None

[2651] Data processing / calculation: The device's built-in GPS sensor periodically measures the current latitude and longitude information.

[2652] Output: Current location information (latitude and longitude)

[2653] Specific operation: The GPS sensor measures the latitude and longitude of the current location and stores the data in the device's memory.

[2654] Step 2:

[2655] Device (kids' glasses)

[2656] Sending current location information

[2657] Input: Current location information (latitude and longitude)

[2658] Data processing / calculation: None

[2659] Output: Current location information (latitude and longitude) is sent to the server

[2660] Specific operation: Use the communication module to send current location information to the server.

[2661] Step 3:

[2662] Device (kids' glasses)

[2663] Acquiring voice input

[2664] Input: User's voice

[2665] Data processing / calculation: Record voice input and convert it into voice data

[2666] Output: Audio data

[2667] Specific operation: The microphone receives the user's voice, and the recording module converts the voice into digital audio data.

[2668] Step 4:

[2669] Device (kids' glasses)

[2670] Sending audio data

[2671] Input: Audio data

[2672] Data processing / calculation: None

[2673] Output: Audio data is sent to the server

[2674] Specific operation: Use the communication module to send audio data to the server.

[2675] Step 5:

[2676] server

[2677] Receiving and analyzing audio data

[2678] Input: Audio data

[2679] Data processing / calculation: Converting voice data into text using a voice recognition engine and analyzing the text data

[2680] Output: Text data (user instructions)

[2681] Specific operation: The server receives the voice data, the speech recognition engine converts the voice into text, and the analysis module extracts the command content.

[2682] Step 6:

[2683] server

[2684] Obtaining destination information

[2685] Input: Text data (user instructions)

[2686] Data processing / calculation: Obtain destination information (latitude and longitude) registered by the user from the database

[2687] Output: Destination information

[2688] Specific operation: The server executes a database query to retrieve destination information using the user ID as a key.

[2689] Step 7:

[2690] server

[2691] Calculating the best route

[2692] Input: Current location information, destination information

[2693] Data processing / calculation: Calculate the optimal route using AI algorithms

[2694] Output: Optimal route information

[2695] Specific operation: The server's route calculation module calculates the optimal route from the current location to the destination.

[2696] Step 8:

[2697] server

[2698] Generate voice guidance

[2699] Input: Optimal route information

[2700] Data processing / calculation: Generates voice guidance messages and converts them into voice data using a voice synthesis engine

[2701] Output: Voice guidance data

[2702] Specific operation: The message generation module creates a text message, and the speech synthesis engine converts it into voice data.

[2703] Step 9:

[2704] server

[2705] Sending audio data

[2706] Input: Voice guidance data

[2707] Data processing / calculation: None

[2708] Output: Voice guidance data is sent to the device.

[2709] Specific operation: The server sends the generated voice guidance data to the terminal.

[2710] Step 10:

[2711] Device (kids' glasses)

[2712] Playing voice guidance

[2713] Input: Voice guidance data

[2714] Data processing / calculation: Decode and play audio data

[2715] Output: A voice prompt that the user hears

[2716] Specific operation: The device receives the audio data, decodes it, and then plays it on the speaker.

[2717] Camera function / recording function

[2718] Step 1:

[2719] Device (kids' glasses)

[2720] Taking an image

[2721] Input: Press the Share button

[2722] Data processing / calculation: The camera captures the image data

[2723] Output: Image data

[2724] Specific operation: When the share button is pressed, the camera module takes a picture and captures image data.

[2725] Step 2:

[2726] Device (kids' glasses)

[2727] Image data compression

[2728] Input: Image data

[2729] Data processing / calculation: Compressed in JPEG format etc.

[2730] Output: Compressed image data

[2731] Specific operation: The image compression module compresses the original image into the specified format.

[2732] Step 3:

[2733] Device (kids' glasses)

[2734] Sending image data

[2735] Input: Compressed image data

[2736] Data processing / calculation: None

[2737] Output: Compressed image data is sent to the server

[2738] Specific operation: The communication module sends the compressed image data to the server.

[2739] Step 4:

[2740] server

[2741] Receiving and storing image data

[2742] Input: Compressed image data

[2743] Data processing / calculation: Save image data

[2744] Output: Saved image data

[2745] Specific operation: The server receives the image data and stores it in a database or file system.

[2746] Step 5:

[2747] User (Parent)

[2748] Image confirmation and instructions

[2749] Input: Image data

[2750] Data processing / calculation: Display image data in the app and create instruction messages

[2751] Output: prompt message

[2752] Specific operations: The parent opens the app, checks the image, creates a prompt message, and sends it to the child's device via the server.

[2753] UV protection

[2754] Step 1:

[2755] Device (kids' glasses)

[2756] Measurement of UV levels

[2757] Input: None

[2758] Data processing / calculation: UV sensor measures the amount of UV light in the environment

[2759] Output: UV data

[2760] How it works: The UV sensor samples the amount of UV light in the environment and sends that data to the device's processor.

[2761] Step 2:

[2762] Device (kids' glasses)

[2763] UV cut filter adjustment

[2764] Input: UV radiation data

[2765] Data processing / calculation: If the amount of UV rays is above a certain level, the transmittance of the UV cut filter is adjusted.

[2766] Output: Adjusted UV cut filter

[2767] Specific operation: The filter control module appropriately adjusts the filter transmittance based on UV intensity data.

[2768] This clearly explains the specific processing steps for each function of the system, as well as the specific operations, inputs, and outputs performed at each step.

[2769] (Application example 1)

[2770] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2771] Currently, it is not easy for customers to find specific product shelves in physical stores, or for parents to remotely monitor their children's locations and behavior. Furthermore, UV protection measures must be taken separately while shopping, creating multiple challenges. A single system is needed to solve these challenges.

[2772] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2773] In this invention, the server includes means for acquiring current location information, means for transmitting the acquired current location information, means for receiving voice input, means for transmitting voice input, means for analyzing voice data to acquire destination information, means for calculating an optimal route based on the current location information and destination information, means for converting the optimal route into voice data, means for transmitting the voice data to the terminal, means for playing the transmitted voice data, means for periodically taking and transmitting images and videos, means for saving the transmitted images and videos so that parents can review them, and means for measuring the amount of ultraviolet light and automatically applying a filter. This enables navigation within physical stores, remote monitoring of children, and ultraviolet light protection.

[2774] "Means for obtaining current location information" refers to the ability to determine the current location of a device using GPS or other location information technology.

[2775] The "means for transmitting acquired current location information" refers to a communication function for transmitting the current location information acquired by the terminal to a server.

[2776] "Means for receiving voice input" refers to functionality including a microphone and voice recognition technology that allows a user to input voice instructions into the device.

[2777] "Means for transmitting voice input" refers to a communication function that transmits received voice input data to a server.

[2778] "Means for analyzing voice data to obtain destination information" refers to technology that enables a server to analyze voice data and identify the user's intended destination.

[2779] "Means for calculating the optimal route based on current location information and destination information" refers to an algorithm that calculates the most efficient travel route using the current location and destination as input.

[2780] "Means for converting the optimal route into voice data" refers to technology that converts the calculated route into a voice message that is easy for the user to understand.

[2781] "Means for transmitting voice data to a terminal" refers to a communication function for transmitting the generated voice data to a terminal.

[2782] "Means for playing back transmitted audio data" refers to a speaker or playback device that allows the user to hear the audio data transmitted to the terminal.

[2783] "Means for periodically taking and transmitting images and videos" refers to a function that takes images and videos at regular intervals using the camera installed on the device and transmits them to a server.

[2784] "Means for storing transmitted images and videos so that parents can view them" refers to technology that stores received image and video data on a server and allows parents to view them remotely.

[2785] "Means for measuring the amount of UV rays and automatically applying a filter" refers to a function that uses a UV sensor built into the device to measure the amount of UV rays in the surrounding area and automatically applies a UV-cut filter as needed.

[2786] This invention provides a multi-function glasses system using GPS and AI, which integrates multiple functions such as customer navigation in physical stores, remote parental monitoring of children, and UV protection.

[2787] System Overview

[2788] Hardware Configuration

[2789] 1. Device (smart glasses)

[2790] The built-in GPS sensor is used to obtain current location information and send that information to the server.

[2791] Use a microphone to receive audio input.

[2792] Use the camera to take pictures and videos.

[2793] The amount of UV rays is measured using a UV sensor and the UV cut filter is automatically adjusted.

[2794] Play audio data through a speaker.

[2795] 2. Server

[2796] A high-performance computer that analyzes voice data and calculates routes.

[2797] Manages data transmission and reception and real-time database.

[2798] 3. Parental Smartphone

[2799] A device for reviewing images and videos and sending instructions to children.

[2800] Software Configuration

[2801] Google Cloud AI / ML services: Used for voice and image analysis.

[2802] Firebase: Used to send, receive, and store data in real time.

[2803] TensorFlow: Used for speech recognition and route optimization algorithms.

[2804] Operation explanation

[2805] 1. Directions function

[2806] The device periodically obtains its current location information using its built-in GPS sensor and sends that information to the server.

[2807] When the user inputs a voice command such as "I want to go to shelf A," the device sends the voice data to the server.

[2808] The server analyzes the voice data, obtains destination information, and calculates the optimal route based on the current location and destination information.

[2809] The calculated route is converted into audio data and sent to the device, which then plays the audio data to guide the user.

[2810] 2. Monitoring function

[2811] The device's camera periodically takes images and videos and sends them to the server.

[2812] The server stores the received data and allows parents to check it in real time via a smartphone app.

[2813] Based on the verification results, parents can send necessary instructions to their children, which will then be played back on the device.

[2814] 3. UV protection

[2815] The device's built-in UV sensor measures the amount of UV rays in the environment and automatically adjusts the UV cut filter if the amount of UV rays exceeds a certain level.

[2816] This protects the user's eyes from UV rays.

[2817] Specific examples

[2818] Example 1: In-store navigation

[2819] A customer uses the smart glasses to voice-input, "I want to go to shelf A." The server analyzes the voice data, calculates the optimal route, and sends instructions to the smart glasses, such as "Turn right and go 10 meters." The smart glasses then play back the instructions aloud, guiding the customer to their destination.

[2820] Example 2: In-store monitoring

[2821] Children wear smart glasses in the store and periodically send images and videos to a server. Parents can check in real time via a smartphone app to understand their child's location and situation. Instructions such as "Go left from that location" are sent via text message, and the child receives the instructions through the smart glasses.

[2822] Example 3: UV protection function

[2823] When shopping outside the store, the UV sensor detects high levels of UV rays and automatically adjusts the UV protection filter to protect children's eyes.

[2824] Prompt Sentence Examples

[2825] "Please help me design a smart glasses application for a brick-and-mortar store. Please print out the application specifications that provide the following functionality:

[2826] 1. Real-time in-store navigation

[2827] 2. Parental monitoring of children's location and behavior

[2828] 3. UV cut function when high levels of UV rays are detected

[2829] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2830] Step 1:

[2831] The device acquires its current location information using the built-in GPS sensor. The input is the location data from the GPS sensor, and the output is the current location information. This data is sent to the next processing step.

[2832] Step 2:

[2833] The device sends the current location information it has acquired to the server. The input is the current location information, and the output is the current location information sent to the server. Transmission is via Wi-Fi or mobile communication networks.

[2834] Step 3:

[2835] The user inputs voice data into the terminal. For example, the user may say, "I want to go to shelf A," and the terminal receives this data through the microphone. The input is voice data, and the output is also voice data.

[2836] Step 4:

[2837] The device sends the received voice data to the server. The input is the voice data, and the output is the voice data sent to the server. Transmission is via Wi-Fi or mobile communication network.

[2838] Step 5:

[2839] The server analyzes the voice data and obtains the destination information. The input is the voice data, and the output is the analyzed destination information. The analysis uses Google Cloud's voice recognition service to identify the destination.

[2840] Step 6:

[2841] The server calculates the optimal route based on the current location and destination information. The input is the current location and destination information, and the output is the optimal route information. This calculation is done using TensorFlow.

[2842] Step 7:

[2843] The server converts the calculated optimal route into voice data. The input is the optimal route information, and the output is the voice data. Google Cloud's voice synthesis service is used for voice synthesis.

[2844] Step 8:

[2845] The server sends the audio data to the device. The input is the audio data, and the output is the audio data sent to the device. The transmission is via Wi-Fi or a mobile communication network.

[2846] Step 9:

[2847] The device plays the received voice data and guides the user from their current location to their destination. The input is the voice data, and the output is the played voice guidance.

[2848] Step 10:

[2849] The device's camera periodically captures images and videos. The input is the current view, and the output is the captured image or video data.

[2850] Step 11:

[2851] The device compresses the captured images and video data and sends it to the server. The input is the image or video data, and the output is the compressed data. Image and video compression algorithms are used for compression.

[2852] Step 12:

[2853] The server stores the received image and video data, allowing parents to view them in real time on their smartphones. The input is compressed image and video data, and the output is the stored data.

[2854] Step 13:

[2855] Parents can view images and videos via a smartphone app and send instructions to their children as needed. The input is the parent's instructions, and the output is the instruction data sent to the device.

[2856] Step 14:

[2857] The UV sensor on the device measures the amount of UV light in the surrounding area. The input is the amount of UV light, and the output is the measured UV light data.

[2858] Step 15:

[2859] When the amount of UV rays exceeds a certain standard, the terminal will automatically adjust the UV cut filter. The input is UV data, and the output is the adjusted UV cut filter.

[2860] As described above, each processing step works together to create a system that provides multifunctional support to users.

[2861] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2862] This invention provides multifunctional children's glasses equipped with GPS and AI-based route guidance, a camera, a recording function, UV protection, and an emotion engine that recognizes the user's emotions. The program processing of this system is explained in natural language below, and will be described in detail with concrete examples.

[2863] GPS and AI-powered route guidance

[2864] Device (kids' glasses)

[2865] The device periodically acquires its current location using its built-in GPS sensor and sends that information to the server. If the user (child) gets lost, they can voice-instruct, "I want to go home." The device then sends that voice data to the server.

[2866] server

[2867] The server receives the current location information and voice data sent from the device, converts it into text using voice recognition technology, and analyzes the question. It then retrieves destination information (e.g., home) from a database. It uses an AI algorithm to calculate the optimal route from the current location to the destination, converts the result into voice data, and sends it to the device.

[2868] Device (kids' glasses)

[2869] The terminal receives the voice data sent from the server and plays it back to the user, allowing the user to follow the voice guidance to reach their destination.

[2870] Examples:

[2871] When a user says "I want to go home," the Kids Glasses sends that voice to the server. The server calculates the optimal route and sends voice data such as "Turn right and go 100 meters" to the device. The device then plays back the voice and guides the user to their destination.

[2872] Camera function / recording function

[2873] Device (kids' glasses)

[2874] When a user presses the share button, the device's camera captures the current view, compresses the captured image data, and sends it to the server.

[2875] ...

Claims

1. A means for obtaining current location information; means for transmitting the acquired current location information; means for receiving audio input; means for transmitting audio input; A means for analyzing voice data to obtain destination information; A method for calculating the optimal route based on current location information and destination information, A means for converting the optimal route into audio data; means for transmitting audio data to a terminal; means for playing the transmitted audio data; A system including:

2. A means of photographing the current scenery, A means for compressing captured image data; means for transmitting the compressed image data to a server; means for receiving and storing image data; The system of claim 1 , comprising:

3. a means for measuring the amount of ultraviolet light; a means for adjusting the UV cut filter based on the measured amount of ultraviolet light; The system of claim 1 , comprising:

Images