System

Abstract

A system is provided.SOLUTION: A system includes a means for providing a vision protection mode, a means for optimizing a layout, a means having a reminder function for urging a user to take a rest at regular time intervals, a means for providing exercise for promoting eye movement, and a means having a timer function for limiting the use time of an application.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, children's long hours of screen time on tablets, smartphones, and other devices have led to serious eye problems, including vision loss. In particular, in dual-income households, it is difficult to properly manage children's screen time, resulting in insufficient eye protection. To solve this problem and protect children's health, a system is needed that provides a vision-friendly environment and encourages appropriate breaks and eye exercises. [Means for solving the problem]

[0005] The present invention is a system for preventing vision loss, which includes the following means:

[0006] Means for providing eyesight protection mode: This means reduces blue light and adjusts color temperature to provide a lighting environment that is gentle on children's eyes.

[0007] Layout optimization method: This method adjusts font size and line spacing based on the user's visual acuity test to provide an easy-to-read layout.

[0008] A device with a timed break reminder function: This device prevents children from looking at the screen for long periods of time and encourages them to take breaks at appropriate times.

[0009] A means of providing exercises to promote eye movement: These means exercise the eye muscles through games and interactive content, protecting vision.

[0010] A means with a timer function to limit the amount of time an app can be used: This means limits the amount of time an app can be used and prevents children from using it for long periods of time.

[0011] By combining these measures, it is possible to effectively prevent vision loss when children use electronic devices.

[0012] "Eye protection mode" is a function that provides a lighting environment that is gentle on the user's eyes by reducing blue light and adjusting color temperature.

[0013] "Layout optimization" is a function that improves visibility by adjusting font size and line spacing based on the user's vision test results.

[0014] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break.

[0015] "Eye Exercise" is an exercise program that uses games and interactive content to exercise eye muscles and protect eyesight.

[0016] The "app timer" is a function that limits the amount of time an app can be used, and is a means of managing the amount of time an app can be used so that it does not become overused. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention relates to a vision protection application for children, which includes features such as a vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer.

[0039] Eye Comfort Mode

[0040] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[0041] Layout optimization

[0042] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[0043] Reminder function

[0044] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[0045] eye exercises

[0046] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[0047] App Timer

[0048] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[0049] In this way, the combination of vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer can effectively prevent children's eyesight from deteriorating. Furthermore, these functions work together to comprehensively protect the user's eye health.

[0050] The processing flow will be explained below.

[0051] Eye comfort mode processing steps

[0052] Step 1:

[0053] When the device launches the app, it obtains the current time from the system clock to prepare for determining whether it is daytime or nighttime.

[0054] Step 2:

[0055] The device sends the acquired time information to the server. The current time data is sent to the server via an API request.

[0056] Step 3:

[0057] The server receives the time information and generates filter parameters for daytime or nighttime use. The time data is analyzed to determine the required blue light reduction level and color temperature adjustment.

[0058] Step 4:

[0059] The server sends the generated filter parameters to the device and returns them in the API response.

[0060] Step 5:

[0061] The device receives the filter parameters and adjusts the screen color temperature and blue light level, then changes the screen settings based on the received parameters to provide a lighting environment that is gentle on the eyes.

[0062] Step 6:

[0063] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[0064] Layout optimization processing steps

[0065] Step 1:

[0066] The user takes a vision test within the app and enters the test results into the device. The vision test results are then registered in the app.

[0067] Step 2:

[0068] The device sends the vision test results to the server. The test result data is sent to the server via an API request.

[0069] Step 3:

[0070] The server analyzes the results of the visual acuity test and generates optimal layout parameters (such as font size and line spacing). The data analysis determines the optimal display parameters for the user.

[0071] Step 4:

[0072] The server sends the generated layout parameters to the device and returns them in the API response.

[0073] Step 5:

[0074] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, changing the display content according to the generated parameters.

[0075] Step 6:

[0076] Users can use the app with an optimized layout, with font size and line spacing set according to their eyesight.

[0077] Reminder function processing steps

[0078] Step 1:

[0079] The device reads the reminder settings when the app starts. Reads the saved setting data.

[0080] Step 2:

[0081] Your device will start the timer for the reminder, which will begin counting down to the set reminder interval.

[0082] Step 3:

[0083] The device displays a notification to the user when the timer expires, encouraging them to take a break. It generates a pop-up notification with the message "Rest your eyes!"

[0084] Step 4:

[0085] Users receive a notification to temporarily stop using the app and rest their eyes.

[0086] Eye exercise processing steps

[0087] Step 1:

[0088] The device periodically displays eye exercise notifications to the user, encouraging them to "do some eye exercises!"

[0089] Step 2:

[0090] The user starts an eye exercise. The user selects an in-app game mode.

[0091] Step 3:

[0092] The device provides an interactive character tracking game, in which the on-screen characters start moving randomly.

[0093] Step 4:

[0094] The user completes the exercise by following the character with their eyes. By continuing to follow the character with their eyes, they exercise their eye muscles.

[0095] Step 5:

[0096] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[0097] App Timer Processing Steps

[0098] Step 1:

[0099] The user sets the usage time for the app. The user enters the desired usage time on the settings screen within the app.

[0100] Step 2:

[0101] The device starts a timer based on the set usage time. The device starts a countdown to the usage time limit.

[0102] Step 3:

[0103] When the device reaches the end of its usage time, it will notify the user by displaying a message saying, "Your usage time is over. Rest your eyes!"

[0104] Step 4:

[0105] The user checks the notification, ends the app, and takes a break.

[0106] Step 5:

[0107] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[0108] The above are the specific processing steps of each function of this vision loss prevention system, which can effectively protect children's eyes.

[0109] Example 1

[0110] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0111] Today's children often use digital devices for long periods of time, which can lead to serious problems such as vision loss and eye fatigue. Furthermore, a lack of proper screen adjustments based on the environment and timing of digital device use can further exacerbate vision loss. Even when vision protection systems exist, they often only offer limited functionality, such as eye protection modes and break reminders, making comprehensive vision protection difficult.

[0112] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0113] In this invention, the server includes means for providing a vision protection mode by acquiring current time information and transmitting it to the server to receive appropriate filter parameters, means for transmitting the user's vision test results to the server and receiving layout parameters based on the vision data to optimize the layout, means for providing a reminder function to encourage breaks at regular intervals, means for providing an interactive game that promotes eye exercise, and means for providing a timer function that counts down the usage time of an app set by the user and displays a notification when the usage time has expired. This not only provides the user with a screen environment that is gentle on the eyes in the vision protection mode, but also enables the display of an optimal layout based on the vision test results, and enables comprehensive vision protection through the regular break reminders and eye exercises.

[0114] "Current time information" refers to the actual date and time information obtained using the internal clock of a terminal or device.

[0115] A "server" is a computer system that performs processing in response to requests from terminals via a network.

[0116] "Filter parameters" are the numerical values ​​and settings used to adjust the screen's color temperature, blue light intensity, etc.

[0117] "Visual acuity test results" refers to specific visual acuity status and numerical information obtained when a user undergoes a visual acuity test.

[0118] "Layout parameters" are setting items related to the arrangement and style of display elements on the screen, such as font size and line spacing.

[0119] "Reminder" is a function that notifies the user periodically and encourages them to take a specific action.

[0120] An "interactive game" is a type of game in which reactions and changes occur depending on the user's operations and actions.

[0121] The "timer function" is a function that counts down a set time and notifies you when that time has elapsed.

[0122] "Eye protection mode" is a function that adjusts the screen's color temperature and blue light to provide a display that is gentle on the eyes in order to reduce strain on the user's eyesight.

[0123] "Layout optimization" is a function that adjusts the layout and size of display elements on the screen according to the user's eyesight condition, improving visibility.

[0124] This invention relates to an application for digital devices to prevent vision loss, and provides the following functions:

[0125] Eye Comfort Mode

[0126] When the app is launched, the device obtains the current time from the system clock. This time information is sent to the server. The server analyzes the time information and generates appropriate filter parameters (such as color temperature and blue light filter strength). These parameters are sent to the device, which then adjusts the screen's color temperature. This allows for an eye-friendly environment for specific times of the day. For example, at night, the screen's color temperature can be set to warmer colors to reduce blue light.

[0127] Layout optimization

[0128] Users take a visual acuity test using the app's visual acuity test function and enter the results into their device. The device then sends this visual acuity data to the server. The server analyzes the visual acuity data and generates layout parameters (such as font size and line spacing) that are optimal for the user. These parameters are then sent to the device, which then dynamically adjusts the display elements on the screen. This allows users to use the app with an optimal layout based on their visual acuity. For example, users with poor eyesight can be provided with a larger font size and wider line spacing.

[0129] Reminder function

[0130] When the app is launched, the device reads the reminder settings and starts an internal timer. After a set period of time has elapsed, the device displays a notification encouraging the user to take a break. This notification allows the user to temporarily stop using the app and rest their eyes. For example, a notification saying "Take a break!" is displayed every 60 minutes.

[0131] eye exercises

[0132] The device periodically displays notifications suggesting eye exercises to the user. Once the user starts the exercise, the device offers an interactive game in which the user is required to follow an on-screen character with their eyes, which exercises the eye muscles and protects eyesight. For example, a game in which the user follows a randomly moving character with their eyes is provided.

[0133] App Timer

[0134] Users can set the time limit for app usage, and the device will then start a timer to count down the set time. When the set time has elapsed, the device will display a notification that usage time has ended, encouraging the user to take a break. This function helps prevent eye strain caused by using apps for long periods of time. For example, if you set the usage time to one hour, a notification will appear saying, "Usage time is over. Take a break!" when the time has elapsed.

[0135] These functions are executed on iOS devices (e.g., iPhone, iPad), and exchange data via Firebase and REST API, adjust color temperature using iOS's "Night Shift" function, link databases using Firebase, and use iOS's "Local Notification" function for notifications. The eye exercise game is implemented using Unity.

[0136] Prompt Sentence Examples

[0137] Please describe in natural language the process of the following system: This system is a vision prevention application for children, and includes features such as a vision protection mode, layout optimization, reminders, eye exercises, and an app timer. Please specify the specific hardware and software used.

[0138] By combining the above treatments, it is possible to effectively prevent children's eyesight from declining and achieve comprehensive vision protection.

[0139] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0140] Eye Comfort Mode

[0141] Step 1:

[0142] The device gets the current time.

[0143] Input: Time information from the system clock

[0144] Specific behavior: Gets the current time using the iOS Date() class.

[0145] Output: Current time (e.g. 21:00)

[0146] Step 2:

[0147] The terminal transmits the time information to the server.

[0148] Input: Current time (e.g. 21:00)

[0149] Specific operation: The device sends time information to the server using an HTTP request. Use a cloud service such as Firebase.

[0150] Output: The time information is sent to the server.

[0151] Step 3:

[0152] The server generates the filter parameters and sends them to the terminal.

[0153] Input: Time information sent from the device (e.g. 21:00)

[0154] Specific operation: Based on the time information received by the server, the appropriate filter parameters (e.g., color temperature 3500K) are calculated.

[0155] Output: Filter parameters (e.g. color temperature 3500K)

[0156] Step 4:

[0157] The device adjusts the screen color temperature based on the filter parameters.

[0158] Input: Filter parameters received from the server (e.g. color temperature 3500K)

[0159] What it does: The device uses iOS's Night Shift feature to adjust the screen's color temperature.

[0160] Output: Calibrated screen color temperature (e.g. 3500K)

[0161] Layout optimization

[0162] Step 1:

[0163] The user takes a vision test and enters the results.

[0164] Input: User's visual acuity test result (e.g., visual acuity 0.5)

[0165] What it does: Use the in-app vision test feature and enter your vision results into the input form.

[0166] Output: Input visual acuity information (e.g., visual acuity 0.5)

[0167] Step 2:

[0168] The device transmits the visual acuity data to the server.

[0169] Input: Visual acuity information entered by the user (e.g., visual acuity 0.5)

[0170] Specific operation: The device sends visual acuity data to the server using an HTTP request, using a cloud service such as Firebase.

[0171] Output: Visual acuity data is sent to the server.

[0172] Step 3:

[0173] The server analyzes the visual acuity data and generates layout parameters.

[0174] Input: Visual acuity data received by the server (e.g., visual acuity 0.5)

[0175] Specific operation: The server analyzes the visual acuity data and generates optimal layout parameters (e.g., font size 20pt, line spacing 1.5x).

[0176] Output: Layout parameters (e.g. font size 20pt, line spacing 1.5x)

[0177] Step 4:

[0178] The device adjusts the screen based on the layout parameters.

[0179] Input: Layout parameters received from the server (e.g. font size 20pt, line spacing 1.5x)

[0180] What it does: Dynamically change display elements within the app using layout parameters received by the device.

[0181] Output: Adjusted layout (e.g., font size 20pt, line spacing 1.5x)

[0182] Reminder function

[0183] Step 1:

[0184] Your device will load your reminder settings.

[0185] Input: Reminder time saved in app settings (e.g. 60 minutes)

[0186] What happens: The device reads the reminder settings from the app settings.

[0187] Output: Reminder time loaded (e.g. 60 minutes)

[0188] Step 2:

[0189] The terminal starts a timer.

[0190] Input: Reminder time (e.g. 60 minutes)

[0191] Specific behavior: The device starts an internal timer based on the specified reminder time. This uses the iOS timer function.

[0192] Output: A timer that starts the countdown.

[0193] Step 3:

[0194] After a certain time has passed, the device will display a notification.

[0195] Input: Reminder time has elapsed (e.g. 60 minutes have elapsed)

[0196] What it does: After the set time has elapsed, the device displays a notification encouraging the user to take a break. This uses iOS's local notifications feature.

[0197] Output: Notification to encourage a break (e.g., "Rest your eyes!")

[0198] eye exercises

[0199] Step 1:

[0200] Your device will display a notification with exercise suggestions.

[0201] Input: Exercise time interval (e.g. every 30 minutes)

[0202] What happens: Your device displays exercise suggestion notifications using iOS's local notifications feature.

[0203] Output: Exercise suggestion notification (e.g. "Let's do some eye exercises!")

[0204] Step 2:

[0205] The user responds to the notification and begins the exercise.

[0206] Enter: Exercise suggestion notification

[0207] Specific action: The user responds to the notification and taps the button to start the exercise.

[0208] Output: Instruction to start exercise

[0209] Step 3:

[0210] The device provides interactive games.

[0211] Input: Start exercise command

[0212] What it does: The device launches an eye exercise game implemented in Unity, which asks the user to follow an on-screen character with their eyes.

[0213] Output: Start of interactive game

[0214] App Timer

[0215] Step 1:

[0216] The user sets the time for using the app.

[0217] Input: Usage time set by the user (e.g. 60 minutes)

[0218] Specific operation: The user enters and sets the usage time on the app's settings screen.

[0219] Output: Set usage time (e.g. 60 minutes)

[0220] Step 2:

[0221] The terminal starts a timer.

[0222] Input: Set usage time (e.g. 60 minutes)

[0223] What it does: The device starts a countdown timer based on the specified usage time. It uses the iOS timer function.

[0224] Output: A timer that starts the countdown.

[0225] Step 3:

[0226] After the set time has elapsed, the device will display a notification that usage time has ended.

[0227] Input: Set time has elapsed (e.g. 60 minutes have elapsed)

[0228] Specific behavior: After the set time has elapsed, the device displays a notification that the usage time has ended, encouraging the user to take a break. This uses iOS's local notification feature.

[0229] Output: Screen time end notification (e.g. "Screen time is over. Rest your eyes!")

[0230] Through the above processing steps, the system effectively prevents children's eyesight from declining and achieves comprehensive vision protection.

[0231] (Application example 1)

[0232] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0233] Today's children often use digital devices for long periods of time, which can lead to problems such as vision loss and eye strain. Furthermore, parents have limited means to effectively manage their children's device usage time and protect their eyesight. This has led to a need for effective methods to prevent vision loss. There is also a growing need for technology that dynamically adjusts screen display based on visual status.

[0234] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0235] In this invention, the server includes means for providing a vision protection mode, means for optimizing the layout, means for providing a reminder function for taking breaks at regular intervals, means for providing exercises to promote eye movement, means for providing a timer function for limiting app usage time, means for dynamically adjusting the screen color temperature based on the user's visual condition and time information, and means for acquiring filter parameters and layout parameters from the server and dynamically optimizing the screen display based on the parameters. This effectively prevents children's eyesight from deteriorating and provides an appropriate vision protection environment. It also makes it easier for parents to manage their children's device usage time and vision protection.

[0236] "Eye Protection Mode" is a function that dynamically adjusts the screen's color temperature and blue light to protect the user's eyesight.

[0237] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing on the screen based on the user's eyesight condition.

[0238] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break.

[0239] "Eye Exercises" is a feature that suggests visual exercises to users and encourages them to move their eye muscles.

[0240] The "timer function" is a function that allows you to set the amount of time you can use the app and displays a notification to the user when the set time has elapsed.

[0241] "Filter parameters" are setting information for color temperature and blue light reduction obtained from the server.

[0242] "Layout parameters" are layout setting information such as font size and line spacing obtained from the server.

[0243] A "server" is a device on a network that generates and provides filter parameters and layout parameters.

[0244] "Means for dynamically adjusting the color temperature of the screen" is a technology that appropriately changes the color temperature of the screen based on time information and the user's visual state.

[0245] "Means for dynamically optimizing screen display" refers to a technology that optimizes the screen layout and display content in real time based on parameters obtained from the server.

[0246] The following describes the mode for implementing the present invention. The system of the present invention combines a vision protection mode, layout optimization, a reminder function, exercises to promote eye movement, and a timer function to limit the time spent using apps. The main functions of the present invention and specific implementation methods thereof are described below.

[0247] Eye Comfort Mode

[0248] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[0249] Layout optimization

[0250] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[0251] Reminder function

[0252] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[0253] eye exercises

[0254] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[0255] App Timer

[0256] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[0257] Server-side processing

[0258] The server generates filter and layout parameters using the time information and vision test results sent from the device. This processing is performed using specific software on the server (e.g., Python, Amazon Web Services (AWS), etc.). The generated parameters are sent to the device and used to adjust the display on the device.

[0259] Specific examples and examples of input to generative AI models

[0260] For example, if you install this application on a smartphone used by a third-grader, when it is used at 8 p.m., the app will automatically apply a blue light filter and change the screen to warmer colors. Based on the results of a vision test, it will also increase the font size and increase the line spacing. Every 60 minutes, the app will send a message saying, "Take a rest!"

[0261] Example prompt for input to a generative AI model:

[0262] Generate code for a smartphone app that automatically applies a blue light blocking color temperature filter based on the current time and displays a reminder to take a break from eye contact at regular intervals. Dynamically adjust font size and optimize line spacing based on the results of a visual acuity test. Also, add a feature that suggests eye exercises to users through an exercise function.

[0263] As described above, this invention is a system that integrates major functions to prevent deterioration of children's eyesight and provide an appropriate eyesight protection environment.

[0264] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0265] Step 1:

[0266] When the device launches the app, it gets the current time. The input is the system time of the user device, and the output is the current time data. This time data is used in the next step.

[0267] Step 2:

[0268] The terminal sends the acquired time data to the server. The input is the time data acquired in step 1, and the output is the request sent to the server.

[0269] Step 3:

[0270] The server generates filter parameters based on the time data received. The input is the time data sent from the device, and the data is processed to calculate the appropriate color temperature and blue light reduction parameters for the time of day. The output is the generated filter parameters.

[0271] Step 4:

[0272] The server sends the generated filter parameters to the terminal. The input is the filter parameters, and the output is the data to be sent to the terminal.

[0273] Step 5:

[0274] The terminal adjusts the color temperature of the screen based on the filter parameters received. The input is the filter parameters received from the server, and the screen settings are changed as data processing. The output is the adjusted screen display.

[0275] Step 6:

[0276] The user takes a vision test and inputs the results into the terminal. The input is the vision test result data entered by the user, and the output is the data stored in the terminal.

[0277] Step 7:

[0278] The terminal sends the vision test result data to the server. The input is the vision test result data, and the output is sending a request to the server.

[0279] Step 8:

[0280] The server generates layout parameters based on the vision test results received. The input is the vision test result data sent from the terminal, and the optimal font size and line spacing are calculated as data processing. The output is the generated layout parameters.

[0281] Step 9:

[0282] The server sends the generated layout parameters to the terminal. The input is the layout parameters, and the output is the data to be sent to the terminal.

[0283] Step 10:

[0284] Based on the layout parameters received by the device, each element on the screen is dynamically adjusted. The input is the layout parameters received from the server, and the screen layout is changed as data processing. The output is a screen display that has been adjusted to be easy to see.

[0285] Step 11:

[0286] When the device launches the app, it reads the reminder settings and starts the timer. The input is the reminder setting data in the device, and the output is the start of the reminder timer.

[0287] Step 12:

[0288] After a certain time has passed, the device displays a notification to the user to encourage them to take a break. The input is the status data of the reminder timer, and the output is the notification display to the user.

[0289] Step 13:

[0290] The device periodically displays a notification to the user suggesting eye exercises. The input is the exercise notification setting data, and the output is the notification display to the user.

[0291] Step 14:

[0292] When the user starts exercising, the device provides an interactive game, prompting the user to follow an on-screen character. The input is the user's operation to start exercising, and the output is the start of the exercise game.

[0293] Step 15:

[0294] After the user sets the app usage time, the device starts a timer to count down that time. The input is the usage time data set by the user, and the output is the start of the usage timer.

[0295] Step 16:

[0296] When the set time has elapsed, the device displays a notification to the user that usage has ended and restricts app use. The input is the timer countdown status data, and the output is a notification to the user that usage has ended.

[0297] The above is a detailed description of the processing steps of the system program for realizing the application example.

[0298] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0299] This invention relates to an application for preventing vision loss for children, and is characterized by combining a vision protection mode, layout optimization, reminder function, eye exercise exercises, and an app timer with an emotion engine.

[0300] Introducing the Emotion Engine

[0301] The emotion engine uses cameras and sensors to recognize the user's emotions and adjusts the behavior of each feature based on that emotional state, thereby providing a more personalized user experience.

[0302] Eye Comfort Mode

[0303] When the app is launched, the device uses the camera to capture the user's face, and the emotion engine analyzes the image to determine the user's emotion. The device also obtains the current time and sends this information to the server. The server generates optimal filter parameters (color temperature and blue light reduction level) based on the time information and the user's emotion data and sends them to the device. For example, if it is nighttime and the server determines that the user is tired, it will apply settings that adopt a warmer color temperature and more strongly reduce blue light. This allows the user to use the app in a lighting environment that is gentle on the eyes.

[0304] Layout optimization

[0305] After the user takes the vision test, they enter the results into their device. The device then sends the vision test results, along with the user's emotional data captured by the camera, to the server. The server analyzes this data and determines the optimal font size and line spacing. For example, if the server determines that the user has poor eyesight and is unable to concentrate, it will send settings to the device to make the font size larger than usual and increase the line spacing. This allows the user to use the app with an optimized layout.

[0306] Reminder function

[0307] When the app is launched, the device reads the reminder settings and uses the camera to recognize the user's emotions. The timing of the reminder is not only based on a pre-set time interval, but is also adjusted taking into account the user's emotional state. For example, if the device determines that the user is concentrating on their work, it can delay the reminder notification a little. When the time comes, the device will display a notification encouraging the user to take a break.

[0308] eye exercises

[0309] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification is displayed, the camera is used to assess the user's emotional state. If the user's emotions are judged to be, for example, enjoyment or relaxation, the exercise continues. Conversely, if the user is judged to be feeling stressed, the exercise content is changed to a more relaxing one. This allows the user to enjoy eye exercise.

[0310] App Timer

[0311] After the user sets the app usage time, the device not only counts down the set time but also continuously monitors the user's emotions using the camera. When the time has elapsed, the device will display a notification to encourage the user to quit using the app. If the emotion engine determines that the user is already tired, the device can notify the user earlier than the scheduled time. This allows the user to quit the app at the appropriate time and rest their eyes.

[0312] In this way, by combining the emotion engine with the vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer, the system can make fine adjustments according to the user's emotional state, more effectively preventing the deterioration of children's eyesight.

[0313] The processing flow will be explained below.

[0314] Eye protection mode processing steps using emotion engine

[0315] Step 1:

[0316] The device launches the app, first launching the camera to capture the user's face, and then getting the current time from the system clock.

[0317] Step 2:

[0318] The device sends the captured face image and the acquired time information to the server using an API request.

[0319] Step 3:

[0320] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as recognizing emotions like "tired" or "concentrated."

[0321] Step 4:

[0322] The server generates optimal filter parameters based on time information and the user's emotional data. If it is nighttime and the user is judged to be "tired," the server will set the color temperature to warmer colors and increase blue light reduction.

[0323] Step 5:

[0324] The server sends the generated filter parameters to the device and returns them in the API response.

[0325] Step 6:

[0326] The device receives the filter parameters and adjusts the screen's color temperature and blue light level, changing the screen settings to provide the user with the optimal lighting environment.

[0327] Step 7:

[0328] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[0329] Processing steps for layout optimization using emotion engine

[0330] Step 1:

[0331] Users take a visual acuity test within the app and enter the results into their device. The visual acuity test is carried out using a dedicated tool.

[0332] Step 2:

[0333] The device sends the results of the eye test and a facial image captured by the camera to the server, sending this data via an API request.

[0334] Step 3:

[0335] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as "tired" or "unhappy."

[0336] Step 4:

[0337] The server generates optimal layout parameters (such as font size and line spacing) based on the results of the vision test and emotional data. If the user's vision is poor and the user is judged to be "tired," the server will increase the font size and widen the line spacing.

[0338] Step 5:

[0339] The server sends the generated layout parameters to the device and returns the parameters in the API response.

[0340] Step 6:

[0341] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, optimizing the content displayed to the user.

[0342] Step 7:

[0343] Users can use the app with an optimized layout, with font size and line spacing settings that suit their eyesight and emotions.

[0344] Processing steps of the reminder function incorporating an emotion engine

[0345] Step 1:

[0346] When the device launches the app, it reads the reminder settings and activates the camera to capture the user's face.

[0347] Step 2:

[0348] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[0349] Step 3:

[0350] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "concentrated" or "relaxed."

[0351] Step 4:

[0352] The device adjusts the timing of reminders based on emotion data, delaying reminder notifications if the user is deemed to be "concentrated."

[0353] Step 5:

[0354] The device will display a notification to the user at the set time to encourage them to take a break. A pop-up message will appear saying "Rest your eyes!"

[0355] Step 6:

[0356] Users receive a notification to temporarily stop using the app and take a break to rest their eyes.

[0357] Processing steps of eye movement exercise using emotion engine

[0358] Step 1:

[0359] The device periodically displays eye exercise notifications to the user and activates the camera to capture the user's face.

[0360] Step 2:

[0361] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[0362] Step 3:

[0363] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as whether they are having fun or feeling stressed.

[0364] Step 4:

[0365] The device adjusts the exercise content based on the user's emotions. If the device determines that the user is "stressed," it changes the exercise to a more relaxing one.

[0366] Step 5:

[0367] The user starts an eye exercise. The user selects an in-app game mode.

[0368] Step 6:

[0369] The device provides an interactive character tracking game. The game starts with the characters moving randomly on the screen.

[0370] Step 7:

[0371] The user follows the character with their eyes and completes the exercise. By continuing to follow the character with their eyes, they exercise their eye muscles.

[0372] Step 8:

[0373] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[0374] Processing steps for app timers using emotion engines

[0375] Step 1:

[0376] The user sets the app usage time by entering the desired usage time on the settings screen within the app.

[0377] Step 2:

[0378] The device starts a timer to count down the set usage time, and activates the camera to monitor the user's face.

[0379] Step 3:

[0380] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[0381] Step 4:

[0382] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "tired" or "concentrated."

[0383] Step 5:

[0384] The device continuously monitors emotional data during use and adjusts timer settings as needed. For example, if the device detects that the user is already tired, it will notify the user to end the timer earlier than scheduled.

[0385] Step 6:

[0386] The device displays a notification to the user that their screen time is over based on a set time or emotional state. It displays the message "Your screen time is over. Rest your eyes!"

[0387] Step 7:

[0388] The user checks the notification, ends the app, and takes a break.

[0389] Step 8:

[0390] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[0391] The above are the specific processing steps for each function of the eyesight prevention system that combines the emotion engine. This allows for fine-tuned adjustments based on the user's emotional state, making it possible to more effectively prevent vision loss in children.

[0392] Example 2

[0393] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0394] Conventional vision loss prevention systems have not been finely adjusted to suit the user's condition, making it difficult to effectively prevent vision loss. In particular, because settings are applied uniformly based on certain environments and conditions, there is a problem in that it is not possible to provide optimal support according to the individual state and emotions of each user.

[0395] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing a eyesight protection mode, a means for optimizing a layout, a means having a reminder function for prompting a break at regular intervals, a means for providing exercises to promote eye movement, a means having a timer function for limiting the usage time of an application, and a means for adjusting the operation of each means based on the emotional state of the user using an emotion recognition engine. This allows each function to be optimized based on the emotional state of the user and the results of a vision test, enabling more effective prevention of vision loss.

[0396] "Eye protection mode" is a function that adjusts the screen color temperature and blue light reduction level to protect the user's eyesight.

[0397] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing of displayed text based on the user's vision test results and emotional state.

[0398] The "reminder function" is a function that displays a notification to encourage users to take a break after a certain amount of time has passed.

[0399] "Eye Exercises" is a feature that encourages users to do specific eye exercises to maintain eye health.

[0400] The "timer function" is a function that monitors the usage time of an application and notifies the user when the set time has elapsed.

[0401] An "emotion recognition engine" is a system that uses a camera or sensor to capture a user's face and determine the user's emotional state through image analysis.

[0402] "Filter parameters" are settings that are adjusted to protect eyesight, such as the screen's color temperature and blue light reduction level.

[0403] "Font size" refers to the size of the characters displayed and is adjusted according to the user's eyesight.

[0404] "Line spacing" refers to the vertical space between displayed text and is adjusted according to the user's visual acuity and emotional state.

[0405] This invention is an application system for preventing vision loss, which uses an emotion recognition engine to adjust the operation of various functions based on the user's emotional state, providing a personalized user experience. Specifically, it is equipped with a vision protection mode, layout optimization, reminder function, eye exercises, and a timer function to manage application usage time.

[0406] Introducing an emotion recognition engine

[0407] The emotion recognition engine is a system that uses the built-in camera and sensors of smartphones and tablet devices to capture the user's face and determine their emotional state through image analysis. This enables the following functions:

[0408] Eye Comfort Mode

[0409] When the app is launched, the device uses the camera to capture the user's face, and the emotion recognition engine analyzes the image to determine the user's emotions. This includes analyzing facial expressions. For example, if the face is determined to look tired, the color temperature is set to 2500K and the blue light reduction level is increased. The device obtains the current time and sends this information to the server. The server then generates optimal filter parameters based on the time information and the user's emotion data and sends them to the device, thereby protecting the user's eyesight.

[0410] Layout optimization

[0411] After the user takes the vision test, they enter the results into the device. The device also uses its camera to capture emotional data and sends this information to the server. The server analyzes the vision test results and emotional data and optimizes font size and line spacing. For example, if it determines that the user has poor eyesight and is unable to concentrate, it will increase the font size and increase the line spacing by sending settings to the device to improve visibility.

[0412] Reminder function

[0413] When the app launches, the device reads the reminder settings and simultaneously uses the camera to recognize the user's emotions. The app adjusts reminder notifications based not only on the set interval, but also on the user's emotional state. For example, if the app determines that the user is concentrating on a task, it can delay the notification. When the time comes, the device will display a notification to the user saying, "Please take a break."

[0414] eye exercises

[0415] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification appears, the device uses the camera to assess the user's emotional state. If the device determines that the user is enjoying or relaxed during the exercise, it continues the exercise. Conversely, if the device determines that the user is feeling stressed, it changes the exercise to make it more relaxing.

[0416] Application Timer

[0417] After the user sets the application usage time, the device counts down the set time. It also continuously monitors the user's emotions using the camera. When the time expires, the device displays a notification to encourage the user to stop using the app. If the emotion recognition engine determines that the user is already tired, the device can send the notification earlier than the scheduled time.

[0418] (Example)

[0419] Example of the emotion recognition engine in action:

[0420] Prompt: "How can I set it to reduce blue light when the user is fatigued?"

[0421] Hardware used: Smartphone camera, server

[0422] Software used: Emotion recognition AI, blue light filter

[0423] Data processing and calculation: Emotion recognition, filter parameter generation, data transmission, setting application

[0424] The system utilizes an emotion recognition engine to optimize various functions, including eye protection mode, layout optimization, reminder function, and eye exercise exercises, to effectively prevent users' eyesight from deteriorating.

[0425] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0426] Eye Comfort Mode

[0427] Step 1:

[0428] When the app is launched, the device uses the camera to capture the user's face.

[0429] Input: App launch event

[0430] Output: User's face image

[0431] How it works: When the app is launched, the device's built-in camera automatically activates and takes a picture of the user's face.

[0432] Step 2:

[0433] The device passes the facial image to an emotion recognition engine for emotion recognition.

[0434] Input: User's face image

[0435] Output: User's emotional state (tired, relaxed, etc.)

[0436] How it works: An analytics algorithm analyzes images and identifies emotional states from facial expressions.

[0437] Step 3:

[0438] The device uses the system clock to obtain the current time.

[0439] Input: None

[0440] Output: current time

[0441] Action: The internal clock returns the current time.

[0442] Step 4:

[0443] The device sends emotion data and the current time to the server.

[0444] Input: Emotion data, current time

[0445] Output: Send data package to server

[0446] How it works: Emotion data and time are packaged together and sent to the server using the communication module.

[0447] Step 5:

[0448] The server receives the data and generates optimal filter parameters.

[0449] Input: Emotion data, current time

[0450] Output: Optimal filter parameters (color temperature, blue light reduction level)

[0451] How it works: An algorithm calculates the response and generates filter parameters based on the data. For example, if it detects you are "tired" at night, it will lower the color temperature and cut blue light.

[0452] Step 6:

[0453] The server sends the generated filter parameters to the terminal.

[0454] Input: Optimal filter parameters

[0455] Output: Data sent to the terminal

[0456] What it does: Packages parameters and sends them to the device.

[0457] Step 7:

[0458] The terminal applies the received filter parameters.

[0459] Input: Optimal filter parameters

[0460] Output: Adjusted display settings

[0461] What it does: Updates display settings to adjust color temperature and blue light reduction levels.

[0462] Layout optimization

[0463] Step 1:

[0464] The user performs a vision test.

[0465] Input: Start vision test

[0466] Output: Vision test result data

[0467] What it does: The app presents the user with a vision test and collects the results.

[0468] Step 2:

[0469] The user inputs the results of the vision test into the terminal.

[0470] Input: Eye test results

[0471] Output: Data input to the terminal

[0472] Action: Enter the test results into the app's input form.

[0473] Step 3:

[0474] The device uses a camera to capture emotion data.

[0475] Input: Facial image (during vision test)

[0476] Output: Emotion data

[0477] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[0478] Step 4:

[0479] The device sends the vision test results and emotion data to the server.

[0480] Input: Eye test results, emotion data

[0481] Output: Data sent to the server

[0482] What it does: Packages the data and sends it to the server.

[0483] Step 5:

[0484] The server receives the data and determines the optimal font size and line spacing.

[0485] Input: Eye test results, emotion data

[0486] Output: Optimal font size and line spacing

[0487] How it works: A data-driven analytical algorithm calculates the optimal value. For example, if your visual acuity is 0.6 and your concentration is declining, increase the font size and increase the line spacing.

[0488] Step 6:

[0489] The server sends the determined settings to the terminal.

[0490] Input: Optimal font size and line spacing

[0491] Output: Data sent to the terminal

[0492] What it does: Packages configuration data and sends it to the device.

[0493] Step 7:

[0494] The device applies the received settings.

[0495] Input: Optimal font size and line spacing

[0496] Output: Updated layout

[0497] Behavior: Updates the app's display settings to provide the optimal layout for the user.

[0498] Reminder function

[0499] Step 1:

[0500] The device loads the reminder settings when the app is launched.

[0501] Input: App launch event

[0502] Output: Reminder setting data

[0503] What it does: Reads reminder settings (e.g., take a break every 30 minutes) from the app configuration file.

[0504] Step 2:

[0505] The device uses a camera to capture emotion data.

[0506] Input: Face image

[0507] Output: Emotion data

[0508] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[0509] Step 3:

[0510] The device calculates the reminder timing.

[0511] Input: Reminder settings, emotion data

[0512] Output: Adjusted reminder timing

[0513] How it works: Optimizes timing based on your settings and emotional data, for example delaying notifications by 10 minutes if you're distracted.

[0514] Step 4:

[0515] The device will display a notification prompting you to take a break at the specified time.

[0516] Input: Reminder timing

[0517] Output: Notification display

[0518] What it does: Pops up a notification saying "Take a break" at the specified time.

[0519] (Examples and prompts)

[0520] Prompt: "How can I set reminder notifications to be delayed when the user is distracted?"

[0521] Hardware used: Smartphone camera, server

[0522] Software used: Emotion recognition AI, notification system

[0523] Data processing and calculation: Emotion recognition, reminder timing calculation, notification display

[0524] By clearly indicating the specific data input, output, and operation for each step, the processing flow of each function of this system to prevent vision loss becomes clear.

[0525] (Application example 2)

[0526] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0527] In today's digital environment, there are concerns that children's long hours of use of digital devices such as smartphones and tablets may lead to a decline in their eyesight. Furthermore, there are a lack of measures to limit usage time and encourage appropriate breaks, and no consideration is given to entertainment elements that children can enjoy without getting bored. The present invention aims to solve these problems by providing a system that prevents children's eyesight from declining and allows them to use digital devices in a fun and healthy way.

[0528] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a eyesight protection mode, means for optimizing the layout, means for having a reminder function for encouraging breaks at regular intervals, means for providing exercises to promote eye movement, means for having a timer function for limiting the amount of time spent using apps, and emotion engine means for recognizing the user's emotions using a camera or sensor and adjusting the operation of each function based on the user's emotional state. This makes it possible for children to enjoy using digital devices while effectively protecting their eyesight and encouraging them to take breaks at appropriate times.

[0529] "Eye protection mode" is a function that protects the user's eyesight by changing the screen settings of digital devices to reduce blue light and adjust color temperature.

[0530] "Layout optimization" means automatically adjusting font size and line spacing based on the user's visual acuity test results and emotional state to provide the most legible screen layout for the user.

[0531] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break, and adjusts the timing based on the user's emotional state to encourage appropriate breaks.

[0532] "Eye Exercises" is a feature that instructs users on eye-resting exercises and workouts, adjusting them based on their emotional state.

[0533] The "timer function" is a function that allows you to set the amount of time you use a digital device, and when that time has elapsed, a notification will be displayed to end the use.

[0534] The "emotion engine" uses cameras and sensors to recognize the user's emotions and adjusts the operation of each function of the system based on that emotional state.

[0535] This invention is a system that uses cameras and sensors to recognize a child's emotional state and adjusts functions such as vision protection, layout optimization, reminders, eye exercises, and app timers based on that information. Specific embodiments of this system are shown below.

[0536] System configuration

[0537] The system consists of digital devices such as smartphones and tablets, and a server that processes and analyzes data. The main hardware and software components are as follows:

[0538] 1. Hardware:

[0539] Device: A smartphone or tablet with a camera and sensors.

[0540] Server: A server for analyzing data and configuring applications.

[0541] 2. Software:

[0542] Emotion recognition algorithm: Uses OpenCV, DeepFace, etc.

[0543] Data transmission and reception API: An API for transmitting and receiving data between a terminal and a server.

[0544] Eye protection settings engine: Reduces blue light and adjusts color temperature.

[0545] UI / UX optimization engine: Adjust font size and line spacing.

[0546] Timer function: A timer to manage app usage time.

[0547] Entertainment module: Offers mini-games and eye exercises.

[0548] System Operation

[0549] 1. Emotion recognition: The device uses the camera to capture the child's face and recognizes their emotional state in real time through an emotion recognition algorithm.

[0550] 2. Eye Care Mode: The device sends time and emotion data to the server, which then generates optimal filter parameters and sends them to the device. When it is nighttime or when you are tired, the blue light reduction level is set high.

[0551] 3. Layout optimization: The device sends the vision test results and emotion data to the server, which analyzes the data and sends layout settings to the device that optimize font size and line spacing.

[0552] 4. Reminder function: The device will display reminder notifications to the user and adjust the timing of notifications depending on the user's emotional state. If the user is concentrating, the device will delay the reminder to encourage them to take a break.

[0553] 5. Eye Exercises: Regularly remind you to exercise and change the content depending on your emotional state. If you are enjoying it, continue, if you are stressed, shift to something more relaxing.

[0554] 6. App Timer: Your device will count down your set usage time and notify you based on your emotional state, encouraging you to stop using the app earlier if you feel tired.

[0555] Example

[0556] This system can be used in brick-and-mortar stores such as bookstores and cafes where children are using smartphones or tablets, providing both vision protection and entertainment.

[0557] Prompt Sentence Examples

[0558] "Based on the current time and a camera image of the user's face, recognize the child's emotional state and set the eye protection mode accordingly, changing the color temperature of the smartphone to a warmer tone and reducing blue light. Also, incorporate the results of the user's eye test to create settings that optimize the font size of the UI."

[0559] The invention can be carried out in the above manner.

[0560] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0561] Step 1:

[0562] The device uses a camera to capture the user's face and detects emotions in real time using emotion recognition algorithms (e.g., OpenCV or DeepFace).

[0563] Input: Camera image

[0564] Data processing: Face recognition and emotion classification using image processing algorithms

[0565] Output: User's emotional state data (e.g., happy, sad, angry, surprised, etc.)

[0566] Step 2:

[0567] The device transmits the current time and emotional state data to the server.

[0568] Input: time data, emotional state data

[0569] Data Calculation: Format Conversion of Time Series Data and Packaging of Emotion Data

[0570] Output: Request to send time information and emotional state data

[0571] Step 3:

[0572] The server analyzes the received time information and emotional state data to determine the optimal filter parameters for the eyesight protection mode (e.g., color temperature, blue light reduction level).

[0573] Input: time information, emotional state data

[0574] Data calculation: Filter parameter determination using a rule-based algorithm

[0575] Output: Filter parameters (e.g. color temperature setting, blue light reduction level)

[0576] Step 4:

[0577] The server sends the generated filter parameters to the terminal, which then adjusts its screen settings accordingly.

[0578] Input: Filter parameters

[0579] Data processing: Changing the device display settings

[0580] Output: Adjusted screen settings (e.g. warmer color temperature, reduced blue light)

[0581] Step 5:

[0582] The device inputs the vision test data (font size and line spacing settings) and sends it to the server.

[0583] Input: Vision test data

[0584] Data Computing: Standardization and Packaging of Vision Test Results

[0585] Output: Request to send vision test data

[0586] Step 6:

[0587] The server analyzes the visual acuity test data and emotional state data to determine the optimal UI layout (font size and line spacing).

[0588] Input: visual acuity test data, emotional state data

[0589] Data Computing: Applying Statistical Analysis and Heuristic Algorithms

[0590] Output: Optimized UI layout settings

[0591] Step 7:

[0592] The server sends the generated UI layout settings to the terminal, and the terminal adjusts the screen layout based on them.

[0593] Input: UI layout settings

[0594] Data manipulation: Positioning and resizing UI elements

[0595] Output: Adjusted UI layout

[0596] Step 8:

[0597] Your device will read your reminder settings and adjust reminder timing based on your emotional state.

[0598] Input: Emotional state data, reminder settings

[0599] Data calculation: timing adjustment algorithm

[0600] Output: Reminder notification

[0601] Step 9:

[0602] The device monitors the user's emotional state, periodically presents eye movement exercises, and changes the content according to the emotional state.

[0603] Input: Emotional state data

[0604] Data calculation: Selection and adjustment of exercise content

[0605] Output: Exercise notification, content change

[0606] Step 10:

[0607] The device counts down the set usage time, monitors the user's emotional state, and notifies the user to stop using the device at the appropriate time.

[0608] Input: Usage time settings, emotional state data

[0609] Data Computation: Countdown Timer and Emotion Data Analysis

[0610] Output: Termination of use notification

[0611] Through these steps, the user can utilize a system that provides vision protection and entertainment.

[0612] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0613] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0614] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0615] [Second embodiment]

[0616] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0617] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0618] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0619] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0620] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0621] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0622] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0623] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0624] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0625] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0626] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0627] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0628] This invention relates to a vision protection application for children, which includes features such as a vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer.

[0629] Eye Comfort Mode

[0630] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[0631] Layout optimization

[0632] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[0633] Reminder function

[0634] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[0635] eye exercises

[0636] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[0637] App Timer

[0638] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[0639] In this way, the combination of vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer can effectively prevent children's eyesight from deteriorating. Furthermore, these functions work together to comprehensively protect the user's eye health.

[0640] The processing flow will be explained below.

[0641] Eye comfort mode processing steps

[0642] Step 1:

[0643] When the device launches the app, it obtains the current time from the system clock to prepare for determining whether it is daytime or nighttime.

[0644] Step 2:

[0645] The device sends the acquired time information to the server. The current time data is sent to the server via an API request.

[0646] Step 3:

[0647] The server receives the time information and generates filter parameters for daytime or nighttime use. The time data is analyzed to determine the required blue light reduction level and color temperature adjustment.

[0648] Step 4:

[0649] The server sends the generated filter parameters to the device and returns them in the API response.

[0650] Step 5:

[0651] The device receives the filter parameters and adjusts the screen color temperature and blue light level, then changes the screen settings based on the received parameters to provide a lighting environment that is gentle on the eyes.

[0652] Step 6:

[0653] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[0654] Layout optimization processing steps

[0655] Step 1:

[0656] The user takes a vision test within the app and enters the test results into the device. The vision test results are then registered in the app.

[0657] Step 2:

[0658] The device sends the vision test results to the server. The test result data is sent to the server via an API request.

[0659] Step 3:

[0660] The server analyzes the results of the visual acuity test and generates optimal layout parameters (such as font size and line spacing). The data analysis determines the optimal display parameters for the user.

[0661] Step 4:

[0662] The server sends the generated layout parameters to the device and returns them in the API response.

[0663] Step 5:

[0664] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, changing the display content according to the generated parameters.

[0665] Step 6:

[0666] Users can use the app with an optimized layout, with font size and line spacing set according to their eyesight.

[0667] Reminder function processing steps

[0668] Step 1:

[0669] The device reads the reminder settings when the app starts. Reads the saved setting data.

[0670] Step 2:

[0671] Your device will start the timer for the reminder, which will begin counting down to the set reminder interval.

[0672] Step 3:

[0673] The device displays a notification to the user when the timer expires, encouraging them to take a break. It generates a pop-up notification with the message "Rest your eyes!"

[0674] Step 4:

[0675] Users receive a notification to temporarily stop using the app and rest their eyes.

[0676] Eye exercise processing steps

[0677] Step 1:

[0678] The device periodically displays eye exercise notifications to the user, encouraging them to "do some eye exercises!"

[0679] Step 2:

[0680] The user starts an eye exercise. The user selects an in-app game mode.

[0681] Step 3:

[0682] The device provides an interactive character tracking game, in which the on-screen characters start moving randomly.

[0683] Step 4:

[0684] The user completes the exercise by following the character with their eyes. By continuing to follow the character with their eyes, they exercise their eye muscles.

[0685] Step 5:

[0686] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[0687] App Timer Processing Steps

[0688] Step 1:

[0689] The user sets the usage time for the app. The user enters the desired usage time on the settings screen within the app.

[0690] Step 2:

[0691] The device starts a timer based on the set usage time. The device starts a countdown to the usage time limit.

[0692] Step 3:

[0693] When the device reaches the end of its usage time, it will notify the user by displaying a message saying, "Your usage time is over. Rest your eyes!"

[0694] Step 4:

[0695] The user checks the notification, ends the app, and takes a break.

[0696] Step 5:

[0697] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[0698] The above are the specific processing steps of each function of this vision loss prevention system, which can effectively protect children's eyes.

[0699] Example 1

[0700] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0701] Today's children often use digital devices for long periods of time, which can lead to serious problems such as vision loss and eye fatigue. Furthermore, a lack of proper screen adjustments based on the environment and timing of digital device use can further exacerbate vision loss. Even when vision protection systems exist, they often only offer limited functionality, such as eye protection modes and break reminders, making comprehensive vision protection difficult.

[0702] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0703] In this invention, the server includes means for providing a vision protection mode by acquiring current time information and transmitting it to the server to receive appropriate filter parameters, means for transmitting the user's vision test results to the server and receiving layout parameters based on the vision data to optimize the layout, means for providing a reminder function to encourage breaks at regular intervals, means for providing an interactive game that promotes eye exercise, and means for providing a timer function that counts down the usage time of an app set by the user and displays a notification when the usage time has expired. This not only provides the user with a screen environment that is gentle on the eyes in the vision protection mode, but also enables the display of an optimal layout based on the vision test results, and enables comprehensive vision protection through the regular break reminders and eye exercises.

[0704] "Current time information" refers to the actual date and time information obtained using the internal clock of a terminal or device.

[0705] A "server" is a computer system that performs processing in response to requests from terminals via a network.

[0706] "Filter parameters" are the numerical values ​​and settings used to adjust the screen's color temperature, blue light intensity, etc.

[0707] "Visual acuity test results" refers to specific visual acuity status and numerical information obtained when a user undergoes a visual acuity test.

[0708] "Layout parameters" are setting items related to the arrangement and style of display elements on the screen, such as font size and line spacing.

[0709] "Reminder" is a function that notifies the user periodically and encourages them to take a specific action.

[0710] An "interactive game" is a type of game in which reactions and changes occur depending on the user's operations and actions.

[0711] The "timer function" is a function that counts down a set time and notifies you when that time has elapsed.

[0712] "Eye protection mode" is a function that adjusts the screen's color temperature and blue light to provide a display that is gentle on the eyes in order to reduce strain on the user's eyesight.

[0713] "Layout optimization" is a function that adjusts the layout and size of display elements on the screen according to the user's eyesight condition, improving visibility.

[0714] This invention relates to an application for digital devices to prevent vision loss, and provides the following functions:

[0715] Eye Comfort Mode

[0716] When the app is launched, the device obtains the current time from the system clock. This time information is sent to the server. The server analyzes the time information and generates appropriate filter parameters (such as color temperature and blue light filter strength). These parameters are sent to the device, which then adjusts the screen's color temperature. This allows for an eye-friendly environment for specific times of the day. For example, at night, the screen's color temperature can be set to warmer colors to reduce blue light.

[0717] Layout optimization

[0718] Users take a visual acuity test using the app's visual acuity test function and enter the results into their device. The device then sends this visual acuity data to the server. The server analyzes the visual acuity data and generates layout parameters (such as font size and line spacing) that are optimal for the user. These parameters are then sent to the device, which then dynamically adjusts the display elements on the screen. This allows users to use the app with an optimal layout based on their visual acuity. For example, users with poor eyesight can be provided with a larger font size and wider line spacing.

[0719] Reminder function

[0720] When the app is launched, the device reads the reminder settings and starts an internal timer. After a set period of time has elapsed, the device displays a notification encouraging the user to take a break. This notification allows the user to temporarily stop using the app and rest their eyes. For example, a notification saying "Take a break!" is displayed every 60 minutes.

[0721] eye exercises

[0722] The device periodically displays notifications suggesting eye exercises to the user. Once the user starts the exercise, the device offers an interactive game in which the user is required to follow an on-screen character with their eyes, which exercises the eye muscles and protects eyesight. For example, a game in which the user follows a randomly moving character with their eyes is provided.

[0723] App Timer

[0724] Users can set the time limit for app usage, and the device will then start a timer to count down the set time. When the set time has elapsed, the device will display a notification that usage time has ended, encouraging the user to take a break. This function helps prevent eye strain caused by using apps for long periods of time. For example, if you set the usage time to one hour, a notification will appear saying, "Usage time is over. Take a break!" when the time has elapsed.

[0725] These functions are executed on iOS devices (e.g., iPhone, iPad), and exchange data via Firebase and REST API, adjust color temperature using iOS's "Night Shift" function, link databases using Firebase, and use iOS's "Local Notification" function for notifications. The eye exercise game is implemented using Unity.

[0726] Prompt Sentence Examples

[0727] Please describe in natural language the process of the following system: This system is a vision prevention application for children, and includes features such as a vision protection mode, layout optimization, reminders, eye exercises, and an app timer. Please specify the specific hardware and software used.

[0728] By combining the above treatments, it is possible to effectively prevent children's eyesight from declining and achieve comprehensive vision protection.

[0729] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0730] Eye Comfort Mode

[0731] Step 1:

[0732] The device gets the current time.

[0733] Input: Time information from the system clock

[0734] Specific behavior: Gets the current time using the iOS Date() class.

[0735] Output: Current time (e.g. 21:00)

[0736] Step 2:

[0737] The terminal transmits the time information to the server.

[0738] Input: Current time (e.g. 21:00)

[0739] Specific operation: The device sends time information to the server using an HTTP request. Use a cloud service such as Firebase.

[0740] Output: The time information is sent to the server.

[0741] Step 3:

[0742] The server generates the filter parameters and sends them to the terminal.

[0743] Input: Time information sent from the device (e.g. 21:00)

[0744] Specific operation: Based on the time information received by the server, the appropriate filter parameters (e.g., color temperature 3500K) are calculated.

[0745] Output: Filter parameters (e.g. color temperature 3500K)

[0746] Step 4:

[0747] The device adjusts the screen color temperature based on the filter parameters.

[0748] Input: Filter parameters received from the server (e.g. color temperature 3500K)

[0749] What it does: The device uses iOS's Night Shift feature to adjust the screen's color temperature.

[0750] Output: Calibrated screen color temperature (e.g. 3500K)

[0751] Layout optimization

[0752] Step 1:

[0753] The user takes a vision test and enters the results.

[0754] Input: User's visual acuity test result (e.g., visual acuity 0.5)

[0755] What it does: Use the in-app vision test feature and enter your vision results into the input form.

[0756] Output: Input visual acuity information (e.g., visual acuity 0.5)

[0757] Step 2:

[0758] The device transmits the visual acuity data to the server.

[0759] Input: Visual acuity information entered by the user (e.g., visual acuity 0.5)

[0760] Specific operation: The device sends visual acuity data to the server using an HTTP request, using a cloud service such as Firebase.

[0761] Output: Visual acuity data is sent to the server.

[0762] Step 3:

[0763] The server analyzes the visual acuity data and generates layout parameters.

[0764] Input: Visual acuity data received by the server (e.g., visual acuity 0.5)

[0765] Specific operation: The server analyzes the visual acuity data and generates optimal layout parameters (e.g., font size 20pt, line spacing 1.5x).

[0766] Output: Layout parameters (e.g. font size 20pt, line spacing 1.5x)

[0767] Step 4:

[0768] The device adjusts the screen based on the layout parameters.

[0769] Input: Layout parameters received from the server (e.g. font size 20pt, line spacing 1.5x)

[0770] What it does: Dynamically change display elements within the app using layout parameters received by the device.

[0771] Output: Adjusted layout (e.g., font size 20pt, line spacing 1.5x)

[0772] Reminder function

[0773] Step 1:

[0774] Your device will load your reminder settings.

[0775] Input: Reminder time saved in app settings (e.g. 60 minutes)

[0776] What happens: The device reads the reminder settings from the app settings.

[0777] Output: Reminder time loaded (e.g. 60 minutes)

[0778] Step 2:

[0779] The terminal starts a timer.

[0780] Input: Reminder time (e.g. 60 minutes)

[0781] Specific behavior: The device starts an internal timer based on the specified reminder time. This uses the iOS timer function.

[0782] Output: A timer that starts the countdown.

[0783] Step 3:

[0784] After a certain time has passed, the device will display a notification.

[0785] Input: Reminder time has elapsed (e.g. 60 minutes have elapsed)

[0786] What it does: After the set time has elapsed, the device displays a notification encouraging the user to take a break. This uses iOS's local notifications feature.

[0787] Output: Notification to encourage a break (e.g., "Rest your eyes!")

[0788] eye exercises

[0789] Step 1:

[0790] Your device will display a notification with exercise suggestions.

[0791] Input: Exercise time interval (e.g. every 30 minutes)

[0792] What happens: Your device displays exercise suggestion notifications using iOS's local notifications feature.

[0793] Output: Exercise suggestion notification (e.g. "Let's do some eye exercises!")

[0794] Step 2:

[0795] The user responds to the notification and begins the exercise.

[0796] Enter: Exercise suggestion notification

[0797] Specific action: The user responds to the notification and taps the button to start the exercise.

[0798] Output: Instruction to start exercise

[0799] Step 3:

[0800] The device provides interactive games.

[0801] Input: Start exercise command

[0802] What it does: The device launches an eye exercise game implemented in Unity, which asks the user to follow an on-screen character with their eyes.

[0803] Output: Start of interactive game

[0804] App Timer

[0805] Step 1:

[0806] The user sets the time for using the app.

[0807] Input: Usage time set by the user (e.g. 60 minutes)

[0808] Specific operation: The user enters and sets the usage time on the app's settings screen.

[0809] Output: Set usage time (e.g. 60 minutes)

[0810] Step 2:

[0811] The terminal starts a timer.

[0812] Input: Set usage time (e.g. 60 minutes)

[0813] What it does: The device starts a countdown timer based on the specified usage time. It uses the iOS timer function.

[0814] Output: A timer that starts the countdown.

[0815] Step 3:

[0816] After the set time has elapsed, the device will display a notification that usage time has ended.

[0817] Input: Set time has elapsed (e.g. 60 minutes have elapsed)

[0818] Specific behavior: After the set time has elapsed, the device displays a notification that the usage time has ended, encouraging the user to take a break. This uses iOS's local notification feature.

[0819] Output: Screen time end notification (e.g. "Screen time is over. Rest your eyes!")

[0820] Through the above processing steps, the system effectively prevents children's eyesight from declining and achieves comprehensive vision protection.

[0821] (Application example 1)

[0822] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0823] Today's children often use digital devices for long periods of time, which can lead to problems such as vision loss and eye strain. Furthermore, parents have limited means to effectively manage their children's device usage time and protect their eyesight. This has led to a need for effective methods to prevent vision loss. There is also a growing need for technology that dynamically adjusts screen display based on visual status.

[0824] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0825] In this invention, the server includes means for providing a vision protection mode, means for optimizing the layout, means for providing a reminder function for taking breaks at regular intervals, means for providing exercises to promote eye movement, means for providing a timer function for limiting app usage time, means for dynamically adjusting the screen color temperature based on the user's visual condition and time information, and means for acquiring filter parameters and layout parameters from the server and dynamically optimizing the screen display based on the parameters. This effectively prevents children's eyesight from deteriorating and provides an appropriate vision protection environment. It also makes it easier for parents to manage their children's device usage time and vision protection.

[0826] "Eye Protection Mode" is a function that dynamically adjusts the screen's color temperature and blue light to protect the user's eyesight.

[0827] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing on the screen based on the user's eyesight condition.

[0828] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break.

[0829] "Eye Exercises" is a feature that suggests visual exercises to users and encourages them to move their eye muscles.

[0830] The "timer function" is a function that allows you to set the amount of time you can use the app and displays a notification to the user when the set time has elapsed.

[0831] "Filter parameters" are setting information for color temperature and blue light reduction obtained from the server.

[0832] "Layout parameters" are layout setting information such as font size and line spacing obtained from the server.

[0833] A "server" is a device on a network that generates and provides filter parameters and layout parameters.

[0834] "Means for dynamically adjusting the color temperature of the screen" is a technology that appropriately changes the color temperature of the screen based on time information and the user's visual state.

[0835] "Means for dynamically optimizing screen display" refers to technology that optimizes the screen layout and display content in real time based on parameters obtained from the server.

[0836] The following describes the mode for implementing the present invention. The system of the present invention combines a vision protection mode, layout optimization, a reminder function, exercises to promote eye movement, and a timer function to limit the time spent using apps. The main functions of the present invention and specific implementation methods thereof are described below.

[0837] Eye Comfort Mode

[0838] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[0839] Layout optimization

[0840] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[0841] Reminder function

[0842] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[0843] eye exercises

[0844] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[0845] App Timer

[0846] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[0847] Server-side processing

[0848] The server generates filter and layout parameters using the time information and vision test results sent from the device. This processing is performed using specific software on the server (e.g., Python, Amazon Web Services (AWS), etc.). The generated parameters are sent to the device and used to adjust the display on the device.

[0849] Specific examples and input examples to generative AI models

[0850] For example, if you install this application on a smartphone used by a third-grader, when it is used at 8 p.m., the app will automatically apply a blue light filter and change the screen to warmer colors. Based on the results of a vision test, it will also increase the font size and increase the line spacing. Every 60 minutes, the app will send a message saying, "Take a rest!"

[0851] Example prompt for input to a generative AI model:

[0852] Generate code for a smartphone app that automatically applies a blue light blocking color temperature filter based on the current time and displays a reminder to take a break from eye contact at regular intervals. Dynamically adjust font size and optimize line spacing based on the results of a visual acuity test. Also, add a feature that suggests eye exercises to users through an exercise function.

[0853] As described above, this invention is a system that integrates major functions to prevent deterioration of children's eyesight and provide an appropriate eyesight protection environment.

[0854] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0855] Step 1:

[0856] When the device launches the app, it gets the current time. The input is the system time of the user device, and the output is the current time data. This time data is used in the next step.

[0857] Step 2:

[0858] The terminal sends the acquired time data to the server. The input is the time data acquired in step 1, and the output is the request sent to the server.

[0859] Step 3:

[0860] The server generates filter parameters based on the time data received. The input is the time data sent from the device, and the data is processed to calculate the appropriate color temperature and blue light reduction parameters for the time of day. The output is the generated filter parameters.

[0861] Step 4:

[0862] The server sends the generated filter parameters to the terminal. The input is the filter parameters, and the output is the data to be sent to the terminal.

[0863] Step 5:

[0864] The terminal adjusts the color temperature of the screen based on the filter parameters received. The input is the filter parameters received from the server, and the screen settings are changed as data processing. The output is the adjusted screen display.

[0865] Step 6:

[0866] The user takes a vision test and inputs the results into the terminal. The input is the vision test result data entered by the user, and the output is the data stored in the terminal.

[0867] Step 7:

[0868] The terminal sends the vision test result data to the server. The input is the vision test result data, and the output is sending a request to the server.

[0869] Step 8:

[0870] The server generates layout parameters based on the vision test results received. The input is the vision test result data sent from the terminal, and the optimal font size and line spacing are calculated as data processing. The output is the generated layout parameters.

[0871] Step 9:

[0872] The server sends the generated layout parameters to the terminal. The input is the layout parameters, and the output is the data to be sent to the terminal.

[0873] Step 10:

[0874] Based on the layout parameters received by the device, each element on the screen is dynamically adjusted. The input is the layout parameters received from the server, and the screen layout is changed as data processing. The output is a screen display that has been adjusted to be easy to see.

[0875] Step 11:

[0876] When the device launches the app, it reads the reminder settings and starts the timer. The input is the reminder setting data in the device, and the output is the start of the reminder timer.

[0877] Step 12:

[0878] After a certain time has passed, the device displays a notification to the user to encourage them to take a break. The input is the status data of the reminder timer, and the output is the notification display to the user.

[0879] Step 13:

[0880] The device periodically displays a notification to the user suggesting eye exercises. The input is the exercise notification setting data, and the output is the notification display to the user.

[0881] Step 14:

[0882] When the user starts exercising, the device provides an interactive game, prompting the user to follow an on-screen character. The input is the user's operation to start exercising, and the output is the start of the exercise game.

[0883] Step 15:

[0884] After the user sets the app usage time, the device starts a timer to count down that time. The input is the usage time data set by the user, and the output is the start of the usage timer.

[0885] Step 16:

[0886] When the set time has elapsed, the device displays a notification to the user that usage has ended and restricts app use. The input is the timer countdown status data, and the output is a notification to the user that usage has ended.

[0887] The above is a detailed description of the processing steps of the system program for realizing the application example.

[0888] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0889] This invention relates to an application for preventing vision loss for children, and is characterized by combining a vision protection mode, layout optimization, reminder function, eye exercise exercises, and an app timer with an emotion engine.

[0890] Introducing the Emotion Engine

[0891] The emotion engine recognizes the user's emotions using cameras and sensors and adjusts the operation of each function based on the user's emotional state, thereby providing a more personalized user experience.

[0892] Eye Comfort Mode

[0893] When the app is launched, the device uses the camera to capture the user's face, and the emotion engine analyzes the image to determine the user's emotion. The device also obtains the current time and sends this information to the server. The server generates optimal filter parameters (color temperature and blue light reduction level) based on the time information and the user's emotion data and sends them to the device. For example, if it is nighttime and the server determines that the user is tired, it will apply settings that adopt a warmer color temperature and more strongly reduce blue light. This allows the user to use the app in a lighting environment that is gentle on the eyes.

[0894] Layout optimization

[0895] After the user takes the vision test, they enter the results into their device. The device then sends the vision test results, along with the user's emotional data captured by the camera, to the server. The server analyzes this data and determines the optimal font size and line spacing. For example, if the server determines that the user has poor eyesight and is unable to concentrate, it will send settings to the device to make the font size larger than usual and increase the line spacing. This allows the user to use the app with an optimized layout.

[0896] Reminder function

[0897] When the app is launched, the device reads the reminder settings and uses the camera to recognize the user's emotions. The timing of the reminder is not only based on a pre-set time interval, but is also adjusted taking into account the user's emotional state. For example, if the device determines that the user is concentrating on their work, it can delay the reminder notification a little. When the time comes, the device will display a notification encouraging the user to take a break.

[0898] eye exercises

[0899] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification is displayed, the camera is used to assess the user's emotional state. If the user's emotions are judged to be, for example, enjoyment or relaxation, the exercise continues. Conversely, if the user is judged to be feeling stressed, the exercise content is changed to a more relaxing one. This allows the user to enjoy eye exercise.

[0900] App Timer

[0901] After the user sets the app usage time, the device not only counts down the set time but also continuously monitors the user's emotions using the camera. When the time has elapsed, the device will display a notification to encourage the user to quit using the app. If the emotion engine determines that the user is already tired, the device can notify the user earlier than the scheduled time. This allows the user to quit the app at the appropriate time and rest their eyes.

[0902] In this way, by combining the emotion engine with the vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer, the system can make fine adjustments according to the user's emotional state, more effectively preventing the deterioration of children's eyesight.

[0903] The processing flow will be explained below.

[0904] Eye protection mode processing steps using emotion engine

[0905] Step 1:

[0906] The device launches the app, first launching the camera to capture the user's face, and then getting the current time from the system clock.

[0907] Step 2:

[0908] The device sends the captured face image and the acquired time information to the server using an API request.

[0909] Step 3:

[0910] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as recognizing emotions like "tired" or "concentrated."

[0911] Step 4:

[0912] The server generates optimal filter parameters based on time information and the user's emotional data. If it is nighttime and the user is judged to be "tired," the server will set the color temperature to warmer colors and increase blue light reduction.

[0913] Step 5:

[0914] The server sends the generated filter parameters to the device and returns them in the API response.

[0915] Step 6:

[0916] The device receives the filter parameters and adjusts the screen's color temperature and blue light level, changing the screen settings to provide the user with the optimal lighting environment.

[0917] Step 7:

[0918] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[0919] Processing steps for layout optimization using emotion engine

[0920] Step 1:

[0921] Users take a visual acuity test within the app and enter the results into their device. The visual acuity test is carried out using a dedicated tool.

[0922] Step 2:

[0923] The device sends the results of the eye test and a facial image captured by the camera to the server, sending this data via an API request.

[0924] Step 3:

[0925] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as "tired" or "unhappy."

[0926] Step 4:

[0927] The server generates optimal layout parameters (such as font size and line spacing) based on the results of the vision test and emotional data. If the user's vision is poor and the user is judged to be "tired," the server will increase the font size and widen the line spacing.

[0928] Step 5:

[0929] The server sends the generated layout parameters to the device and returns the parameters in the API response.

[0930] Step 6:

[0931] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, optimizing the content displayed to the user.

[0932] Step 7:

[0933] Users can use the app with an optimized layout, with font size and line spacing settings that suit their eyesight and emotions.

[0934] Processing steps of the reminder function incorporating an emotion engine

[0935] Step 1:

[0936] When the device launches the app, it reads the reminder settings and activates the camera to capture the user's face.

[0937] Step 2:

[0938] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[0939] Step 3:

[0940] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "concentrated" or "relaxed."

[0941] Step 4:

[0942] The device adjusts the timing of reminders based on emotion data, delaying reminder notifications if the user is deemed to be "concentrated."

[0943] Step 5:

[0944] The device will display a notification to the user at the set time to encourage them to take a break. A pop-up message will appear saying "Rest your eyes!"

[0945] Step 6:

[0946] Users receive a notification to temporarily stop using the app and rest their eyes.

[0947] Processing steps of eye movement exercise using emotion engine

[0948] Step 1:

[0949] The device periodically displays eye exercise notifications to the user and activates the camera to capture the user's face.

[0950] Step 2:

[0951] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[0952] Step 3:

[0953] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as whether they are having fun or feeling stressed.

[0954] Step 4:

[0955] The device adjusts the exercise content based on the user's emotions. If the device determines that the user is "stressed," it changes the exercise to a more relaxing one.

[0956] Step 5:

[0957] The user starts an eye exercise. The user selects an in-app game mode.

[0958] Step 6:

[0959] The device provides an interactive character tracking game. The game starts with the characters moving randomly on the screen.

[0960] Step 7:

[0961] The user follows the character with their eyes and completes the exercise. By continuing to follow the character with their eyes, they exercise their eye muscles.

[0962] Step 8:

[0963] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[0964] Processing steps for app timers using emotion engines

[0965] Step 1:

[0966] The user sets the app usage time by entering the desired usage time on the settings screen within the app.

[0967] Step 2:

[0968] The device starts a timer to count down the set usage time, and activates the camera to monitor the user's face.

[0969] Step 3:

[0970] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[0971] Step 4:

[0972] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "tired" or "concentrated."

[0973] Step 5:

[0974] The device continuously monitors emotional data during use and adjusts timer settings as needed. For example, if the device detects that the user is already tired, it will notify the user to end the timer earlier than scheduled.

[0975] Step 6:

[0976] The device displays a notification to the user that their screen time is over based on a set time or emotional state. It displays the message "Your screen time is over. Rest your eyes!"

[0977] Step 7:

[0978] The user checks the notification, ends the app, and takes a break.

[0979] Step 8:

[0980] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[0981] The above are the specific processing steps for each function of the eyesight prevention system that combines the emotion engine. This allows for fine-tuned adjustments based on the user's emotional state, making it possible to more effectively prevent vision loss in children.

[0982] Example 2

[0983] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0984] Conventional vision loss prevention systems have not been finely adjusted to suit the user's condition, making it difficult to effectively prevent vision loss. In particular, because settings are applied uniformly based on certain environments and conditions, there is a problem in that it is not possible to provide optimal support according to the individual state and emotions of each user.

[0985] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing a eyesight protection mode, a means for optimizing a layout, a means having a reminder function for prompting a break at regular intervals, a means for providing exercises to promote eye movement, a means having a timer function for limiting the usage time of an application, and a means for adjusting the operation of each means based on the emotional state of the user using an emotion recognition engine. This allows each function to be optimized based on the emotional state of the user and the results of a vision test, enabling more effective prevention of vision loss.

[0986] "Eye protection mode" is a function that adjusts the screen color temperature and blue light reduction level to protect the user's eyesight.

[0987] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing of displayed text based on the user's vision test results and emotional state.

[0988] The "reminder function" is a function that displays a notification to encourage users to take a break after a certain amount of time has passed.

[0989] "Eye Exercises" is a feature that encourages users to do specific eye exercises to maintain eye health.

[0990] The "timer function" monitors the application usage time and notifies the user when the set time has elapsed.

[0991] An "emotion recognition engine" is a system that uses cameras and sensors to capture the user's face and determine the user's emotional state through image analysis.

[0992] "Filter parameters" are settings that are adjusted to protect eyesight, such as the screen's color temperature and blue light reduction level.

[0993] "Font size" refers to the size of the characters displayed and is adjusted according to the user's eyesight.

[0994] "Line spacing" refers to the vertical space between displayed text and is adjusted according to the user's visual acuity and emotional state.

[0995] This invention is an application system for preventing vision loss, which uses an emotion recognition engine to adjust the operation of various functions based on the user's emotional state, providing a personalized user experience. Specifically, it is equipped with a vision protection mode, layout optimization, reminder function, eye exercises, and a timer function to manage application usage time.

[0996] Introducing an emotion recognition engine

[0997] The emotion recognition engine is a system that uses the camera and sensors built into smartphones and tablet devices to capture the user's face and determine their emotional state through image analysis. This enables the following functions:

[0998] Eye Comfort Mode

[0999] When the app is launched, the device uses the camera to capture the user's face, and the emotion recognition engine analyzes the image to determine the user's emotions. This includes analyzing facial expressions. For example, if the face is determined to look tired, the color temperature is set to 2500K and the blue light reduction level is increased. The device obtains the current time and sends this information to the server. The server then generates optimal filter parameters based on the time information and the user's emotion data and sends them to the device, thereby protecting the user's eyesight.

[1000] Layout optimization

[1001] After the user takes the vision test, they enter the results into the device. The device also uses its camera to capture emotional data and sends this information to the server. The server analyzes the vision test results and emotional data and optimizes font size and line spacing. For example, if it determines that the user has poor eyesight and is unable to concentrate, it will increase the font size and increase the line spacing by sending settings to the device to improve visibility.

[1002] Reminder function

[1003] When the app launches, the device reads the reminder settings and simultaneously uses the camera to recognize the user's emotions. The app adjusts reminder notifications based not only on the set interval, but also on the user's emotional state. For example, if the app determines that the user is concentrating on a task, it can delay the notification. When the time comes, the device will display a notification to the user saying, "Please take a break."

[1004] eye exercises

[1005] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification appears, the device uses the camera to assess the user's emotional state. If the device determines that the user is enjoying or relaxed during the exercise, it continues the exercise. Conversely, if the device determines that the user is feeling stressed, it changes the exercise to make it more relaxing.

[1006] Application Timer

[1007] After the user sets the application usage time, the device counts down the set time. It also continuously monitors the user's emotions using the camera. When the time expires, the device displays a notification to encourage the user to stop using the app. If the emotion recognition engine determines that the user is already tired, the device can send the notification earlier than the scheduled time.

[1008] (Example)

[1009] Example of the emotion recognition engine in action:

[1010] Prompt: "How can I set it to reduce blue light when the user is fatigued?"

[1011] Hardware used: Smartphone camera, server

[1012] Software used: Emotion recognition AI, blue light filter

[1013] Data processing and calculation: Emotion recognition, filter parameter generation, data transmission, setting application

[1014] The system utilizes an emotion recognition engine to optimize various functions, such as eye protection mode, layout optimization, reminder function, and eye exercise exercises, to effectively prevent users' eyesight from deteriorating.

[1015] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1016] Eye Comfort Mode

[1017] Step 1:

[1018] When the app is launched, the device uses the camera to capture the user's face.

[1019] Input: App launch event

[1020] Output: User's face image

[1021] How it works: When the app is launched, the device's built-in camera automatically activates and takes a picture of the user's face.

[1022] Step 2:

[1023] The device passes the facial image to an emotion recognition engine for emotion recognition.

[1024] Input: User's face image

[1025] Output: User's emotional state (tired, relaxed, etc.)

[1026] How it works: An analytics algorithm analyzes images and identifies emotional states from facial expressions.

[1027] Step 3:

[1028] The device uses the system clock to obtain the current time.

[1029] Input: None

[1030] Output: current time

[1031] Action: The internal clock returns the current time.

[1032] Step 4:

[1033] The device sends emotion data and the current time to the server.

[1034] Input: Emotion data, current time

[1035] Output: Send data package to server

[1036] How it works: Emotion data and time are packaged together and sent to the server using the communication module.

[1037] Step 5:

[1038] The server receives the data and generates optimal filter parameters.

[1039] Input: Emotion data, current time

[1040] Output: Optimal filter parameters (color temperature, blue light reduction level)

[1041] How it works: An algorithm calculates the response and generates filter parameters based on the data. For example, if it detects you are "tired" at night, it will lower the color temperature and cut blue light.

[1042] Step 6:

[1043] The server sends the generated filter parameters to the terminal.

[1044] Input: Optimal filter parameters

[1045] Output: Data sent to the terminal

[1046] What it does: Packages parameters and sends them to the device.

[1047] Step 7:

[1048] The terminal applies the received filter parameters.

[1049] Input: Optimal filter parameters

[1050] Output: Adjusted display settings

[1051] What it does: Updates display settings to adjust color temperature and blue light reduction levels.

[1052] Layout optimization

[1053] Step 1:

[1054] The user performs a vision test.

[1055] Input: Start vision test

[1056] Output: Vision test result data

[1057] What it does: The app presents the user with a vision test and collects the results.

[1058] Step 2:

[1059] The user inputs the results of the vision test into the terminal.

[1060] Input: Eye test results

[1061] Output: Data input to the terminal

[1062] Action: Enter the test results into the app's input form.

[1063] Step 3:

[1064] The device uses a camera to capture emotion data.

[1065] Input: Facial image (during vision test)

[1066] Output: Emotion data

[1067] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[1068] Step 4:

[1069] The device sends the vision test results and emotion data to the server.

[1070] Input: Eye test results, emotion data

[1071] Output: Data sent to the server

[1072] What it does: Packages the data and sends it to the server.

[1073] Step 5:

[1074] The server receives the data and determines the optimal font size and line spacing.

[1075] Input: Eye test results, emotion data

[1076] Output: Optimal font size and line spacing

[1077] How it works: A data-driven analytical algorithm calculates the optimal value. For example, if your visual acuity is 0.6 and your concentration is declining, increase the font size and increase the line spacing.

[1078] Step 6:

[1079] The server sends the determined settings to the terminal.

[1080] Input: Optimal font size and line spacing

[1081] Output: Data sent to the terminal

[1082] What it does: Packages configuration data and sends it to the device.

[1083] Step 7:

[1084] The device applies the received settings.

[1085] Input: Optimal font size and line spacing

[1086] Output: Updated layout

[1087] Behavior: Updates the app's display settings to provide the optimal layout for the user.

[1088] Reminder function

[1089] Step 1:

[1090] The device loads the reminder settings when the app is launched.

[1091] Input: App launch event

[1092] Output: Reminder setting data

[1093] What it does: Reads reminder settings (e.g., take a break every 30 minutes) from the app configuration file.

[1094] Step 2:

[1095] The device uses a camera to capture emotion data.

[1096] Input: Face image

[1097] Output: Emotion data

[1098] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[1099] Step 3:

[1100] The device calculates the reminder timing.

[1101] Input: Reminder settings, emotion data

[1102] Output: Adjusted reminder timing

[1103] How it works: Optimizes timing based on your settings and emotional data, for example delaying notifications by 10 minutes if you're distracted.

[1104] Step 4:

[1105] The device will display a notification prompting you to take a break at the specified time.

[1106] Input: Reminder timing

[1107] Output: Notification display

[1108] What it does: Pops up a notification saying "Take a break" at the specified time.

[1109] (Examples and prompts)

[1110] Prompt: "How can I set reminder notifications to be delayed when the user is distracted?"

[1111] Hardware used: Smartphone camera, server

[1112] Software used: Emotion recognition AI, notification system

[1113] Data processing and calculation: Emotion recognition, reminder timing calculation, notification display

[1114] By clearly indicating the specific data input, output, and operation for each step, the processing flow of each function of this system to prevent vision loss becomes clear.

[1115] (Application example 2)

[1116] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1117] In today's digital environment, there are concerns that children's long hours of use of digital devices such as smartphones and tablets may lead to a decline in their eyesight. Furthermore, there are a lack of measures to limit usage time and encourage appropriate breaks, and no consideration is given to entertainment elements that children can enjoy without getting bored. The present invention aims to solve these problems by providing a system that prevents children's eyesight from declining and allows them to use digital devices in a fun and healthy way.

[1118] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a eyesight protection mode, means for optimizing the layout, means for having a reminder function for encouraging breaks at regular intervals, means for providing exercises to promote eye movement, means for having a timer function for limiting the amount of time spent using apps, and emotion engine means for recognizing the user's emotions using a camera or sensor and adjusting the operation of each function based on the user's emotional state. This makes it possible for children to enjoy using digital devices while effectively protecting their eyesight and encouraging them to take breaks at appropriate times.

[1119] "Eye protection mode" is a function that protects the user's eyesight by changing the screen settings of digital devices to reduce blue light and adjust color temperature.

[1120] "Layout optimization" means automatically adjusting font size and line spacing based on the user's visual acuity test results and emotional state to provide the most legible screen layout for the user.

[1121] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break, and adjusts the timing based on the user's emotional state to encourage appropriate breaks.

[1122] "Eye Exercises" is a feature that instructs users on eye-resting exercises and workouts, adjusting them based on their emotional state.

[1123] The "timer function" is a function that allows you to set the amount of time you use a digital device, and when that time has elapsed, a notification will be displayed to end the use.

[1124] The "emotion engine" uses cameras and sensors to recognize the user's emotions and adjusts the operation of each function of the system based on that emotional state.

[1125] This invention is a system that uses cameras and sensors to recognize a child's emotional state and adjusts functions such as vision protection, layout optimization, reminders, eye exercises, and app timers based on that information. Specific embodiments of this system are shown below.

[1126] System configuration

[1127] The system consists of digital devices such as smartphones and tablets, and a server that processes and analyzes data. The main hardware and software components are as follows:

[1128] 1. Hardware:

[1129] Device: A smartphone or tablet with a camera and sensors.

[1130] Server: A server for analyzing data and configuring applications.

[1131] 2. Software:

[1132] Emotion recognition algorithm: Uses OpenCV, DeepFace, etc.

[1133] Data transmission and reception API: An API for transmitting and receiving data between a terminal and a server.

[1134] Eye protection settings engine: Reduces blue light and adjusts color temperature.

[1135] UI / UX optimization engine: Adjust font size and line spacing.

[1136] Timer function: A timer to manage app usage time.

[1137] Entertainment module: Offers mini-games and eye exercises.

[1138] System Operation

[1139] 1. Emotion recognition: The device uses the camera to capture the child's face and recognizes their emotional state in real time through an emotion recognition algorithm.

[1140] 2. Eye Care Mode: The device sends time and emotion data to the server, which then generates optimal filter parameters and sends them to the device. When it is nighttime or when you are tired, the blue light reduction level is set high.

[1141] 3. Layout optimization: The device sends the vision test results and emotion data to the server, which analyzes the data and sends layout settings to the device that optimize font size and line spacing.

[1142] 4. Reminder function: The device will display reminder notifications to the user and adjust the timing of notifications depending on the user's emotional state. If the user is concentrating, the device will delay the reminder to encourage them to take a break.

[1143] 5. Eye Exercises: Regularly remind you to exercise and change the content depending on your emotional state. If you are enjoying it, continue, if you are stressed, shift to something more relaxing.

[1144] 6. App Timer: Your device will count down your set usage time and notify you based on your emotional state, encouraging you to stop using the app earlier if you feel tired.

[1145] Example

[1146] This system can be used in brick-and-mortar stores such as bookstores and cafes where children are using smartphones or tablets, providing both vision protection and entertainment.

[1147] Prompt Sentence Examples

[1148] "Based on the current time and a camera image of the user's face, recognize the child's emotional state and set the eye protection mode accordingly, changing the color temperature of the smartphone to a warmer tone and reducing blue light. Also, incorporate the user's eye test results to create settings that optimize the font size of the UI."

[1149] The invention can be carried out in the above manner.

[1150] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1151] Step 1:

[1152] The device uses a camera to capture the user's face and detects emotions in real time using emotion recognition algorithms (e.g., OpenCV or DeepFace).

[1153] Input: Camera image

[1154] Data processing: Face recognition and emotion classification using image processing algorithms

[1155] Output: User's emotional state data (e.g., happy, sad, angry, surprised, etc.)

[1156] Step 2:

[1157] The device transmits the current time and emotional state data to the server.

[1158] Input: time data, emotional state data

[1159] Data Calculation: Format Conversion of Time Series Data and Packaging of Emotion Data

[1160] Output: Request to send time information and emotional state data

[1161] Step 3:

[1162] The server analyzes the received time information and emotional state data to determine the optimal filter parameters for the eyesight protection mode (e.g., color temperature, blue light reduction level).

[1163] Input: time information, emotional state data

[1164] Data calculation: Filter parameter determination using a rule-based algorithm

[1165] Output: Filter parameters (e.g. color temperature setting, blue light reduction level)

[1166] Step 4:

[1167] The server sends the generated filter parameters to the terminal, which then adjusts its screen settings accordingly.

[1168] Input: Filter parameters

[1169] Data processing: Changing the device display settings

[1170] Output: Adjusted screen settings (e.g. warmer color temperature, reduced blue light)

[1171] Step 5:

[1172] The device inputs the vision test data (font size and line spacing settings) and sends it to the server.

[1173] Input: Vision test data

[1174] Data Computing: Standardization and Packaging of Vision Test Results

[1175] Output: Request to send vision test data

[1176] Step 6:

[1177] The server analyzes the visual acuity test data and emotional state data to determine the optimal UI layout (font size and line spacing).

[1178] Input: visual acuity test data, emotional state data

[1179] Data Computing: Applying Statistical Analysis and Heuristic Algorithms

[1180] Output: Optimized UI layout settings

[1181] Step 7:

[1182] The server sends the generated UI layout settings to the terminal, and the terminal adjusts the screen layout based on them.

[1183] Input: UI layout settings

[1184] Data manipulation: Positioning and resizing UI elements

[1185] Output: Adjusted UI layout

[1186] Step 8:

[1187] Your device will read your reminder settings and adjust reminder timing based on your emotional state.

[1188] Input: Emotional state data, reminder settings

[1189] Data calculation: timing adjustment algorithm

[1190] Output: Reminder notification

[1191] Step 9:

[1192] The device monitors the user's emotional state, periodically presents eye movement exercises, and changes the content according to the emotional state.

[1193] Input: Emotional state data

[1194] Data calculation: Selection and adjustment of exercise content

[1195] Output: Exercise notification, content change

[1196] Step 10:

[1197] The device counts down the set usage time, monitors the user's emotional state, and notifies the user to stop using the device at the appropriate time.

[1198] Input: Usage time settings, emotional state data

[1199] Data Computation: Countdown Timer and Emotion Data Analysis

[1200] Output: Termination of use notification

[1201] Through these steps, the user can utilize a system that provides vision protection and entertainment.

[1202] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1203] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1204] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1205] [Third embodiment]

[1206] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1207] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1208] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1209] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1210] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1211] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1212] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1213] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1214] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1215] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1216] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1217] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1218] This invention relates to a vision protection application for children, which includes features such as a vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer.

[1219] Eye Comfort Mode

[1220] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[1221] Layout optimization

[1222] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[1223] Reminder function

[1224] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[1225] eye exercise exercises

[1226] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[1227] App Timer

[1228] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[1229] In this way, the combination of vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer can effectively prevent children's eyesight from deteriorating. Furthermore, these functions work together to comprehensively protect the user's eye health.

[1230] The processing flow will be explained below.

[1231] Eye comfort mode processing steps

[1232] Step 1:

[1233] When the device launches the app, it obtains the current time from the system clock to prepare for determining whether it is daytime or nighttime.

[1234] Step 2:

[1235] The device sends the acquired time information to the server. The current time data is sent to the server via an API request.

[1236] Step 3:

[1237] The server receives the time information and generates filter parameters for daytime or nighttime use. The time data is analyzed to determine the required blue light reduction level and color temperature adjustment.

[1238] Step 4:

[1239] The server sends the generated filter parameters to the device and returns them in the API response.

[1240] Step 5:

[1241] The device receives the filter parameters and adjusts the screen color temperature and blue light level, then changes the screen settings based on the received parameters to provide a lighting environment that is gentle on the eyes.

[1242] Step 6:

[1243] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[1244] Layout optimization processing steps

[1245] Step 1:

[1246] The user takes a vision test within the app and enters the test results into the device. The vision test results are then registered in the app.

[1247] Step 2:

[1248] The device sends the vision test results to the server. The test result data is sent to the server via an API request.

[1249] Step 3:

[1250] The server analyzes the results of the visual acuity test and generates optimal layout parameters (such as font size and line spacing). The data analysis determines the optimal display parameters for the user.

[1251] Step 4:

[1252] The server sends the generated layout parameters to the device and returns them in the API response.

[1253] Step 5:

[1254] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, changing the display content according to the generated parameters.

[1255] Step 6:

[1256] Users can use the app with an optimized layout, with font size and line spacing set according to their eyesight.

[1257] Reminder function processing steps

[1258] Step 1:

[1259] The device reads the reminder settings when the app starts. Reads the saved setting data.

[1260] Step 2:

[1261] Your device will start the timer for the reminder, which will begin counting down to the set reminder interval.

[1262] Step 3:

[1263] The device displays a notification to the user when the timer expires, encouraging them to take a break. It generates a pop-up notification with the message "Rest your eyes!"

[1264] Step 4:

[1265] Users receive a notification to temporarily stop using the app and rest their eyes.

[1266] Eye exercise processing steps

[1267] Step 1:

[1268] The device periodically displays eye exercise notifications to the user, encouraging them to "do some eye exercises!"

[1269] Step 2:

[1270] The user starts an eye exercise. The user selects an in-app game mode.

[1271] Step 3:

[1272] The device provides an interactive character tracking game, in which the on-screen characters start moving randomly.

[1273] Step 4:

[1274] The user completes the exercise by following the character with their eyes. By continuing to follow the character with their eyes, they exercise their eye muscles.

[1275] Step 5:

[1276] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[1277] App Timer Processing Steps

[1278] Step 1:

[1279] The user sets the usage time for the app. The user enters the desired usage time on the settings screen within the app.

[1280] Step 2:

[1281] The device starts a timer based on the set usage time. The device starts a countdown to the usage time limit.

[1282] Step 3:

[1283] When the device reaches the end of its usage time, it will notify the user by displaying a message saying, "Your usage time is over. Rest your eyes!"

[1284] Step 4:

[1285] The user checks the notification, ends the app, and takes a break.

[1286] Step 5:

[1287] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[1288] The above are the specific processing steps of each function of this vision loss prevention system, which can effectively protect children's eyes.

[1289] Example 1

[1290] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1291] Today's children often use digital devices for long periods of time, which can lead to serious problems such as vision loss and eye fatigue. Furthermore, a lack of proper screen adjustments based on the environment and timing of digital device use can further exacerbate vision loss. Even when vision protection systems exist, they often only offer limited functionality, such as eye protection modes and break reminders, making comprehensive vision protection difficult.

[1292] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1293] In this invention, the server includes means for providing a vision protection mode by acquiring current time information, transmitting it to the server, and receiving appropriate filter parameters, means for transmitting the user's vision test results to the server and receiving layout parameters based on the vision data to optimize the layout, means for providing a reminder function to encourage breaks at regular intervals, means for providing an interactive game that promotes eye exercise, and means for providing a timer function that counts down the usage time of an app set by the user and displays a notification when the usage time has expired. This not only provides the user with a screen environment that is gentle on the eyes in the vision protection mode, but also enables the display of an optimal layout based on the vision test results, and enables comprehensive vision protection through the regular break reminders and eye exercises.

[1294] "Current time information" refers to the actual date and time information obtained using the internal clock of a terminal or device.

[1295] A "server" is a computer system that performs processing in response to requests from terminals via a network.

[1296] "Filter parameters" are the numerical values ​​and settings used to adjust the screen's color temperature, blue light intensity, etc.

[1297] "Visual acuity test results" refers to specific visual acuity status and numerical information obtained when a user undergoes a visual acuity test.

[1298] "Layout parameters" are setting items related to the arrangement and style of display elements on the screen, such as font size and line spacing.

[1299] "Reminder" is a function that notifies the user periodically and encourages them to take a specific action.

[1300] An "interactive game" is a type of game in which reactions and changes occur depending on the user's operations and actions.

[1301] The "timer function" is a function that counts down a set time and notifies you when that time has elapsed.

[1302] "Eye protection mode" is a function that adjusts the screen's color temperature and blue light to provide a display that is gentle on the eyes in order to reduce strain on the user's eyesight.

[1303] "Layout optimization" is a function that adjusts the layout and size of display elements on the screen according to the user's eyesight condition, improving visibility.

[1304] This invention relates to an application for digital devices to prevent vision loss, and provides the following functions:

[1305] Eye Comfort Mode

[1306] When the app is launched, the device obtains the current time from the system clock. This time information is sent to the server. The server analyzes the time information and generates appropriate filter parameters (such as color temperature and blue light filter strength). These parameters are sent to the device, which then adjusts the screen's color temperature. This allows for an eye-friendly environment for specific times of the day. For example, at night, the screen's color temperature can be set to warmer colors to reduce blue light.

[1307] Layout optimization

[1308] Users take a visual acuity test using the app's visual acuity test function and enter the results into their device. The device then sends this visual acuity data to the server. The server analyzes the visual acuity data and generates layout parameters (such as font size and line spacing) that are optimal for the user. These parameters are then sent to the device, which then dynamically adjusts the display elements on the screen. This allows users to use the app with an optimal layout based on their visual acuity. For example, users with poor eyesight can be provided with a larger font size and wider line spacing.

[1309] Reminder function

[1310] When the app is launched, the device reads the reminder settings and starts an internal timer. After a set period of time has elapsed, the device displays a notification encouraging the user to take a break. This notification allows the user to temporarily stop using the app and rest their eyes. For example, a notification saying "Take a break!" is displayed every 60 minutes.

[1311] eye exercise exercises

[1312] The device periodically displays notifications suggesting eye exercises to the user. Once the user starts the exercise, the device offers an interactive game in which the user is required to follow an on-screen character with their eyes, which exercises the eye muscles and protects eyesight. For example, a game in which the user follows a randomly moving character with their eyes is provided.

[1313] App Timer

[1314] Users can set the usage time for an app, and the device will then start a timer to count down the set time. When the set time has elapsed, the device will display a notification that usage time has ended, encouraging the user to take a break. This function helps prevent eye strain caused by using an app for long periods of time. For example, if you set the usage time to one hour, a notification will appear saying, "Usage time is over. Take a break!" when the time has elapsed.

[1315] These functions are executed on iOS devices (e.g., iPhone, iPad), and exchange data via Firebase and REST API, adjust color temperature using iOS's "Night Shift" function, link databases using Firebase, and use iOS's "Local Notification" function for notifications. The eye exercise game is implemented using Unity.

[1316] Prompt Sentence Examples

[1317] Please describe in natural language the process of the following system: This system is a vision prevention application for children, and includes features such as a vision protection mode, layout optimization, reminders, eye exercises, and an app timer. Please specify the specific hardware and software used.

[1318] By combining the above treatments, it is possible to effectively prevent children's eyesight from declining and achieve comprehensive vision protection.

[1319] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1320] Eye Comfort Mode

[1321] Step 1:

[1322] The device gets the current time.

[1323] Input: Time information from the system clock

[1324] Specific behavior: Gets the current time using the iOS Date() class.

[1325] Output: Current time (e.g. 21:00)

[1326] Step 2:

[1327] The terminal transmits the time information to the server.

[1328] Input: Current time (e.g. 21:00)

[1329] Specific operation: The device sends time information to the server using an HTTP request. Use a cloud service such as Firebase.

[1330] Output: The time information is sent to the server.

[1331] Step 3:

[1332] The server generates the filter parameters and sends them to the terminal.

[1333] Input: Time information sent from the device (e.g. 21:00)

[1334] Specific operation: Based on the time information received by the server, the appropriate filter parameters (e.g., color temperature 3500K) are calculated.

[1335] Output: Filter parameters (e.g. color temperature 3500K)

[1336] Step 4:

[1337] The device adjusts the screen color temperature based on the filter parameters.

[1338] Input: Filter parameters received from the server (e.g. color temperature 3500K)

[1339] What it does: The device uses iOS's Night Shift feature to adjust the screen's color temperature.

[1340] Output: Calibrated screen color temperature (e.g. 3500K)

[1341] Layout optimization

[1342] Step 1:

[1343] The user takes a vision test and enters the results.

[1344] Input: User's visual acuity test result (e.g., visual acuity 0.5)

[1345] What it does: Use the in-app vision test feature and enter your vision results into the input form.

[1346] Output: Input visual acuity information (e.g., visual acuity 0.5)

[1347] Step 2:

[1348] The device transmits the visual acuity data to the server.

[1349] Input: Visual acuity information entered by the user (e.g., visual acuity 0.5)

[1350] Specific operation: The device sends visual acuity data to the server using an HTTP request, using a cloud service such as Firebase.

[1351] Output: Visual acuity data is sent to the server.

[1352] Step 3:

[1353] The server analyzes the visual acuity data and generates layout parameters.

[1354] Input: Visual acuity data received by the server (e.g., visual acuity 0.5)

[1355] Specific operation: The server analyzes the visual acuity data and generates optimal layout parameters (e.g., font size 20pt, line spacing 1.5x).

[1356] Output: Layout parameters (e.g. font size 20pt, line spacing 1.5x)

[1357] Step 4:

[1358] The device adjusts the screen based on the layout parameters.

[1359] Input: Layout parameters received from the server (e.g. font size 20pt, line spacing 1.5x)

[1360] What it does: Dynamically change display elements within the app using layout parameters received by the device.

[1361] Output: Adjusted layout (e.g., font size 20pt, line spacing 1.5x)

[1362] Reminder function

[1363] Step 1:

[1364] Your device will load your reminder settings.

[1365] Input: Reminder time saved in app settings (e.g. 60 minutes)

[1366] What happens: The device reads the reminder settings from the app settings.

[1367] Output: Reminder time loaded (e.g. 60 minutes)

[1368] Step 2:

[1369] The terminal starts a timer.

[1370] Input: Reminder time (e.g. 60 minutes)

[1371] Specific behavior: The device starts an internal timer based on the specified reminder time. This uses the iOS timer function.

[1372] Output: A timer that starts the countdown.

[1373] Step 3:

[1374] After a certain time has passed, the device will display a notification.

[1375] Input: Reminder time has elapsed (e.g. 60 minutes have elapsed)

[1376] What it does: After the set time has elapsed, the device displays a notification encouraging the user to take a break. This uses iOS's local notifications feature.

[1377] Output: Notification to encourage a break (e.g., "Rest your eyes!")

[1378] eye exercise exercises

[1379] Step 1:

[1380] Your device will display a notification with exercise suggestions.

[1381] Input: Exercise time interval (e.g. every 30 minutes)

[1382] What happens: Your device displays exercise suggestion notifications using iOS's local notifications feature.

[1383] Output: Exercise suggestion notification (e.g. "Let's do some eye exercises!")

[1384] Step 2:

[1385] The user responds to the notification and begins the exercise.

[1386] Enter: Exercise suggestion notification

[1387] Specific action: The user responds to the notification and taps the button to start the exercise.

[1388] Output: Instruction to start exercise

[1389] Step 3:

[1390] The device provides interactive games.

[1391] Input: Start exercise command

[1392] What it does: The device launches an eye exercise game implemented in Unity, which asks the user to follow an on-screen character with their eyes.

[1393] Output: Start of interactive game

[1394] App Timer

[1395] Step 1:

[1396] The user sets the time for using the app.

[1397] Input: Usage time set by the user (e.g. 60 minutes)

[1398] Specific operation: The user enters and sets the usage time on the app's settings screen.

[1399] Output: Set usage time (e.g. 60 minutes)

[1400] Step 2:

[1401] The terminal starts a timer.

[1402] Input: Set usage time (e.g. 60 minutes)

[1403] What it does: The device starts a countdown timer based on the specified usage time. It uses the iOS timer function.

[1404] Output: A timer that starts the countdown.

[1405] Step 3:

[1406] After the set time has elapsed, the device will display a notification that usage time has ended.

[1407] Input: Set time has elapsed (e.g. 60 minutes have elapsed)

[1408] Specific behavior: After the set time has elapsed, the device displays a notification that the usage time has ended, encouraging the user to take a break. This uses iOS's local notification feature.

[1409] Output: Screen time end notification (e.g. "Screen time is over. Rest your eyes!")

[1410] Through the above processing steps, the system effectively prevents children's eyesight from declining and achieves comprehensive vision protection.

[1411] (Application example 1)

[1412] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1413] Today's children often use digital devices for long periods of time, which can lead to problems such as vision loss and eye strain. Furthermore, parents have limited means to effectively manage their children's device usage time and protect their eyesight. This has led to a need for effective methods to prevent vision loss. There is also a growing need for technology that dynamically adjusts screen display based on visual status.

[1414] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1415] In this invention, the server includes means for providing a vision protection mode, means for optimizing the layout, means for providing a reminder function for taking breaks at regular intervals, means for providing exercises to promote eye movement, means for providing a timer function for limiting app usage time, means for dynamically adjusting the screen color temperature based on the user's visual condition and time information, and means for acquiring filter parameters and layout parameters from the server and dynamically optimizing the screen display based on the parameters. This effectively prevents children's eyesight from deteriorating and provides an appropriate vision protection environment. It also makes it easier for parents to manage their children's device usage time and vision protection.

[1416] "Eye Protection Mode" is a function that dynamically adjusts the screen's color temperature and blue light to protect the user's eyesight.

[1417] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing on the screen based on the user's eyesight.

[1418] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break.

[1419] "Eye Exercises" is a feature that suggests visual exercises to users and encourages them to move their eye muscles.

[1420] The "timer function" is a function that allows you to set the amount of time you can use the app and displays a notification to the user when the set time has elapsed.

[1421] "Filter parameters" are setting information for color temperature and blue light reduction obtained from the server.

[1422] "Layout parameters" are layout setting information such as font size and line spacing obtained from the server.

[1423] A "server" is a device on a network that generates and provides filter parameters and layout parameters.

[1424] "Means for dynamically adjusting the color temperature of the screen" is a technology that appropriately changes the color temperature of the screen based on time information and the user's visual state.

[1425] "Means for dynamically optimizing screen display" refers to technology that optimizes the screen layout and display content in real time based on parameters obtained from the server.

[1426] The following describes the mode for implementing the present invention. The system of the present invention combines a vision protection mode, layout optimization, a reminder function, exercises to promote eye movement, and a timer function to limit the time spent using apps. The main functions of the present invention and specific implementation methods thereof are described below.

[1427] Eye Comfort Mode

[1428] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[1429] Layout optimization

[1430] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[1431] Reminder function

[1432] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[1433] eye exercises

[1434] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[1435] App Timer

[1436] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[1437] Server-side processing

[1438] The server generates filter and layout parameters using the time information and vision test results sent from the device. This processing is performed using specific software on the server (e.g., Python, Amazon Web Services (AWS), etc.). The generated parameters are sent to the device and used to adjust the display on the device.

[1439] Specific examples and input examples to generative AI models

[1440] For example, if you install this application on a smartphone used by a third-grader, when it is used at 8 p.m., the app will automatically apply a blue light filter and change the screen to warmer colors. Based on the results of a vision test, it will also increase the font size and increase the line spacing. Every 60 minutes, the app will send a message saying, "Take a rest!"

[1441] Example prompt for input to a generative AI model:

[1442] Generate code for a smartphone app that automatically applies a blue light blocking color temperature filter based on the current time and displays a reminder to take a break from eye contact at regular intervals. Dynamically adjust font size and optimize line spacing based on the results of a visual acuity test. Also, add a feature that suggests eye exercises to users through an exercise function.

[1443] As described above, this invention is a system that integrates major functions to prevent deterioration of children's eyesight and provide an appropriate eyesight protection environment.

[1444] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1445] Step 1:

[1446] When the device launches the app, it gets the current time. The input is the system time of the user device, and the output is the current time data. This time data is used in the next step.

[1447] Step 2:

[1448] The terminal sends the acquired time data to the server. The input is the time data acquired in step 1, and the output is the request sent to the server.

[1449] Step 3:

[1450] The server generates filter parameters based on the time data received. The input is the time data sent from the device, and the data is processed to calculate the appropriate color temperature and blue light reduction parameters for the time of day. The output is the generated filter parameters.

[1451] Step 4:

[1452] The server sends the generated filter parameters to the terminal. The input is the filter parameters, and the output is the data to be sent to the terminal.

[1453] Step 5:

[1454] The terminal adjusts the color temperature of the screen based on the filter parameters received. The input is the filter parameters received from the server, and the screen settings are changed as data processing. The output is the adjusted screen display.

[1455] Step 6:

[1456] The user takes a vision test and inputs the results into the terminal. The input is the vision test result data entered by the user, and the output is the data stored in the terminal.

[1457] Step 7:

[1458] The terminal sends the vision test result data to the server. The input is the vision test result data, and the output is sending a request to the server.

[1459] Step 8:

[1460] The server generates layout parameters based on the vision test results received. The input is the vision test result data sent from the terminal, and the optimal font size and line spacing are calculated as data processing. The output is the generated layout parameters.

[1461] Step 9:

[1462] The server sends the generated layout parameters to the terminal. The input is the layout parameters, and the output is the data to be sent to the terminal.

[1463] Step 10:

[1464] Based on the layout parameters received by the device, each element on the screen is dynamically adjusted. The input is the layout parameters received from the server, and the screen layout is changed as data processing. The output is a screen display that has been adjusted to be easy to see.

[1465] Step 11:

[1466] When the device launches the app, it reads the reminder settings and starts the timer. The input is the reminder setting data in the device, and the output is the start of the reminder timer.

[1467] Step 12:

[1468] After a certain time has passed, the device displays a notification to the user to encourage them to take a break. The input is the status data of the reminder timer, and the output is the notification display to the user.

[1469] Step 13:

[1470] The device periodically displays a notification to the user suggesting eye exercises. The input is the exercise notification setting data, and the output is the notification display to the user.

[1471] Step 14:

[1472] When the user starts exercising, the device provides an interactive game, prompting the user to follow an on-screen character. The input is the user's operation to start exercising, and the output is the start of the exercise game.

[1473] Step 15:

[1474] After the user sets the app usage time, the device starts a timer to count down that time. The input is the usage time data set by the user, and the output is the start of the usage timer.

[1475] Step 16:

[1476] When the set time has elapsed, the device displays a notification to the user that usage has ended and restricts app use. The input is the timer countdown status data, and the output is a notification to the user that usage has ended.

[1477] The above is a detailed description of the processing steps of the system program for realizing the application example.

[1478] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1479] This invention relates to an application for preventing vision loss for children, and is characterized by combining a vision protection mode, layout optimization, reminder function, eye exercise exercises, and an app timer with an emotion engine.

[1480] Introducing the Emotion Engine

[1481] The emotion engine recognizes the user's emotions using cameras and sensors and adjusts the operation of each function based on the user's emotional state, thereby providing a more personalized user experience.

[1482] Eye Comfort Mode

[1483] When the app is launched, the device uses the camera to capture the user's face, and the emotion engine analyzes the image to determine the user's emotion. The device also obtains the current time and sends this information to the server. The server generates optimal filter parameters (color temperature and blue light reduction level) based on the time information and the user's emotion data and sends them to the device. For example, if it is nighttime and the server determines that the user is tired, it will apply settings that adopt a warmer color temperature and more strongly reduce blue light. This allows the user to use the app in a lighting environment that is gentle on the eyes.

[1484] Layout optimization

[1485] After the user takes the vision test, they enter the results into their device. The device then sends the vision test results, along with the user's emotional data captured by the camera, to the server. The server analyzes this data and determines the optimal font size and line spacing. For example, if the server determines that the user has poor eyesight and is unable to concentrate, it will send settings to the device to make the font size larger than usual and increase the line spacing. This allows the user to use the app with an optimized layout.

[1486] Reminder function

[1487] When the app is launched, the device reads the reminder settings and uses the camera to recognize the user's emotions. The timing of the reminder is not only based on a pre-set time interval, but is also adjusted taking into account the user's emotional state. For example, if the device determines that the user is concentrating on their work, it can delay the reminder notification a little. When the time comes, the device will display a notification encouraging the user to take a break.

[1488] eye exercises

[1489] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification is displayed, the camera is used to assess the user's emotional state. If the user's emotions are judged to be, for example, enjoyment or relaxation, the exercise continues. Conversely, if the user is judged to be feeling stressed, the exercise content is changed to a more relaxing one. This allows the user to enjoy eye exercise.

[1490] App Timer

[1491] After the user sets the app usage time, the device not only counts down the set time but also continuously monitors the user's emotions using the camera. When the time has elapsed, the device will display a notification to encourage the user to quit using the app. If the emotion engine determines that the user is already tired, the device can notify the user earlier than the scheduled time. This allows the user to quit the app at the appropriate time and rest their eyes.

[1492] In this way, by combining the emotion engine with the vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer, the system can make fine adjustments according to the user's emotional state, more effectively preventing the deterioration of children's eyesight.

[1493] The processing flow will be explained below.

[1494] Eye protection mode processing steps using emotion engine

[1495] Step 1:

[1496] The device launches the app, first launching the camera to capture the user's face, and then getting the current time from the system clock.

[1497] Step 2:

[1498] The device sends the captured face image and the acquired time information to the server using an API request.

[1499] Step 3:

[1500] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as recognizing emotions like "tired" or "concentrated."

[1501] Step 4:

[1502] The server generates optimal filter parameters based on time information and the user's emotional data. If it is nighttime and the user is judged to be "tired," the server will set the color temperature to warmer colors and increase blue light reduction.

[1503] Step 5:

[1504] The server sends the generated filter parameters to the device and returns them in the API response.

[1505] Step 6:

[1506] The device receives the filter parameters and adjusts the screen's color temperature and blue light level, changing the screen settings to provide the user with the optimal lighting environment.

[1507] Step 7:

[1508] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[1509] Processing steps for layout optimization using emotion engine

[1510] Step 1:

[1511] Users take a visual acuity test within the app and enter the results into their device. The visual acuity test is carried out using a dedicated tool.

[1512] Step 2:

[1513] The device sends the results of the eye test and a facial image captured by the camera to the server, sending this data via an API request.

[1514] Step 3:

[1515] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as "tired" or "unhappy."

[1516] Step 4:

[1517] The server generates optimal layout parameters (such as font size and line spacing) based on the results of the vision test and emotional data. If the user's vision is poor and the user is judged to be "tired," the server will increase the font size and widen the line spacing.

[1518] Step 5:

[1519] The server sends the generated layout parameters to the device and returns the parameters in the API response.

[1520] Step 6:

[1521] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, optimizing the content displayed to the user.

[1522] Step 7:

[1523] Users can use the app with an optimized layout, with font size and line spacing settings that suit their eyesight and emotions.

[1524] Processing steps of the reminder function incorporating an emotion engine

[1525] Step 1:

[1526] When the device launches the app, it reads the reminder settings and activates the camera to capture the user's face.

[1527] Step 2:

[1528] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[1529] Step 3:

[1530] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "concentrated" or "relaxed."

[1531] Step 4:

[1532] The device adjusts the timing of reminders based on emotion data, delaying reminder notifications if the user is deemed to be "concentrated."

[1533] Step 5:

[1534] The device will display a notification to the user at the set time to encourage them to take a break. A pop-up message will appear saying "Rest your eyes!"

[1535] Step 6:

[1536] Users receive a notification to temporarily stop using the app and rest their eyes.

[1537] Processing steps of eye movement exercise using emotion engine

[1538] Step 1:

[1539] The device periodically displays eye exercise notifications to the user and activates the camera to capture the user's face.

[1540] Step 2:

[1541] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[1542] Step 3:

[1543] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as whether they are having fun or feeling stressed.

[1544] Step 4:

[1545] The device adjusts the exercise content based on the user's emotions. If the device determines that the user is "stressed," it changes the exercise to a more relaxing one.

[1546] Step 5:

[1547] The user starts an eye exercise. The user selects an in-app game mode.

[1548] Step 6:

[1549] The device provides an interactive character tracking game. The game starts with the characters moving randomly on the screen.

[1550] Step 7:

[1551] The user follows the character with their eyes and completes the exercise. By continuing to follow the character with their eyes, they exercise their eye muscles.

[1552] Step 8:

[1553] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[1554] Processing steps for app timers using emotion engines

[1555] Step 1:

[1556] The user sets the app usage time by entering the desired usage time on the settings screen within the app.

[1557] Step 2:

[1558] The device starts a timer to count down the set usage time, and activates the camera to monitor the user's face.

[1559] Step 3:

[1560] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[1561] Step 4:

[1562] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "tired" or "concentrated."

[1563] Step 5:

[1564] The device continuously monitors emotional data during use and adjusts timer settings as needed. For example, if the device detects that the user is already tired, it will notify the user to end the timer earlier than scheduled.

[1565] Step 6:

[1566] The device displays a notification to the user that their screen time is over based on a set time or emotional state. It displays the message "Your screen time is over. Rest your eyes!"

[1567] Step 7:

[1568] The user checks the notification, ends the app, and takes a break.

[1569] Step 8:

[1570] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[1571] The above are the specific processing steps for each function of the eyesight prevention system that combines the emotion engine. This allows for fine-tuned adjustments based on the user's emotional state, making it possible to more effectively prevent vision loss in children.

[1572] Example 2

[1573] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1574] Conventional vision loss prevention systems have not been finely adjusted to suit the user's condition, making it difficult to effectively prevent vision loss. In particular, because settings are applied uniformly based on certain environments and conditions, there is a problem in that it is not possible to provide optimal support according to the individual state and emotions of each user.

[1575] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing a eyesight protection mode, a means for optimizing a layout, a means having a reminder function for prompting a break at regular intervals, a means for providing exercises to promote eye movement, a means having a timer function for limiting the usage time of an application, and a means for adjusting the operation of each means based on the emotional state of the user using an emotion recognition engine. This allows each function to be optimized based on the emotional state of the user and the results of a vision test, enabling more effective prevention of vision loss.

[1576] "Eye protection mode" is a function that adjusts the screen color temperature and blue light reduction level to protect the user's eyesight.

[1577] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing of displayed text based on the user's vision test results and emotional state.

[1578] The "reminder function" is a function that displays a notification to encourage users to take a break after a certain amount of time has passed.

[1579] "Eye Exercises" is a feature that encourages users to do specific eye exercises to maintain eye health.

[1580] The "timer function" monitors the application usage time and notifies the user when the set time has elapsed.

[1581] An "emotion recognition engine" is a system that uses cameras and sensors to capture the user's face and determine the user's emotional state through image analysis.

[1582] "Filter parameters" are settings that are adjusted to protect eyesight, such as the screen's color temperature and blue light reduction level.

[1583] "Font size" refers to the size of the characters displayed and is adjusted according to the user's eyesight.

[1584] "Line spacing" refers to the vertical space between displayed text and is adjusted according to the user's visual acuity and emotional state.

[1585] This invention is an application system for preventing vision loss, which uses an emotion recognition engine to adjust the operation of various functions based on the user's emotional state, providing a personalized user experience. Specifically, it is equipped with a vision protection mode, layout optimization, reminder function, eye exercises, and a timer function to manage application usage time.

[1586] Introducing an emotion recognition engine

[1587] The emotion recognition engine is a system that uses the camera and sensors built into smartphones and tablet devices to capture the user's face and determine their emotional state through image analysis. This enables the following functions:

[1588] Eye Comfort Mode

[1589] When the app is launched, the device uses the camera to capture the user's face, and the emotion recognition engine analyzes the image to determine the user's emotions. This includes analyzing facial expressions. For example, if the face is determined to look tired, the color temperature is set to 2500K and the blue light reduction level is increased. The device obtains the current time and sends this information to the server. The server then generates optimal filter parameters based on the time information and the user's emotion data and sends them to the device, thereby protecting the user's eyesight.

[1590] Layout optimization

[1591] After the user takes the vision test, they enter the results into the device. The device also uses its camera to capture emotional data and sends this information to the server. The server analyzes the vision test results and emotional data and optimizes font size and line spacing. For example, if it determines that the user has poor eyesight and is unable to concentrate, it will increase the font size and increase the line spacing by sending settings to the device to improve visibility.

[1592] Reminder function

[1593] When the app launches, the device reads the reminder settings and simultaneously uses the camera to recognize the user's emotions. The app adjusts reminder notifications based not only on the set interval, but also on the user's emotional state. For example, if the app determines that the user is concentrating on a task, it can delay the notification. When the time comes, the device will display a notification to the user saying, "Please take a break."

[1594] eye exercises

[1595] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification appears, the device uses the camera to assess the user's emotional state. If the device determines that the user is enjoying or relaxed during the exercise, it continues the exercise. Conversely, if the device determines that the user is feeling stressed, it changes the exercise to make it more relaxing.

[1596] Application Timer

[1597] After the user sets the application usage time, the device counts down the set time. It also continuously monitors the user's emotions using the camera. When the time expires, the device displays a notification to encourage the user to stop using the app. If the emotion recognition engine determines that the user is already tired, the device can send the notification earlier than the scheduled time.

[1598] (Example)

[1599] Example of the emotion recognition engine in action:

[1600] Prompt: "How can I set it to reduce blue light when the user is fatigued?"

[1601] Hardware used: Smartphone camera, server

[1602] Software used: Emotion recognition AI, blue light filter

[1603] Data processing and calculation: Emotion recognition, filter parameter generation, data transmission, setting application

[1604] The system utilizes an emotion recognition engine to optimize various functions, such as eye protection mode, layout optimization, reminder function, and eye exercise exercises, to effectively prevent users' eyesight from deteriorating.

[1605] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1606] Eye Comfort Mode

[1607] Step 1:

[1608] When the app is launched, the device uses the camera to capture the user's face.

[1609] Input: App launch event

[1610] Output: User's face image

[1611] How it works: When the app is launched, the device's built-in camera automatically activates and takes a picture of the user's face.

[1612] Step 2:

[1613] The device passes the facial image to an emotion recognition engine for emotion recognition.

[1614] Input: User's face image

[1615] Output: User's emotional state (tired, relaxed, etc.)

[1616] How it works: An analytics algorithm analyzes images and identifies emotional states from facial expressions.

[1617] Step 3:

[1618] The device uses the system clock to obtain the current time.

[1619] Input: None

[1620] Output: current time

[1621] Action: The internal clock returns the current time.

[1622] Step 4:

[1623] The device sends emotion data and the current time to the server.

[1624] Input: Emotion data, current time

[1625] Output: Send data package to server

[1626] How it works: Emotion data and time are packaged together and sent to the server using the communication module.

[1627] Step 5:

[1628] The server receives the data and generates optimal filter parameters.

[1629] Input: Emotion data, current time

[1630] Output: Optimal filter parameters (color temperature, blue light reduction level)

[1631] How it works: An algorithm calculates the response and generates filter parameters based on the data. For example, if it detects you are "tired" at night, it will lower the color temperature and cut blue light.

[1632] Step 6:

[1633] The server sends the generated filter parameters to the terminal.

[1634] Input: Optimal filter parameters

[1635] Output: Data sent to the terminal

[1636] What it does: Packages parameters and sends them to the device.

[1637] Step 7:

[1638] The terminal applies the received filter parameters.

[1639] Input: Optimal filter parameters

[1640] Output: Adjusted display settings

[1641] What it does: Updates display settings to adjust color temperature and blue light reduction levels.

[1642] Layout optimization

[1643] Step 1:

[1644] The user performs a vision test.

[1645] Input: Start vision test

[1646] Output: Vision test result data

[1647] What it does: The app presents the user with a vision test and collects the results.

[1648] Step 2:

[1649] The user inputs the results of the vision test into the terminal.

[1650] Input: Eye test results

[1651] Output: Data input to the terminal

[1652] Action: Enter the test results into the app's input form.

[1653] Step 3:

[1654] The device uses a camera to capture emotion data.

[1655] Input: Facial image (during vision test)

[1656] Output: Emotion data

[1657] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[1658] Step 4:

[1659] The device sends the vision test results and emotion data to the server.

[1660] Input: Eye test results, emotion data

[1661] Output: Data sent to the server

[1662] What it does: Packages the data and sends it to the server.

[1663] Step 5:

[1664] The server receives the data and determines the optimal font size and line spacing.

[1665] Input: Eye test results, emotion data

[1666] Output: Optimal font size and line spacing

[1667] How it works: A data-driven analytical algorithm calculates the optimal value. For example, if your visual acuity is 0.6 and your concentration is declining, increase the font size and increase the line spacing.

[1668] Step 6:

[1669] The server sends the determined settings to the terminal.

[1670] Input: Optimal font size and line spacing

[1671] Output: Data sent to the terminal

[1672] What it does: Packages configuration data and sends it to the device.

[1673] Step 7:

[1674] The device applies the received settings.

[1675] Input: Optimal font size and line spacing

[1676] Output: Updated layout

[1677] Behavior: Updates the app's display settings to provide the optimal layout for the user.

[1678] Reminder function

[1679] Step 1:

[1680] The device loads the reminder settings when the app is launched.

[1681] Input: App launch event

[1682] Output: Reminder setting data

[1683] What it does: Reads reminder settings (e.g., take a break every 30 minutes) from the app configuration file.

[1684] Step 2:

[1685] The device uses a camera to capture emotion data.

[1686] Input: Face image

[1687] Output: Emotion data

[1688] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[1689] Step 3:

[1690] The device calculates the reminder timing.

[1691] Input: Reminder settings, emotion data

[1692] Output: Adjusted reminder timing

[1693] How it works: Optimizes timing based on your settings and emotional data, for example delaying notifications by 10 minutes if you're distracted.

[1694] Step 4:

[1695] The device will display a notification prompting you to take a break at the specified time.

[1696] Input: Reminder timing

[1697] Output: Notification display

[1698] What it does: Pops up a notification saying "Take a break" at the specified time.

[1699] (Examples and prompts)

[1700] Prompt: "How can I set reminder notifications to be delayed when the user is distracted?"

[1701] Hardware used: Smartphone camera, server

[1702] Software used: Emotion recognition AI, notification system

[1703] Data processing and calculation: Emotion recognition, reminder timing calculation, notification display

[1704] By clearly indicating the specific data input, output, and operation for each step, the processing flow of each function of this system to prevent vision loss becomes clear.

[1705] (Application example 2)

[1706] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1707] In today's digital environment, there are concerns that children's long hours of use of digital devices such as smartphones and tablets may lead to a decline in their eyesight. Furthermore, there are a lack of measures to limit usage time and encourage appropriate breaks, and no consideration is given to entertainment elements that children can enjoy without getting bored. The present invention aims to solve these problems by providing a system that prevents children's eyesight from declining and allows them to use digital devices in a fun and healthy way.

[1708] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a eyesight protection mode, means for optimizing the layout, means for having a reminder function for encouraging breaks at regular intervals, means for providing exercises to promote eye movement, means for having a timer function for limiting the amount of time spent using apps, and emotion engine means for recognizing the user's emotions using a camera or sensor and adjusting the operation of each function based on the user's emotional state. This makes it possible for children to enjoy using digital devices while effectively protecting their eyesight and encouraging them to take breaks at appropriate times.

[1709] "Eye protection mode" is a function that protects the user's eyesight by changing the screen settings of digital devices to reduce blue light and adjust color temperature.

[1710] "Layout optimization" means automatically adjusting font size and line spacing based on the user's visual acuity test results and emotional state to provide the most legible screen layout for the user.

[1711] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break, and adjusts the timing based on the user's emotional state to encourage appropriate breaks.

[1712] "Eye Exercises" is a feature that instructs users on eye-resting exercises and workouts, adjusting them based on their emotional state.

[1713] The "timer function" is a function that allows you to set the amount of time you use a digital device, and when that time has elapsed, a notification will be displayed to end the use.

[1714] The "emotion engine" uses cameras and sensors to recognize the user's emotions and adjusts the operation of each function of the system based on that emotional state.

[1715] This invention is a system that uses cameras and sensors to recognize a child's emotional state and adjusts functions such as vision protection, layout optimization, reminders, eye exercises, and app timers based on that information. Specific embodiments of this system are shown below.

[1716] System configuration

[1717] The system consists of digital devices such as smartphones and tablets, and a server that processes and analyzes data. The main hardware and software components are as follows:

[1718] 1. Hardware:

[1719] Device: A smartphone or tablet with a camera and sensors.

[1720] Server: A server for analyzing data and configuring applications.

[1721] 2. Software:

[1722] Emotion recognition algorithm: Uses OpenCV, DeepFace, etc.

[1723] Data transmission and reception API: An API for transmitting and receiving data between a terminal and a server.

[1724] Eye protection settings engine: Reduces blue light and adjusts color temperature.

[1725] UI / UX optimization engine: Adjust font size and line spacing.

[1726] Timer function: A timer to manage app usage time.

[1727] Entertainment module: Offers mini-games and eye exercises.

[1728] System Operation

[1729] 1. Emotion recognition: The device uses the camera to capture the child's face and recognizes their emotional state in real time through an emotion recognition algorithm.

[1730] 2. Eye Care Mode: The device sends time and emotion data to the server, which then generates optimal filter parameters and sends them to the device. When it is nighttime or when you are tired, the blue light reduction level is set high.

[1731] 3. Layout optimization: The device sends the vision test results and emotion data to the server, which analyzes the data and sends layout settings to the device that optimize font size and line spacing.

[1732] 4. Reminder function: The device will display reminder notifications to the user and adjust the timing of notifications depending on the user's emotional state. If the user is concentrating, the device will delay the reminder to encourage them to take a break.

[1733] 5. Eye Exercises: Regularly remind you to exercise and change the content depending on your emotional state. If you are enjoying it, continue, if you are stressed, shift to something more relaxing.

[1734] 6. App Timer: Your device will count down your set usage time and notify you based on your emotional state, encouraging you to stop using the app earlier if you feel tired.

[1735] Example

[1736] This system can be used in brick-and-mortar stores such as bookstores and cafes where children are using smartphones or tablets, providing both vision protection and entertainment.

[1737] Prompt Sentence Examples

[1738] "Based on the current time and a camera image of the user's face, recognize the child's emotional state and set the eye protection mode accordingly, changing the color temperature of the smartphone to a warmer tone and reducing blue light. Also, incorporate the user's eye test results to create settings that optimize the font size of the UI."

[1739] The invention can be carried out in the above manner.

[1740] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1741] Step 1:

[1742] The device uses a camera to capture the user's face and detects emotions in real time using emotion recognition algorithms (e.g., OpenCV or DeepFace).

[1743] Input: Camera image

[1744] Data processing: Face recognition and emotion classification using image processing algorithms

[1745] Output: User's emotional state data (e.g., happy, sad, angry, surprised, etc.)

[1746] Step 2:

[1747] The device transmits the current time and emotional state data to the server.

[1748] Input: time data, emotional state data

[1749] Data Calculation: Format Conversion of Time Series Data and Packaging of Emotion Data

[1750] Output: Request to send time information and emotional state data

[1751] Step 3:

[1752] The server analyzes the received time information and emotional state data to determine the optimal filter parameters for the eyesight protection mode (e.g., color temperature, blue light reduction level).

[1753] Input: time information, emotional state data

[1754] Data calculation: Filter parameter determination using a rule-based algorithm

[1755] Output: Filter parameters (e.g. color temperature setting, blue light reduction level)

[1756] Step 4:

[1757] The server sends the generated filter parameters to the terminal, which then adjusts its screen settings accordingly.

[1758] Input: Filter parameters

[1759] Data processing: Changing the device display settings

[1760] Output: Adjusted screen settings (e.g. warmer color temperature, reduced blue light)

[1761] Step 5:

[1762] The device inputs the vision test data (font size and line spacing settings) and sends it to the server.

[1763] Input: Vision test data

[1764] Data Computing: Standardization and Packaging of Vision Test Results

[1765] Output: Request to send vision test data

[1766] Step 6:

[1767] The server analyzes the visual acuity test data and emotional state data to determine the optimal UI layout (font size and line spacing).

[1768] Input: visual acuity test data, emotional state data

[1769] Data Computing: Applying Statistical Analysis and Heuristic Algorithms

[1770] Output: Optimized UI layout settings

[1771] Step 7:

[1772] The server sends the generated UI layout settings to the terminal, and the terminal adjusts the screen layout based on them.

[1773] Input: UI layout settings

[1774] Data manipulation: Positioning and resizing UI elements

[1775] Output: Adjusted UI layout

[1776] Step 8:

[1777] Your device will read your reminder settings and adjust reminder timing based on your emotional state.

[1778] Input: Emotional state data, reminder settings

[1779] Data calculation: timing adjustment algorithm

[1780] Output: Reminder notification

[1781] Step 9:

[1782] The device monitors the user's emotional state, periodically presents eye movement exercises, and changes the content according to the emotional state.

[1783] Input: Emotional state data

[1784] Data calculation: Selection and adjustment of exercise content

[1785] Output: Exercise notification, content change

[1786] Step 10:

[1787] The device counts down the set usage time, monitors the user's emotional state, and notifies the user to stop using the device at the appropriate time.

[1788] Input: Usage time settings, emotional state data

[1789] Data Computation: Countdown Timer and Emotion Data Analysis

[1790] Output: Termination of use notification

[1791] Through these steps, the user can utilize a system that provides vision protection and entertainment.

[1792] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1793] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1794] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1795] [Fourth embodiment]

[1796] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1797] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1798] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1799] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1800] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1801] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1802] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1803] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1804] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1805] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1806] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1807] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1808] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1809] This invention relates to a vision protection application for children, which includes features such as a vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer.

[1810] Eye Comfort Mode

[1811] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[1812] Layout optimization

[1813] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[1814] Reminder function

[1815] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[1816] eye exercise exercises

[1817] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[1818] App Timer

[1819] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[1820] In this way, the combination of vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer can effectively prevent children's eyesight from deteriorating. Furthermore, these functions work together to comprehensively protect the user's eye health.

[1821] The processing flow will be explained below.

[1822] Eye comfort mode processing steps

[1823] Step 1:

[1824] When the device launches the app, it obtains the current time from the system clock to prepare for determining whether it is daytime or nighttime.

[1825] Step 2:

[1826] The device sends the acquired time information to the server. The current time data is sent to the server via an API request.

[1827] Step 3:

[1828] The server receives the time information and generates filter parameters for daytime or nighttime use. The time data is analyzed to determine the required blue light reduction level and color temperature adjustment.

[1829] Step 4:

[1830] The server sends the generated filter parameters to the device and returns them in the API response.

[1831] Step 5:

[1832] The device receives the filter parameters and adjusts the screen color temperature and blue light level, then changes the screen settings based on the received parameters to provide a lighting environment that is gentle on the eyes.

[1833] Step 6:

[1834] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[1835] Layout optimization processing steps

[1836] Step 1:

[1837] The user takes a vision test within the app and enters the test results into the device. The vision test results are then registered in the app.

[1838] Step 2:

[1839] The device sends the vision test results to the server. The test result data is sent to the server via an API request.

[1840] Step 3:

[1841] The server analyzes the results of the visual acuity test and generates optimal layout parameters (such as font size and line spacing). The data analysis determines the optimal display parameters for the user.

[1842] Step 4:

[1843] The server sends the generated layout parameters to the device and returns them in the API response.

[1844] Step 5:

[1845] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, changing the display content according to the generated parameters.

[1846] Step 6:

[1847] Users can use the app with an optimized layout, with font size and line spacing set according to their eyesight.

[1848] Reminder function processing steps

[1849] Step 1:

[1850] The device reads the reminder settings when the app starts. Reads the saved setting data.

[1851] Step 2:

[1852] Your device will start the timer for the reminder, which will begin counting down to the set reminder interval.

[1853] Step 3:

[1854] The device displays a notification to the user when the timer expires, encouraging them to take a break. It generates a pop-up notification with the message "Rest your eyes!"

[1855] Step 4:

[1856] Users receive a notification to temporarily stop using the app and rest their eyes.

[1857] Eye exercise processing steps

[1858] Step 1:

[1859] The device periodically displays eye exercise notifications to the user, encouraging them to "do some eye exercises!"

[1860] Step 2:

[1861] The user starts an eye exercise. The user selects an in-app game mode.

[1862] Step 3:

[1863] The device provides an interactive character tracking game, in which the on-screen characters start moving randomly.

[1864] Step 4:

[1865] The user completes the exercise by following the character with their eyes. By continuing to follow the character with their eyes, they exercise their eye muscles.

[1866] Step 5:

[1867] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[1868] App Timer Processing Steps

[1869] Step 1:

[1870] The user sets the usage time for the app. The user enters the desired usage time on the settings screen within the app.

[1871] Step 2:

[1872] The device starts a timer based on the set usage time. The device starts a countdown to the usage time limit.

[1873] Step 3:

[1874] When the device reaches the end of its usage time, it will notify the user by displaying a message saying, "Your usage time is over. Rest your eyes!"

[1875] Step 4:

[1876] The user checks the notification, ends the app, and takes a break.

[1877] Step 5:

[1878] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[1879] The above are the specific processing steps of each function of this vision loss prevention system, which can effectively protect children's eyes.

[1880] Example 1

[1881] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1882] Today's children often use digital devices for long periods of time, which can lead to serious problems such as vision loss and eye fatigue. Furthermore, a lack of proper screen adjustments based on the environment and timing of digital device use can further exacerbate vision loss. Even when vision protection systems exist, they often only offer limited functionality, such as eye protection modes and break reminders, making comprehensive vision protection difficult.

[1883] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1884] In this invention, the server includes means for providing a vision protection mode by acquiring current time information, transmitting it to the server, and receiving appropriate filter parameters, means for transmitting the user's vision test results to the server and receiving layout parameters based on the vision data to optimize the layout, means for providing a reminder function to encourage breaks at regular intervals, means for providing an interactive game that promotes eye exercise, and means for providing a timer function that counts down the usage time of an app set by the user and displays a notification when the usage time has expired. This not only provides the user with a screen environment that is gentle on the eyes in the vision protection mode, but also enables the display of an optimal layout based on the vision test results, and enables comprehensive vision protection through the regular break reminders and eye exercises.

[1885] "Current time information" refers to the actual date and time information obtained using the internal clock of a terminal or device.

[1886] A "server" is a computer system that performs processing in response to requests from terminals via a network.

[1887] "Filter parameters" are the numerical values ​​and settings used to adjust the screen's color temperature, blue light intensity, etc.

[1888] "Visual acuity test results" refers to specific visual acuity status and numerical information obtained when a user undergoes a visual acuity test.

[1889] "Layout parameters" are setting items related to the arrangement and style of display elements on the screen, such as font size and line spacing.

[1890] "Reminder" is a function that notifies the user periodically and encourages them to take a specific action.

[1891] An "interactive game" is a type of game in which reactions and changes occur depending on the user's operations and actions.

[1892] The "timer function" is a function that counts down a set time and notifies you when that time has elapsed.

[1893] "Eye protection mode" is a function that adjusts the screen's color temperature and blue light to provide a display that is gentle on the eyes in order to reduce strain on the user's eyesight.

[1894] "Layout optimization" is a function that adjusts the layout and size of display elements on the screen according to the user's eyesight condition, improving visibility.

[1895] This invention relates to an application for digital devices to prevent vision loss, and provides the following functions:

[1896] Eye Comfort Mode

[1897] When the app is launched, the device obtains the current time from the system clock. This time information is sent to the server. The server analyzes the time information and generates appropriate filter parameters (such as color temperature and blue light filter strength). These parameters are sent to the device, which then adjusts the screen's color temperature. This allows for an eye-friendly environment for specific times of the day. For example, at night, the screen's color temperature can be set to warmer colors to reduce blue light.

[1898] Layout optimization

[1899] Users take a visual acuity test using the app's visual acuity test function and enter the results into their device. The device then sends this visual acuity data to the server. The server analyzes the visual acuity data and generates layout parameters (such as font size and line spacing) that are optimal for the user. These parameters are then sent to the device, which then dynamically adjusts the display elements on the screen. This allows users to use the app with an optimal layout based on their visual acuity. For example, users with poor eyesight can be provided with a larger font size and wider line spacing.

[1900] Reminder function

[1901] When the app is launched, the device reads the reminder settings and starts an internal timer. After a set period of time has elapsed, the device displays a notification encouraging the user to take a break. This notification allows the user to temporarily stop using the app and rest their eyes. For example, a notification saying "Take a break!" is displayed every 60 minutes.

[1902] eye exercise exercises

[1903] The device periodically displays notifications suggesting eye exercises to the user. Once the user starts the exercise, the device offers an interactive game in which the user is required to follow an on-screen character with their eyes, which exercises the eye muscles and protects eyesight. For example, a game in which the user follows a randomly moving character with their eyes is provided.

[1904] App Timer

[1905] Users can set the usage time for an app, and the device will then start a timer to count down the set time. When the set time has elapsed, the device will display a notification that usage time has ended, encouraging the user to take a break. This function helps prevent eye strain caused by using an app for long periods of time. For example, if you set the usage time to one hour, a notification will appear saying, "Usage time is over. Take a break!" when the time has elapsed.

[1906] These functions are executed on iOS devices (e.g., iPhone, iPad), and exchange data via Firebase and REST API, adjust color temperature using iOS's "Night Shift" function, link databases using Firebase, and use iOS's "Local Notification" function for notifications. The eye exercise game is implemented using Unity.

[1907] Prompt Sentence Examples

[1908] Please describe in natural language the process of the following system: This system is a vision prevention application for children, and includes features such as a vision protection mode, layout optimization, reminders, eye exercises, and an app timer. Please specify the specific hardware and software used.

[1909] By combining the above treatments, it is possible to effectively prevent children's eyesight from declining and achieve comprehensive vision protection.

[1910] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1911] Eye Comfort Mode

[1912] Step 1:

[1913] The device gets the current time.

[1914] Input: Time information from the system clock

[1915] Specific behavior: Gets the current time using the iOS Date() class.

[1916] Output: Current time (e.g. 21:00)

[1917] Step 2:

[1918] The terminal transmits the time information to the server.

[1919] Input: Current time (e.g. 21:00)

[1920] Specific operation: The device sends time information to the server using an HTTP request. Use a cloud service such as Firebase.

[1921] Output: The time information is sent to the server.

[1922] Step 3:

[1923] The server generates the filter parameters and sends them to the terminal.

[1924] Input: Time information sent from the device (e.g. 21:00)

[1925] Specific operation: Based on the time information received by the server, the appropriate filter parameters (e.g., color temperature 3500K) are calculated.

[1926] Output: Filter parameters (e.g. color temperature 3500K)

[1927] Step 4:

[1928] The device adjusts the screen color temperature based on the filter parameters.

[1929] Input: Filter parameters received from the server (e.g. color temperature 3500K)

[1930] What it does: The device uses iOS's Night Shift feature to adjust the screen's color temperature.

[1931] Output: Calibrated screen color temperature (e.g. 3500K)

[1932] Layout optimization

[1933] Step 1:

[1934] The user takes a vision test and enters the results.

[1935] Input: User's visual acuity test result (e.g., visual acuity 0.5)

[1936] What it does: Use the in-app vision test feature and enter your vision results into the input form.

[1937] Output: Input visual acuity information (e.g., visual acuity 0.5)

[1938] Step 2:

[1939] The device transmits the visual acuity data to the server.

[1940] Input: Visual acuity information entered by the user (e.g., visual acuity 0.5)

[1941] Specific operation: The device sends visual acuity data to the server using an HTTP request, using a cloud service such as Firebase.

[1942] Output: Visual acuity data is sent to the server.

[1943] Step 3:

[1944] The server analyzes the visual acuity data and generates layout parameters.

[1945] Input: Visual acuity data received by the server (e.g., visual acuity 0.5)

[1946] Specific operation: The server analyzes the visual acuity data and generates optimal layout parameters (e.g., font size 20pt, line spacing 1.5x).

[1947] Output: Layout parameters (e.g. font size 20pt, line spacing 1.5x)

[1948] Step 4:

[1949] The device adjusts the screen based on the layout parameters.

[1950] Input: Layout parameters received from the server (e.g. font size 20pt, line spacing 1.5x)

[1951] What it does: Dynamically change display elements within the app using layout parameters received by the device.

[1952] Output: Adjusted layout (e.g., font size 20pt, line spacing 1.5x)

[1953] Reminder function

[1954] Step 1:

[1955] Your device will load your reminder settings.

[1956] Input: Reminder time saved in app settings (e.g. 60 minutes)

[1957] What happens: The device reads the reminder settings from the app settings.

[1958] Output: Reminder time loaded (e.g. 60 minutes)

[1959] Step 2:

[1960] The terminal starts a timer.

[1961] Input: Reminder time (e.g. 60 minutes)

[1962] Specific behavior: The device starts an internal timer based on the specified reminder time. This uses the iOS timer function.

[1963] Output: A timer that starts the countdown.

[1964] Step 3:

[1965] After a certain time has passed, the device will display a notification.

[1966] Input: Reminder time has elapsed (e.g. 60 minutes have elapsed)

[1967] What it does: After the set time has elapsed, the device displays a notification encouraging the user to take a break. This uses iOS's local notifications feature.

[1968] Output: Notification to encourage a break (e.g., "Rest your eyes!")

[1969] eye exercise exercises

[1970] Step 1:

[1971] Your device will display a notification with exercise suggestions.

[1972] Input: Exercise time interval (e.g. every 30 minutes)

[1973] What happens: Your device displays exercise suggestion notifications using iOS's local notifications feature.

[1974] Output: Exercise suggestion notification (e.g. "Let's do some eye exercises!")

[1975] Step 2:

[1976] The user responds to the notification and begins the exercise.

[1977] Enter: Exercise suggestion notification

[1978] Specific action: The user responds to the notification and taps the button to start the exercise.

[1979] Output: Instruction to start exercise

[1980] Step 3:

[1981] The device provides interactive games.

[1982] Input: Start exercise command

[1983] What it does: The device launches an eye exercise game implemented in Unity, which asks the user to follow an on-screen character with their eyes.

[1984] Output: Start of interactive game

[1985] App Timer

[1986] Step 1:

[1987] The user sets the time for using the app.

[1988] Input: Usage time set by the user (e.g. 60 minutes)

[1989] Specific operation: The user enters and sets the usage time on the app's settings screen.

[1990] Output: Set usage time (e.g. 60 minutes)

[1991] Step 2:

[1992] The terminal starts a timer.

[1993] Input: Set usage time (e.g. 60 minutes)

[1994] What it does: The device starts a countdown timer based on the specified usage time. It uses the iOS timer function.

[1995] Output: A timer that starts the countdown.

[1996] Step 3:

[1997] After the set time has elapsed, the device will display a notification that usage time has ended.

[1998] Input: Set time has elapsed (e.g. 60 minutes have elapsed)

[1999] Specific behavior: After the set time has elapsed, the device displays a notification that the usage time has ended, encouraging the user to take a break. This uses iOS's local notification feature.

[2000] Output: Screen time end notification (e.g. "Screen time is over. Rest your eyes!")

[2001] Through the above processing steps, the system effectively prevents children's eyesight from declining and achieves comprehensive vision protection.

[2002] (Application example 1)

[2003] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2004] Today's children often use digital devices for long periods of time, which can lead to problems such as vision loss and eye strain. Furthermore, parents have limited means to effectively manage their children's device usage time and protect their eyesight. This has led to a need for effective methods to prevent vision loss. There is also a growing need for technology that dynamically adjusts screen display based on visual status.

[2005] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2006] In this invention, the server includes means for providing a vision protection mode, means for optimizing the layout, means for providing a reminder function for taking breaks at regular intervals, means for providing exercises to promote eye movement, means for providing a timer function for limiting app usage time, means for dynamically adjusting the screen color temperature based on the user's visual condition and time information, and means for acquiring filter parameters and layout parameters from the server and dynamically optimizing the screen display based on the parameters. This effectively prevents children's eyesight from deteriorating and provides an appropriate vision protection environment. It also makes it easier for parents to manage their children's device usage time and vision protection.

[2007] "Eye Protection Mode" is a function that dynamically adjusts the screen's color temperature and blue light to protect the user's eyesight.

[2008] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing on the screen based on the user's eyesight.

[2009] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break.

[2010] "Eye Exercises" is a feature that suggests visual exercises to users and encourages them to move their eye muscles.

[2011] The "timer function" is a function that allows you to set the amount of time you can use the app and displays a notification to the user when the set time has elapsed.

[2012] "Filter parameters" are setting information for color temperature and blue light reduction obtained from the server.

[2013] "Layout parameters" are layout setting information such as font size and line spacing obtained from the server.

[2014] A "server" is a device on a network that generates and provides filter parameters and layout parameters.

[2015] "Means for dynamically adjusting the color temperature of the screen" is a technology that appropriately changes the color temperature of the screen based on time information and the user's visual state.

[2016] "Means for dynamically optimizing screen display" refers to technology that optimizes the screen layout and display content in real time based on parameters obtained from the server.

[2017] The following describes the mode for implementing the present invention. The system of the present invention combines a vision protection mode, layout optimization, a reminder function, exercises to promote eye movement, and a timer function to limit the time spent using apps. The main functions of the present invention and specific implementation methods thereof are described below.

[2018] Eye Comfort Mode

[2019] When the app is launched, the device obtains the current time and sends it to the server. The server then generates appropriate filter parameters based on the time and sends them to the device. Based on these filter parameters, the device adjusts the screen's color temperature and reduces blue light, allowing users to use the app in a lighting environment that is gentle on the eyes. For example, at night, the screen's color temperature can be changed to a warmer color and blue light can be reduced.

[2020] Layout optimization

[2021] The user takes a visual acuity test and enters the results into the device. The device then sends this data to the server, which generates optimal layout parameters (such as font size and line spacing) based on the visual acuity test results. These are then sent to the device, which then dynamically adjusts each element on the screen. This allows the user to use the app with a layout that is easy to see. For example, if the user has poor eyesight, the font size can be increased and the line spacing widened to make it easier to see.

[2022] Reminder function

[2023] When the device launches the app, it reads the reminder settings and starts the timer. After a certain amount of time has passed, the device displays a notification encouraging the user to take a break. When the notification is displayed, the user can temporarily stop using the app and rest their eyes. For example, the device could display a notification saying "Take a break!" every 60 minutes.

[2024] eye exercise exercises

[2025] The device periodically displays notifications suggesting eye exercises to the user. When the user starts the exercise, the device provides an interactive game, encouraging the user to follow an on-screen character with their eyes. This exercise helps exercise eye muscles and protect eyesight. For example, a game in which a character moves randomly can be played, and the user can follow it with their eyes.

[2026] App Timer

[2027] After the user sets the app usage time, the device starts a timer to count down that time. When the set time has elapsed, the device displays a notification to the user that the usage time has ended and limits the use of the app. This prevents eye strain caused by using the app for long periods of time and allows the user to take appropriate breaks. For example, if the usage time is set to one hour, a notification will be displayed saying "Usage time is over. Take a break!" when that time has elapsed.

[2028] Server-side processing

[2029] The server generates filter and layout parameters using the time information and vision test results sent from the device. This processing is performed using specific software on the server (e.g., Python, Amazon Web Services (AWS), etc.). The generated parameters are sent to the device and used to adjust the display on the device.

[2030] Specific examples and input examples to generative AI models

[2031] For example, if you install this application on a smartphone used by a third-grader, when it is used at 8 p.m., the app will automatically apply a blue light filter and change the screen to warmer colors. Based on the results of a vision test, it will also increase the font size and increase the line spacing. Every 60 minutes, the app will send a message saying, "Take a rest!"

[2032] Example prompt for input to a generative AI model:

[2033] Generate code for a smartphone app that automatically applies a blue light blocking color temperature filter based on the current time and displays a reminder to take a break from eye contact at regular intervals. Dynamically adjust font size and optimize line spacing based on the results of a visual acuity test. Also, add a feature that suggests eye exercises to users through an exercise function.

[2034] As described above, this invention is a system that integrates major functions to prevent deterioration of children's eyesight and provide an appropriate eyesight protection environment.

[2035] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2036] Step 1:

[2037] When the device launches the app, it gets the current time. The input is the system time of the user device, and the output is the current time data. This time data is used in the next step.

[2038] Step 2:

[2039] The terminal sends the acquired time data to the server. The input is the time data acquired in step 1, and the output is the request sent to the server.

[2040] Step 3:

[2041] The server generates filter parameters based on the time data received. The input is the time data sent from the device, and the data is processed to calculate the appropriate color temperature and blue light reduction parameters for the time of day. The output is the generated filter parameters.

[2042] Step 4:

[2043] The server sends the generated filter parameters to the terminal. The input is the filter parameters, and the output is the data to be sent to the terminal.

[2044] Step 5:

[2045] The terminal adjusts the color temperature of the screen based on the filter parameters received. The input is the filter parameters received from the server, and the screen settings are changed as data processing. The output is the adjusted screen display.

[2046] Step 6:

[2047] The user takes a vision test and inputs the results into the terminal. The input is the vision test result data entered by the user, and the output is the data stored in the terminal.

[2048] Step 7:

[2049] The terminal sends the vision test result data to the server. The input is the vision test result data, and the output is sending a request to the server.

[2050] Step 8:

[2051] The server generates layout parameters based on the vision test results received. The input is the vision test result data sent from the terminal, and the optimal font size and line spacing are calculated as data processing. The output is the generated layout parameters.

[2052] Step 9:

[2053] The server sends the generated layout parameters to the terminal. The input is the layout parameters, and the output is the data to be sent to the terminal.

[2054] Step 10:

[2055] Based on the layout parameters received by the device, each element on the screen is dynamically adjusted. The input is the layout parameters received from the server, and the screen layout is changed as data processing. The output is a screen display that has been adjusted to be easy to see.

[2056] Step 11:

[2057] When the device launches the app, it reads the reminder settings and starts the timer. The input is the reminder setting data in the device, and the output is the start of the reminder timer.

[2058] Step 12:

[2059] After a certain time has passed, the device displays a notification to the user to encourage them to take a break. The input is the status data of the reminder timer, and the output is the notification display to the user.

[2060] Step 13:

[2061] The device periodically displays a notification to the user suggesting eye exercises. The input is the exercise notification setting data, and the output is the notification display to the user.

[2062] Step 14:

[2063] When the user starts exercising, the device provides an interactive game, prompting the user to follow an on-screen character. The input is the user's operation to start the exercise, and the output is the start of the exercise game.

[2064] Step 15:

[2065] After the user sets the app usage time, the device starts a timer to count down that time. The input is the usage time data set by the user, and the output is the start of the usage timer.

[2066] Step 16:

[2067] When the set time has elapsed, the device displays a notification to the user that usage time has ended and restricts app use. The input is the timer countdown status data, and the output is a notification to the user that usage has ended.

[2068] The above is a detailed description of the processing steps of the system program for realizing the application example.

[2069] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2070] This invention relates to an application for preventing vision loss for children, and is characterized by combining a vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer with an emotion engine.

[2071] Introducing the Emotion Engine

[2072] The emotion engine uses cameras and sensors to recognize the user's emotions and adjusts the behavior of each feature based on that emotional state, thereby providing a more personalized user experience.

[2073] Eye Comfort Mode

[2074] When the app is launched, the device uses the camera to capture the user's face, and the emotion engine analyzes the image to determine the user's emotion. The device also obtains the current time and sends this information to the server. The server generates optimal filter parameters (color temperature and blue light reduction level) based on the time information and the user's emotion data and sends them to the device. For example, if it is nighttime and the server determines that the user is tired, it will apply settings that adopt a warmer color temperature and more strongly reduce blue light. This allows the user to use the app in a lighting environment that is gentle on the eyes.

[2075] Layout optimization

[2076] After the user takes the vision test, they enter the results into their device. The device then sends the vision test results, along with the user's emotional data captured by the camera, to the server. The server analyzes this data and determines the optimal font size and line spacing. For example, if the server determines that the user has poor eyesight and is unable to concentrate, it will send settings to the device to make the font size larger than usual and increase the line spacing. This allows the user to use the app with an optimized layout.

[2077] Reminder function

[2078] When the app is launched, the device reads the reminder settings and uses the camera to recognize the user's emotions. The timing of the reminder is not only based on a pre-set time interval, but is also adjusted taking into account the user's emotional state. For example, if the device determines that the user is concentrating on their work, it can delay the reminder notification a little. When the time comes, the device will display a notification encouraging the user to take a break.

[2079] eye exercise exercises

[2080] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification is displayed, the camera is used to assess the user's emotional state. If the user's emotions are judged to be, for example, enjoyment or relaxation, the exercise continues. Conversely, if the user is judged to be feeling stressed, the exercise content is changed to a more relaxing one. This allows the user to enjoy eye exercise.

[2081] App Timer

[2082] After the user sets the app usage time, the device not only counts down the set time but also continuously monitors the user's emotions using the camera. When the time has elapsed, the device will display a notification to encourage the user to quit using the app. If the emotion engine determines that the user is already tired, the device can notify the user earlier than the scheduled time. This allows the user to quit the app at the appropriate time and rest their eyes.

[2083] In this way, by combining the emotion engine with the vision protection mode, layout optimization, reminder function, eye exercise exercises, and app timer, the system can make fine adjustments according to the user's emotional state, more effectively preventing the deterioration of children's eyesight.

[2084] The processing flow will be explained below.

[2085] Eye protection mode processing steps using emotion engine

[2086] Step 1:

[2087] The device launches the app, first launching the camera to capture the user's face, and then getting the current time from the system clock.

[2088] Step 2:

[2089] The device sends the captured face image and the acquired time information to the server using an API request.

[2090] Step 3:

[2091] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as recognizing emotions like "tired" or "concentrated."

[2092] Step 4:

[2093] The server generates optimal filter parameters based on time information and the user's emotional data. If it is nighttime and the user is judged to be "tired," the server will set the color temperature to warmer colors and increase blue light reduction.

[2094] Step 5:

[2095] The server sends the generated filter parameters to the device and returns them in the API response.

[2096] Step 6:

[2097] The device receives the filter parameters and adjusts the screen's color temperature and blue light level, changing the screen settings to provide the user with the optimal lighting environment.

[2098] Step 7:

[2099] The user starts using the app in the optimized eye comfort mode, with color temperature and blue light adjusted.

[2100] Processing steps for layout optimization using emotion engine

[2101] Step 1:

[2102] Users take a visual acuity test within the app and enter the results into their device. The visual acuity test is carried out using a dedicated tool.

[2103] Step 2:

[2104] The device sends the results of the eye test and a facial image captured by the camera to the server, sending this data via an API request.

[2105] Step 3:

[2106] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as "tired" or "unhappy."

[2107] Step 4:

[2108] The server generates optimal layout parameters (such as font size and line spacing) based on the results of the vision test and emotional data. If the user's vision is poor and the user is judged to be "tired," the server will increase the font size and widen the line spacing.

[2109] Step 5:

[2110] The server sends the generated layout parameters to the device and returns the parameters in the API response.

[2111] Step 6:

[2112] The device receives the layout parameters and dynamically adjusts the text and image sizes within the app, optimizing the content displayed to the user.

[2113] Step 7:

[2114] Users can use the app with an optimized layout, with font size and line spacing settings that suit their eyesight and emotions.

[2115] Processing steps of the reminder function incorporating an emotion engine

[2116] Step 1:

[2117] When the device launches the app, it reads the reminder settings and activates the camera to capture the user's face.

[2118] Step 2:

[2119] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[2120] Step 3:

[2121] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "concentrated" or "relaxed."

[2122] Step 4:

[2123] The device adjusts the timing of reminders based on emotion data, delaying reminder notifications if the user is deemed to be "concentrated."

[2124] Step 5:

[2125] The device will display a notification to the user at the set time to encourage them to take a break. A pop-up message will appear saying "Rest your eyes!"

[2126] Step 6:

[2127] Users receive a notification to temporarily stop using the app and rest their eyes.

[2128] Processing steps of eye movement exercise using emotion engine

[2129] Step 1:

[2130] The device periodically displays eye exercise notifications to the user and activates the camera to capture the user's face.

[2131] Step 2:

[2132] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[2133] Step 3:

[2134] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, such as whether they are having fun or feeling stressed.

[2135] Step 4:

[2136] The device adjusts the exercise content based on the user's emotions. If the device determines that the user is "stressed," it changes the exercise to a more relaxing one.

[2137] Step 5:

[2138] The user starts an eye exercise. The user selects an in-app game mode.

[2139] Step 6:

[2140] The device provides an interactive character tracking game. The game starts with the characters moving randomly on the screen.

[2141] Step 7:

[2142] The user follows the character with their eyes and completes the exercise. By continuing to follow the character with their eyes, they exercise their eye muscles.

[2143] Step 8:

[2144] The device will notify you when the exercise is complete and will display the message "Eye exercise completed!" when the game ends.

[2145] Processing steps for app timers using emotion engines

[2146] Step 1:

[2147] The user sets the app usage time by entering the desired usage time on the settings screen within the app.

[2148] Step 2:

[2149] The device starts a timer to count down the set usage time, and activates the camera to monitor the user's face.

[2150] Step 3:

[2151] The device sends the captured facial image to the server, and the user's facial image is sent via an API request.

[2152] Step 4:

[2153] The server analyzes the facial image data and uses an emotion engine to determine the user's emotional state, recognizing emotions such as "tired" or "concentrated."

[2154] Step 5:

[2155] The device continuously monitors emotional data during use and adjusts timer settings as needed. For example, if the device detects that the user is already tired, it will notify the user to end the timer earlier than scheduled.

[2156] Step 6:

[2157] The device displays a notification to the user that their screen time is over based on a set time or emotional state. It displays the message "Your screen time is over. Rest your eyes!"

[2158] Step 7:

[2159] The user checks the notification, ends the app, and takes a break.

[2160] Step 8:

[2161] The device temporarily disables the app, restricting access to the app until a set break has elapsed.

[2162] These are the specific processing steps for each function of the eyesight loss prevention system that combines the emotion engine. This allows for fine-tuned adjustments based on the user's emotional state, making it possible to more effectively prevent children's eyesight loss.

[2163] Example 2

[2164] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2165] Conventional vision loss prevention systems have not been finely adjusted to suit the user's condition, making it difficult to effectively prevent vision loss. In particular, because settings are applied uniformly based on certain environments and conditions, there is a problem in that it is not possible to provide optimal support according to the individual state and emotions of each user.

[2166] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for providing a eyesight protection mode, a means for optimizing a layout, a means having a reminder function for prompting a break at regular intervals, a means for providing exercises to promote eye movement, a means having a timer function for limiting the usage time of an application, and a means for adjusting the operation of each means based on the emotional state of the user using an emotion recognition engine. This allows each function to be optimized based on the emotional state of the user and the results of a vision test, enabling more effective prevention of vision loss.

[2167] "Eye protection mode" is a function that adjusts the screen color temperature and blue light reduction level to protect the user's eyesight.

[2168] "Layout optimization" is a function that improves visibility by adjusting the font size and line spacing of displayed text based on the user's vision test results and emotional state.

[2169] The "reminder function" is a function that displays a notification to encourage users to take a break after a certain amount of time has passed.

[2170] "Eye Exercises" is a feature that encourages users to do specific eye exercises to maintain eye health.

[2171] The "timer function" monitors the application usage time and notifies the user when the set time has elapsed.

[2172] An "emotion recognition engine" is a system that uses a camera or sensor to capture a user's face and determine the user's emotional state through image analysis.

[2173] "Filter parameters" are settings that are adjusted to protect eyesight, such as the screen's color temperature and blue light reduction level.

[2174] "Font size" refers to the size of the characters displayed and is adjusted according to the user's eyesight.

[2175] "Line spacing" refers to the vertical space between displayed text and is adjusted according to the user's visual acuity and emotional state.

[2176] This invention is an application system for preventing vision loss, which uses an emotion recognition engine to adjust the operation of various functions based on the user's emotional state, providing a personalized user experience. Specifically, it is equipped with a vision protection mode, layout optimization, reminder function, eye exercises, and a timer function to manage application usage time.

[2177] Introducing an emotion recognition engine

[2178] The emotion recognition engine is a system that uses the built-in camera and sensors of smartphones and tablet devices to capture the user's face and determine their emotional state through image analysis. This enables the following functions:

[2179] Eye Comfort Mode

[2180] When the app is launched, the device uses the camera to capture the user's face, and the emotion recognition engine analyzes the image to determine the user's emotions. This includes analyzing facial expressions. For example, if the face is determined to look tired, the color temperature is set to 2500K and the blue light reduction level is increased. The device obtains the current time and sends this information to the server. The server then generates optimal filter parameters based on the time information and the user's emotion data and sends them to the device, thereby protecting the user's eyesight.

[2181] Layout optimization

[2182] After the user takes the vision test, they enter the results into the device. The device also uses its camera to capture emotional data and sends this information to the server. The server analyzes the vision test results and emotional data and optimizes font size and line spacing. For example, if it determines that the user has poor eyesight and is unable to concentrate, it will increase the font size and increase the line spacing by sending settings to the device to improve visibility.

[2183] Reminder function

[2184] When the app launches, the device reads the reminder settings and simultaneously uses the camera to recognize the user's emotions. The app adjusts reminder notifications based not only on the set interval, but also on the user's emotional state. For example, if the app determines that the user is concentrating on a task, it can delay the notification. When the time comes, the device will display a notification to the user saying, "Please take a break."

[2185] eye exercise exercises

[2186] The device periodically displays a notification to the user informing them that an eye exercise has begun. When the notification appears, the device uses the camera to assess the user's emotional state. If the device determines that the user is enjoying or relaxed during the exercise, it continues the exercise. Conversely, if the device determines that the user is feeling stressed, it changes the exercise to make it more relaxing.

[2187] Application Timer

[2188] After the user sets the application usage time, the device counts down the set time. It also continuously monitors the user's emotions using the camera. When the time expires, the device displays a notification to encourage the user to stop using the app. If the emotion recognition engine determines that the user is already tired, the device can send the notification earlier than the scheduled time.

[2189] (Example)

[2190] Example of the emotion recognition engine in action:

[2191] Prompt: "How can I set it to reduce blue light when the user is fatigued?"

[2192] Hardware used: Smartphone camera, server

[2193] Software used: Emotion recognition AI, blue light filter

[2194] Data processing and calculation: Emotion recognition, filter parameter generation, data transmission, setting application

[2195] The system utilizes an emotion recognition engine to optimize various functions, such as eye protection mode, layout optimization, reminder function, and eye exercise exercises, to effectively prevent users' eyesight from deteriorating.

[2196] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2197] Eye Comfort Mode

[2198] Step 1:

[2199] When the app is launched, the device uses the camera to capture the user's face.

[2200] Input: App launch event

[2201] Output: User's face image

[2202] How it works: When the app is launched, the device's built-in camera automatically activates and takes a picture of the user's face.

[2203] Step 2:

[2204] The device passes the facial image to an emotion recognition engine for emotion recognition.

[2205] Input: User's face image

[2206] Output: User's emotional state (tired, relaxed, etc.)

[2207] How it works: An analytics algorithm analyzes images and identifies emotional states from facial expressions.

[2208] Step 3:

[2209] The device uses the system clock to obtain the current time.

[2210] Input: None

[2211] Output: current time

[2212] Action: The internal clock returns the current time.

[2213] Step 4:

[2214] The device sends emotion data and the current time to the server.

[2215] Input: Emotion data, current time

[2216] Output: Send data package to server

[2217] How it works: Emotion data and time are packaged together and sent to the server using the communication module.

[2218] Step 5:

[2219] The server receives the data and generates optimal filter parameters.

[2220] Input: Emotion data, current time

[2221] Output: Optimal filter parameters (color temperature, blue light reduction level)

[2222] How it works: An algorithm calculates the response and generates filter parameters based on the data. For example, if it detects you are "tired" at night, it will lower the color temperature and cut blue light.

[2223] Step 6:

[2224] The server sends the generated filter parameters to the terminal.

[2225] Input: Optimal filter parameters

[2226] Output: Data sent to the terminal

[2227] What it does: Packages parameters and sends them to the device.

[2228] Step 7:

[2229] The terminal applies the received filter parameters.

[2230] Input: Optimal filter parameters

[2231] Output: Adjusted display settings

[2232] What it does: Updates display settings to adjust color temperature and blue light reduction levels.

[2233] Layout optimization

[2234] Step 1:

[2235] The user performs a vision test.

[2236] Input: Start vision test

[2237] Output: Vision test result data

[2238] What it does: The app presents the user with a vision test and collects the results.

[2239] Step 2:

[2240] The user inputs the results of the vision test into the terminal.

[2241] Input: Eye test results

[2242] Output: Data input to the terminal

[2243] Action: Enter the test results into the app's input form.

[2244] Step 3:

[2245] The device uses a camera to capture emotion data.

[2246] Input: Facial image (during vision test)

[2247] Output: Emotion data

[2248] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[2249] Step 4:

[2250] The device sends the vision test results and emotion data to the server.

[2251] Input: Eye test results, emotion data

[2252] Output: Data sent to the server

[2253] What it does: Packages the data and sends it to the server.

[2254] Step 5:

[2255] The server receives the data and determines the optimal font size and line spacing.

[2256] Input: Eye test results, emotion data

[2257] Output: Optimal font size and line spacing

[2258] How it works: A data-driven analytical algorithm calculates the optimal value. For example, if your visual acuity is 0.6 and your concentration is declining, increase the font size and increase the line spacing.

[2259] Step 6:

[2260] The server sends the determined settings to the terminal.

[2261] Input: Optimal font size and line spacing

[2262] Output: Data sent to the terminal

[2263] What it does: Packages configuration data and sends it to the device.

[2264] Step 7:

[2265] The device applies the received settings.

[2266] Input: Optimal font size and line spacing

[2267] Output: Updated layout

[2268] Behavior: Updates the app's display settings to provide the optimal layout for the user.

[2269] Reminder function

[2270] Step 1:

[2271] The device loads the reminder settings when the app is launched.

[2272] Input: App launch event

[2273] Output: Reminder setting data

[2274] What it does: Reads reminder settings (e.g., take a break every 30 minutes) from the app configuration file.

[2275] Step 2:

[2276] The device uses a camera to capture emotion data.

[2277] Input: Face image

[2278] Output: Emotion data

[2279] How it works: A face is photographed with a camera and analyzed by an emotion recognition engine.

[2280] Step 3:

[2281] The device calculates the reminder timing.

[2282] Input: Reminder settings, emotion data

[2283] Output: Adjusted reminder timing

[2284] How it works: Optimizes timing based on your settings and emotional data, for example delaying notifications by 10 minutes if you're distracted.

[2285] Step 4:

[2286] The device will display a notification prompting you to take a break at the specified time.

[2287] Input: Reminder timing

[2288] Output: Notification display

[2289] What it does: Pops up a notification saying "Take a break" at the specified time.

[2290] (Examples and prompts)

[2291] Prompt: "How can I set reminder notifications to be delayed when the user is distracted?"

[2292] Hardware used: Smartphone camera, server

[2293] Software used: Emotion recognition AI, notification system

[2294] Data processing and calculation: Emotion recognition, reminder timing calculation, notification display

[2295] By clearly indicating the specific data input, output, and operation for each step, the processing flow of each function of this system to prevent vision loss becomes clear.

[2296] (Application example 2)

[2297] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2298] In today's digital environment, there are concerns that children's long hours of use of digital devices such as smartphones and tablets may lead to a decline in their eyesight. Furthermore, there are a lack of measures to limit usage time and encourage appropriate breaks, and no consideration is given to entertainment elements that children can enjoy without getting bored. The present invention aims to solve these problems by providing a system that prevents children's eyesight from declining and allows them to use digital devices in a fun and healthy way.

[2299] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a eyesight protection mode, means for optimizing the layout, means for having a reminder function for encouraging breaks at regular intervals, means for providing exercises to promote eye movement, means for having a timer function for limiting the amount of time spent using apps, and emotion engine means for recognizing the user's emotions using a camera or sensor and adjusting the operation of each function based on the user's emotional state. This makes it possible for children to enjoy using digital devices while effectively protecting their eyesight and encouraging them to take breaks at appropriate times.

[2300] "Eye protection mode" is a function that protects the user's eyesight by changing the screen settings of digital devices to reduce blue light and adjust color temperature.

[2301] "Layout optimization" means automatically adjusting font size and line spacing based on the user's visual acuity test results and emotional state to provide the most legible screen layout for the user.

[2302] The "reminder function" is a function that displays a notification to the user at regular intervals to encourage them to take a break, and adjusts the timing based on the user's emotional state to encourage appropriate breaks.

[2303] "Eye Exercises" is a feature that instructs users on eye-resting exercises and workouts, adjusting them based on their emotional state.

[2304] The "timer function" is a function that allows you to set the amount of time you use a digital device, and when that time has elapsed, a notification will be displayed to end the use.

[2305] The "emotion engine" uses cameras and sensors to recognize the user's emotions and adjusts the operation of each function of the system based on that emotional state.

[2306] This invention is a system that uses cameras and sensors to recognize a child's emotional state and adjusts functions such as vision protection, layout optimization, reminders, eye exercises, and app timers based on that information. Specific embodiments of this system are shown below.

[2307] System configuration

[2308] The system consists of digital devices such as smartphones and tablets, and a server that processes and analyzes data. The main hardware and software components are as follows:

[2309] 1. Hardware:

[2310] Device: A smartphone or tablet with a camera and sensors.

[2311] Server: A server for analyzing data and configuring applications.

[2312] 2. Software:

[2313] Emotion recognition algorithm: Uses OpenCV, DeepFace, etc.

[2314] Data transmission and reception API: An API for transmitting and receiving data between a terminal and a server.

[2315] Eye protection settings engine: Reduces blue light and adjusts color temperature.

[2316] UI / UX optimization engine: Adjust font size and line spacing.

[2317] Timer function: A timer to manage app usage time.

[2318] Entertainment module: Offers mini-games and eye exercises.

[2319] System Operation

[2320] 1. Emotion recognition: The device uses the camera to capture the child's face and recognizes their emotional state in real time through an emotion recognition algorithm.

[2321] 2. Eye Care Mode: The device sends time and emotion data to the server, which then generates optimal filter parameters and sends them to the device. When it is nighttime or when you are tired, the blue light reduction level is set high.

[2322] 3. Layout optimization: The device sends the vision test results and emotion data to the server, which analyzes the data and sends layout settings that optimize font size and line spacing to the device.

[2323] 4. Reminder function: The device will display reminder notifications to the user and adjust the timing of notifications depending on the user's emotional state. If the user is concentrating, the device will delay the reminder to encourage them to take a break.

[2324] 5. Eye Exercises: It periodically notifies you of exercises and changes them depending on your emotional state. If you enjoy them, it keeps you going, but if you feel stressed, it shifts to something more relaxing.

[2325] 6. App Timer: Your device will count down your set usage time and notify you based on your emotional state, encouraging you to stop using the app earlier if you feel tired.

[2326] Example

[2327] This system can be used in brick-and-mortar stores such as bookstores and cafes where children are using smartphones or tablets, providing both vision protection and entertainment.

[2328] Prompt Sentence Examples

[2329] "Based on the current time and a camera image of the user's face, recognize the child's emotional state and set the eye protection mode accordingly, changing the color temperature of the smartphone to a warmer tone and reducing blue light. Also, incorporate the user's eye test results to create settings that optimize the font size of the UI."

[2330] The invention can be carried out in the above manner.

[2331] The ...

Claims

1. means for providing an eyesight-saving mode; a means for optimizing the layout; A means with a reminder function to encourage breaks at regular intervals, a means for providing exercises to promote eye movement; A timer function that limits the usage time of the app, A system including:

2. 10. The system of claim 1, further comprising means for reducing blue light and adjusting color temperature in the eyesight conservation mode.

3. 2. The system of claim 1, further comprising a layout optimization means for adjusting font size and line spacing based on the results of a user's visual acuity test.

Images