A wearable study assistant device and a study assistant system comprising the same

Abstract

A wearable learning aid device (100) may be provided. The wearable learning aid device (100) may include: a glasses body (10); a camera (20) configured to be provided in at least a portion of the glasses body (10) and configured to photograph a user's learning material; and a wireless communication module (80) configured to transmit an image captured by the camera (20) to a server (300) via a user terminal (200).

Description

Technology Field

[0001] The present invention relates to a wearable learning aid device and a learning aid system including the same. More specifically, the invention relates to a wearable learning aid device implemented as glasses, which is configured to propose a customized learning method to a student by analyzing the student's learning style, learning performance, and areas for improvement based on AI as a result of the student wearing the learning aid device and performing learning; to induce the student to concentrate more on learning by monitoring the student's attitude or posture during the learning process; to improve the student's service satisfaction by having an AI tutor on the server side analyze and respond to the student's learning-related inquiries in real time; and to promote the improvement of the student's grades by inducing the student to solve similar problems with correct answers in the future by having the server side automatically sort and analyze categories based on AI for the student's incorrect answers and provide them to the student. Background Technology

[0002] With the recent popularization of mobile devices such as smartphones and tablets, learning support services utilizing these devices are being provided to students in various forms. Students access learning service servers using mobile devices like phones and tablets, and proceed with their studies according to the diverse educational content and curricula provided by the connected service servers.

[0003] However, since these mobile device-based learning support services are based on simply broadcasting pre-recorded lecture videos, they are mostly unsuitable for the level, skill level, and learning style of each student watching the lecture videos. In particular, there is a limitation in that students cannot immediately ask questions or inquire with the teacher about problems they do not know or problems they got wrong. Consequently, these mobile device-based online lectures are not very appealing to students, especially those with lower grades.

[0004] Therefore, in order to overcome the problems and limitations of existing online lecture methods, there is a rapidly increasing need in the industry for a new type of wearable learning aid device and a learning aid system that includes it. This device is configured to suggest a customized learning method to the student by analyzing their learning style, learning performance, and areas for improvement based on AI as a result of the student wearing a learning aid device implemented in the form of glasses and performing learning; to encourage the student to focus more on learning by monitoring the student's attitude or posture during the learning process; to improve the student's service satisfaction by having an AI tutor on the server side analyze and respond to the student's learning-related inquiries in real time; and to promote the improvement of the student's grades by automatically categorizing and analyzing incorrect answers on the server side and providing them to the student to encourage them to solve similar problems in the future. The problem to be solved

[0005] The present invention is designed to solve the above-mentioned problems. The present invention aims to provide a wearable learning aid device and a learning aid system including the same, which can propose a customized learning method to a student by analyzing the student's learning style, learning performance, and learning improvement points based on AI as a result of the student wearing a learning aid device implemented in the form of glasses and performing learning.

[0006] In addition, the present invention aims to provide a wearable learning assistance device and a learning assistance system including the same, which can induce a student to focus more on learning by monitoring the student's attitude or posture during the learning process.

[0007] In addition, the present invention aims to provide a wearable learning assistance device and a learning assistance system including the same, which can improve student service satisfaction by having a server-side AI tutor analyze and respond to a student's learning-related inquiries in real time.

[0008] In addition, the present invention aims to provide a wearable learning assistance device and a learning assistance system including the same, which can improve a student's grades by automatically categorizing and analyzing the student's incorrect answers on the server side using AI and providing them to the student, thereby inducing the student to solve similar problems with correct answers in the future.

[0009] In addition, the present invention aims to provide a wearable learning assistance device and a learning assistance system including the same, which can create the effect of private tutoring by utilizing a server-side AI tutor to provide real-time AI-based responses to matters, inquiries, and questions that students are curious about, and thereby alleviate the financial burden on parents regarding private education costs.

[0010] In addition, the present invention aims to provide a wearable learning assistance device and a learning assistance system including the same, which enables students to focus more on learning by identifying a student's learning content based on camera-captured video and selecting and playing customized music for the identified learning content.

[0011] In addition, the present invention aims to provide a wearable learning assistance device and a learning assistance system including the same, which allows a student to wear a learning assistance device implemented in the form of glasses and transmit video, time, analysis results, etc., of the student performing learning to their parents, thereby enabling the student to take on a role similar to that of a parent when parents are absent at home, and thereby further improve the satisfaction of parent users.

[0012] The technical problems of the present invention are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0013] A wearable learning aid device according to one embodiment of the present invention for solving the above technical problem may include: a glasses body; a camera configured to photograph a user's learning material provided in at least a portion of the glasses body; and a wireless communication module configured to transmit an image captured by the camera to a server through a user terminal.

[0014] In addition, the wireless communication module may be further configured to transmit at least a portion of the images of the learning material among the images captured by the camera to the server as a query through the user terminal.

[0015] Additionally, the wearable learning assistance device may further include a display configured to visually represent a response to the query received from the server; and a speaker configured to audibly represent a response to the query received from the server.

[0016] In addition, the wearable learning assistance device may be configured to turn the learning mode on or off.

[0017] In addition, a learning assistance system according to another embodiment of the present invention for solving the above technical problem may include the above-mentioned wearable learning assistance device; a user terminal coupled to communicate with the wearable learning assistance device; and a server coupled to communicate with the user terminal. Effects of the invention

[0018] According to a wearable learning assistance device and a learning assistance system including the same according to one embodiment of the present invention, a customized learning method can be proposed to a student by analyzing the student's learning style, learning performance, and learning improvement points based on AI as a result of the student wearing a learning assistance device implemented in the form of glasses and performing learning.

[0019] In addition, according to one embodiment of the present invention, a wearable learning assistance device and a learning assistance system including the same can be used to induce a student to focus more on learning by monitoring the student's attitude or posture during the learning process.

[0020] In addition, according to a wearable learning assistance device and a learning assistance system including the same according to one embodiment of the present invention, a server-side AI tutor can analyze and respond in real time to a student's learning-related inquiries, thereby improving the student's service satisfaction.

[0021] In addition, according to a wearable learning assistance device and a learning assistance system including the same according to one embodiment of the present invention, the server side automatically sorts and analyzes the student's incorrect answers into categories based on AI and provides them to the student, thereby encouraging the student to solve similar problems with correct answers in the future and promoting the improvement of the student's grades.

[0022] In addition, according to a wearable learning assistance device and a learning assistance system including the same according to one embodiment of the present invention, by utilizing a server-side AI tutor to provide real-time responses based on AI to matters, inquiries, and questions that students are curious about, the effect of private tutoring can be created, and accordingly, the financial burden on parents regarding private education costs can be alleviated.

[0023] In addition, according to one embodiment of the present invention, a wearable learning assistance device and a learning assistance system including the same can identify a student's learning content based on camera footage and select and play customized music for the identified learning content, thereby enabling students to focus more on their studies.

[0024] In addition, according to one embodiment of the present invention, a wearable learning assistance device and a learning assistance system including the same can transmit video, time, analysis results, etc., of a student wearing a learning assistance device implemented in the form of glasses and performing learning to a parent, thereby enabling the student to take on a role similar to that of a parent when the parent is absent at home, and thereby further improve the satisfaction of the parent user. Brief explanation of the drawing

[0025] A brief description of each drawing is provided to help to more fully understand the drawings cited in the detailed description of the present invention. FIG. 1 shows a perspective view of a wearable learning assistance device (100) according to one embodiment of the present invention. FIG. 2 is a schematic block diagram of a wearable learning assistance device (100) and a learning assistance system (1000) including the same according to one embodiment of the present invention. FIG. 3 is an example diagram illustrating a drowsiness detection and notification service among learning assistance scenarios implemented according to an embodiment of the present invention. FIG. 4 is an example diagram illustrating a query service for unknown problems during the learning process among learning assistance scenarios implemented according to an embodiment of the present invention. FIG. 5 is an example diagram illustrating the database creation of incorrect answers and automatic category classification among learning assistance scenarios implemented according to an embodiment of the present invention. Specific details for implementing the invention

[0026] Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings. It should be noted that in assigning reference numerals to the components of each drawing, the same components are given the same reference numeral whenever possible, even if they are shown in different drawings. Furthermore, in describing the embodiments of the present invention, if it is determined that a detailed description of related known components or functions would hinder understanding of the embodiments of the present invention, such detailed description is omitted. Additionally, while embodiments of the present invention will be described below, the technical concept of the present invention is not limited or restricted thereto and can be modified and implemented in various ways by those skilled in the art.

[0027] Throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "indirectly connected" with other elements interposed between them. Throughout the specification, when a part is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, in describing the components of the embodiments of the present invention, terms such as first, second, A, B, (a), (b), etc., may be used. These terms are used merely to distinguish the component from other components, and the essence, order, or sequence of the component is not limited by such terms.

[0029] The wearable learning aid device (100) according to the present invention is characterized by being configured to suggest a customized learning method to a student by analyzing the student's learning style, learning performance, and learning improvement points based on AI as a result of the student wearing the learning aid device implemented in the form of glasses and performing learning, and to induce the student to concentrate more on learning by monitoring the student's attitude or posture during the learning process, and to improve the student's service satisfaction by having an AI tutor on the server side analyze and respond in real time to the student's learning-related inquiries, and to promote the improvement of the student's grades by automatically sorting and analyzing the student's incorrect answers based on AI on the server side and providing them to the student so that the student can solve similar problems with correct answers in the future. A perspective view of such a wearable learning aid device (100) is exemplarily illustrated in FIG. 1, and a schematic block diagram of the wearable learning aid device (100) according to the present invention and a learning aid system (1000) including the same is exemplarily illustrated in FIG. 2.

[0030] As illustrated in FIG. 1, the wearable learning aid device (100) according to the present invention can be implemented as a wearable device, that is, as a glasses type that can be worn by a user (e.g., a student, etc.), and accordingly, a degree of freedom can be secured so that students can use their hands freely while studying, which is in contrast to existing learning aid devices that are mainly fixed in a desktop form.

[0031] For reference, the following description describes a user who performs learning (or studying) while wearing the wearable learning aid device (100) according to the present invention as a representative student, but it will be obvious that all types of learners who perform learning for various purposes other than school admission (e.g., students preparing for exams, etc.) may also be included as users of the wearable learning aid device (100) according to the present invention.

[0032] Additionally, the wearable learning aid device (100) shown in FIG. 1 (which may be referred to by other terms such as a wearable learning aid device (100)) may be configured to communicate with a user terminal (200) and to transmit data such as the user's learning environment, posture, questions, and incorrect answers to a server (300). Based on this, the user may receive a user-customized learning process, method, etc. proposed from the server (300), more specifically from the AI ​​tutor (310) of the server (300) based on the results of analyzing learning data using artificial intelligence (AI). For example, such a service may be implemented as an application type, for example, as a so-called 'learning aid application' type, and provided to the user (and their parents).

[0033] As illustrated in FIG. 1, a wearable learning aid device (100) according to one embodiment of the present invention may be composed of a glasses body (10), a camera (20), a display (30), a speaker (40), a microphone (50), a charging port (60), a battery (70), a wireless communication module (80), a gyroscope sensor (90), etc.

[0034] For reference, the configuration (10, 20, 30, 40, 50, 60, 70, 80, 90) of the wearable learning aid device (100) illustrated in FIG. 1 is merely an exemplary configuration for explaining the operation, function, etc. of the wearable learning aid device (100) according to the present invention, and therefore it is evident that the wearable learning aid device (100) according to one embodiment of the present invention may additionally include other configurations (e.g., LED elements, etc.) other than the illustrated configuration (10, 20, 30, 40, 50, 60, 70, 80, 90).

[0035] The eyeglass body (10) may define the basic body or body of the wearable learning aid device (100) according to the present invention. As shown in FIG. 1, the eyeglass body (10) according to the present invention may be implemented in a form similar to ordinary eyeglasses so that a user can wear it across both ears and the left and right sides of the nose. However, as it may be manufactured in various sizes, colors, designs, etc., the user may be able to select the wearable learning aid device (100) that they desire (or prefer), and in some cases, it is also possible to manufacture the eyeglass body (10) according to the present invention and the wearable learning aid device (100) including it based on user custom manufacturing. For reference, although not explicitly shown in the drawings, the wearable learning aid device (100) according to the present invention may further include a case (not shown) for safe storage of the eyeglass body (10).

[0036] A camera (20) is provided in at least a portion of the main body of the glasses (10), more specifically provided on each end piece of the main body of the glasses (10) as shown in FIG. 1, and can be configured to photograph the front of a user wearing the wearable learning aid device (100), more specifically, when the study mode is set, a learning material (e.g., textbook, teaching material, test paper, etc.) located in front of the user.

[0037] Here, the video of the learning material captured by the camera (20) is transmitted to the server (300) in real time and can be utilized as important data for analyzing learning patterns and recommending user-customized learning methods, processes, etc. Additionally, by constructing the learning assistance system (1000) and the service according to the present invention so that the video captured by the camera (20) is also transmitted to the parent terminal (400), for example, in real time, there is an advantage that the parent can monitor the child's study status even when absent from home (even if present at home, without directly observing the study).

[0038] In addition, the image of the learning material captured by the camera (20) according to the present invention can be further utilized for a learning question / answer service, an incorrect answer note service, drowsiness detection, etc. For example, when a student has a problem they do not know well while studying, they can request a question from the server (300), more specifically from the AI ​​tutor (310), and at this time, the problem is effectively identified from the image captured by the camera (20), thereby enabling a more intuitive and faster question and a faster server response therefrom.

[0039] For reference, the scenario of querying the server (300) for unknown problems based on the video captured by the camera (20) and the scenario of database-ing incorrect problems (or wrong problems) and automatically sorting categories will be explained in more detail in FIGS. 4 and 5 below.

[0040] Additionally, the camera (20) according to the present invention may be implemented as a so-called depth camera or as a camera capable of emitting / receiving a laser, and may be configured to measure the distance between the wearable learning aid device (100) according to the present invention and the learning material. It is desirable for students to maintain an appropriate distance from textbooks, study materials, test papers, etc. while studying. If it is confirmed that the distance is closer than the recommended distance suggested by educational institutions or research, guidance on adjusting the distance appropriately may be provided to the student to improve learning efficiency and prevent deterioration of the student's eyesight.

[0041] To this end, distance data between a wearable learning aid device (100) and a learning material, measured by a camera (20) which can be implemented as a depth sensing camera or a laser-based distance measuring camera according to the present invention, may be transmitted to a server (300). When the measured distance is less than a threshold, the server (300) may control a display (30) provided in the wearable learning aid device (100) to visually display a predetermined warning message (e.g., text such as “The distance to the book is too close, please step back a little” is displayed on the display (30)), and / or control a speaker (40) provided in the wearable learning aid device (100) to audibly display a predetermined warning message (e.g., sound such as “The distance to the book is too close, please step back a little” is displayed through the speaker (40)), thereby supporting a student wearing the wearable learning aid device (100) according to the present invention to maintain an appropriate distance from a learning material that has been experimentally confirmed to have superior learning efficiency.

[0042] At this time, the server (300) may additionally implement object recognition of the target learning material based on the captured image of the camera (20), and the threshold for guiding the appropriate distance adjustment may be set differently depending on whether the target learning material is a book (e.g., textbook, study material, test paper, etc.) or a mobile device (e.g., PC, tablet, etc.).

[0043] More specifically, when the learning material being photographed is a book such as a textbook, a threshold for guiding appropriate distance adjustment may be pre-set as a first threshold, and when the learning material being photographed is a portable device such as a tablet, a threshold for guiding appropriate distance adjustment may be pre-set as a second threshold, wherein the second threshold may be greater than the first threshold (for example, the first threshold for a book may be 30 cm, and the second threshold for a portable device may be 100 cm).

[0044] For reference, FIG. 1 illustrates an exemplary configuration in which two cameras (20) are provided on the glasses body (10), but in the case of implementing a camera (20) configured to measure the distance to a front object based on an emitting laser and a radiation laser, only a single camera (20) may be provided on the front area of ​​the glasses body (10).

[0045] The display (30) is provided in at least a portion of the main body of the glasses (10), more specifically provided in each of a pair of lens areas as shown in FIG. 1, and can be configured to visually display various information, data, etc. related to learning assistance. More preferably, when the active mode of the wearable learning assistance device (100) is set to ON, the display (30) can be visually checked through the display (30), and when the active mode of the wearable learning assistance device (100) is set to OFF, the display (30) according to the present invention can be implemented as a transparent display so that it can be used as a lens of a normal pair of glasses.

[0046] In addition, there may be various ways to visually display information, data, etc. through a display (30) so that a user wearing the wearable learning aid device (100) according to the present invention can perceive it, and for example, a method may be adopted in which digital information is superimposed on a real environment using optical technology such as AR glasses so that the user interacts with the physical world and the digital world.

[0047] For example, when the distance between the wearable learning aid device (100) and the learning material, which is measured based on the camera (20), is measured to be less than a preset threshold, a warning message for appropriate distance adjustment / maintenance may be displayed through the display (30), and when a student sends a question to the server (300) regarding a problem they do not know well, a problem they want advice on, a problem they got wrong, etc. during the learning process, the response of the server (300) to the question, more specifically the response of the AI ​​tutor (310), may be displayed through the display (30) in the form of text, video, etc.

[0048] For reference, FIG. 1 illustrates a configuration in which a display (30) is provided on both lens areas of the eyeglass body (10), but according to another embodiment of the present invention, a display (30) may be selectively provided on only one of the two lens areas of the eyeglass body (10). In particular, when two displays (30) are provided in the wearable learning aid device (100) according to the present invention, the same content may be controlled to be displayed on each display (30), or the content may be divided into two and distributed to be displayed on each display (30).

[0049] A speaker (40) is provided in at least a portion of the main body of the glasses (10), and more specifically, as shown in FIG. 1, is provided in the temple (or arm) of the main body of the glasses (10) adjacent to the user's ear, and can be configured to audibly display various information, data, etc. related to assisting students in their learning. For reference, the speaker (40) according to the present invention may be provided in each of the two temples constituting the main body of the glasses (10), or may be selectively provided in only one of the two temples, and for example, the speaker (40) according to the present invention may be implemented as a bone conduction speaker, etc., which has an excellent effect of blocking external noise.

[0050] For example, when the distance between the wearable learning aid device (100) and the learning material, which is measured based on the camera (20), is measured to be less than a preset threshold, a warning message for appropriate distance adjustment / maintenance can be audibly displayed through the speaker (40), and when a student sends a question to the server (300) regarding a problem they do not know well, a problem they want advice on, a problem they got wrong, etc. during the learning process, the response of the server (300) to the question can be output through the speaker (40).

[0051] Additionally, the subject, topic, etc. of the learning material captured by the camera (20) according to the present invention can be specified in the server (300) (e.g., by analyzing the captured image of the camera (20)), and appropriate music (or sound waves) (e.g., verified / confirmed as having the best concentration) according to the specified subject, topic, etc. can be pre-set, and thus the server (300) can support further improvement of students' concentration on studying by causing appropriate music (or sound waves) to be output through the speaker (40) according to the subject, topic, etc. of the specified learning material (e.g., if the specified subject is mathematics, a first type of music (or sound waves) can be set and output, and if the specified subject is English, a second type of music (or sound waves) can be set and output).

[0052] For reference, although not explicitly shown in the drawing, the speaker (40) according to the present invention may additionally be provided with an earphone terminal, and accordingly, even if a student wears the wearable learning aid device (100) according to the present invention while studying in a public place such as a library or reading room, they can listen to answers to questions, music, etc. through the earphone connected to the speaker (40) without inconvenience.

[0053] The microphone (50) may be configured to receive the voice of a user who is wearing the wearable learning aid device (100) according to the present invention and performing learning. For example, when a student performs English speaking, the student's English voice may be collected through the microphone (50), and when the student asks the server (300) about problems they do not know, data such as voice inquiries may be collected through the microphone (50), and the voice information, data, voice control commands, etc. collected through the microphone (50) may be transmitted to the server (300) through the wireless communication module (80).

[0054] For example, in existing learning support systems / services, when students encounter problems they do not know well during the problem-solving process, there is the inconvenience of having to visit a teacher with the problem sheet in person or leave a question on a bulletin board and wait for an answer. However, according to the present invention, students can immediately query the server (300) about problems they do not know through a microphone (50) based on voice, and the AI ​​tutor (310) provides a real-time response to the student visually and / or audibly based on AI, for example, generative AI, thereby significantly improving the convenience and efficiency of the students' learning.

[0055] The charging port (60) may be configured to provide an electrical connection for charging the battery (70) of the wearable learning aid device (100) according to the present invention. The battery (70) according to the present invention may be implemented as a rechargeable battery, and the charging port (60) according to the present invention may be implemented as a C-type charging port, etc., to allow the battery (70) to be charged with a commercial power source (e.g., 220V, etc.), or may be implemented as a magnet-based charging port (60) so that the battery (70) can be charged by a wireless charging method.

[0056] The power charged to the battery (70) through the charging port (60) can be supplied to each component of the wearable learning aid device (100) according to the present invention, and the power of the battery (70) can be utilized, for example, for shooting operations of the camera (20), visual display operations of the display (30), auditory display operations of the speaker (40), voice collection operations of the microphone (50), and data transmission and reception operations of the wireless communication module (80).

[0057] Here, although not explicitly shown in the drawings, an indicator (not shown) indicating the remaining power of the battery (70) may be additionally provided in a part of the glasses body (10) of the wearable learning aid device (100) according to the present invention, and additionally, if the remaining power of the battery (70) is less than a preset threshold, this may be visually indicated through the display (30) and / or audibly indicated through the speaker (40), so that the user may immediately recognize the need to charge the battery (70).

[0058] The wireless communication module (80) may be configured to communicate with the user terminal (200), more specifically to perform short-range wireless communication. The learning assistance service based on the wearable learning assistance device (100) according to the present invention may be implemented as an application type, and an interface for registering the wearable learning assistance device (100) that communicates with the user terminal (200) when setting up communication through this application may be additionally provided, and for example, by registering the wearable learning assistance device (100) according to the present invention as a Bluetooth device for application-based communication, real-time communication between the wearable learning assistance device (100) and the user terminal (200), for example, Bluetooth communication, may be implemented.

[0059] For example, the wireless communication module (80) according to the present invention may be configured to transmit images captured by the camera (20) to a user terminal (200), and may be configured to transmit data such as questions selected by the user during the learning process, unknown questions, and incorrect questions to the user terminal (200), and may be configured to receive a response to the questions from the user terminal (200). For example, the wireless communication module (80) according to the present invention may be configured to transmit at least some images of the learning material among the images captured by the camera (20) to the server (300) through the user terminal (200) as questions, and such question questions and identification will be described in more detail through FIG. 4 below.

[0060] For reference, since it is more desirable for the wearable learning aid device (100) implemented in the form of glasses according to the present invention to be relatively lightweight and implemented at a lower cost, the wireless communication module (80) provided in the wearable learning aid device (100) is configured to implement short-range wireless communication such as Bluetooth, and accordingly, as shown in FIG. 2, the wearable learning aid device (100) is described as an example configuration in which it does not perform direct communication with the server (300) but communicates via the user terminal (200). However, if the wireless communication module (80) according to the present invention is implemented to enable long-range communication such as LTE or 5G, it is of course possible to implement the wearable learning aid device (100) according to the present invention communicating directly with the server (300) without going through the user terminal (200).

[0061] A gyroscope sensor (90) may be configured to be placed in at least a portion of the main body of glasses (10) to detect the tilt, inclination, etc. of the wearable learning aid device (100) according to the present invention. It is of utmost importance for students to maintain a correct posture while studying. Data such as the tilt, inclination, etc. detected by the gyroscope sensor (90) may be transmitted to a server (300), and the server (300) may control the display (30) and / or speaker (40) to display guidance for posture correction based on the received data such as the tilt, inclination, etc., if the student is studying in an incorrect posture.

[0062] Additionally, data such as the tilt and inclination of the wearable learning aid device (100) detected by the gyroscope sensor (90) can be further utilized not only for posture correction but also for detecting whether the student is drowsy. If the student falls asleep during learning, the angle of the head may be tilted more than necessary, and such an angle is detected by the gyroscope sensor (90), and a warning message can be displayed visually through the display (30) and / or audibly through the speaker (40) under the control of the server (300).

[0063] For reference, detecting whether a student is drowsy during study time can be implemented based on a captured image from a camera (20) as well as a gyroscope sensor (90). A study assistance scenario for determining whether a student is drowsy based on a captured image from a camera (20) will be described in more detail in FIG. 3 below.

[0064] Additionally, although not explicitly shown in FIG. 1, a button (not shown) for transmitting a query, transmitting an incorrect answer, setting a mode, etc. may be additionally provided in a part of the eyeglass body (10) according to the present invention (for reference, a plurality of buttons may be provided for each item, or a single button may be used to implement a plurality of items in different ways). Scenarios for transmitting a query and transmitting an incorrect answer using the wearable learning aid device (100) according to the present invention will be described in more detail in FIG. 4 and FIG. 5 below.

[0065] As the wearable learning aid device (100) according to the present invention, as described in detail above through FIGS. 1 and 2, is implemented in the form of glasses, it is more desirable to utilize it for its original purpose as glasses during times when the user is not performing learning. To this end, the wearable learning aid device (100) according to the present invention is characterized by being configured to turn the learning mode ON or OFF. Accordingly, when the learning mode is ON, the camera (20) takes a picture, the display (30) displays, the speaker (40) outputs voice, the microphone (50) collects voice, the wireless communication module (80) transmits / receives, and the gyroscope sensor (90) detects tilt. When the learning mode is OFF, all of these functions are deactivated, allowing the user to utilize the wearable learning aid device (100) as ordinary glasses.

[0066] The learning mode of the wearable learning aid device (100) according to the present invention may be manually set to on or off, for example, the on or off of the learning mode may be controlled using a button (not shown) provided in a part area of ​​the glasses body (10), or the on or off of the learning mode may be controlled using a learning aid application installed on a user terminal (200).

[0067] Alternatively, the learning mode of the wearable learning assistance device (100) according to the present invention may be automatically set to on or off, and, for example, a learning time (e.g., 10:00 AM to 12:00 PM, 9:00 PM to 10:00 PM, etc.) may be pre-registered in a learning assistance application installed on a user terminal (200), and the learning assistance system (1000) according to the present invention may be implemented so that when the pre-registered learning time arrives under the control of the server (300), the learning mode of the wearable learning assistance device (100) is automatically set to on.

[0068] For reference, the pre-registered study time through the learning assistance application according to the present invention can be set to be modified / edited / postponed / adjustable (e.g., with the consent of a service operator or parent), and can be set differently for periods such as days / weeks / months (e.g., 9 PM to 11 PM on Monday, 8 PM to 10 PM on Tuesday, etc.), and a certain notification regarding the registered study time can be provided visually through the display (30) and / or audibly through the speaker (40) and / or through the learning assistance application before the registered study time arrives (e.g., 10 minutes before, etc.), thereby encouraging the user to more reliably comply with the registered study time.

[0069] A user terminal (200) can be coupled to communicate with a wearable learning assistance device (100) according to the present invention. For example, the user terminal (200) can be coupled to communicate with the wearable learning assistance device (100) based on short-range wireless communication (e.g., Bluetooth).

[0070] Additionally, the user terminal (200) can be coupled to communicate with the server (300), and more specifically, can provide a service that assists the user's learning using the wearable learning assistance device (100) by communicating with the server (300) based on a learning assistance application that is downloaded and installed on the user terminal (200).

[0071] The parent terminal (400) may correspond to a terminal owned by the guardian of the student user, and although a single parent terminal (400) is shown in FIG. 2 for convenience, it will also be obvious that multiple parent terminals (400) (e.g., a father terminal and a mother terminal) may be included in the learning assistance system (1000) according to the present invention and combined to communicate with the server (300).

[0072] That is, in order for parents to also monitor the learning attitude of a user receiving a learning assistance service according to the present invention and to also receive services such as suggestions based on the analysis results, the learning assistance system (1000) according to the present invention may further include a parent terminal (400) coupled to communicate with a server (300), for example, mutual communication between the server (300) and the parent terminal (400) may be implemented based on a learning assistance application.

[0073] For example, the parent terminal (400) may be configured to receive in real time video of the learning material captured by the camera (20), may be configured to receive the student's learning pattern analyzed by the server (300), the learning process and method suggested to the user, and may be configured to receive information regarding the student's learning attitude, etc., monitored by the server (300).

[0074] For reference, the user terminal (200) and the parent terminal (400) may be referred to as a subscriber unit, subscriber station, mobile station, mobile terminal, remote station, remote terminal, mobile device, access terminal, terminal, wireless communication device, user agent, user device, or user equipment (UE). The access terminal may be a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a handheld device with wireless connectivity capabilities, a computing device, or other processing device connected to a wireless modem.

[0075] The server (300) may be configured to comprehensively control the operation, function, transmission / reception, etc. of the wearable learning assistance device (100) according to the present invention and the learning assistance service / scenario implemented thereby. To this end, as shown in FIG. 2, the server (300) according to the present invention may be composed of an AI tutor (310; AI tutor) and a database (320; database). For reference, although not explicitly shown in FIG. 2, control modules such as a processor, controller, microprocessor, and microcontroller configured to comprehensively control the operation, function, etc. of the server (300) may be additionally provided.

[0076] The AI ​​tutor (310; AI tutor) can be configured to analyze the user's learning patterns, learning styles, etc. based on artificial intelligence (AI) and / or big data, and to suggest customized learning methods, courses, etc. based on the analysis results. For example, the server (300) can receive data such as learning videos captured by the camera (20) from the wearable learning aid device (100), questions regarding unknown problems, incorrect answers, and whether the registered study time is accessed at the right time. Based on this received data, the AI ​​tutor (310) can be configured to recommend customized learning methods, courses, etc. to promote grade improvement by analyzing the student's learning patterns. The analyzed learning patterns and the data regarding the suggested learning methods, courses, etc. can be transmitted not only to the user terminal (200) but also to the parent terminal (400), for example, through a learning aid application.

[0077] In particular, a user may send a query to the server (300) during the learning process, and the server (300) that receives the query may control the AI ​​tutor (310) to send a response to the query to the user terminal (200), for example, the response to the query may be implemented in real time or near real time, and the response generated by the AI ​​tutor (310) and sent to the user terminal (200) may be provided to the user visually through the display (30) of the wearable learning aid device (100) and / or audibly through the speaker (40).

[0078] The AI ​​tutor (310) according to the present invention may be implemented as software equipped with ChatGPT that can converse while sharing real-time video with the user, and in some cases, real-time calls for questions and answers (e.g., wired calls, video calls, etc.) may be implemented through an additional connection between the AI ​​tutor (310) and a real teacher or counselor.

[0079] In addition, as the server (300) according to the present invention receives the video captured by the camera (20) in real time, object identification of the captured video can be performed. As a result of object identification, if the captured object is an object unrelated to learning (e.g., comic books, YouTube, etc.) (for reference, when a user watches a video through a device such as a tablet, the server (300) can determine whether the video is educational content or non-educational content based on an AI engine), such fact can be displayed as a predetermined warning message on the display (30) and / or speaker (40) or transmitted to the parent terminal (400), thereby inducing students to focus only on learning during the learning time.

[0080] The database (320; database) may be configured to store any data, materials, information, etc. related to the learning assistance service, scenario, etc. according to the present invention. In particular, related data or information may be categorized and stored in the database (320) by subject and unit for each user, and additionally may be categorized and stored in the database (320) by problems queried by the user, problems that took a long time to solve, problems that were incorrect, etc., and accordingly, the AI ​​tutor (310) can more efficiently suggest a learning method customized to the user.

[0081] For reference, the database (320) can be implemented as various types of storage devices capable of inputting and outputting information, such as HDD (Hard Disk Drive), ROM (Read Only Memory), RAM (Random Access Memory), EEPROM (Electrically Erasable and Programmable Read Only Memory), flash memory, CF (Compact Flash) card, SD (Secure Digital) card, SM (Smart Media) card, MMC (Multimedia) card, or Memory Stick, as is known to a person skilled in the art, and may be provided inside the server (300) as shown in FIG. 2 or provided in a separate external device. Alternatively, the database (320) may be replaced with web storage that performs storage functions on the Internet.

[0082] Additionally, although not explicitly illustrated in FIG. 2, the server (300) according to the present invention may further include a communication unit (not shown) configured to communicate with a user terminal (200) and a parent terminal (400). The server (300) may receive images captured by a wearable learning assistance device (100) from the user terminal (200) through the communication unit (not shown), and may be configured to transmit data regarding a user-customized learning process, method, etc. proposed based on an analyzed learning pattern to the user terminal (200), and the transmission and reception of such data may be implemented through a learning assistance application.

[0083] For reference, the communication unit (not shown) of the server (300) can communicate via LAN, WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), WiBro (Wireless Broadband Internet), RF (Radio Frequency) communication, Wireless LAN, Wi-Fi (Wireless Fidelity), NFC (Near Field Communication), Bluetooth, infrared communication, etc. However, this is merely an example, and various wired and wireless communication technologies applicable in the relevant technical field may be used according to the embodiment to which the present invention is applied.

[0084] Additionally, although not explicitly illustrated in FIG. 2, the server (300) according to the present invention may further include a display unit (not shown) configured to display any information, data, video, etc. related to a learning assistance service, scenario, application, etc. For example, the display unit (not shown) may be configured to display a video captured by the camera (20) of the wearable learning assistance device (100), and may be configured to display each user's analyzed learning pattern and suggestions for the learning process, method, etc. accordingly.

[0085] For reference, a display unit (not shown) may be implemented as a predetermined display means, and the display means may include at least one of a Liquid Crystal Display (LCD), a Thin Film Transistor-Liquid Crystal Display (TFT LCD), an Organic Light-Emitting Diode (OLED), a Flexible Display, and a 3D Display.

[0086] FIG. 3 is an example diagram illustrating a drowsiness detection and notification service among learning assistance scenarios implemented according to an embodiment of the present invention.

[0087] A wearable learning aid device (100) according to the present invention is provided with a camera (20) on the front of a glasses body (10), and a user's learning attitude, for example, whether or not the user is drowsy during learning, can be monitored based on an image captured by the camera (20). More specifically, when the wearable learning aid device (100) according to the present invention is set to a learning mode, the image captured by the camera (20) can be transmitted to a server (300) through a user terminal (200) or directly to a server (300), and the server (300) that receives the camera (20) image can determine whether or not the user is drowsy based on the object being captured.

[0088] For example, as shown in FIG. 3 (a), if the image captured by the camera (20) is focused on a learning material, such as a textbook, teaching material, or test paper, the server (300) can determine that the user is performing learning normally without dozing off based on such image characteristics, and as shown in FIG. 3 (b), if the image captured by the camera (20) is not focused on a learning material but is focused on another area (e.g., the floor of a desk, etc.), the server (300) can determine that the user is dozing off based on such image characteristics and if such non-learning material focus persists for a preset time (e.g., 10 seconds, etc.).

[0089] In the latter case, that is, when the server (300) determines that the student is dozing off based on AI analysis of the video from the camera (20), it can control the output of a predetermined drowsiness-repelling sound (e.g., a siren sound) through the speaker (40), and additionally transmit the fact of drowsiness to the parent terminal (400), and also store such drowsiness data (e.g., time, frequency, etc.) in the database (320) so that it can be used for future statistical analysis, attitude evaluation, etc.

[0090] For reference, in determining whether the user is drowsy, in addition to the image captured by the camera (20) as shown in FIG. 3, values ​​such as tilt and inclination measured by the gyroscope sensor (90) provided in the wearable learning aid device (100) according to the present invention may be additionally and / or alternatively utilized.

[0091] FIG. 4 is an example diagram illustrating a query service for unknown problems during the learning process among learning assistance scenarios implemented according to an embodiment of the present invention.

[0092] The present invention is characterized in that a user, for example, a student, can receive assistance from a server (300), more specifically an AI tutor (310), regarding problems they do not know well while performing learning with the wearable learning assistance device (100) according to the present invention and the learning mode activated. An exemplary learning assistance scenario for explaining such a user's question service and the corresponding response service is illustrated in FIG. 4.

[0093] When a user is solving a math problem as illustrated in FIG. 4 (a), an image of the math problem captured by the camera (20) can be transmitted to the server (300) in real time. At this time, if the user has a problem they do not know well, for example, if they do not know math problem number 2 in the example of FIG. 4, a query regarding this can be transmitted to the server (300), thereby providing the user with a faster and more efficient query and response service.

[0094] For a query to the server (300), the user may send a query by voice using a microphone (50) provided in the wearable learning aid device (100) (e.g., “XX, I don’t know math problem number 2 well, please tell me how to solve it”), or may request help with problem solving / explanation from the server (300) by using a query button (not shown) additionally provided in the wearable learning aid device (100).

[0095] In the latter case, when multiple problems are included in the learning material video captured by the camera (20), the problem of the query can be specified through a pre-defined finger gesture (e.g., making a rectangle with fingers, etc.) as in (b) of FIG. 4, and thus the server (300) can provide a response to the user for the query problem identified through the pre-defined finger gesture (e.g., math problem 2 in the example of FIG. 4).

[0096] The response to a query received by the server (300) can be implemented in real time, and the response is visually implemented through the display (30) and simultaneously audibly implemented through the speaker (40), thereby supporting the user to more clearly understand a problem they were not well aware of. In particular, the AI ​​tutor (310) according to the present invention is equipped with ChatGPT, which can converse while sharing real-time video with the user, thereby providing immediate responses and solutions to the student's questions through real-time conversation, which can improve user convenience and also promote academic improvement.

[0097] For reference, while FIG. 4 illustrates a query for a math problem as an example, the service of receiving a learning assistance service from an AI tutor (310) of a server (300) using a wearable learning assistance device (100) according to the present invention can be applied collectively to all types of learning. For example, when a user learns to speak English, the user's English voice collected through a microphone (50) is transmitted in real time to the server (300), and the AI ​​tutor (310) can return improvement points regarding the user's lacking accent, pronunciation, or grammatically incorrect parts, as well as content of an accurate native English pronunciation, to the display (30) and / or speaker (40) through the user terminal (200).

[0098] FIG. 5 is an example diagram illustrating the database creation of incorrect answers and automatic category classification among learning assistance scenarios implemented according to an embodiment of the present invention.

[0099] Additionally, the learning assistance service / scenario according to the present invention is characterized by analyzing the problems that a student got wrong while studying, i.e., incorrect answers, so that the student can solve problems of similar patterns correctly without making mistakes in the future. The transmission, database creation, and automatic categorization of incorrect answers for this purpose are exemplarily illustrated in FIG. 5.

[0100] As illustrated in FIG. 5, when a user solves an English problem and an incorrect answer occurs, the user can use the microphone (50) to transmit the incorrect answer to the server (300) (e.g., “XX, I got question number 12 wrong”), or use a button (not shown) provided on the wearable learning aid device (100), such as an incorrect answer button, to transmit the incorrect answer to the server (300). The user's incorrect answer received by the server (300) can be stored in the database (320).

[0101] At this time, as conceptually illustrated on the right side of FIG. 5, the server (300) according to the present invention can store a user's incorrect answer problem in a database (320) by automatically classifying categories such as subject, unit, and type of the incorrect answer problem (e.g., 'English-verb conjugation' in the example of FIG. 5) based on the results of analyzing the video of the learning material captured by the camera (20), and can store and manage the incorrect answer problem in such a classified form, and by systematically analyzing the pattern, type, and reason of the incorrect answer, it can recommend a customized learning process and method to the user, for example, a learning process and method that prevents the user from making the same mistake again.

[0102] Accordingly, the user can check their incorrect answers categorized by subject and unit at any time through the learning assistance service implemented by the learning assistance system (1000) according to the present invention, for example, through a learning assistance application installed on a user terminal (200), and thus has the advantage of significantly reducing the inconvenience of having to manually write incorrect answer notes and the time required for such actions.

[0103] For reference, the AI ​​tutor (310) of the server (300) according to the present invention can determine what the content of the text is (e.g., based on OCR technology) when analyzing the captured video of the camera (20), and based on that, can classify the subject, unit, type, etc. to which the incorrect answer problem belongs in detail, and can store the user's incorrect answer problem in the database (320) according to the items classified in detail.

[0104] Additionally, although not explicitly illustrated in the scenarios of FIGS. 3 to 5, a server (300) according to an additional embodiment of the present invention may further perform a user's learning evaluation based on images captured by a camera (20), received queries, received incorrect answers, monitored learning posture, etc., and may provide the results of the learning evaluation to a user terminal (200) and a parent terminal (400) through a learning assistance application in a predetermined report type (e.g., a graph type accompanied by text). Accordingly, the student and their parents can intuitively recognize whether the student is progressing correctly in learning and how to supplement if there is a lack, thereby inducing progress in a positive direction for improving grades.

[0105] Here, in order to resolve the problem of insufficient learning stimulation resulting from learning being performed solely by a student user, the server (300) according to an additional embodiment of the present invention may be further configured to form a predetermined user group (e.g., a group consisting of classmates) including the user and to provide a ranking (or ranking) of the students within the group based on the learning evaluation results of each student, thereby stimulating the competitive spirit of the students and further enhancing the students' motivation for voluntary learning.

[0106] In this way, the server (300) can analyze the user's learning patterns, weaknesses, etc. based on the user's learning-related data. In this regard, the server (300) according to an additional embodiment of the present invention may be further configured to recommend an institution (e.g., a private academy, etc.) and / or an individual (e.g., a private tutor, etc.) to the student and their parents that can compensate for the student's analyzed weaknesses. Although it is possible for the student to achieve a certain degree of academic improvement on their own by using the learning assistance service implemented and provided according to the present invention, user satisfaction with the learning assistance service can be further enhanced by additionally providing a matching service through linkage with external educational institutions and / or individuals to satisfy the needs of students or parents who expect academic improvement more certainly and more quickly.

[0108] As described above, according to one embodiment of the present invention, a wearable learning aid device and a learning aid system including the same can propose a customized learning method to a student by analyzing the student's learning style, learning performance, and learning improvement points based on AI as a result of the student wearing a learning aid device implemented in the form of glasses and performing learning.

[0109] In addition, according to one embodiment of the present invention, a wearable learning assistance device and a learning assistance system including the same can be used to induce a student to focus more on learning by monitoring the student's attitude or posture during the learning process.

[0110] In addition, according to a wearable learning assistance device and a learning assistance system including the same according to one embodiment of the present invention, a server-side AI tutor can analyze and respond in real time to a student's learning-related inquiries, thereby improving the student's service satisfaction.

[0111] In addition, according to a wearable learning assistance device and a learning assistance system including the same according to one embodiment of the present invention, the server side automatically sorts and analyzes the student's incorrect answers into categories based on AI and provides them to the student, thereby encouraging the student to solve similar problems with correct answers in the future and promoting the improvement of the student's grades.

[0112] In addition, according to a wearable learning assistance device and a learning assistance system including the same according to one embodiment of the present invention, by utilizing a server-side AI tutor to provide real-time responses based on AI to matters, inquiries, and questions that students are curious about, the effect of private tutoring can be created, and accordingly, the financial burden on parents regarding private education costs can be alleviated.

[0113] In addition, according to one embodiment of the present invention, a wearable learning assistance device and a learning assistance system including the same can identify a student's learning content based on camera footage and select and play customized music for the identified learning content, thereby enabling students to focus more on their studies.

[0114] In addition, according to one embodiment of the present invention, a wearable learning assistance device and a learning assistance system including the same can transmit video, time, analysis results, etc., of a student wearing a learning assistance device implemented in the form of glasses and performing learning to a parent, thereby enabling the student to take on a role similar to that of a parent when the parent is absent at home, and thereby further improve the satisfaction of the parent user.

[0116] As described above, the best embodiments have been disclosed in the drawings and specification. Specific terms have been used herein, but they are used only for the purpose of describing the invention and are not intended to limit the meaning or the scope of the invention as described in the claims. Therefore, those skilled in the art will understand that various modifications and equivalent alternative embodiments are possible therefrom. Accordingly, the true technical scope of protection of the invention should be determined by the technical spirit of the appended claims. Explanation of the symbols

[0117] 100: Wearable learning assistance devices 10: Glasses body 20: Camera 30: Display 40: Speaker 50: Mike 60: Charging port 70: Battery 80: Wireless communication module 90: Gyro sensor 200: User terminal 300: Server 310: AI Tutor 320: Database 400: Parent terminal 1000: Learning Assistance System

Claims

Claim 1 A wearable learning aid device (100), comprising: a glasses body (10); a camera (20) provided in at least a portion of the glasses body (10) and configured to photograph a user's learning material; a wireless communication module (80) configured to transmit an image captured by the camera (20) to a server (300) via a user terminal (200), wherein at least a portion of the image of the learning material among the captured images is transmitted to the server (300) as a query; a display (30) configured to visually express a response to the query received from an AI tutor (310) of the server (300); and a speaker (40) configured to audibly express a response to the query received from an AI tutor (310) of the server (300). A wearable learning aid device (100) comprising a gyroscope sensor (90) disposed in at least a portion of the main body (10) of the glasses, wherein when a plurality of problems are included in the image of the learning material being captured, the problem of the question subject is specified through a pre-defined finger gesture, the incorrect answer problem is transmitted to the server (300) by the user using a microphone (50) or a button, and the incorrect answer problem received by the server (300) is automatically classified into categories of subject, unit, and type and stored in a database (320), wherein the gyroscope sensor (90) is configured to detect the tilt and inclination of the wearable learning aid device (100), and the detected tilt and inclination of the wearable learning aid device (100) is utilized for posture correction or detection of drowsiness of the user. Claim 2 delete Claim 3 delete Claim 4 In claim 1, the wearable learning aid device (100) is configured to turn a learning mode ON or OFF. Claim 5 A learning assistance system (1000), comprising: a wearable learning assistance device (100) according to claim 1; a user terminal (200) coupled to communicate with the wearable learning assistance device (100); and a server (300) coupled to communicate with the user terminal (200).

Images