Device and method of reading assistance for arousing interest in reading

Abstract

Disclosed are a device and method of reading assistance for arousing interest in reading. The device of reading assistance comprises: smart glasses which are worn by a user and which take images of a book the user is reading and pupils of the user who is reading, so as to generate corresponding image information; and a control unit which detects book-related information and a book part currently being read by the user on the basis of the generated image information, determines that a preset event has occurred if a preset word is included in content of the detected book part, and controls at least one of a visual effect and auditory effect corresponding to the event to be output.

Description

Reading assistance devices and methods that stimulate interest in reading

[0001] The present invention relates to a reading assistance device, and more particularly, to a reading assistance device and method that induce interest in reading by generating various effects depending on the reading environment and thereby helping the user feel interested in reading.

[0002] Recently, children are increasingly losing interest in reading due to exposure to games and animation from a young age. This has led to insufficient reading, resulting in children entering school and entering their formative years without the development of literacy, critical thinking, and creativity—the educational benefits of reading.

[0003] In other words, the problem is that children are entering adolescence without having properly developed the intellectual abilities necessary for early childhood due to a lack of reading training necessary to improve intellectual abilities.

[0004] Therefore, there is a need for a way to encourage children to read and naturally increase their reading volume.

[0005] The problem to be solved by the present invention is to provide a reading assistance device and method that stimulates interest in reading by providing the user with visual and auditory effects corresponding to events occurring during the reading process, thereby helping to stimulate interest in reading.

[0006] In order to solve the above problem, the reading assistance device according to the present invention includes smart glasses that are worn by a user and capture a book that the user is reading and the eyes of the user while reading to generate corresponding image information, and a control unit that detects book-related information and a portion of a book that the user is currently reading based on the generated image information, and if a preset word is included in the contents of the detected portion of the book, determines that a preset event has occurred and controls to output at least one of a visual effect and an auditory effect corresponding to the event.

[0007] In addition, the control unit is characterized in that it detects status information on the user's gaze and focus based on image information of the user's pupils, calculates reading-related concentration using the detected status information, and determines that the event has occurred if the calculated concentration is lower than a preset standard.

[0008] In addition, the control unit further detects the user's reading pattern and difficulty of reading using the status information, and supports chatbot conversation in conjunction with the smart glasses based on the detected concentration, reading pattern, and difficulty of reading.

[0009] In addition, when the user reads the book aloud, the control unit detects information related to at least one of pronunciation, breathing position, reading speed, and misreading included in the voice information for the sound, and provides feedback information on a part requiring correction based on the detected information.

[0010] In addition, when reading an electronic book that provides the contents of the book as an image, the control unit is characterized in that it controls to replace the name of at least one character included in the contents of the book with an arbitrary name and output the contents of the electronic book with the replaced name.

[0011] In addition, the control unit is characterized in that it determines that the event has occurred whenever the arbitrary name is output from the contents of the electronic book.

[0012] In addition, the control unit is characterized in that it performs an analysis of the contents of the book, estimates the personality of each character using the analyzed result, and controls the character so that when one of the characters is selected, the personality of the character is reflected in the chatbot conversation pattern.

[0013] In addition, the control unit is characterized in that, when a user input is input from the user and the user input includes a specific word, the control unit returns to a preset page of the electronic book.

[0014] In addition, the control unit is characterized in that, if the detected book portion is the last page of the book, it determines that a reading completion event has occurred and controls the output of a congratulatory message and information about the reading process.

[0015] In addition, the control unit is characterized in that it controls the completion event to occur only when a record of the user sequentially reading from the first page to the last page of the book is saved.

[0016] A reading assistance method performed by a reading assistance device according to the present invention includes the steps of generating image information by capturing a book being read by a user and the pupils of the user while reading, the step of detecting book-related information and a portion of a book currently being read by the user based on the generated image information, and the step of determining that a preset word is included in the contents of the detected portion of the book and outputting at least one of a visual effect and an auditory effect corresponding to the event.

[0017] A reading assistance system according to the present invention comprises at least one reading assistance device that assists a reading process so that a user becomes interested in reading, and a management server that receives user information and monitoring information on a reading process of the user from the reading assistance device and manages the reading habits of the user using the received monitoring information, wherein the reading assistance device comprises smart glasses that are worn by the user and capture a book that the user is reading and the eyes of the user while reading to generate corresponding image information, and a control unit that detects book-related information and a portion of a book that the user is currently reading based on the generated image information, and if a preset word is included in the contents of the detected portion of the book, determines that a preset event has occurred and controls to output at least one of a visual effect and an auditory effect corresponding to the event.

[0018] In addition, the management server is characterized in that it processes the monitoring information based on the user information to create a new story in which the user is included as a character, and creates image-based content using the created story.

[0019] In addition, when the user reads the book aloud, the control unit is characterized in that it detects information related to at least one of pronunciation, breathing position, reading speed, and misreading included in the voice information for the sound, and provides feedback information on a part requiring correction based on the detected information.

[0020] In addition, when reading an electronic book that provides the contents of the book as an image, the control unit is characterized in that it controls to replace the name of at least one character included in the contents of the book with an arbitrary name and output the contents of the electronic book with the replaced name.

[0021] According to an embodiment of the present invention, an event occurring during a reading process is determined by using video information captured during a user's reading process, and when an event occurs, at least one of a visual effect and an auditory effect corresponding to the event is output to provide the user with interest in reading.

[0022] This can encourage continuous reading activities and improve users' literacy, thinking skills, and creativity.

[0023] FIG. 1 is a configuration diagram for explaining a reading assistance system according to an embodiment of the present invention.

[0024] FIG. 2 is a block diagram illustrating a reading assistance device according to an embodiment of the present invention.

[0025] FIG. 3 is a block diagram illustrating a management server according to an embodiment of the present invention.

[0026] Figure 4 is a flowchart for explaining a reading assistance method according to an embodiment of the present invention.

[0027] Figure 5 is a flowchart for explaining a reading assistance method according to another embodiment of the present invention.

[0028] FIG. 6 is a block diagram illustrating a computing device according to an embodiment of the present invention.

[0029] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted for clarity of description, and similar parts are designated with similar reference numerals throughout the specification.

[0030] In this specification and drawings (hereinafter referred to as “this specification”), duplicate descriptions of identical components are omitted.

[0031] Additionally, when a component is referred to herein as being "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may be other components present in between. Conversely, when a component is referred to herein as being "directly connected" or "directly connected" to another component, it should be understood that there are no other components present in between.

[0032] Additionally, the terms used herein are only used to describe specific embodiments and are not intended to limit the present invention.

[0033] Also, in this specification, singular expressions may include plural expressions unless the context clearly indicates otherwise.

[0034] In addition, in this specification, it should be understood that terms such as “include” or “have” are intended to specify only the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, and do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0035] Also, in this specification, the term 'and / or' includes a combination of multiple listed items or any item among multiple listed items. In this specification, 'A or B' can include 'A', 'B', or 'both A and B'.

[0036] Additionally, in this specification, detailed descriptions of known functions and configurations that may obscure the gist of the present invention will be omitted.

[0037]

[0038] FIG. 1 is a configuration diagram for explaining a reading assistance system according to an embodiment of the present invention.

[0039] Referring to FIG. 1, a reading assistance system (300) provides users (e.g., readers) with visual and auditory effects corresponding to events occurring during the reading process, thereby helping to stimulate interest in reading. The reading assistance system (300) includes at least one reading assistance device (100) and a management server (200).

[0040] A reading assistance device (100) is a device that assists reading so that a user can become interested in reading books (e.g., paper books, audio books, electronic books, etc.). The reading assistance device (100) analyzes the user's status and the contents of the book, and determines whether a preset event has occurred using the analyzed result. When an event has occurred, the reading assistance device (100) outputs at least one of a visual effect and an auditory effect corresponding to the occurred event. Preferably, the reading assistance device (100) can provide the user with visual and auditory effects through augmented reality (AR), brightness change, color change, background change, word emphasis, background sound, sound effects, etc. Here, when the reading assistance device (100) is used by multiple users with one device, each user can first perform a log-in procedure using an ID and password, and then support reading activities.

[0041] The management server (200) communicates with at least one reading assistance device (100), and for this purpose, a program or algorithm that is linked to the reading assistance device (100) is stored. The management server (200) manages the reading habits of a user who uses the reading assistance device (100). Specifically, the management server (200) receives monitoring information on the reading process generated by comprehensively analyzing information such as the user's reading amount, information on books read (e.g., book title, author, book content, book genre, publisher, etc.), reading time, reading pattern, and reading interest from the reading assistance device (100). In addition, the management server (200) receives user information including the user's identification information, area of ​​interest, age, and gender. The management server (200) can manage the reading habits of each user using the received user information and monitoring information, and support checking the managed results for each user. That is, when multiple users share and use a single reading assistance device (100), the management server (200) can distinguish each user through identification information and then manage the reading habits of the corresponding users. If the management server (200) detects that a user among the multiple users has relatively poor reading habits compared to other users, it can provide feedback to the corresponding user regarding the lacking areas. For example, if the management server (200) detects that a user has relatively insufficient reading volume compared to other users, it can suggest additional reading volume and schedule information regarding reading time to the corresponding user. In addition, the management server (200) can process monitoring information to generate new content. Here, the new content is image-based user-customized digital content consisting of a new story in which the user is included as a character, and can be generated using information about books the user has read so far. The management server (200) transmits the generated content to the reading assistance device (100) so that the corresponding user can check the user-customized content.

[0042] Meanwhile, the reading assistance system (300) establishes a communication network (350) between the reading assistance device (100) and the management server (200) to support communication between them. The communication network (350) may be composed of a backbone network and a subscriber network. The backbone network may be composed of one or more integrated networks among an X.25 network, a Frame Relay network, an ATM network, an MPLS (Multi-Protocol Label Switching) network, and a GMPLS (Generalized Multi-Protocol Label Switching) network. The subscriber network may be FTTH (Fiber To The Home), ADSL (Asymmetric Digital Subscriber Line), cable network, zigbee, bluetooth, Wireless LAN (IEEE 802.11b, IEEE 802.11a, IEEE 802.11g, IEEE 802.11n), Wireless Hart (ISO / IEC62591-1), ISA100.11a (ISO / IEC 62734), CoAP (Constrained Application Protocol), MQTT (Message Queuing Telemetry Transport), WIBro (Wireless Broadband), Wimax, 3G, HSDPA (High Speed ​​Downlink Packet Access), 4G, 5G, and 6G. In some embodiments, the communication network (350) may be an Internet network or a mobile communication network. In addition, the communication network (350) may include any other widely known or future-developed wireless or wired communication method.

[0043]

[0044] FIG. 2 is a block diagram illustrating a reading assistance device according to an embodiment of the present invention.

[0045] Referring to FIGS. 1 and 2, the reading assistance device (100) includes smart glasses (120) and a control unit (140), and may include a communication unit (110), a microphone (130), a speaker (150), a display unit (160), and a storage unit (170).

[0046] The communication unit (110) communicates with the management server (200). The communication unit (110) transmits user information and reading-related information to the management server (200). The communication unit (110) receives content based on reading-related feedback information and monitoring information from the management server (200).

[0047] Smart glasses (120) are glasses worn on the user's face, which collect various information and provide augmented reality content. Specifically, when the smart glasses (120) are worn on the user, they capture the forward view of the user and simultaneously capture the user's pupils to generate corresponding image information. In other words, the smart glasses (120) can capture the book the user is reading while simultaneously capturing the user's pupils while looking at the book. For this purpose, the smart glasses (120) may include at least two cameras. In addition, the smart glasses (120) output augmented reality content provided when an event occurs. That is, the smart glasses (120) have a structure in which an image (e.g., letters, shapes, numbers, etc.) can be output inside at least one of the transparent binocular lenses, thereby providing the user with a three-dimensional visual effect.

[0048] The microphone (130) receives the user's voice. When the user reads a book aloud, the microphone (130) receives the voice. Furthermore, when the user uses a voice to provide input for a reading assistance service, the microphone (130) receives the voice.

[0049] The control unit (140) performs overall control of the reading assistance device (100). When a user reads a paper book, the control unit (140) maximizes the tactile sensation of holding the paper book while helping the user easily read difficult parts of the reading process. Furthermore, when a user reads an electronic book, the control unit (140) simultaneously outputs the electronic book and maximizes the digital effect of the electronic book, thereby amplifying the user's interest in reading.

[0050] The control unit (140) can perform a login procedure of a user who performs a reading assistance service by using a user input input from at least one of the smart glasses (120), the microphone (130), and the display unit (150). For example, the control unit (140) can check biometric information (e.g., including voice tone, heart rate, fingerprint, iris, etc.) included in the user input and support a login procedure according to the checked biometric information. In addition, the control unit (140) determines that a preset event has occurred if the contents of the part of the book currently being read by the user include preset words based on the image information generated from the smart class (120) and book-related information (e.g., paper book, electronic book, book title, author, publisher, etc.). If the control unit (140) determines that an event has occurred, it controls to output at least one of a visual effect and an auditory effect corresponding to the event.

[0051] Specifically, the control unit (140) can collect book-related information by using at least one of the book cover, table of contents, author's note, and the part of the book that the user is currently reading, which are included in the image information of the book. The control unit (140) detects the content of the part of the book that the user is currently reading by using the collected book-related information, and determines that a preset event has occurred if a specific word is included in the detected content. The specific word may be a word indicating a specific name, a specific region, a specific action, etc., and the preset event may be an operation of providing augmented reality content related to the specific word, providing a sound effect or background sound related to the specific word, providing an image related to the specific word, or adjusting the volume or speed of an output sound (e.g., music, voice, etc.).

[0052] In addition, the control unit (140) determines that a completion event has occurred if the detected book portion is the very last page of the book, and controls the output of a congratulatory message and information about the reading process. At this time, the control unit (140) can control the occurrence of a completion event only when a record of the user sequentially reading from the first page to the very last page of the book is stored. Here, the control unit (140) can generate monitoring information about the reading process by comprehensively analyzing information such as book information (e.g., book title, author, book content, book genre, publisher, etc.), reading time, reading pattern, frequency of reading assistance, and reading interest. In addition, the control unit (140) can estimate the area of ​​interest by determining the likes and dislikes of words or sentences in the book based on the time the user's gaze remains on them, and can further generate monitoring information using the estimated area of ​​interest. Preferably, the control unit (140) can use the monitoring information to recommend reading habits that the user should improve in the next reading and suggest actions to carry out the recommended reading habits. For example, if a user reads after dinner and their concentration level drops sharply 30 minutes after starting reading, the control unit (140) may suggest moving the user's reading time to before dinner. Alternatively, if the user only reads humanities books, the control unit (140) may suggest reading recommendations for science books related to humanities.

[0053] The control unit (140) detects status information regarding the user's gaze and focus based on image information captured of the user's pupils. The control unit (140) can detect status information based on the shaking of the user's gaze and focus. Here, the control unit (140) can estimate the number of characters read per minute based on the user's gaze. The control unit (140) calculates a reading-related concentration level using the detected status information. Here, the concentration level is a numerical representation of the concentration during reading. A low concentration level may be judged as a low interest in reading, and a high concentration level may be judged as a high interest in reading. Accordingly, the control unit (140) can determine that an event has occurred if the calculated concentration level is lower than a preset standard and control at least one of a visual effect and an auditory effect to be output. For example, if the user is drowsy and the concentration level is lower than the preset standard, the control unit (140) can output a sound effect or turn on a light to improve the user's concentration level. The control unit (140) can further detect the user's reading pattern and whether the text is difficult to read using the status information. That is, the control unit (140) can detect reading patterns such as sequential reading or skimming, and can detect whether the text is difficult to read based on the pattern of re-reading the words or sentences read. Based on the detected concentration, reading pattern, and whether the text is difficult to read, the control unit (140) supports chatbot conversations in conjunction with smart glasses (120). Chatbot conversations can be conducted through written or voice, and the chatbot supports customized conversations through its own learning ability during the conversation.

[0054] When a user reads a book aloud, the control unit (140) detects information related to at least one of pronunciation, breathing position, misreading, and reading speed included in the audio information. The control unit (140) can collect the detected information and build a database for each user. In addition, the control unit (140) supports feedback information on parts that require correction based on the detected information. The control unit (140) can provide feedback on a paragraph after the user has completely read the paragraph. If the pronunciation, breathing position, or misreading in the paragraph is incorrect, the control unit (140) can control the output of a correct reading voice for the corresponding part. In addition, the control unit (140) can control the output of a sound effect or a notification message to notify the user that the reading speed needs to be adjusted when the reading speed increases or decreases while reading the book.

[0055] When reading an electronic book that provides the contents of a book as an image, the control unit (140) controls the display of the contents of the electronic book by replacing the name of at least one character included in the contents of the book with a random name. At this time, the random name can be set by user input. In other words, the user can set his / her own name in place of the character name to provide the feeling of becoming a character of the book. At this time, the control unit (140) can control an event to occur whenever a preset random name is displayed in the contents of the electronic book, and at least one of a visual effect and an auditory effect related to the event to be displayed. For example, when the name "Hong Gil-dong" is set and the content "Hong Gil-dong jumps toward the sky," the control unit (140) can control the display of the image of Hong Gil-dong jumping toward the sky to be emphasized in the text color and expressed in augmented reality. In addition, the control unit (140) analyzes the contents of the book and uses the analyzed results to infer the personality of each character. At this time, the control unit (140) can control the chatbot conversation pattern to reflect the personality of a character selected by a user input. For example, the control unit (140) can support the chatbot conversation to proceed with a conversation pattern that includes the speech habits, dialect, etc. of the selected character. Through this, the control unit (140) can instill a sense of immersion that allows the user to become more immersed in the book. When voice information is input from the user and the voice information includes a specific word, the control unit (140) returns to a preset page of the e-book. The control unit (140) controls the paragraph or word related to the specific word among the returned pages to be highlighted, thereby helping the user to intuitively check information about the specific word even in the returned page.In addition, when touch input information is input at an illustration or character location, the control unit (140) outputs effects such as sound effects, background sounds, voices, and screen transitions corresponding to the illustration or character located at the touch input information.

[0056] Meanwhile, the control unit (140) controls the user to check at least one piece of reading-related feedback information and content when it receives it from the management server (200). In other words, the control unit (140) can inform the user of improvements to their reading habits through the feedback information and stimulate their interest in reading through the content.

[0057] The speaker (150) outputs sounds used in the reading assistance process. The speaker (150) outputs background sounds, sound effects, etc. that provide auditory effects. In addition, when a user reads an e-book, the speaker (150) outputs the contents of the e-book.

[0058] The display unit (160) outputs a screen performed during the reading assistance process. When a user reads an e-book, the display unit (160) outputs the book cover, illustrations, book contents, etc. In addition, the display unit (160) outputs visual effects such as changes in brightness, color, and background of the e-book. The display unit (160) may include a display with a touch screen function, and the display may collect the user's touch input information through the touch screen function. Preferably, the display may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, and a 3D display.

[0059] The storage unit (170) stores programs or algorithms for operating the reading assistance device (100). The storage unit (170) stores information on electronic books that the user has previously read, is currently reading, or will read in the future. The storage unit (170) stores information on each event, as well as information on visual and auditory effects output for each event. The storage unit (170) stores feedback information and content received from the management server (200). The storage unit (170) may include at least one storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk.

[0060]

[0061] FIG. 3 is a block diagram illustrating a management server according to an embodiment of the present invention.

[0062] Referring to FIGS. 1 and 3, the management server (200) includes a server communication unit (210), a server control unit (220), and a server storage unit (230).

[0063] The server communication unit (210) communicates with at least one reading assistance device (100). The server communication unit (210) receives user information and reading-related information from the reading assistance device (100). The server communication unit (210) transmits content based on reading-related feedback information and monitoring information to the reading assistance device (100).

[0064] The server control unit (220) performs overall control of the management server (200). The server control unit (220) manages the reading habits of each user based on their user information and monitoring information. In other words, the server control unit (220) can manage the reading habits of multiple users. To this end, the server control unit (220) detects reading habits for each user and compares the detected reading habits with those of other users to diagnose any deficiencies. The server control unit (220) generates feedback information by deriving alternatives for the diagnosed deficiencies. The server control unit (220) helps the user check the generated feedback information to improve his or her reading habits.

[0065] The server control unit (220) processes monitoring information based on user information to generate a new story in which the user included in the user information is included as a character. Preferably, the server control unit (220) may generate a new story using artificial intelligence technology, but is not limited thereto. The server control unit (220) generates image-based content using the generated story. Here, the content may be content composed of connected images, such as illustrations for a story, or content composed of consecutively connected images, such as a video. The server control unit (220) transmits the content to the reading assistance device that transmitted the user information and supports output on the reading assistance device.

[0066] The server storage unit (230) stores a program or algorithm for operating the management server (200). The server storage unit (230) stores information on each reading assistance device, user information on each user, and monitoring information. In addition, the server storage unit (230) stores content based on the monitoring information. The server storage unit (230) may include at least one storage medium among flash memory type, hard disk type, media card micro type, card type memory (e.g., SD or XD memory, etc.), RAM, SRAM, ROM, EEPROM, PROM, magnetic memory, magnetic disk, and optical disk.

[0067]

[0068] Figure 4 is a flowchart for explaining a reading assistance method according to an embodiment of the present invention.

[0069] Referring to Figures 1 and 4, the reading assistance method utilizes video information captured during the user's reading process to determine events occurring during the reading process. When an event occurs, at least one visual or auditory effect corresponding to the event is output, thereby stimulating the user's interest in reading. Through this, the reading assistance method can encourage continuous reading activities, thereby enhancing the user's literacy, thinking skills, creativity, and other aspects.

[0070] In step S101, the reading assistance device (100) performs a login procedure for the user reading. The reading assistance device (100) can perform the login procedure using biometric information, ID / password information, etc. Through this, the reading assistance device (100) supports multiple users to receive reading assistance services through a single device.

[0071] In step S103, the reading assistance device (100) collects reading-related information. The reading assistance device (100) collects book-related information using at least one of the book cover, table of contents, author's note, and the section of the book currently being read by the user, which are included in the image information of the book. In addition, the reading assistance device (100) collects book-related information using voice information spoken by the user and touch input information touched by the user. Through this, the reading assistance device (100) can collect information about the image viewed by the user, the voice spoken by the user, and the actions taken by the user.

[0072] In step S105, the reading assistance device (100) determines whether an event has occurred. The reading assistance device (100) determines whether a preset word is included in the contents of the book based on the book-related information and the book section that the user is currently reading. If the preset word is included, the reading assistance device (100) determines that an event has occurred and performs step S107. If the preset word is not included, the reading assistance device determines that an event has not occurred and performs step S103 again.

[0073] In step S107, the reading assistance device (100) outputs an effect corresponding to the event. The reading assistance device (100) outputs at least one of a visual effect and an auditory effect corresponding to the generated event. The visual effects may include augmented reality, brightness changes, color changes, background changes, word emphasis, etc., and the auditory effects may include background sounds, sound effects, etc.

[0074]

[0075] Figure 5 is a flowchart for explaining a reading assistance method according to another embodiment of the present invention.

[0076] Referring to FIG. 5, the reading assistance method helps the user become interested in reading by generating new content based on the user's reading habits and providing the generated content to the user.

[0077] In step S201, the reading assistance device (100) collects reading-related information from the user. The reading assistance device (100) collects book-related information using at least one of the book cover, table of contents, author's note, and the section of the book currently being read by the user, which are included in the image information of the book. In addition, the reading assistance device (100) collects book-related information using voice information of the user and touch input information of the user's touch. Through this, the reading assistance device (100) can collect information about the image viewed by the user, the voice spoken by the user, and the actions performed by the user.

[0078] In step S203, the reading assistance device (100) generates monitoring information about the reading process. The reading assistance device (100) generates monitoring information using information generated during the user's reading process. The book assistance device (100) can generate monitoring information about the reading process by comprehensively analyzing information such as information about the book read (e.g., book title, author, book content, book genre, publisher, etc.), reading time, reading pattern, frequency of reading assistance, and reading interest.

[0079] In step S205, the reading assistance device (100) transmits user information and monitoring information to the management server (200). Here, the user information may be information on a user currently performing reading activities through the reading assistance device (100).

[0080] In step S207, the management server (200) manages reading habits for each user. The management server (200) classifies monitoring information for each user based on user information and can manage the reading habits of the corresponding user using the classified monitoring information. If a user among multiple users has reading habits that are relatively unbalanced compared to other users, the management server (200) detects areas where the user is lacking based on the unbalanced habits. The management server (200) can generate feedback information regarding the detected insufficient areas and provide the generated feedback information to the corresponding user.

[0081] In step S209, the management server (200) transmits feedback information to the reading assistance device (100) used by the user.

[0082] In step S211, the reading assistance device (100) outputs feedback information. The reading assistance device (100) provides feedback information to the user to help the user improve his or her reading habits.

[0083] At step S213, the management server (200) processes the monitoring information to generate new content. Based on user information, the management server (200) processes the monitoring information to generate a new story in which the user is included as a character. Using the generated story, the management server (200) generates image-based content.

[0084] At step S215, the management server (200) transmits the content to the reading assistance device (100) used by the user.

[0085] In step S217, the reading assistance device (100) outputs content. The reading assistance device (100) provides content to the user to help the user become interested in reading.

[0086]

[0087] FIG. 6 is a block diagram illustrating a computing device according to an embodiment of the present invention.

[0088] Referring to FIG. 6, the computing device (TN100) may be a device described herein (e.g., a reading assistance device, a management server, etc.).

[0089] The computing device (TN100) may include at least one processor (TN110), a transmitter / receiver device (TN120), and a memory (TN130). In addition, the computing device (TN100) may further include a storage device (TN140), an input interface device (TN150), an output interface device (TN160), and the like. The components included in the computing device (TN100) may be connected by a bus (TN170) to communicate with each other.

[0090] The processor (TN110) can execute program commands stored in at least one of the memory (TN130) and the storage device (TN140). The processor (TN110) may refer to a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor in which methods according to embodiments of the present invention are performed. The processor (TN110) may be configured to implement procedures, functions, methods, etc. described in relation to embodiments of the present invention. The processor (TN110) may control each component of the computing device (TN100).

[0091] The memory (TN130) and the storage device (TN140) can each store various information related to the operation of the processor (TN110). The memory (TN130) and the storage device (TN140) can each be configured with at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory (TN130) can be configured with at least one of a read-only memory (ROM) and a random access memory (RAM).

[0092] The transceiver (TN120) can transmit or receive wired or wireless signals. The transceiver (TN120) can be connected to a network to perform communication.

[0093]

[0094] Meanwhile, the embodiments of the present invention are not implemented only through the devices and / or methods described so far, but may also be implemented through a program that realizes a function corresponding to the configuration of the embodiments of the present invention or a recording medium on which the program is recorded, and such implementation can be easily implemented by a person skilled in the art to which the present invention pertains based on the description of the embodiments described above.

[0095]

[0096] Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concept of the present invention defined in the following claims also fall within the scope of the present invention.

Claims

1. Smart glasses worn by the user, which capture images of the book the user is reading and the eyes of the user while reading, and generate corresponding image information; and A control unit that detects book-related information and a portion of a book that a user is currently reading based on the generated image information, and if a preset word is included in the content of the detected portion of the book, determines that a preset event has occurred and controls to output at least one of a visual effect and an auditory effect corresponding to the event; A reading aid device including:

2. In paragraph 1, The above control unit, A reading assistance device characterized in that it detects status information about the user's gaze and focus based on image information captured of the user's pupils, calculates reading-related concentration using the detected status information, and determines that the event has occurred if the calculated concentration is lower than a preset standard.

3. In paragraph 2, The above control unit, A reading assistance device characterized in that it further detects the user's reading pattern and difficulty of reading using the above status information, and supports chatbot conversation in conjunction with the smart glasses based on the detected concentration, reading pattern, and difficulty of reading.

4. In paragraph 1, If the above user reads the above book aloud, The above control unit, A reading assistance device characterized in that it detects information related to at least one of pronunciation, breathing position, reading speed, and misreading included in the voice information for the above sound, and provides feedback information on a part requiring correction based on the detected information.

5. In paragraph 1, When reading an e-book that provides the contents of the book as an image, The above control unit, A reading assistance device characterized in that it replaces the name of at least one character included in the contents of the above book with an arbitrary name and controls the contents of the above electronic book to be output with the replaced name.

6. In paragraph 5, The above control unit, A reading assistance device characterized in that it is determined that the event has occurred whenever the arbitrary name is output from the contents of the electronic book.

7. In paragraph 5, The above control unit, A reading assistance device characterized in that it performs an analysis of the contents of the above book, estimates the personality of each character using the analysis results, and controls the personality of one of the characters to be reflected in the chatbot conversation pattern when the character is selected.

8. In paragraph 5, The above control unit, A reading assistance device characterized in that, when a user input is input from the user and the user input includes a specific word, the device returns to a preset page of the electronic book.

9. In paragraph 1, The above control unit, A reading assistance device characterized in that, if the detected book portion is the last page of the book, it is determined that a reading completion event has occurred and a congratulatory message and information about the reading process are output.

10. In paragraph 9, The above control unit, A reading assistance device characterized in that the completion event is controlled to occur only when a record of the user sequentially reading from the first page to the last page of the book is saved.

11. In a reading assistance method performed by a reading assistance device, A step of generating image information by taking pictures of the book the user is reading and the pupils of the user reading; A step of detecting book-related information and the part of the book that the user is currently reading based on the generated image information; and A step of determining that a preset word is included in the contents of the detected book portion, and outputting at least one of a visual effect and an auditory effect corresponding to the preset event; A reading assistance method including:

12. At least one reading assistance device that assists the reading process to make the user interested in reading; and A management server that receives user information and monitoring information on the reading process of the user from the reading assistance device and manages the reading habits of the user using the received monitoring information; The above reading aid device is, Smart glasses worn by a user, which capture images of the book the user is reading and the eyes of the user while reading, thereby generating corresponding image information; and A control unit that detects book-related information and a portion of a book that a user is currently reading based on the generated image information, and if a preset word is included in the content of the detected portion of the book, determines that a preset event has occurred and controls to output at least one of a visual effect and an auditory effect corresponding to the event; A reading assistance system characterized by including:

13. In paragraph 12, The above management server, A reading assistance system characterized in that it processes the monitoring information based on the user information to create a new story in which the user is included as a character, and creates image-based content using the created story.

14. In paragraph 12, If the above user reads the above book aloud, The above control unit, A reading assistance system characterized in that it detects information related to at least one of pronunciation, breathing position, reading speed, and misreading included in the speech information for the above sound, and provides feedback information on a part requiring correction based on the detected information.

15. In paragraph 12, When reading an e-book that provides the contents of the book as an image, The above control unit, A reading assistance system characterized in that it replaces the name of at least one character included in the contents of the above book with an arbitrary name and controls the contents of the above electronic book to be output with the replaced name.

Images