Learning support program, learning support device, and learning support method
The learning support system addresses the issue of lacking pressure feedback in conventional handwriting recognition by evaluating and adjusting line thickness and providing auditory cues, enhancing the learning experience.
Patent Information
- Application Number
- JP2021172738
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-10-21
- Publication Date
- 2025-12-24
- Estimated Expiration
- 2041-10-21
AI Technical Summary
Conventional technologies for recognizing handwritten characters focus solely on shape similarity to a model, failing to assess writing pressure, leading to inaccurate learning feedback and lack of awareness about appropriate writing pressure.
A learning support system that recognizes and evaluates writing pressure of handwritten characters, adjusting line thickness and providing feedback on pressure through visual and auditory cues to ensure proper pen pressure.
Enhances user awareness of appropriate writing pressure, ensuring effective learning by visually and audibly indicating pressure deviations, thereby improving handwriting quality.
Smart Images

Figure 0007791686000001 
Figure 0007791686000002 
Figure 0007791686000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a learning support program, a learning support device, and a learning support method for supporting learning. [Background technology]
[0002] Conventionally, there has been a technology that accepts answers to questions posed to a user via a terminal device by handwriting input from the user, performs pattern recognition on the answers accepted by handwriting input, and displays a correct / incorrect judgment result based on the pattern-recognized answer and a correct answer (model) stored in advance (see, for example, Patent Document 1 below).
[0003] Furthermore, there has been a conventional technology that compares handwritten input characters with character information (model) that serves as a criterion for determining whether the handwritten input characters are correct, thereby determining whether the start and end positions of the characters are within a predetermined range (see, for example, Patent Document 2 below). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-241736 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-225980 Summary of the Invention [Problem to be solved by the invention]
[0005] However, all of the above-mentioned conventional techniques determine the accuracy of handwritten input characters based on the degree to which they resemble a model, and are unable to determine whether each character is written with the correct writing pressure. As the accuracy of pattern recognition improves, by making the shape of handwritten characters resemble a model, even handwritten characters that are not written with the appropriate writing pressure can be recognized as characters.
[0006] This has led to the problem that it is not possible to make the user aware of writing characters with appropriate writing pressure. Also, even if handwritten characters that are not written with appropriate writing pressure can be made to resemble the shape of the model, it cannot be said that learning to write characters has been achieved, and there has been a problem that the original effect of learning to write handwritten characters cannot be achieved. Also, it is not realistic for the user's parents or others to constantly monitor the user's learning and instruct the user to write characters with the correct writing pressure.
[0007] In order to solve the problems of the conventional technology described above, the present invention aims to provide a learning support program, a learning support device, and a learning support method that can make users aware of writing characters with appropriate pen pressure. [Means for solving the problem]
[0008] In order to solve the above-mentioned problems and achieve the objectives, the learning support program of the present invention is characterized in that it causes a computer to execute the following processes: requesting a user to write, accepting input of handwritten characters from the user, recognizing the input handwritten characters or the strokes of the handwritten characters, determining the writing pressure of the recognized handwritten characters or the strokes of the handwritten characters, and outputting information related to the determination result.
[0009] In addition, the learning support program of this invention is characterized in that, in the above invention, the output process outputs information regarding the judgment result by displaying the recognized handwritten character or strokes of the handwritten character with line thickness varying depending on the writing pressure of the handwritten character or strokes of the handwritten character.
[0010] The output process is characterized in that the recognized handwritten characters or strokes of the handwritten characters are displayed without generating jaggies within a single stroke.
[0011] In addition, the learning support program of the present invention is characterized in that, in the above invention, the judgment process judges the writing pressure of the recognized handwritten character or the strokes of the handwritten character based on a predetermined threshold value for judging writing pressure.
[0012] In addition, the learning support program of this invention is characterized in that, in the above invention, the threshold value for determining the pen pressure is set in multiple stages, and the output process outputs information regarding the determination result by displaying the recognized handwritten character or the strokes of the handwritten character with different line thicknesses depending on the pen pressure of the handwritten character or the strokes of the handwritten character, depending on whether the pen pressure on the handwritten character or the strokes of the handwritten character is greater than or equal to the multiple-stage threshold value for determining the pen pressure.
[0013] Furthermore, the learning support program of this invention is characterized in that, in the above invention, the judging process judges whether the rate at which the writing pressure on the recognized handwritten character or stroke of the handwritten character exceeds a threshold value for determining whether the handwritten character or stroke needs to be rewritten is equal to or less than a predetermined rate, and the outputting process, if the rate at which the writing pressure on the recognized handwritten character or stroke of the handwritten character exceeds the threshold value for determining whether the handwritten character needs to be rewritten is equal to or less than a predetermined rate, erases the display of the handwritten character or stroke that was most recently input, and outputs information requesting the handwritten character or stroke that was most recently input to be rewritten.
[0014] In addition, in the learning assistance program according to the present invention, in the above invention, the output process outputs information about the judgment result by outputting a voice notifying the judgment result.
[0015] The learning support device of the present invention is characterized by comprising an input unit that accepts input of handwritten characters that a user has requested the user to write, a recognition unit that recognizes the handwritten characters or strokes of the handwritten characters that the input unit has accepted, a determination unit that determines the writing pressure of the handwritten characters or strokes of the handwritten characters that the recognition unit has recognized, and an output unit that outputs information related to the determination result of the determination unit.
[0016] Furthermore, the learning support method of the present invention is characterized in that it accepts input of handwritten characters from a user who has been requested to write, recognizes the input handwritten characters or the strokes of the handwritten characters, determines the writing pressure of the recognized handwritten characters or the strokes of the handwritten characters, and outputs information related to the determination result. [Effects of the Invention]
[0017] The learning support program, learning support device, and learning support method according to the present invention have the effect of making a user aware of the need to write characters with appropriate pen pressure. [Brief explanation of the drawings]
[0018] [Figure 1] FIG. 1 is an explanatory diagram showing the system configuration of a correspondence education system. [Figure 2A] FIG. 2 is an explanatory diagram illustrating an example of a hardware configuration of a computer device that realizes a server. [Figure 2B] FIG. 2 is an explanatory diagram illustrating an example of a hardware configuration of a computer device that realizes an operation terminal. [Figure 3] FIG. 2 is a block diagram showing a functional configuration of an operation terminal. [Figure 4A] FIG. 1 is an explanatory diagram (part 1) showing an example of a display screen displayed on a display of an operation terminal. [Figure 4B] FIG. 2 is an explanatory diagram (part 2) showing an example of a display screen displayed on the display of the operation terminal. [Figure 4C] FIG. 10 is an explanatory diagram (part 3) showing an example of a display screen displayed on the display of the operation terminal. [Figure 5] FIG. 10 is an explanatory diagram showing a comparative example of a display screen. [Figure 6] FIG. 10 is an explanatory diagram showing an example of a child's writing tendency. [Figure 7] 10 is a flowchart illustrating an example of a processing procedure of an operation terminal. DETAILED DESCRIPTION OF THE INVENTION
[0019] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of a learning support program, a learning support device, and a learning support method according to the present invention will be described in detail below with reference to the accompanying drawings.
[0020] (System configuration of correspondence education system) First, a system configuration of a correspondence education system including a learning support device according to an embodiment of the present invention will be described. Fig. 1 is an explanatory diagram showing the system configuration of the correspondence education system.
[0021] 1, a distance learning system 100 according to an embodiment of the present invention includes a server 110 and a plurality of operation terminals (learning support devices) 120. The server 110 is managed by an operator (administrator) of the distance learning system 100. The server 110 can be realized by a general-purpose computer device such as a personal computer (see FIG. 2A). The server 110 stores a teaching material database and a subscriber database (both not shown).
[0022] The operation terminal 120 can be realized by, for example, a portable computer device (mobile terminal device) called a tablet computer or tablet terminal (see FIG. 2B). The operation terminal 120 is distributed to users of the distance learning system 100 in advance when the distance learning system 100 is put into operation.
[0023] The operation terminal 120 is equipped with a touch screen that is made up of a display and a touch panel (see FIG. 2B). The operation terminal 120 can be operated using a predetermined operation member 130. Specifically, for example, when a capacitance-type or pressure-sensitive touch panel is used, the operation member 130 can be realized by a capacitance-type touch pen (stylus pen) or the user's finger.
[0024] Specifically, for example, when an electromagnetic induction touch panel is used, a dedicated electronic pen called a digitizer stylus (hereinafter referred to as a "digitizer") can be used instead of a stylus pen to realize the predetermined operation member 130. The operation member 130 realized by the digitizer includes a writing unit that outputs a writing signal and an erasing unit that outputs an erasing signal.
[0025] In response to the switching operation, the operation terminal 120 determines the type of the operation member 130 and the designated object, and performs an operation according to the determined type. Specifically, the operation terminal 120 determines, for example, the type of the operation member 130, such as whether it is a stylus pen, a finger, or a digitizer, and determines, as the object, whether it is a writing action, a mouse (selection action), an eraser (erasing action), or unknown.
[0026] By operating the operation terminal 120 using a dedicated pen such as a digitizer or a stylus pen as the operation member 130, even if the user has his / her hand in contact with the touch screen when inputting an answer by handwriting, the input handwritten characters can be recognized, and the input of handwritten characters can be performed naturally and effortlessly.
[0027] The server 110 and each operation terminal 120 are connected to each other so as to be able to communicate with each other via a network 140 such as the Internet. Each operation terminal 120 can perform wireless communication with a radio wave repeater provided on the network 140, for example, by a wireless LAN such as Wi-Fi (registered trademark), thereby realizing good portability of the operation terminal 120.
[0028] (Hardware configuration of server 110) 2A is an explanatory diagram showing an example of the hardware configuration of a computer device that realizes server 110. In FIG. 2A, the computer device that realizes server 110 includes a CPU 211, a memory 212, and a network I / F (Interface) 213. The units 211 to 213 included in the computer device are connected to each other via a bus 210. The CPU 211 is responsible for overall control of the computer device that realizes server 110.
[0029] Memory 212 stores programs such as a boot program and data constituting various databases. Memory 212 also stores various databases, such as a teaching material database and a subscriber database, which will be described later. The various databases are stored in non-volatile storage media, among the various storage media that implement memory 212, whose stored contents are not erased even when the power is turned off.
[0030] The memory 212 is used as a work area for the CPU 211. The memory 212 can be realized by, for example, a read-only memory (ROM), a random access memory (RAM), a hard disc drive (HDD), or a hard disc (HD).
[0031] The network I / F 213 is connected to a network 140 such as the Internet, and is connected to an external device such as the operation terminal 120 via the network 140. The network I / F 213 is responsible for interfacing between the network 140 and the inside of the computer device that realizes the server 110, and controls the input and output of data between the computer device that realizes the server 110 and the external device.
[0032] (Hardware configuration of operation terminal 120) Fig. 2B is an explanatory diagram showing an example of the hardware configuration of a computer device that realizes the operation terminal 120. In Fig. 2B, the computer device that realizes the operation terminal 120 includes a CPU 221, a memory 222, a network I / F 223, a timer 224, a touch screen 225, a microphone 226, a speaker 227, a camera 228, and a power switch 229. In addition, the units 221 to 229 included in the computer device that realizes the operation terminal 120 in the correspondence education system 100 according to the embodiment of the present invention are connected to each other via a bus 220.
[0033] The CPU 221 is responsible for overall control of the operation terminal 120. The memory 222 stores programs such as a boot program and various data such as a password for startup. The memory 222 is also used as a work area for the CPU 221. The memory 222 can be realized by, for example, a flash memory.
[0034] The network I / F 223 is connected to a network 140 such as the Internet via a radio wave relay device such as a Wi-Fi router (not shown). The network I / F 223 controls input and output of data to and from an external device such as the server 110 via the network 140.
[0035] The timer 224 measures (counts up) the elapsed time from the start of measurement. Specifically, the timer 224 measures the elapsed time from the start of displaying a character (model) that requires handwritten input. Alternatively, specifically, the timer 224 may measure the elapsed time from the start of writing a handwritten character or a stroke of the handwritten character until the writing is completed.
[0036] The touch screen 225 includes a display 225a and a touch panel 225b. The display 225a displays, for example, images of characters (models) to be handwritten and a frame indicating an area in which to write the handwritten characters to be input (hereinafter referred to as an "answer input frame" as appropriate).
[0037] Display 225a can be realized, for example, mainly by a liquid crystal display (LCD), an organic electroluminescence (EL) display, etc. Display 225a may be a color display or a monochrome (black and white) display.
[0038] Touch panel 225b is stacked on the display surface side of display 225a, and outputs a signal according to the operation position to CPU 221. Touch panel 225b determines, for example, whether or not an input operation has been performed on touch panel 225b, the position on touch panel 225b where the input operation was accepted, the medium on which the input operation was performed, and the like, and outputs a signal according to the accepted input operation to CPU 221.
[0039] The touch panel 225b outputs different types of signals depending on the medium used for the input operation. The CPU 221 can determine whether the medium used for the input operation is a human hand or the operation member 130 based on the difference between the amount of static electricity when a human hand touches the touch panel 225b and the amount of static electricity when the operation member 130 touches the touch panel 225b. The touch panel 225b is not limited to a capacitance type, and various known types such as an electromagnetic induction type, a resistive film type, an acoustic pulse recognition type, an ultrasonic surface acoustic wave type, an infrared shading type, and an image recognition type can be used.
[0040] The touch screen 225 may be realized by a multi-touch screen that can accept multi-touch operations by touching multiple points on the touch panel 225b simultaneously, among touch screens that accept operations by the user touching the touch panel 225b.
[0041] The multi-touch screen can accept, for example, a pinch-out operation in which two fingertips, such as a thumb and index finger, are placed in contact with the touch panel 225b, widening the gap between the two fingertips, or a pinch-in operation in which the two fingertips are brought closer together. By implementing the touch screen 225 as a multi-touch screen, complex input operations can be accepted without using a keyboard.
[0042] Furthermore, when the touch screen 225 detects contact of the operating member 130 with the touch panel 225b while displaying characters (questions) requiring handwritten input on the display 225a, even if the detected contact position is not within the answer input frame, as long as it is included within a predetermined area on the touch panel 225b, handwritten information such as handwritten characters that visualize the position contacted by the operating member 130 may be displayed on the display 225a.
[0043] As a result, the touch screen 225 can accept input (writing) of any handwritten characters such as notes by the user on the touch panel 225b, and display the accepted input handwritten characters as handwritten information on the display 225a. In addition, the operation terminal 120 may store any handwritten characters such as notes by the user in the memory 222.
[0044] Each time operation terminal 120 receives input of information such as handwritten characters, it generates image data of the input handwritten characters, generates handwritten information for transmission that associates the identification information of the study content (characters) when the handwritten characters were input and the identification information of operation terminal 120, and transmits each piece of handwritten information for transmission to server 110. When server 110 receives handwritten information for transmission, it associates the handwritten information included in the information with the identification information of the study content and the identification information of operation terminal 120 included in the handwritten information for transmission, and stores the information in memory 222.
[0045] The handwritten information to be transmitted may be stored in memory 222 for a certain period of time, such as until a certain amount of data is reached or until the learning of one learning content is completed, and may be transmitted to server 110 when the certain amount of data is reached or when the learning of one character is completed.
[0046] The microphone 226 performs analog-to-digital conversion of audio, such as a speaker's voice, input as analog data, to generate digital audio data. The microphone 226 is used, for example, when learning pronunciation in an English class. The speaker 227 performs digital-to-analog conversion of the digital audio data and outputs audio by, for example, passing electricity through a coil in a speaker cone based on the analog audio data. The speaker 227 outputs, for example, a message such as "Try writing a little harder." Specifically, the speaker 227 may also output audio such as a warning alarm.
[0047] Camera 228 captures an image of an object to be imaged by operating touch panel 225b and generates image data. The generated image data can be stored in memory 222. Network I / F 223 is connected to network 140 such as the Internet, and serves as an interface for communication with server 110 via network 140.
[0048] The power switch 229 switches ON / OFF the power supply from a power source (not shown) to each unit of the operation terminal 120. The power switch 229 switches ON / OFF the power supply on the power source side (most upstream side) of the power path from a power source (not shown) to each unit of the operation terminal 120. The power switch 229 outputs an ON / OFF signal to the CPU 221 in response to the received operation. The power switch 229 may also switch ON / OFF the power supply by stopping or canceling the power supply from the power source on the most upstream side of the power path.
[0049] (An example of a teaching material database) The learning material database stores learning content related to handwritten character learning. The learning content is composed of "question" content and "answer" content. The "question" content includes, for example, image data showing a model of the character to be learned (handwritten character to be input). The model may be any of hiragana, katakana, kanji, numbers (e.g., Arabic numerals), and alphabets, or may include all of them. The model may also include multiple styles (fonts) for a single character, such as regular script, cursive script, and semi-cursive script.
[0050] Furthermore, the "question" content may include, for example, image data of an answer input box. The answer input box may include solid lines that indicate the outer frame of the answer input box, or cross-shaped lines that are thinner (or lighter in color) than the solid lines or dotted lines (see, for example, FIG. 4A). The solid lines that indicate the outer frame of the answer input box may form, for example, a square, and the lines may form a cross that divides the square into four equal parts.
[0051] Furthermore, the "question" content may include a message such as "Try writing this character" or "Try tracing the model." The message may be in text, audio, or both text and audio.
[0052] The "question" content is in a format that can be played back using a question playback application installed on the operation terminal 120, and is composed of various types of data such as characters (text), still images, and audio. The "question" content may also include video (video and audio) data. The "question" content may have different levels of difficulty depending on the user's level of proficiency.
[0053] In the study content, each character to be studied is assigned a unique identification. The unique identification is information that identifies the character to be studied, and as will be described later, the unique identification can be used to understand the user's progress in studying. The unique identification may be assigned only to the "question" content, only to the "answer" content, or to the study content that includes both the "question" content and the "answer" content.
[0054] The "answer" content includes information regarding a predetermined threshold value for determining pen pressure. The threshold value for determining pen pressure is a reference value for determining whether the pen pressure of characters handwritten by a user is appropriate, and can be any value set within a range from "0 (zero)," which indicates that no pressure is applied to the touch panel 225b from the specified operation member 130, to "100," which is the maximum value at which the pressure can be determined to be appropriate. The threshold value for determining pen pressure is a numerical value relative to the actual measured value of the pressure applied to the touch panel 225b from the specified operation member 130, and the specific pressure (numerical value) corresponding to "0" or "100" can be set arbitrarily.
[0055] The threshold for determining writing pressure may be set to one level or multiple levels. When multiple levels of threshold for determining writing pressure are set, for example, the lower limit of the threshold for determining writing pressure may be set to "50", the intermediate value of the threshold for determining writing pressure may be set to "75", and the upper limit of the threshold for determining writing pressure may be set to "100".
[0056] The threshold for determining writing pressure may be set for each character or for each stroke in a character.Furthermore, the threshold for determining writing pressure may be set for each writing part in the stroke of a handwritten character, for example.
[0057] Strokes are broadly classified into eight types: roku, a horizontal stroke; do, a vertical stroke; ryaku, a left stroke; soku, a dot; taku, a right stroke; saku, the bottom stroke of a water element or a nisui element (a stroke pointing diagonally upward to the right); tensetsu, a bend; and teki, a stroke. When setting a threshold for determining writing pressure for each stroke in a handwritten character, the threshold for determining writing pressure for each stroke can be set based on these eight classifications.
[0058] Specifically, a stroke can be divided into multiple parts, such as the pressure at the starting point of each stroke, such as a horizontal or vertical stroke, the pressure at the intermediate part from the starting point to a left stroke or a right stroke, and the pressure at the left stroke or the right stroke, and a threshold value for determining the pressure at each part can be set.
[0059] The "answer" content also includes image data (font) of answer characters used to determine the pattern of handwritten characters input in response to a request from the "question" content. The answer characters correspond to the "question" content and may be hiragana, katakana, kanji, numbers (for example, Arabic numerals), or the alphabet. The answer characters may be any image data (font) such as regular script, running script, or cursive script, depending on the "question" content. In the "answer" content, different thresholds for determining pen pressure may be set depending on the font, such as regular script, running script, or cursive script.
[0060] The "answer" content may include information regarding the stroke order of the characters that make up the answer, and information regarding the determination of "stops," "strokes," "stroke strokes," etc. Information regarding the determination of "stops," "strokes," "stroke strokes," etc. can be realized, for example, by information indicating the starting position of each "stop," "stroke," or "stroke stroke," the ending position of each "stop," "stroke," or "stroke stroke," and the pen pressure (pressure) at each position.
[0061] The "answer" content may include text data instead of, or in addition to, image data (font) of the characters (hiragana, katakana, kanji, numbers, alphabet, etc.) that constitute the answer.
[0062] Each "answer" content is stored in association with each "question" content in the teaching material database. In the teaching material database, each "answer" content is stored in association with one "question" content. In the teaching material database, at least one "answer" content is stored in association with each "question" content.
[0063] (An example of a subscriber database) The subscriber database stores information relating to the progress of learning associated with each user's identification information. The information relating to the progress of learning indicates the progress of learning. The information relating to the progress of learning can be realized, for example, by information relating to the playback history of learning content. The information relating to the progress of learning can also be realized, for example, by information relating to "question" content that has been displayed on the display 225a of the operation terminal 120 or "question" content for which input of answers has been accepted.
[0064] In addition, information regarding the progress of learning may be realized by information regarding "question" content that has been displayed on the display 225a of the operation terminal 120 or "question" content for which answer input has been accepted, and which has been determined to have exceeded a predetermined percentage in the proportion of the stroke pressure of the recognized handwritten characters or strokes of the handwritten characters that exceeds a threshold for determining whether the handwritten characters or strokes need to be rewritten.
[0065] Information regarding the progress of learning may include, for example, identification information of learning content that is determined to have exceeded a predetermined percentage, such as playing learning content / displaying learning content / accepting answer input / exceeding the threshold for determining rewriting, and information regarding the date and time when the learning content was played / displayed / accepted answer input / the above determination was made (hereinafter referred to as the "learning date and time" as appropriate).
[0066] In this way, by managing the learning progress of each user, it is possible to have each user learn appropriate characters that match the user's learning progress. The subscriber database may also store information about the users themselves, such as the names (member names), grades, and dates of birth of users who are subscribers to the correspondence education system 100. The subscriber database may also include information about the users' guardians, such as the users' parents.
[0067] (Functional configuration of operation terminal 120) Next, the functional configuration of the operation terminal 120 will be described. Fig. 3 is a block diagram showing the functional configuration of the operation terminal 120. In Fig. 3, the functions of the operation terminal 120 can be realized by a processing unit 301. The processing unit 301 includes a storage unit 302, a control unit (recognition unit, determination unit) 303, an output unit 304, and an input unit 305.
[0068] Storage unit 302 stores the learning material database. For example, storage unit 302 may store only the learning content downloaded by the user from server 110 from the learning material database stored in server 110. Alternatively, storage unit 302 may store, for example, learning content downloaded by the user from server 110 within a predetermined period prior to the current time.
[0069] The storage unit 302 also stores information about handwritten characters input by the user. The information about handwritten characters input by the user includes image data of the handwritten characters and information about the writing pressure of the characters. The information about the writing pressure of the handwritten characters can be realized by, for example, whether the percentage of the writing pressure of the accepted handwritten input character that is below the lower limit of the writing pressure determination threshold is equal to or less than a predetermined percentage, or the numerical value of the percentage that is below the lower limit of the writing pressure determination threshold.
[0070] The information about handwritten characters input by the user may also include at least one of the date and time the characters were handwritten, the number of times the characters were handwritten, etc. The information about handwritten characters input by the user may also include data about the stroke order of the characters handwritten by the user. For example, storage unit 302 stores the information about handwritten characters in association with the unique identification information of the study content in which the handwritten characters were input.
[0071] Furthermore, the storage unit 302 stores, for example, identification information of the operation terminal 120, information about the user, and a password used to start up and operate the operation terminal 120. In this embodiment, the function of the storage unit 302 can be realized by the memory 222.
[0072] The control unit 303 controls the output unit 304 to present questions to the user. Specifically, the output unit 304 can be realized by the display 225a. Specifically, the control unit 303 presents questions by, for example, displaying characters (models) that require handwritten input, answer input boxes, and the like on the display 225a.
[0073] More specifically, the control unit 303 presents a question by displaying characters (models) that require handwritten input within an answer input box at a size appropriate for the answer input box (see FIG. 4A). This allows the user to learn characters by tracing the displayed characters (models).
[0074] Alternatively, the control unit 303 may present a question by displaying characters (models) that require handwritten input next to the answer input box, allowing the user to learn characters by looking at the displayed characters (models) and writing the characters in a way that imitates the characters (models).
[0075] In addition to the characters (model) that require handwritten input and the answer input box, the control unit 303 may also display on the display 225a, for example, messages such as "Try tracing the characters on the screen" or "Try writing the characters displayed on the screen," or illustrations that may stimulate children's interest in learning characters.
[0076] Specifically, the output unit 304 may be realized by the speaker 227 in addition to the display 225a. In this case, the control unit 303 may specifically, for example, display on the display 225a characters (models) that require handwritten input, answer input boxes, and the like, and may also cause the speaker 227 to output a message by voice, such as "Try tracing the characters on the screen" or "Try writing the characters displayed on the screen."
[0077] Furthermore, the control unit 303 controls the input unit 305 to accept input of handwritten characters by the user relating to answers to the questions posed via the output unit 304. Specifically, the input unit 305 can be realized by the touch panel 225b. The control unit 303 controls the input unit 305 to accept an input operation on the touch panel 225b by a user or other user, and acquires a signal corresponding to the accepted input operation from the touch panel 225b. In this embodiment, the functions of the control unit 303 can be realized by the CPU 221 and the memory 222.
[0078] For example, when handwritten characters are input using a dedicated electronic pen such as a digitizer as the operation member 130, the control unit 303 may recognize the input handwritten characters or the strokes of the handwritten characters. This makes it possible to recognize only the handwritten characters even when the user is touching the display 225a with their hand.
[0079] Furthermore, the control unit 303 recognizes the input handwritten characters and determines the writing pressure of the recognized handwritten characters. Based on a writing pressure determination threshold, the control unit 303 determines whether the writing pressure of the recognized handwritten characters is equal to or greater than the writing pressure determination threshold or is below the writing pressure determination threshold. If multiple levels of writing pressure determination thresholds are set, the control unit 303 determines whether the writing pressure of the recognized handwritten characters is equal to or greater than each writing pressure determination threshold or is below the writing pressure determination threshold.
[0080] Specifically, for example, if the lower limit of the threshold for determining pen pressure is set to "50" and the intermediate value of the threshold for determining pen pressure is set to "75," the control unit 303 will determine that the pen pressure of the character accepted as handwritten input is "0 to 49," which is below the lower limit of the threshold for determining pen pressure, "50," as "too weak pen pressure."
[0081] In this case, the control unit 303 determines that the writing pressure of the accepted handwritten input character is "not too weak, but could be a little stronger" if the writing pressure is "50 to 74," which is equal to or greater than "50," the lower limit of the writing pressure determination threshold, and less than "75," the intermediate value of the writing pressure determination threshold.In this case, the control unit 303 determines that the writing pressure of the accepted handwritten input character is "good" if the writing pressure is "75 to 100," which is equal to or greater than "75," the intermediate value of the writing pressure determination threshold.
[0082] Based on the determination result of the writing pressure of the recognized handwritten character, the control unit 303 controls the output unit 304 to output information related to the determination result. For example, the control unit 303 outputs information related to the determination result by causing the display 225a to display lines whose thickness varies depending on the writing pressure of the recognized handwritten character or the stroke of the handwritten character along the trajectory of the movement of the tip of the digitizer.
[0083] Specifically, the control unit 303 displays the recognized handwritten characters or strokes of the handwritten characters on the display 225a so that, for example, the higher the writing pressure, the thicker the line, and the lower the writing pressure, the thinner the line. This allows the user to visually recognize the writing pressure of the handwritten characters or strokes written by the user in an easy-to-understand manner (see FIG. 4B, etc.).
[0084] Specifically, the control unit 303 may cause the display 225a to display the recognized handwritten characters so that, for example, the higher the writing pressure, the darker the line color, and the lower the writing pressure, the lighter the line color. Alternatively, specifically, the control unit 303 may cause the display 225a to display the recognized handwritten characters so that, for example, the line color is black when the writing pressure of the handwritten characters is equal to or greater than the intermediate value of the writing pressure determination threshold, the line color is blue when the writing pressure is equal to or greater than the lower limit of the writing pressure determination threshold and less than the intermediate value of the writing pressure determination threshold, and the line color is red when the writing pressure is less than the lower limit of the writing pressure determination threshold.
[0085] The control unit 303 displays the recognized handwritten characters so that no jaggies occur in the strokes that make up the handwritten characters. Jaggies occur when handwritten characters or strokes of the handwritten characters are displayed in staircase-like (jagged) steps rather than as smooth lines, and the control unit 303 adjusts and displays the recognized handwritten characters or strokes of the handwritten characters so that no jaggies occur in lines that are oblique to the pixel arrangement direction (vertical or horizontal) of the display.
[0086] This allows the user to visually recognize the pressure of the handwritten characters and strokes written by the user in an easy-to-understand manner, without giving the user any sense of incongruity about the handwritten characters and strokes.
[0087] The control unit 303 may recognize each stroke of an input handwritten character, determine the pressure of the recognized stroke, and output information related to the determination result. That is, before the input of one character is completed, each time the input of one stroke is accepted, the control unit 303 may recognize the stroke, determine the pressure of the recognized stroke, and display a stroke of a thickness according to the pressure.
[0088] When determining the writing pressure, the control unit 303 may determine the writing pressure for each part of the stroke. Specifically, for example, based on eight types of classifications, namely, roku (a horizontal stroke), do (a vertical stroke), ryaku (a left stroke), soku (a dot), taku (a right stroke), saku (a stroke at the bottom of a water element or a water element (a stroke pointing diagonally upward to the right), tensetsu (a bend), and teki (a stroke), the control unit 303 may determine the writing pressure at the part where the digitizer comes into contact with the touch panel 225b and starts writing (starting point), the writing pressure at the part where the digitizer is released from the touch panel 225b (ending point), and the writing pressure between the starting point and the ending point.
[0089] The control unit 303 may also determine whether the percentage by which the writing pressure of the recognized handwritten character or stroke of the handwritten character exceeds a threshold value for determining whether the handwritten character or stroke is equal to or less than a predetermined percentage. The threshold value for determining whether the handwritten character or stroke is rewritten may be, for example, the lower limit of the threshold value for determining the writing pressure.
[0090] The percentage (i.e., a predetermined percentage) at which the writing pressure in a recognized handwritten character or a stroke of the handwritten character exceeds the threshold for determining whether the writing pressure is appropriate, which is preset for determining whether the writing pressure is appropriate, can be set to any value, such as "40%." If this predetermined percentage is set for one handwritten character, for example, the control unit 303 determines, at the stage when writing of one character is completed, whether the percentage at which the writing pressure when writing the character exceeds the threshold for determining whether the writing pressure is above 40% or below 40%.
[0091] Furthermore, when the above-mentioned predetermined ratio is set for, for example, a stroke, the control unit 303 determines, when writing of one stroke is completed, whether the ratio of the writing pressure when writing that one stroke that exceeds the threshold value for determining whether rewriting is more than 40% or less than 40%.
[0092] Furthermore, if the rate at which the pressure of the recognized handwritten character or stroke of the handwritten character exceeds the threshold for determining whether to rewrite is equal to or less than a predetermined rate (e.g., 40%), the control unit 303 may erase the display of the handwritten character or stroke most recently input and request that the handwritten character or stroke most recently input be rewritten.
[0093] In this case, the control unit 303 may display a message on the display 225a urging the user to rewrite, such as "Try writing harder" or "Try writing a little harder." Alternatively, in this case, the control unit 303 may output an audio message from the speaker 227 urging the user to rewrite, such as "Try writing harder" or "Try writing a little harder." In particular, by urging the user to rewrite by audio in addition to the display, it is possible to reliably inform the user that the pen pressure was insufficient.
[0094] The message to encourage rewriting output via display 225a or speaker 227 may be, for example, "Write a little more firmly," "Try writing it again," or "Try writing the same character (line) again. This time write it more firmly."
[0095] The message to encourage rewriting output via display 225a or speaker 227 may be, for example, "Try writing with more force," "Try writing thicker," or "Try writing with your hand on the tablet," depending on the age of the user. On the other hand, if the user is a child such as a preschooler or a child in the early grades of elementary school, the message "Try writing with more force" may raise concerns that the user will only grip the pen tightly and will not be able to apply strong writing pressure, the message "Try writing thicker" may raise concerns that the user will not know how to write thicker, and the message "Try writing with your hand on the tablet" may raise concerns that the user will apply weak writing pressure even if he or she places his or her hand on the tablet. Therefore, the content of the message may be varied depending on the age of the user.
[0096] The messages output via the display 225a or the speaker 227 may be, for example, "Your writing pressure on the vertical bars is weak," "Please write the dots a little harder!", or "Your writing pressure on the numbers (kanji) is low (high)," pointing out strokes that the user may have difficulty with.
[0097] The message output via display 225a or speaker 227 may be, for example, "Your writing pressure is just right" or "Good luck," which notifies that the writing pressure is appropriate. Furthermore, the message output via display 225a or speaker 227 may be, for example, "Your average writing pressure is XX%," which notifies a specific numerical value regarding the writing pressure.
[0098] Furthermore, the message output via display 225a or speaker 227 may be, for example, "Please write with a little less pressure" or "Please write more gently," which indicates that the writing pressure is too high. Alternatively, if the device is configured to accept input of both handwritten characters written with a finger and handwritten characters written with a digitizer, the message may be one that indicates differences in the tendency of writing pressure for each operating member 130, such as "Your writing pressure is low when using your finger" or "Your writing pressure is high when using the digitizer."
[0099] The control unit 303 may continue to display the handwritten characters or strokes input immediately before while outputting the audio message prompting the user to rewrite the characters, and may erase the display of the handwritten characters or strokes after the output of the audio message prompting the user to rewrite the characters and strokes is complete, and may accept the user to rewrite the handwritten characters or strokes. In this case, the control unit 303 may continue to display the text message prompting the user to rewrite the characters and strokes even after output of the audio message prompting the user to rewrite the characters, and may erase the display of the handwritten characters or strokes after the output of the audio message prompting the user to rewrite the characters and strokes is complete, and may accept the user to rewrite the handwritten characters or strokes.
[0100] The control unit 303 may further determine whether the input handwritten character is similar to a model character to a degree that it can be recognized. Specifically, the control unit 303 can perform pattern recognition on the input handwritten character, and determine whether a character based on the input handwritten character is similar to a model character to a degree that it can be recognized, based on a pattern-recognized solution (character) and a pre-stored character (model).
[0101] In addition, the control unit 303 can, for example, extract a judgment target portion in the shape of a handwritten character, and determine whether the input handwritten character is similar enough to be recognized as a model character based on the degree of deviation between the judgment target portion and the judgment target portion in the model shape, the number of judgment target portions that are determined to have a deviation of more than a predetermined number, etc.
[0102] Furthermore, the control unit 303 can determine whether an input handwritten character is similar enough to be recognized as a model character, for example, based on whether the character is easy to read and well-balanced, whether the stop, stroke, and stroke stroke are written correctly, whether parts that should be straight are written straight, etc. Furthermore, the control unit 303 can determine whether an input handwritten character is similar enough to be recognized as a model character, for example, based on whether the input handwritten character is well-balanced with respect to the size of the answer input frame, whether the radicals, side characters, and radicals are well-balanced, etc.
[0103] The control unit 303 may further determine whether the input handwritten character is similar enough to be recognized as a model character based on not only the shape of the input handwritten character but also the stroke order of the handwritten character. In this case, the control unit 303 compares the model shape and stroke order of a character to be compared with the shape and stroke order of the input handwritten character. Then, based on the difference between the shape of the handwritten character and the model shape and the difference between the stroke order of the handwritten character and the stroke order of the character to be compared, the control unit 303 determines whether the input handwritten character is similar enough to be recognized as a model character.
[0104] By making a judgment that takes into account the stroke order of handwritten characters, it is possible to learn not only the shape of handwritten characters but also the stroke order. By making a judgment that takes into account the stroke order of handwritten characters, it is possible to judge whether the input handwritten characters are similar enough to be recognized as model characters based on the movement of the operating member 130, even if the handwritten characters are slightly cursive and have deviated from regular script. This makes it possible to make the user aware of writing characters with appropriate pen pressure without reducing the user's motivation to learn.
[0105] Furthermore, the control unit 303 may output the handwritten character determination result by controlling the output unit 304. For example, if the input handwritten character is not recognizably similar to the model character or the strokes are excessively meandering, the control unit 303 controls the output unit 304 to output a message such as "Try writing it again" to encourage the user to rewrite the character.
[0106] Furthermore, if the input handwritten characters are not recognizably similar to the model characters or the strokes are excessively meandering, the control unit 303 may display an input field for the user to re-input the handwritten characters. Specifically, the control unit 303 may, for example, control the output unit 304 to display an input field for re-inputting the handwritten characters next to or near the answer input frame that was initially displayed.
[0107] The control unit 303 may display a model in the answer input box where the user is to re-input by handwriting. That is, the control unit 303 may initially display a model next to the answer input box when the user is to input handwritten characters, and when the user is to request rewriting of handwritten characters or strokes, the control unit 303 may display the model in the answer input box where the user is to re-input by handwriting.
[0108] In this case, the control unit 303 may display the model characters in a lighter color than the color of the handwritten characters in the answer input frame where the user re-enters the answer. Alternatively, the control unit 303 may display the model characters in a different color (for example, "black") from the color of the characters displayed when the answer is input in the answer input frame where the user re-enters the answer (for example, "gray" or "blue").
[0109] (Display screen example) Next, a description will be given of examples of display screens displayed on the display 225a by the operation terminal 120. Figures 4A to 4C are explanatory diagrams showing examples of display screens displayed on the display 225a by the operation terminal 120.
[0110] As shown in Fig. 4A, based on the "question" content, operation terminal 120 displays on display 225a model 401 of the character to be studied (handwritten character to be input) and answer input box 402. Fig. 4A shows a state in which the hiragana character "a" is displayed on display 225a as model 401 as the "question" content.
[0111] The model 401 is displayed in a lighter color than the outer frame of the answer input frame 402. This allows the user to visually recognize the characters they are handwriting without being obstructed by the model 401, and to practice writing characters.
[0112] A cross-shaped ruled line 402a is displayed inside answer input frame 402, which is a dotted line that is lighter in color than the outer frame of answer input frame 402. This makes it easier to see the position of each stroke that makes up the character, making it easier to write well-balanced handwritten characters. In the example shown in Fig. 4A, the user inputs (writes) handwritten characters by using a dedicated electronic pen such as a digitizer as operation member 130 and tracing model 401.
[0113] 4B shows the state in which the writing of the hiragana character "a" set as the "question" content has been completed. As shown in FIG. 4B, when operation terminal 120 accepts input of handwritten characters, it displays on display 225a lines (strokes) 403 whose thickness varies depending on the handwriting pressure of the handwritten characters and the strokes of the handwritten characters.
[0114] The operation terminal 120 may be configured to display lines 403 with different thicknesses depending on the writing pressure of handwritten characters or strokes of the handwritten characters only when a specific operation member 130, such as a digitizer or eraser, is used as the operation member 130. This allows the user to reliably learn how to adjust the writing pressure by controlling the force of the fingers when writing handwritten characters.
[0115] 4B shows that the writing pressure near the end point of the first stroke 403a is higher than the writing pressure near the start point of the first stroke 403a. Also, FIG. 4B shows that the writing pressure at the third stroke 403c is higher than the writing pressure at the first and second strokes 403a and 403b.
[0116] 4C shows the state in which the writing of the hiragana character "ho" set as the "question" content has been completed. The example shown in FIG. 4C shows that the writing pressure of the second stroke 403b is low, and the proportion of the writing pressure of the second stroke 403b that exceeds the threshold for determining whether the second stroke 403b needs to be rewritten is equal to or less than a predetermined proportion (e.g., 40%).
[0117] (Example of a display screen comparison) Fig. 5 is an explanatory diagram showing a comparative example of a display screen. As shown in Fig. 5, if a line (stroke) 501 with steps (jagged edges) 501a like stairs, rather than a smooth line, is displayed in accordance with the accepted handwritten character and the pressure of the stroke 403 of the handwritten character, the shape will be difficult to produce when actually writing with a pencil or pen, and the user will feel uncomfortable.
[0118] In contrast to this, in this embodiment, by displaying the strokes 403 that make up the handwritten characters without causing jaggedness, even when the handwritten characters are displayed (reproduced) electronically (digitally) using the terminal device 120, the user can recognize the handwritten characters as natural without feeling any discomfort.
[0119] When determining whether the proportion of the writing pressure in a recognized handwritten character that exceeds a threshold for determining whether rewriting is necessary is equal to or less than a predetermined proportion (for example, 40%) on a stroke-by-stroke basis, the operation terminal 120 does not output a special message when the first stroke is written. In the example shown in Fig. 4B, the operation terminal 120 outputs a voice message urging the user to rewrite the character, such as "Try writing a little harder," when the second stroke 403b is written.
[0120] The operation terminal 120 may display the second stroke 403b and not accept rewriting while outputting the audio message urging the user to rewrite. After the output of the audio message urging the user to rewrite is completed, the operation terminal 120 may erase the display of the second stroke 403b written immediately before and accept rewriting of the second stroke 403b.
[0121] When the audio message prompting rewriting is output for each handwritten character, i.e., when the audio message prompting rewriting is output when the handwritten input of one character is completed, rewriting of the character after the output of the message prompting rewriting may be optional. Also, when the audio message prompting rewriting is output for each handwritten character, the display color of the strokes prompting rewriting may be different from the display color of the strokes that do not need to be rewritten. This makes it possible to reliably notify the user of the strokes prompting rewriting.
[0122] (An example of children's writing habits) Fig. 6 is an explanatory diagram showing an example of children's writing habits. As shown in Fig. 6, children such as preschoolers and elementary school students in the lower grades can write vertical strokes or strokes similar to vertical strokes relatively stably among the parts that make up a character, but tend to have difficulty writing horizontal strokes or strokes similar to horizontal strokes, such as the stroke surrounded by a dashed-line frame 601 in Fig. 6.
[0123] (Example of processing procedure of operation terminal 120) Next, an example of a processing procedure of the operation terminal 120 will be described. Fig. 7 is a flowchart showing an example of a processing procedure of the operation terminal 120. In the flowchart of Fig. 7, first, based on the question content, a model 401 of handwritten characters (question) to be written and an answer input box 402 are displayed on the display 225a (step S701), and the operation waits until input of a stroke (writing of a stroke) using a predetermined operation member 130 such as a digitizer is accepted in the answer input box 402 displayed in step S701 (step S702: No).
[0124] In step S702, if input of a stroke is accepted (step S702: Yes), the writing pressure of the accepted input stroke is determined (step S703). In step S703, for example, the writing pressure of the accepted input stroke is determined for each part of the stroke. The writing pressure of the accepted input stroke may be determined for the entire stroke.
[0125] Next, based on the determination result in step S703, the shape of the stroke to be displayed on the display 225a is determined (step S704). In step S704, the thickness of the line for each part of the stroke to be displayed on the display 225a is determined based on, for example, the path of movement of the tip of the digitizer and the pressure applied to the touch panel 225b along that path.
[0126] Furthermore, in step S704, the shape of the stroke to be displayed on display 225a is determined based on the pen pressure of the accepted input stroke so as to prevent visible jaggies (steps or rough edges) from appearing in the line thickness of adjacent portions within a single stroke. In step S704, the shape of the stroke is determined so that the higher the pen pressure (pressure) applied to touch panel 225b, the thicker the line will be, and the lower the pen pressure, the thinner the line will be. Then, the stroke of the shape determined in step S704 is displayed on display 225a (step S705).
[0127] Next, it is determined whether the rate at which the writing pressure of the strokes accepted for input in step S702: Yes exceeds the threshold for determining whether rewriting is performed is equal to or less than a predetermined rate (step S706). If the rate at which the writing pressure of the strokes accepted for input exceeds the threshold for determining whether rewriting is performed is equal to or less than a predetermined rate (step S706: Yes), it is determined whether the input of all strokes (strokes for one character) of the handwritten character (question) to be written and displayed on display 225a in step S701 has been accepted (step S707).
[0128] In step S707, if the input of all strokes has been accepted (step S707: Yes), the series of processes ends. On the other hand, in step S707, if the input of all strokes has not been accepted, that is, if writing of one character is not complete (step S707: No), the process proceeds to step S702 and waits for the input of the next stroke.
[0129] On the other hand, in step S706, if the rate at which the pen pressure of the accepted stroke exceeds the threshold for determining whether or not the stroke needs to be rewritten is not equal to or less than the predetermined rate (step S706: No), a message prompting the user to rewrite the stroke is output (step S708). In step S708, the message prompting the user to rewrite the stroke is output via, for example, the display 225a or the speaker 227.
[0130] After outputting the message prompting the user to rewrite, the previously input stroke is erased (step S709), and the process proceeds to step S702, where the process waits until the input of the corresponding stroke is accepted. The stroke is erased in step S709, for example, after outputting the message prompting the user to rewrite by voice. In this case, the output of the message prompting the user to rewrite by text may be continued, or the output of the message prompting the user to rewrite by text may be terminated after outputting the message prompting the user to rewrite by voice.
[0131] In the above-described processing example, when step S707: Yes is reached and input of one character is completed by accepting input of all strokes, the series of processes is terminated, but this is not limited to this. For example, when step S707: Yes is reached and input of one character is completed by accepting input of all strokes, the next handwritten character (question) to be written may be selected, and the model 401 of the handwritten character (question) and the answer input box 402 may be displayed on the display 225a.
[0132] Alternatively, in step S707, when the input of one character is completed by accepting the input of all strokes, the next handwritten character (question) to be written may be selected according to a predetermined operation performed by the user, and a model 401 of the handwritten character (question) and an answer input box 402 may be displayed on the display 225a.
[0133] As described above, the learning support program, learning support device, and learning support method according to the embodiments of the present invention are characterized by causing a computer to execute the following processes: requesting a user to write, accepting input of handwritten characters from the user, recognizing the input handwritten characters or the strokes of the handwritten characters, determining the writing pressure of the recognized handwritten characters or the strokes of the handwritten characters, and outputting information related to the determination result.
[0134] According to this invention, it is possible to convey to a user the writing pressure of handwritten characters or strokes of the handwritten characters, thereby making the user aware of the need to write characters with an appropriate writing pressure.
[0135] In addition, the learning support program, learning support device, and learning support method of the embodiments of the present invention are characterized in that the recognized handwritten characters or strokes of the handwritten characters are displayed with different line thicknesses depending on the writing pressure of the handwritten characters or strokes of the handwritten characters.
[0136] According to this invention, the writing pressure of handwritten characters or strokes of handwritten characters can be visually conveyed to the user in an easily understandable manner, thereby more reliably making the user aware of the need to write characters with appropriate writing pressure.
[0137] In addition, the learning support program, learning support device, and learning support method according to the embodiments of the present invention are characterized in that they display recognized handwritten characters or strokes of the handwritten characters without causing jaggedness within a single stroke.
[0138] According to this invention, the writing pressure of the recognized handwritten characters or the strokes of the handwritten characters can be conveyed in a natural manner, as if they were written with a writing implement such as a pencil or a brush, thereby enabling the user's handwriting to be conveyed more accurately.
[0139] In addition, the learning support program, learning support device, and learning support method of the embodiments of the present invention are characterized by determining the writing pressure of a recognized handwritten character or a stroke of the handwritten character based on a predetermined threshold value for determining writing pressure.
[0140] According to this invention, by determining the writing pressure based on a threshold value for determining the writing pressure, the processing load on the CPU can be reduced and the processing speed can be improved. As a result, handwritten characters or the writing pressure of the handwritten characters can be quickly determined in accordance with the writing action and communicated to the user. This allows the user to learn handwritten characters without feeling uncomfortable or stressed.
[0141] Furthermore, the learning support program, learning support device, and learning support method according to the embodiments of the present invention are characterized in that they output information relating to the judgment result by displaying the recognized handwritten character or the strokes of the handwritten character with different line thicknesses depending on the pressure applied to the handwritten character or the strokes of the handwritten character, depending on whether the pressure applied to the recognized handwritten character or the strokes of the handwritten character is greater than or equal to a threshold value for judging pressure in multiple stages.
[0142] According to this invention, the stroke pressure of a recognized handwritten character or a stroke of the handwritten character can be displayed with different line thicknesses depending on whether the stroke pressure is greater or smaller than a threshold value for determining the stroke pressure in multiple stages, thereby enabling the user to be informed of the stroke pressure of the handwritten character or the stroke of the handwritten character in stages, thereby providing detailed guidance to the user on how to write characters with an appropriate stroke pressure.
[0143] Furthermore, the learning support program, learning support device, and learning support method of the embodiments of the present invention are characterized in that they determine whether the rate at which the writing pressure on a recognized handwritten character or stroke of that handwritten character exceeds a threshold value for determining whether the handwritten character or stroke needs to be rewritten is equal to or less than a predetermined rate, and if the rate at which the writing pressure on the recognized handwritten character or stroke of that handwritten character exceeds the threshold value for determining whether the handwritten character or stroke needs to be rewritten is equal to or less than the predetermined rate, they erase the display of the handwritten character or stroke that was most recently input, and output information requesting that the handwritten character or stroke that was most recently input be rewritten.
[0144] According to this invention, if the rate at which the writing pressure of a recognized handwritten character or a stroke of the handwritten character exceeds a threshold for determining whether or not the character needs to be rewritten is equal to or less than a predetermined rate, the user is requested to rewrite the handwritten character or stroke, thereby informing the user that their proficiency level is insufficient and encouraging repeated learning to improve their proficiency level.
[0145] Furthermore, by requesting the user to rewrite if the writing pressure is not appropriate, the user can be made aware of the importance of writing characters with appropriate writing pressure at an early stage, which allows the user to efficiently learn handwriting.
[0146] Furthermore, the learning assistance program, the learning assistance device, and the learning assistance method according to the embodiments of the present invention are characterized in that they output information about the determination result by outputting a voice notifying the determination result.
[0147] According to this invention, by notifying the judgment result by voice, it is possible to stimulate the sense of hearing in addition to the sense of touch for handwriting. For young users such as infants and elementary school children, it is easier to make them aware of the need to increase their writing pressure by conveying the message to them by voice rather than by conveying the message in writing, such as "Try writing harder" or "Try writing harder," or by conveying the message in addition to the written message. This makes it possible to effectively make young users, in particular, aware of the need to increase their writing pressure.
[0148] It is known that there is a strong correlation between finger strength and the development of the frontal lobe of the brain, and that appropriate stimulation can activate the brain. It is also known that improving finger strength promotes the development of the ability to make comprehensive judgments. According to this invention, by encouraging children to write by hand with appropriate pressure, it is possible to not only acquire the ability to write by hand, but also to activate the brain and improve the ability to make comprehensive judgments.
[0149] The learning support method described in this embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, flexible disk, CD-ROM, MO, or DVD, and is executed by being read from the recording medium by the computer. This program may also be a transmission medium that can be distributed via a network such as the Internet. [Industrial Applicability]
[0150] As described above, the learning support program, learning support device, and learning support method of the present invention are useful as learning support programs, learning support devices, and learning support methods that support learning, and are particularly suitable as learning support programs, learning support methods, and learning support devices that support learning by inputting answers by handwriting. [Explanation of symbols]
[0151] 100 Correspondence Education System 110 Server 120 Operation terminal 225 Touchscreen 225a Display 225b Touch Panel 301 Processing section 302 Storage section 303 Control Unit 304 Output section 305 Input section 401 Model (problem) 402 Answer input box
Claims
1. Requesting the user to write, accepting input of handwritten characters from the user; Recognizes the input handwritten characters or strokes of the handwritten characters, determining the pressure of the recognized handwritten character or stroke of the handwritten character; Output information about the judgment result, The determining process includes: determining whether the rate at which the writing pressure of the recognized handwritten character or stroke of the handwritten character exceeds a threshold value set for determining whether the handwritten character or stroke needs rewriting is equal to or less than a predetermined rate; The output process includes: outputting information relating to the determination result by displaying the recognized handwritten character or the stroke of the handwritten character with a line thickness that varies depending on the writing pressure of the handwritten character or the stroke of the handwritten character; If the rate at which the writing pressure of the recognized handwritten character or stroke of the handwritten character exceeds the threshold for determining whether or not the character needs to be rewritten is equal to or less than a predetermined rate, the display of the handwritten character or stroke that was input immediately before is erased, and information requesting the user to rewrite the handwritten character or stroke that was input immediately before is output. A learning support program that causes a computer to execute a process.
2. The output process comprises: Displaying the recognized handwritten character or strokes of the handwritten character without generating jagged edges within a single stroke; 2. The learning support program according to claim 1.
3. The process of determining determining the writing pressure of the recognized handwritten character or the stroke of the handwritten character based on a predetermined threshold value for determining writing pressure; 3. The learning support program according to claim 1 or 2.
4. The threshold value for determining the pen pressure is set in multiple stages, the output process outputs information about the judgment result by displaying the recognized handwritten character or the stroke of the handwritten character with a line thickness that varies depending on the pressure of the handwritten character or the stroke of the handwritten character, in accordance with whether the pressure of the handwritten character or the stroke of the handwritten character is greater or smaller than the threshold value for the judgment of the pressure in multiple stages.
4. The learning support program according to claim 3.
5. The output process comprises: outputting information about the determination result by outputting a sound notifying the determination result; 5. The learning support program according to claim 1, wherein the learning support program is a program for providing a learning support service to a user.
6. An input unit that accepts input of handwritten characters from a user who has requested the user to write; a recognition unit that recognizes handwritten characters or strokes of handwritten characters input by the input unit; a determination unit that determines the writing pressure of the handwritten character recognized by the recognition unit or the stroke of the handwritten character; an output unit that outputs information related to the determination result of the determination unit, The determination unit determining whether the rate at which the writing pressure of the recognized handwritten character or stroke of the handwritten character exceeds a threshold value set for determining whether the handwritten character or stroke needs rewriting is equal to or less than a predetermined rate; The output unit outputting information relating to the determination result by displaying the recognized handwritten character or the stroke of the handwritten character with a line thickness that varies depending on the writing pressure of the handwritten character or the stroke of the handwritten character; A learning support device characterized in that, when the rate at which the pressure of a recognized handwritten character or stroke of that handwritten character exceeds the threshold for determining whether it needs to be rewritten is equal to or less than a predetermined rate, the display of the handwritten character or stroke that was input immediately before is erased and information requesting the rewriting of the handwritten character or stroke that was input immediately before is output.
7. A method for requesting a user to write, accepting input of handwritten characters from the user, Recognizes the input handwritten characters or strokes of the handwritten characters, determining the pressure of the recognized handwritten character or stroke of the handwritten character; Output information about the judgment result, The determining process includes: determining whether the rate at which the writing pressure of the recognized handwritten character or stroke of the handwritten character exceeds a threshold value set for determining whether the handwritten character or stroke needs rewriting is equal to or less than a predetermined rate; The output process includes: outputting information relating to the determination result by displaying the recognized handwritten character or the stroke of the handwritten character with a line thickness that varies depending on the writing pressure of the handwritten character or the stroke of the handwritten character; If the rate at which the writing pressure of the recognized handwritten character or stroke of the handwritten character exceeds the threshold for determining whether or not the character needs to be rewritten is equal to or less than a predetermined rate, the display of the handwritten character or stroke that was input immediately before is erased, and information requesting the user to rewrite the handwritten character or stroke that was input immediately before is output. A learning support method characterized in that processing is executed by a computer.
Citation Information
Patent Citations
Image input device
JP1996087372A
Learning terminal and its controlling method, correct / incorrect determining sever and its control method, learning system, learning terminal control program, correct / incorrect determination server control program, and recording medium with program recorded thereon
JP2008241736A
Character learning machine
JP2012225980A
Learning support device, method for supporting learning, and program
JP2021096452A
Information processing device, image display method, and program
WO2016194650A1