Learning support program, learning support device and learning support method

Abstract

To enable motivating a user to writing characters in correct stroke order.SOLUTION: A computer of an operation terminal is caused to execute a process including: receiving input of a character that a user is requested to write, the character being handwritten and input by the user; recognizing the input character or strokes of the input character; determining the recognized handwritten character or stroke order of the strokes of the handwritten character; and outputting information related to a result of the determination. This may make the user to pay attention to writing handwritten character or to writing characters in the correct stroke order in the handwritten character.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] This invention relates to a learning support program, a learning support device, and a learning support method for assisting learning.

Background Art

[0002] Conventionally, answers to questions for users via a terminal device have been received by handwritten input by the user, pattern recognition of the solution received by handwritten input has been performed, and based on the pattern-recognized solution and a previously stored correct answer (model), there has been a technique for displaying a correct / incorrect determination result (see, for example, Patent Document 1 below).

[0003] Also conventionally, there has been a technique for performing a correct / incorrect determination of handwritten input characters by comparing the handwritten input characters with character information (model) that serves as a criterion for correct / incorrect determination of the handwritten input characters, and determining whether the start position and end position of writing are within a predetermined range (see, for example, Patent Document 2 below).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, all of the above-described conventional technologies determine the correctness based on the degree of similarity between the handwritten characters and the model, and there is a problem that they cannot make the user aware of the specific writing order for writing characters in the appropriate order. In addition, even if a handwritten character written in an inappropriate order can be made to resemble the model in terms of its shape, it cannot be said that the learning of writing the character has been achieved, and there is a problem that the original effect of learning to write handwritten characters cannot be achieved. Also, it is not realistic for the user's parents or the like to constantly monitor the user's learning and give guidance on writing characters in the correct order.

[0006] In addition, when allowing a user such as an infant to write characters such as hiragana for the first time, it is necessary to teach them that each stroke must be written in one continuous motion.

[0007] An object of the present invention is to provide a learning support program, a learning support device, and a learning support method that can make a user aware of writing characters in an appropriate order in order to solve the problems caused by the above-described conventional technologies.

Means for Solving the Problem

[0008] In order to solve the above-described problems and achieve the object, a learning support program according to the present invention causes a computer to execute a process of accepting an input of a user's handwritten characters when a writing is requested from the user, recognizing the input handwritten characters or the strokes of the handwritten characters, determining the writing order in the recognized handwritten characters or the strokes of the handwritten characters, and outputting information regarding the determination result.

[0009] Further, the learning support program according to the present invention includes, in the above invention, a process of displaying a guiding object for guiding the writing order of the handwritten characters when requesting writing from the user.

[0010] Also, in the learning support program according to this invention, in the above invention, the guiding object is characterized in that it is displayed superimposed on the handwritten characters, and includes guiding information for guiding the position of tracing the characters from the writing start position to the writing end position.

[0011] Also, in the learning support program according to this invention, in the above invention, the guiding information is information for sequentially guiding a plurality of points that are displayed superimposed on the handwritten characters and trace the characters from the writing start position to the writing end position, and according to the state of the user tracing the characters at the position of one point of the guiding information, the guiding information of the next point is repeatedly displayed.

[0012] Also, in the learning support program according to this invention, in the above invention, the guiding object is characterized in that it is displayed on the side of the handwritten characters and includes direction information indicating the direction of the writing order of the characters.

[0013] Also, in the learning support program according to this invention, in the above invention, the outputting process outputs information regarding the determination result by displaying the recognized handwritten characters or the strokes of the handwritten characters in the writing order of the handwritten characters or the strokes of the handwritten characters.

[0014] Also, in the learning support device according to this invention, the outputting process outputs information regarding the determination result by displaying the recognized handwritten characters or the strokes of the handwritten characters with information corresponding to the pen pressure of the handwritten characters or the strokes of the handwritten characters.

[0015] Also, in the learning support method according to this invention, the outputting process outputs including reproducing an effect corresponding to the determination result of the writing order and pen pressure of the recognized handwritten characters or the strokes of the handwritten characters.

[0016] In addition, in the learning support method according to the present invention, in the determination process, the recognized handwritten character or the stroke of the handwritten character is compared with a predetermined pen pressure at a plurality of points based on the pen pressure of the handwritten character or the stroke of the handwritten character, and in the output process, the point portion corresponding to the low pen pressure is displayed to indicate that it is the low pen pressure. This is a characteristic.

[0017] In addition, in the learning support method according to the present invention, in the determination process, the pen pressure in the recognized handwritten character or the stroke of the handwritten character is compared with a predetermined threshold value set for the handwritten character or the stroke, and the pen pressure is determined. In the output process, when the pen pressure in the recognized handwritten character or the stroke of the handwritten character is lower than the threshold value, the display of the immediately preceding input handwritten character or stroke is erased, and information requesting the re-writing of the immediately preceding input handwritten character or stroke is output. This is a characteristic.

[0018] In addition, in the learning support method according to the present invention, in the output process, information regarding the determination result is output by outputting a voice notifying the determination result. This is a characteristic.

Effect of the Invention

[0019] According to the learning support program, learning support device, and learning support method of the present invention, there is an effect that the user can be made aware of writing characters in an appropriate writing order.

Brief Description of the Drawings

[0020]

Fig. 1

Fig. 2A

Fig. 2B

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 10

Embodiments for Carrying Out the Invention

[0021] Hereinafter, with reference to the accompanying drawings, preferred embodiments of the learning support program, learning support device, and learning support method according to the present invention will be described in detail.

[0022] (System Configuration of the Communication Education System) First, the system configuration of the communication education system including the learning support device according to the embodiment of the present invention will be described. FIG. 1 is an explanatory diagram showing the system configuration of the communication education system.

[0023] In FIG. 1, a communication education system 100 according to an embodiment of the present invention is composed of a server 110 and a plurality of operation terminals (learning support devices) 120. The server 110 is managed by an operator (administrator) of the communication education system 100 or the like. The server 110 can be realized by a general-purpose computer device such as a personal computer (see FIG. 2A). The server 110 stores a teaching material database and a subscriber database (both not shown).

[0024] The operation terminal 120 can be realized by a portable computer device (portable terminal device) such as a tablet computer or a tablet terminal (see FIG. 2B). The operation terminal 120 is distributed in advance to users of the communication education system 100 when the communication education system 100 is operated.

[0025] The operation terminal 120 is provided with a touch screen composed of a display and a touch panel (see FIG. 2B). The operation terminal 120 can be operated using a predetermined operation member 130. Specifically, for example, when using a capacitive or pressure-sensitive touch panel, the operation member 130 can be realized by a capacitive touch pen (stylus pen) or the user's finger.

[0026] Also, specifically, for example, when using an electromagnetic induction touch panel, instead of a stylus pen or the like, a dedicated electronic pen called a digitizer stylus (hereinafter, appropriately referred to as a "digitizer") can be used to realize a predetermined operation member 130. The operation member 130 realized by the digitizer includes a writing part that outputs a writing signal and an erasing part that outputs an erasing signal.

[0027] The operation terminal 120 discriminates the type of the operation member 130 and the designated object according to the switching operation, and performs an operation according to the discriminated type. Specifically, for example, the operation terminal 120 discriminates whether the operation member 130 is a stylus pen, a finger, a digitizer, etc., and discriminates whether the object is a handwriting operation, a mouse (selection operation), an eraser (erasure operation), or unknown.

[0028] By operating the operation terminal 120 using a dedicated pen such as a digitizer or a stylus pen as the operation member 130, even when the user touches the touch screen with a hand or the like when inputting an answer in handwritten characters, the input handwritten characters can be recognized, and the input of handwritten characters can be performed smoothly and naturally.

[0029] The server 110 and each operation terminal 120 are communicably connected to each other via a network 140 such as the Internet. Each operation terminal 120 can perform wireless communication by a wireless LAN such as Wi-Fi (registered trademark) with a radio repeater provided in the network 140, thereby realizing good portability of the operation terminal 120.

[0030] (Hardware Configuration of Server 110) FIG. 2A is an explanatory diagram showing an example of the hardware configuration of a computer device that realizes the server 110. In FIG. 2A, the computer device that realizes the server 110 includes a CPU 211, a memory 212, and a network I / F (Interface) 213. Each part 211 to 213 included in the computer device is connected by a bus 210. The CPU 211 functions as a control unit that controls the entire computer device that realizes the server 110.

[0031] The memory 212 stores programs such as a boot program and data that constitutes various databases. Also, the memory 212 stores various databases such as, for example, a teaching material database and a subscriber database which will be described later. The various databases are stored in a non-volatile storage medium that does not erase the stored content even when the power is OFF among the various storage media that implement the memory 212.

[0032] Also, the memory 212 is used as a work area for the CPU 211. The memory 212 can be realized by, for example, a ROM (Read-Only Memory), a RAM (Random Access Memory), an HDD (Hard Disc Drive), and an HD (Hard Disc).

[0033] The network I / F 213 is connected to a network 140 such as the Internet and is connected to an external device such as the operation terminal 120 via the network 140. The network I / F 213 controls the interface between the network 140 and the inside of the computer device that realizes the server 110, and controls the input / output of data between the computer device that realizes the server 110 and the external device.

[0034] (Hardware Configuration of the Operation Terminal 120) FIG. 2B is an explanatory diagram showing an example of the hardware configuration of the computer device that realizes the operation terminal 120. In FIG. 2B, the computer device that realizes the operation terminal 120 includes a CPU 221, a memory 222, a network I / F 223, a timer 224, a touch screen 225, a microphone 226, a speaker 227, a camera 228, and a power switch 229. Also, each of the units 221 to 229 included in the computer device that realizes the operation terminal 120 in the communication education system 100 according to the embodiment of the present invention is connected by a bus 220.

[0035] The CPU 221 functions as a control unit that controls the entire operation terminal 120. The memory 222 stores programs such as a boot program and various data such as a startup password. Also, the memory 222 is used as a work area for the CPU 221. The memory 222 can be realized, for example, by a flash memory or the like.

[0036] The network I / F 223 is connected to a network 140 such as the Internet via a radio wave relay device such as a Wi-Fi router (not shown). The network I / F 223 controls the input and output of data between the external device such as the server 110 via the network 140.

[0037] The timer 224 measures the elapsed time from the start of measurement (counts up). Specifically, the timer 224 measures, for example, the elapsed time since the display of a character (model) that requests a handwritten input was started. Alternatively, specifically, the timer 224 may measure, for example, the elapsed time from the start of writing a handwritten character or a stroke of the handwritten character until the writing is completed.

[0038] The touch screen 225 includes a display 225a and a touch panel 225b. The display 225a displays, for example, an image related to a character (model) that requests a handwritten input, a frame line indicating an area for writing a handwritten character that requests an input (hereinafter, appropriately referred to as a "response input frame"), and the like.

[0039] The display 225a can be realized, for example, mainly by a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) display. The display 225a may be a color display or a monochrome (black and white) display.

[0040] The touch panel 225b is laminated on the display surface side of the display 225a and outputs a signal corresponding to the operation position to the CPU 221. The touch panel 225b determines, for example, the presence or absence of an input operation on the touch panel 225b, the position where the input operation is received on the touch panel 225b, the medium on which the input operation is performed, etc., and outputs a signal corresponding to the received input operation to the CPU 221.

[0041] The touch panel 225b outputs signals of different types, for example, according to the medium on which the input operation is performed. The CPU 221 can determine whether the medium on which the input operation is performed is a human hand or the operation member 130 based on the difference between the amount of static electricity when a human hand touches the touch panel 225b and the amount of static electricity when the operation member 130 touches the touch panel 225b. The touch panel 225b is not limited to the capacitive type, and various known types such as electromagnetic induction type, resistive film type, acoustic pulse recognition type, surface acoustic wave type, infrared light shielding type, and image recognition type can be used.

[0042] The touch screen 225 may be realized by a multi-touch screen that can receive a multi-touch operation in which a plurality of points on the touch panel 225b are simultaneously touched among the touch screens that receive operations by having the user touch the touch panel 225b.

[0043] The multi-touch screen can receive, for example, a pinch-out operation in which the distance between two fingertips such as the thumb and index finger is widened or a pinch-in operation in which the distance between the two fingertips is narrowed while the two fingertips are in contact with the touch panel 225b. By realizing the touch screen 225 with a multi-touch screen, complex input operations can be received without using a keyboard.

[0044] In addition, while the touch screen 225 is displaying a character (problem) that requests a handwritten input on the display 225a, if the contact of the operation member 130 with the touch panel 225b is detected, even if the detected contact position is not within the answer input frame, as long as it is within a predetermined area on the touch panel 225b, the display 225a may be caused to display handwritten information such as handwritten characters visualizing the position where the operation member 130 has contacted.

[0045] Thereby, the touch screen 225 can accept an input (writing) of arbitrary handwritten characters such as a memo written by the user on the touch panel 225b, and display the received handwritten characters and the like on the display 225a as handwritten information. Further, the operation terminal 120 may store arbitrary handwritten characters such as a memo written by the user in the memory 222.

[0046] Each time the operation terminal 120 accepts an input of information such as handwritten characters, it generates image data of the input handwritten characters, and generates handwritten information for transmission in which identification information of the learning content (characters) when the handwritten characters are input, identification information of the operation terminal 120, and the like are associated, and transmits it to the server 110 each time the handwritten information for transmission is generated. When the server 110 receives the handwritten information for transmission, it associates the learning content identification information and the operation terminal 120 identification information included in the transmitted information with the handwritten information included in the information and stores it in the memory 222.

[0047] The handwritten information for transmission may be stored in the memory 222 for a certain period, such as until a certain data volume is reached or until the learning of one learning content is completed, and transmitted to the server 110 at the timing when a certain data volume is reached or at the timing when the learning of one character is completed.

[0048] The microphone 226 converts analog voice such as the voice of a speaker input as analog data into digital data, and generates voice data in digital format. The microphone 226 is used, for example, when learning pronunciation in an English lecture. The speaker 227 converts digital voice data into digital / analog data, and outputs voice by energizing a coil in a speaker cone based on the analog voice data. The speaker 227 outputs messages such as "Try writing a little harder" and "You played well", for example. Specifically, the speaker 227 may output voice such as a warning alarm, for example.

[0049] The camera 228 captures an imaging target by operating the touch panel 225b, and generates image data. The generated image data can be stored in the memory 222. The network I / F 223 is connected to a network 140 such as the Internet, and controls the interface in communication with the server 110 via the network 140.

[0050] The power switch 229 performs ON / OFF switching for power supply from a power source (not shown) to each part of the operation terminal 120. The power switch 229 performs ON / OFF switching for power supply at the most power source side (the most upstream side) in the power path from a power source (not shown) to each part of the operation terminal 120. The power switch 229 outputs an ON / OFF signal to the CPU 221 according to the received operation. The power switch 229 may perform ON / OFF switching for power supply by stopping or releasing the power supply by the power source at the most upstream side of the power path.

[0051] (An example of a teaching material database) The textbook database stores learning content related to the learning of handwritten characters. The learning content is composed of "problem" content and "answer" content. The "problem" content includes, for example, image data showing a model of the character to be learned (the handwritten character for which input is required). The model may be any of hiragana, katakana, Chinese characters, numbers (e.g., Arabic numerals), alphabets, or may include all of them. Also, the model may include multiple styles (scripts) for one character, such as regular script, semi-cursive script, and cursive script.

[0052] In addition, the "problem" content includes information on guiding objects, which is image data showing the writing order of the character to the user. The guiding object is an object that guides the writing position of the user along the writing order of the character. For example, it includes guiding information, such as a star mark (☆), that is displayed superimposed on the image data of the character. As the user writes the character using the operation member 130, the guiding information ☆ moves and is displayed one point at a time in sequence to guide the user to the next point (writing position). Corresponding to the number of strokes of the character, the guiding information ☆ is displayed by increasing the number in order from the starting writing position for each stroke.

[0053] By displaying one guiding information ☆ at the first point of the stroke (the starting writing position of the character), the user can start writing the character from the correct position. Each time the user touches (hits) the position of one guiding information ☆, a new guiding information ☆ is displayed at the next position corresponding to the writing order of the character. Each time a guiding information ☆ is displayed, a predetermined notification sound may be emitted for notification.

[0054] By displaying multiple guiding information ☆ according to the writing order corresponding to the character, the user is guided to write the character in the correct writing order. Also, the guiding information ☆ may be configured to blink and display one starting point in the initial state and switch the traced position part to the lit state, thereby making it easy for the user to know the position to continue writing the character next.

[0055] In addition, the guiding object includes direction information, such as an arrow (→), together with guiding information ☆. The direction information → is image data indicating the direction of the writing order of characters. The → which is direction information is displayed on the side of the character, and by tracing along the position of the direction information → by the user, the character is guided in the direction of the correct writing order. For example, when there is a branch in the character, by displaying the direction information →, it becomes possible to write forward without making a mistake in the connecting direction.

[0056] Also, the "problem" content may include, for example, image data of an answer input frame. The answer input frame may include a solid line indicating the outer frame of the answer input frame, a solid line thinner (or lighter in color) than the solid line, or a cross grid line realized by a dotted line or the like. The solid line indicating the outer frame of the answer input frame may form a square, for example, and the grid line may form a cross shape that divides the square into four equal parts.

[0057] Furthermore, the "problem" content may include messages such as "Try writing this character." and "Try tracing the picture book." The message may be text, may be voice, or may be both text and voice.

[0058] The "problem" content is in a format that can be played using a problem playback application installed on the operation terminal 120, and is composed of various data such as characters (text), still images, and voices. The "problem" content may include video (moving images such as animation images and voices) data. The "problem" content may have different difficulties according to the proficiency of the user.

[0059] In learning content, unique identification information is assigned to each character to be learned. The unique identification information is information for identifying the character to be learned, and as will be described later, the progress of the user's learning can be grasped using the unique identification information. The unique identification information may be assigned only to the "question" content, only to the "answer" content, or to the learning content including the "question" content and the "answer" content.

[0060] The "answer" content includes information regarding the determination of the tracing order as to whether the user traces the character in the correct stroke order. For example, when the user writes a character, the portion traced (hit) by the user using the operation member 130 along the guidance of the guidance information ☆ and the direction information → sequentially displayed as the guidance object displayed in the "question" content is held as the handwriting object.

[0061] Characters are to be traced continuously in one stroke for each stroke (one brush stroke). Therefore, the "answer" content determines the pen pressure when the user makes one stroke for each stroke (one brush stroke). When hitting the guidance information ☆, the pen pressure at the hit point is determined and a pen pressure object corresponding to the pen pressure, for example, pen pressure object A or pen pressure object B, is displayed.

[0062] For example, when tracing at a predetermined pen pressure or higher where the pen pressure at the point of the guidance information ☆ exceeds the lower limit of the pen pressure determination threshold, the guidance information ☆ at the traced position is left in the displayed state as the pen pressure object A. On the other hand, when there is a portion (point) where the pen pressure at the time of tracing is below the lower limit of the pen pressure determination threshold, this portion with a weak pen pressure is displayed differently from the guidance information ☆ as the handwriting object B, for example, with a gray round mark (〇). Also, the pen pressure object A may be displayed as a predetermined mark different from the guidance information ☆ and the pen pressure object 〇.

[0063] Furthermore, when the tracing position deviates from the guiding information ☆ above the characters or when the operation member 130 is released halfway during the "Answer" content, the number-of-strokes part of the written characters is highlighted, for example, displayed with a red dotted line, and each stroke is guided to be written in one stroke.

[0064] In addition, the "Answer" content includes information regarding a preset threshold value for pen pressure determination. The threshold value for pen pressure determination is a value that serves as a criterion for determining whether the pen pressure of the characters handwritten by the user is an appropriate pen pressure. For example, it can be set to any value within the range from "0 (zero)", where there is no pressure applied to the touch panel 225b from the predetermined operation member 130, to "100", which is the maximum value at which the pressure can be determined to be an appropriate pen pressure. The threshold value for pen pressure determination is a relative numerical value with respect to the actually measured value of the pressure applied to the touch panel 225b from the predetermined operation member 130, and the specific pressure (numerical value) corresponding to "0" or "100" can be arbitrarily set.

[0065] There may be only one threshold value for pen pressure determination, or it may be set in multiple stages. When setting the threshold value for pen pressure determination in multiple stages, for example, the lower limit of the threshold value for pen pressure determination can be set to "50", the intermediate value of the threshold value for pen pressure determination can be set to "75", and the upper limit of the threshold value for pen pressure determination can be set to "100".

[0066] The threshold value for pen pressure determination may be set in units of characters or in units of strokes in the characters. Also, the threshold value for pen pressure determination may be set, for example, for each pen pressure in the characters or for each writing part in the strokes of the handwritten characters.

[0067] The strokes can be broadly classified into eight types: the horizontal stroke called "le" (roku), the vertical stroke called "nu" (do), the leftward stroke called "ryaku" (ryaku), the dot called "soku" (soku), the rightward stroke called "taku" (taku), the "saku" (saku) which is the bottommost stroke of the "sanzui" or "nisui" (the upward slanting hook), the turning stroke called "tenseki" (tenseki), and the hook called "teki" (teki). When setting the threshold for pen pressure determination for each writing part in the strokes of handwritten characters, based on these eight classifications, the threshold for pen pressure determination for each writing part can be set.

[0068] Specifically, for example, the pen pressure at the starting point of each stroke such as a horizontal or vertical stroke, the pen pressure in the middle part from the starting point to a leftward or rightward stroke, and the pen pressure of a leftward or rightward stroke, etc. The stroke can be divided into multiple parts, and the threshold for pen pressure determination for each part can be set.

[0069] Also, the "answer" content includes the image data (font style) of the characters that serve as the answer for determining the pattern of handwritten characters input in response to the requirements of the "question" content. The characters serving as the answer correspond to the "question" content and can be hiragana, katakana, Chinese characters, numbers (for example, Arabic numerals), alphabets, etc. Also, the characters serving as the answer can be any image data (font style) such as regular script, semi-cursive script, or cursive script according to the "question" content. In the "answer" content, different thresholds for pen pressure determination may be set according to the font styles such as regular script, semi-cursive script, or cursive script.

[0070] The "answer" content may also include information regarding the writing order of the characters serving as the answer and information related to the determination of "tome", "hane", "harai", "musubi", etc. Information related to the determination of "tome", "hane", "harai", "musubi", etc. can be realized, for example, by information indicating the starting position of "tome", "hane", "harai", "musubi", the ending position of "tome", "hane", "harai", the tracing direction of "musubi", and the pen pressure (pressure) at each position.

[0071] In addition, the "Answer" content determines whether the user has correctly written one character for each stroke. For example, if all the strokes of a character are traced along the guiding object with a predetermined pen pressure or higher, it will output an audio message "You wrote it well" and reproduce the written character with an animation image or the like. Also, if there is a part where the pen pressure during tracing is below the lower limit of the pen pressure determination threshold, this weak pen pressure part will be indicated by a circle and an audio message "Next, try writing more strongly" will be output. On the other hand, for example, when tracing outside the position of the guiding information ☆ of the guiding object, an audio message "Your tracing is incorrect" will be output and the guiding object corresponding to the relevant stroke will be displayed again.

[0072] The "Answer" content may include text data in addition to or instead of the image data (font style) of the characters (hiragana, katakana, kanji, numbers, alphabets, etc.) that are the answers.

[0073] Each "Answer" content is stored in the teaching material database in association with each "Question" content. In the teaching material database, each "Answer" content is stored in association with one "Question" content. In the teaching material database, at least one "Answer" content is stored in association with each "Question" content.

[0074] (An example of the participant database) The participant database stores information related to the learning progress status in association with each user's identification information. The information related to the learning progress status represents the learning progress status. The information related to the learning progress status can be realized, for example, by information related to the playback history of learning content. Also, the information related to the learning progress status may be realized, for example, by information related to the "Question" content that has been displayed on the display 225a of the operation terminal 120 or the "Question" content for which answer input has been received.

[0075] Information on the progress of learning may include, for example, identification information of learning content determined such that, for instance, the ratio exceeding a threshold for playback of learning content / display of learning content / reception of answer input / rejudgment exceeds a predetermined ratio, and information regarding the date and time (hereinafter, appropriately referred to as "learning date and time") when the playback / display / reception of answer input / above judgment of the learning content was performed.

[0076] In this way, by managing the learning progress for each user, it is possible to have each user learn appropriate characters according to the learning progress of that user. Also, the subscriber database may store information about the user, such as the name (member name), grade, date of birth, etc. of the user who is a subscriber to the correspondence education system 100. Further, the subscriber database may include information about the user's guardian, such as the user's parent.

[0077] (Functional Configuration of the Operation Terminal 120) Next, the functional configuration of the operation terminal 120 will be described. FIG. 3 is a block diagram showing the functional configuration of the operation terminal 120. In FIG. 3, the functions of the operation terminal 120 can be realized by a processing unit 301. The processing unit 301 includes a storage unit 302, a control unit (recognition unit, determination unit) 303, an output unit 304, and an input unit 305.

[0078] The storage unit 302 stores the above-mentioned teaching material database. The storage unit 302 may store, for example, only the learning content downloaded by the user from the server 110 among the teaching material databases stored in the server 110. Also, the storage unit 302 may store, for example, the learning content downloaded during a period retroactively from the current time by a predetermined time among the learning content downloaded by the user from the server 110.

[0079] In addition, the storage unit 302 stores information related to handwritten characters. The information related to the handwritten characters input by the user includes image data of the handwritten characters and information related to the writing order and pen pressure of the characters. The information related to the writing order of the characters can be realized by guidance information ☆ for guiding the writing order of the corresponding characters by display, guidance objects such as direction information →, and information on whether the user traces the characters along the guidance objects at a pen pressure equal to or higher than a predetermined value. The information related to the pen pressure of the characters can be realized by, for example, whether the pen pressure of the characters received by the handwritten input is below the lower limit of the threshold for pen pressure determination and the ratio is below a predetermined ratio, and the value of the ratio of the pen pressure below the lower limit of the threshold for pen pressure determination.

[0080] In addition, the information related to the handwritten characters input by the user may include at least one of the date and time when the characters were handwritten and the number of times the characters were handwritten. The information related to the handwritten characters input by the user may further store data related to the writing order of the characters handwritten by the user. The storage unit 302 stores information related to the handwritten characters, for example, in association with the unique identification information of the learning content in which the handwritten characters are input.

[0081] In addition, the storage unit 302 stores, for example, the identification information of the operation terminal 120, information related to the user, and passwords used for starting and operating the operation terminal 120. In this embodiment, the function of the storage unit 302 can be realized by the memory 222.

[0082] The control unit 303 controls the output unit 304 to present a problem to the user. Specifically, the output unit 304 can be realized by the display 225a. Specifically, the control unit 303 presents a problem by, for example, displaying on the display 225a characters (models) that require handwritten input, answer input frames, and the like.

[0083] More specifically, the control unit 303 poses a problem, for example, by displaying a character (model) that requests handwritten input within the answer input frame in a size suitable for the answer input frame. At this time, the control unit 303 displays a guiding object (guiding information ☆ and direction information →) indicating the writing order of the character. As a result, the user can learn the character by tracing the displayed guiding object as a model.

[0084] Alternatively, the control unit 303 may pose a problem, for example, by displaying a character (model) that requests handwritten input next to the answer input frame. As a result, the user can learn the character by writing the character while imitating the displayed character (model).

[0085] In addition to the character (model) that requests handwritten input and the answer input frame, the control unit 303 may, for example, display on the display 225a messages such as "Try tracing the characters on the screen." or "Try writing the characters on the screen." and illustrations that can arouse the interest of children and others in character learning.

[0086] More specifically, the output unit 304 may be realized by the speaker 227 in addition to the display 225a. In this case, specifically, the control unit 303, for example, displays on the display 225a a character (model) that requests handwritten input, an answer input frame, etc., and may also output messages such as "Try tracing the characters on the screen." or "Try writing the characters on the screen." from the speaker 227 by voice.

[0087] Further, the control unit 303 controls the input unit 305 to accept the input of the user's handwritten characters regarding the answer to the question presented via the output unit 304. Specifically, the input unit 305 can be realized by the touch panel 225b. The control unit 303 controls the input unit 305 to accept the input operation on the touch panel 225b by a user such as the user, and acquires a signal corresponding to the accepted input operation from the touch panel 225b. In this embodiment, the functions of the control unit 303 can be realized by the CPU 221 and the memory 222.

[0088] For example, when handwritten characters are input using a dedicated electronic pen such as a digitizer as the operation member 130, the control unit 303 may recognize the input handwritten characters or the strokes of the handwritten characters. Thereby, even when the user's hand is touching the display 225a, only the handwritten characters written can be recognized.

[0089] Further, the control unit 303 recognizes the input handwritten characters and holds the traced portion on the guiding object as a handwriting object. The control unit 303 determines whether the writing order of the held handwriting object is correct based on the information for determining the writing order for each character.

[0090] Specifically, for example, if it is a handwriting object when the user traces from top to bottom along the guiding information ☆ of the guiding object for the entire character, it is determined that the writing order is correct. For example, the control unit 303 determines based on the pen pressure information whether, for each stroke of the character, the tracing from the starting point to the ending point is made in one stroke with a predetermined pen pressure or more.

[0091] For example, when the user traces a position that deviates from the guidance information ☆ or traces in a direction different from the direction information → at the connection position, the control unit 303 determines that the writing order is incorrect. For example, the writing order is determined based on the tracing state (the deviation of the handwriting object from the guidance information ☆), in units of one point (guidance information ☆) sequentially displayed as a guidance object. The control unit 303 may determine the writing order and the pen pressure in units of strokes or characters.

[0092] For example, regarding the writing order of characters, the control unit 303 determines that the writing order is correct if the handwriting object is traced along the guidance object (guidance information ☆ and direction information →), and determines that the writing order is incorrect if the handwriting object is not along the guidance object, and outputs information regarding the determination result.

[0093] For example, when the determination result shows that the writing order is correct as per the model, the control unit 303 may display a message such as "You wrote it well" on the display 225a, and when the writing order is incorrect, display a message prompting correction such as "Your tracing is incorrect".

[0094] In addition, the control unit 303 recognizes the input handwritten characters and determines the pen pressure of the recognized handwritten characters. The control unit 303 determines whether the pen pressure of the recognized handwritten characters is equal to or greater than the threshold for pen pressure determination or is below the threshold for pen pressure determination, based on the threshold for pen pressure determination. For example, the control unit 303 determines the pen pressure in units of one guidance information ☆ for continuous handwriting objects. Also, when there are multiple levels of thresholds set for pen pressure determination, the control unit 303 determines whether the pen pressure of the recognized handwritten characters is equal to or greater than each threshold for pen pressure determination or is below the threshold for pen pressure determination.

[0095] Specifically, for example, when the lower limit of the threshold for pen pressure determination is set to "50" and the median value of the threshold for pen pressure determination is set to "75", the control unit 303 determines that the pen pressure of the character for which handwritten input has been received is "too weak" when the pen pressure is in the range of "0 to 49", which is lower than the lower limit of the threshold for pen pressure determination, i.e., "50".

[0096] Also, when the pen pressure of the character for which handwritten input has been received is equal to or greater than the lower limit of the threshold for pen pressure determination, i.e., "50", and lower than the median value of the threshold for pen pressure determination, i.e., "75", in the range of "50 to 74", the control unit 303 determines that "it is not too weak but could be a bit stronger". Also, in this case, when the pen pressure of the character for which handwritten input has been received is in the range of "75 to 100", which is equal to or greater than the median value of the threshold for pen pressure determination, i.e., "75", the control unit 303 determines that it is "good".

[0097] Based on the determination result of the pen pressure in the recognized handwritten character, the control unit 303 controls the output unit 304 to output information regarding the determination result.

[0098] Also, for example, the control unit 303 outputs information regarding the determination result by causing a line with a thickness varied according to the pen pressure of the recognized handwritten character or the stroke of the handwritten character to be displayed on the display 225a along the trajectory of the movement of the tip of the digitizer.

[0099] Specifically, the control unit 303 causes the recognized handwritten character or the stroke of the handwritten character to be displayed on the display 225a such that, for example, the line becomes thicker as the pen pressure increases and thinner as the pen pressure decreases. Thereby, the user can visually and easily recognize the pen pressure of the handwritten characters and strokes written by the user.

[0100] For example, if the traced pen pressure is equal to or greater than the threshold for pen pressure determination, the control unit 303 retains the guiding information ☆ as a handwriting object in the lit display state. On the other hand, if there is a portion where the traced pen pressure is below the threshold for pen pressure determination, the corresponding portion is displayed as a handwriting object 〇 in a display state different from the guiding information ☆. Further, the control unit 303 may change the size of the mark (☆, 〇) of the handwriting object according to the pen pressure and display it on the display 225a.

[0101] The control unit 303 may also recognize the input handwritten characters stroke by stroke, determine the pen pressure of the recognized stroke, and output information regarding the determination result. That is, before the input of one character is completed, each time the input of one stroke is received, the stroke is recognized, the pen pressure of the recognized stroke is determined, and a stroke with a thickness corresponding to the pen pressure may be displayed.

[0102] When determining the pen pressure, the control unit 303 may determine the pen pressure for each part in the stroke. Specifically, for example, based on the eight types of classifications of the horizontal stroke "roku", the vertical stroke "do", the leftward stroke "ryaku", the dot "soku", the rightward stroke "taku", the bottommost stroke of "sanzuiya" or "sui" (the upward slanting spring to the right) "saku", the bend "tenseki", and the spring "teki", the pen pressure at the part where the digitizer starts to contact the touch panel 225b (starting point), the pen pressure at the part immediately before the digitizer leaves the touch panel 225b (ending point), and the pen pressure between the starting point and the ending point may be determined respectively.

[0103] Further, the control unit 303 may determine whether the ratio of the pen pressure in the recognized handwritten character or the stroke of the handwritten character exceeding the threshold for rewrite determination set for the handwritten character or the stroke is equal to or less than a predetermined ratio. The threshold for rewrite determination can be, for example, the lower limit of the threshold for pen pressure determination.

[0104] The ratio (i.e., a predetermined ratio) at which the recognized handwritten character or the pen pressure in the stroke of the handwritten character exceeds the threshold for rewrite determination, which is set in advance for determining the adequacy of the pen pressure, can be set to an arbitrary value, such as "40%". When this predetermined ratio is set for, for example, one handwritten character, the control unit 303 determines, at the stage when the writing of one character is completed, whether the ratio at which the pen pressure when writing the one character exceeds the threshold for rewrite determination is greater than 40% or 40% or less.

[0105] Also, when the above-mentioned predetermined ratio is set for a stroke, for example, the control unit 303 determines, at the stage when the writing of one stroke is completed, whether the ratio at which the pen pressure when writing the one stroke exceeds the threshold for rewrite determination is greater than 40% or 40% or less.

[0106] Furthermore, when the ratio at which the recognized handwritten character or the pen pressure in the stroke of the handwritten character exceeds the threshold for rewrite determination is equal to or less than a predetermined ratio (for example, 40% etc.), the control unit 303 may erase the display of the immediately preceding handwritten character or stroke and request a rewrite of the immediately preceding handwritten character or stroke.

[0107] In this case, the control unit 303 may cause the display 225a to display a message prompting a rewrite, such as "Write more strongly" or "Write a little more strongly." Alternatively, in this case, the control unit 303 may cause the speaker 227 to output an audio message prompting a rewrite, such as "Write more strongly" or "Write a little more strongly." In particular, by prompting a rewrite by voice in combination with the display, it is possible to reliably convey to the user that the pen pressure was insufficient.

[0108] Messages prompting rewriting output via the display 225a or the speaker 227 may be, for example, "Write more strongly", "Write strongly again", "Write the same character again. This time, write more strongly than before." and the like.

[0109] Messages prompting rewriting output via the display 225a or the speaker 227 may be, depending on the user's age and the like, for example, "Try writing with more strength", "Write boldly", "Try writing while touching the tablet with your hand." On the other hand, when the user is a child such as a preschooler or a lower elementary school student, there are concerns that with a message like "Try writing with more strength", the pen pressure may not increase just by gripping the pen strongly, or with a message like "Write boldly", the user may not know how to write thickly, or with a message like "Try writing while touching the tablet with your hand", there are concerns that the pen pressure may be low even when touching the tablet with the hand. Therefore, the content may be varied according to the user's age.

[0110] Messages output via the display 225a or the speaker 227 may be of the content that points out the strokes that the user seems to be weak at, such as "The vertical stroke is weak", "Make the dot stronger!", "The strength of the character is low (high)".

[0111] Messages output via the display 225a or the speaker 227 may be of the content that notifies that the pen pressure is appropriate, such as "The strength is just right", "That posture!" Further, messages output via the display 225a or the speaker 227 may be of the content that notifies specific numerical values regarding the pen pressure, such as "Your strength is ○○%."

[0112] In addition, the message output via the display 225a or the speaker 227 may be content that points out that the pen pressure is too high, such as "Write with a little more force" or "Write more gently". Alternatively, when the specification is such that both input of handwritten characters by finger and input of handwritten characters by digitizer are accepted, it may be content that points out the difference in the tendency of pen pressure for each operation member 130, such as "The strength when using your finger is weak" or "The strength when using the digitizer is high".

[0113] While outputting a voice message prompting rewriting, the control unit 303 may continue to display the handwritten characters or strokes input immediately before, and after the output of the voice message prompting rewriting is completed, erase the display of the handwritten characters or strokes and accept the rewriting of the handwritten characters or strokes. In this case, even after the output of the voice message prompting rewriting, the display of the message by the characters prompting rewriting may be continued, and after the output of the voice message prompting rewriting is completed, the display of the handwritten characters or strokes may be erased and the rewriting of the handwritten characters or strokes may be accepted.

[0114] Furthermore, the control unit 303 may determine whether the input handwritten characters are similar enough to be recognized as the model characters. Specifically, the control unit 303 performs pattern recognition on the input handwritten characters, and based on the pattern-recognized solution (character) and the characters (model) stored in advance, can determine whether the characters based on the input handwritten characters are similar enough to be recognized as the model characters.

[0115] In addition, the control unit 303 can, for example, extract the determination target portions in the shape of the handwritten characters, and based on the degree of deviation between the determination target portions and the determination target portions in the exemplary shape, or the number of determination target portions determined to have a deviation of a predetermined number or more, determine whether the input handwritten characters are similar enough to be recognized as the model characters.

[0116] In addition, the control unit 303 can determine whether the input handwritten character is similar enough to the reference character to be recognized based on, for example, whether the character is easy to read and has a balanced appearance, such as whether the user can correctly write characters like "tome" (stop), "hane" (spring), "harai" (sweep), "musubi" (knot), or whether the parts that should be straight can be written straight. Also, the control unit 303 can determine whether the input handwritten character is similar enough to the reference character to be recognized based on, for example, whether the balance of the input handwritten character with respect to the size of the answer input frame is appropriate, or whether the balance of radicals, side components, or partial components is appropriate.

[0117] In addition to the shape of the input handwritten character, the control unit 303 determines whether the input handwritten character is in accordance with the guiding information ☆ and direction information → of the guiding object serving as the reference based on the writing order of the handwritten character. For example, the control unit 303 compares the exemplary shape and writing order of the character to be compared with the shape and writing order of the input handwritten character. Then, based on the deviation between the shape of the handwritten character and the exemplary shape (the position of the guiding information ☆) and the deviation between the writing order of the handwritten character and the writing order of the character to be compared, it determines whether the input handwritten character is written in the same way as the reference character.

[0118] By determining the writing order of the handwritten character, not only the shape but also the writing order of the handwritten character can be learned together. By determining the writing order of the handwritten character, even for handwritten characters that have deviated from the regular script due to some cursive writing, it is possible to determine whether the input handwritten character is similar enough to the reference character to be recognized based on the movement of the operation member 130. This can make the user aware of writing characters with an appropriate pen pressure without reducing the user's learning awareness.

[0119] Furthermore, the control unit 303 may control the output unit 304 to output the determination result of the handwritten character. For example, when the input handwritten character does not resemble the model character to a recognizable degree or the strokes are excessively serpentine, the control unit 303 controls the output unit 304 to output a message prompting the user to rewrite, such as "Write it one more time".

[0120] In addition, when the input handwritten character does not resemble the model character to a recognizable degree or the strokes are excessively serpentine, the control unit 303 may display an input field for the user to input the handwritten character again. Specifically, for example, the control unit 303 can control the output unit 304 to display an input field for re-handwriting input next to or in the vicinity of the initially displayed answer input frame.

[0121] The control unit 303 may display the model next to the answer input frame for re-handwriting input. That is, initially, the model may be displayed next to the answer input frame when inputting the handwritten character, and when requesting the user to rewrite the handwritten character or strokes, the model may be displayed in the answer input frame for re-handwriting input.

[0122] In this case, the control unit 303 may display the color of the model character in a lighter color than the color of the handwritten input character in the answer input frame for re-handwriting input. Alternatively, the control unit 303 may display the color of the character displayed when the answer is input (for example, "black") and the color of the model character (for example, "gray" or "blue") differently in the answer input frame for re-handwriting input.

[0123] (Example of a character stroke display screen) Next, an example of the display screen of the characters displayed by the operation terminal 120 on the display 225a will be described. FIGS. 4 and 5 are explanatory diagrams showing an example of the stroke display screen displayed by the operation terminal 120 on the display 225a.

[0124] As shown in FIG. 4, the operation terminal 120 causes the display 225a to display a model 401 of a character to be learned (a handwritten character for which input is requested) and an answer input frame 402 based on the "problem" content. In FIG. 4, as the "problem" content, the hiragana character "も" is shown in a state of being displayed on the display 225a as the model 401.

[0125] The character "も" of the model 401 has a total of 3 strokes. At the starting position of the first stroke shown in FIG. 4, guiding information 403 (☆) of the guiding object is displayed, and one or more direction information 404 (→) indicating the direction when tracing the first stroke in one stroke are displayed. For example, in the character "も", the second and third strokes intersect in the direction of tracing the first stroke. In this case, by displaying a plurality of direction information 404 (404a, 404b) on the side of the character, the direction of tracing with the first stroke is correctly guided.

[0126] The model 401 is displayed in a color lighter than the outer frame of the answer input frame 402, for example. Thereby, the user can visually recognize the handwritten characters he or she writes without being obstructed by the model 401 and perform learning of writing the characters.

[0127] In the example shown in FIG. 4, the user is made to write a handwritten character (input) by using a dedicated electronic pen such as a digitizer as the operation member 130 to start tracing the model 401 of the character "も" from the position of the guiding information 403 (☆).

[0128] Next, in FIG. 5, the state of writing the second stroke of the hiragana character "よ" as the model 401, which is presented as the "problem" content, is shown. In the state shown in FIG. 5(a), the tracing of the first stroke of the "problem" content "よ" has been completed and is displayed and held as the first-stroke handwriting object 511.

[0129] In Fig. 5(a), it shows the display state guided by the guiding information 403n(☆) up to the mid-position of the second stroke of the hiragana character "yo". The guiding information 403n(☆) indicates the latest tracing position of the user. The user can write the second stroke by tracing the characters along the sequentially displayed guiding information 403(☆) and the direction information 404a(→). By tracing along the guiding information 403(☆) without deviation, the display states of the multiple guiding information 403(☆) at the positions traced by the previous strokes are displayed and held as the stroke object 512 of the second stroke.

[0130] Specifically, when the user traces and writes while following the guiding information 403n part of one point at the most recent (tip) position, the operation terminal 120 repeatedly newly displays the guiding information 403n of one point at the next tracing position until reaching the end position of the second stroke. At this time, if the writing order and pen pressure are normal each time the point is advanced, an effect sound (SE) indicating normality may be output.

[0131] Also, a plurality of direction information 404a~404d are displayed as guiding objects, and the user can write without misinterpreting the direction traced by the second stroke. The hiragana character "yo" has a knot. By displaying a plurality of correct direction information 404a~404d in the second stroke, the user can continue tracing and writing in the correct direction along the display of the new guiding information 403n without tracing the wrong direction at the knot part.

[0132] After that, as shown in Fig. 5(b), it becomes the state where the second stroke of the hiragana character "yo" has been written. As shown in Fig. 5(b), the state where the user traced and wrote along the guiding information 403 is held as the stroke objects 511, 512. The stroke object 512a is the start position of the second stroke, and the stroke object 512n is the end position of the second stroke.

[0133] In addition, when tracing and writing, the operation terminal 120 causes a line (stroke) with different thicknesses according to the handwritten characters and the pen pressure of the strokes of the handwritten characters to be displayed on the display 225a.

[0134] When the operation terminal 120 uses a specific operation member 130 such as a digitizer and an eraser as the operation member 130, it may be configured to display handwritten characters and lines with different thicknesses according to the pen pressure of the strokes of the handwritten characters. Thereby, when taking notes of handwritten characters, the user can surely learn the operation of controlling the finger pressure and adjusting the pen pressure.

[0135] In the example shown in FIG. 5(b), since the pen pressures of the three trace objects 512a near the start of the second stroke and the two trace objects 512b after connection are lower than the pen pressure threshold (for example, the lower limit “50” of the threshold for pen pressure determination), they are indicated by a shape (〇) indicating a low pen pressure. Thereby, it is possible to notify the user that the pen pressure of a part of the second stroke of the hiragana “yo” is weak. In this case, the operation terminal 120 may display and notify a message such as “Try writing a little harder” to the user and prompt the user to rewrite.

[0136] Further, the operation terminal 120 may determine the pen pressure of the written characters in multiple stages and display the size of the shape (〇) of the trace object 512 changed according to the pen pressure of each stage. For example, for a pen pressure higher than the lower limit “50” of the threshold for pen pressure determination, if the pen pressure is higher than the threshold “75”, the size of the trace object 512 (☆) may be increased, and if the pen pressure is lower than the threshold “75”, the size of the trace object 512 (☆) may be decreased. Also, for example, for a pen pressure lower than the lower limit “50” of the threshold for pen pressure determination, if the pen pressure is higher than the threshold “25”, the size of the trace object 512 (〇) may be increased, and if the pen pressure is lower than the threshold “25”, the size of the trace object 512 (〇) may be decreased.

[0137] The operation terminal 120 may, for example, after the output of the message voice prompting rewriting is completed, erase the display of the second-stroke trace object 512 written immediately before and accept the rewriting of the second stroke.

[0138] When outputting a message voice prompting rewriting in units of one handwritten character, that is, when outputting a message voice prompting rewriting when the input of one handwritten character is completed, the rewriting of the character after the output of the message prompting rewriting may be optional. Also, when outputting a message voice prompting rewriting in units of one handwritten character, the display color of the stroke prompting rewriting may be made different from the display color of the strokes that do not require rewriting. This can reliably notify the strokes prompting rewriting.

[0139] (Application Example to a Textbook Application) Next, an application example to a textbook application for conducting character education on the writing order of the above-described characters will be described. FIGS. 6 to 8 are diagrams showing screen display examples of a textbook application for conducting character education on the writing order of characters. For example, the server 110 displays and outputs various screens for conducting character education on the writing order of characters to the user's operation terminal 120 by program-executing the textbook application, and determines processes such as the writing order of characters based on the user's character input.

[0140] As shown in FIG. 6, the textbook application displays a character learning screen 600 for the writing order of the character "yo" on the display 225a of the operation terminal 120. At the upper part of the character learning screen 600, selection buttons 601 for "next" and "back" to select the character to be learned, a "complete" button 602 when the learning of the displayed character is completed, and a "stop" button 603 to stop the character learning are displayed.

[0141] Also, on the character learning screen 600, as "problem" content for learning the writing order, a model 401 of the character "yo" is displayed in the answer input frame 402. Also, on the character learning screen 600, as learning content 605 of the "problem" content, it is displayed as 'Let's try writing "yo". You'll want to write strongly.', guiding the way to write the character. Also, on the character learning screen 600, as "problem" content, characters and illustrations of an example 606 showing "clothes" including the model 401 of the character "yo" are displayed.

[0142] The character learning screen 600 shown in FIG. 6 is, for example, a state where the user has finished writing the first stroke of the character "よ" in the correct writing order and pen pressure, and the operation terminal 120 displays the stroke object 511 of the first stroke of the character "よ" with ☆. In this state, the operation terminal 120 guides the correct writing order of the second stroke of the character "よ" that the user will write next, for example, with an emphasized display 610 of a red dotted line.

[0143] The emphasized display 610 sequentially displays and outputs with SE an animated image of red dots from the start point to the end point of the correct writing order of the character "よ".

[0144] Here, for example, if a point with low pen pressure occurs, such as when the user releases the operation member 130 during the one-stroke writing of the second stroke of the character "よ", a voice that advises "Continue until the end like this" may be output to prompt the user to rewrite.

[0145] The emphasized display 610 such as a red dotted line may be displayed as an animated image and output with SE when the operation terminal 120 determines that the writing order of the character is incorrect and when it determines that a part of the pen pressure is low. With the emphasized display 610, the correct writing order can be guided to the user. At this time, the operation terminal 120 notifies the user on the character learning screen 600 with a message or voice output to rewrite, such as "Write it one more time".

[0146] The example shown in FIG. 7 is the display state of the character learning screen 600 immediately after the user has finished writing the character "よ". When the operation terminal 120 has finished writing the character "よ" in the answer input frame 402, this character "よ" is again displayed, for example, in black characters, by an animated image 701 of the correct writing order. Also, the reading of the character "よ" is output as voice to notify the user. The voice may be pronounced, for example, as "ようふくの「よ」" corresponding to the usage example 606.

[0147] After the display in Fig. 7, the operation terminal 120 displays a production screen related to the determination of the writing order of the characters shown in Fig. 8. When the user finishes writing the character "よ", the operation terminal 120 displays the display screen of the character "よ" shown in Fig. 8. When the operation terminal 120 determines that the character "よ" is traced in the correct writing order at all points with the correct pen pressure (the pen pressure is higher than the threshold value), as an effect, after voice-outputting "Great! You wrote 'よ' very well!", it reproduces the correct writing through SE and the animation image 801. For example, the animation image 801 is displayed with a ring (〇) indicating that the learned character "よ" on the answer input frame 402 is written correctly. In addition, a plurality of decorative images (☆) 802 such as animations may be displayed on the outer edge part of the character "よ".

[0148] On the other hand, when the operation terminal 120 determines that the writing order of the character "よ" is incorrect, as an effect reproduction, for example, it displays a message to rewrite such as "Write it one more time". Also, when it determines that there are some points where the pen pressure is weak (the pen pressure is lower than the threshold value), for example, it displays a message indicating that the pen pressure is weak such as "You wrote 'よ'. Next, try writing more strongly". At this time, the above-described highlighting display 610 such as a red dotted line may be displayed as an animation.

[0149] (An example of the processing procedure for character learning) Next, with reference to Figs. 9 and 10, an example of the processing procedure for character learning will be described. Fig. 9 is a flowchart showing an example of the processing procedure for character learning. The processing in Fig. 9 will be described as being performed by the control unit 330 (CPU 221) of the operation terminal 120. However, it is not limited to this. Among the processing shown in Fig. 9, the processing related to the determination of the writing order and the like may be executed by the CPU 211 of the server 110, and the operation terminal 120 may transmit the information necessary for the determination to the server 110 and output the determination result of the server 110 for display and the like in a system configuration.

[0150] In the flowchart of FIG. 9, first, based on the problem content, a model 401 of a handwritten character (problem) that requires note-taking and an answer input frame 402 are displayed on the display 225a (step S901). Next, in the answer input frame 402 displayed in step S901, guiding information (for example, ☆ in FIG. 4) is displayed at the first point of the stroke of the character (step S902).

[0151] Next, an input of a stroke (note-taking of a stroke) by a predetermined operation member 130 such as a digitizer is received, and it is determined whether or not the input of the stroke hits the guiding information (step S903). In step S903, for example, it is determined whether or not the displayed guiding information portion is traced.

[0152] If the determination result in step S903 is that the input of the stroke hits the guiding information (step S903: Yes), the pen pressure of the stroke at the hit point is determined (step S904). On the other hand, if the determination result in step S903 is that the input of the stroke does not hit the guiding information (step S903: No), the process returns to step S903.

[0153] After the process of step S904, the display shape at the current point is determined (step S905). For example, if the pen pressure is higher than the threshold value, the guiding information (☆) is kept displayed, and if the pen pressure is lower than the threshold value, it is determined to display in a shape (〇) indicating that the pen pressure is low, and the stroke is displayed in the determined display shape (step S906).

[0154] Next, it is determined whether or not it is the last check point of the stroke (step S907). For example, when the character has a plurality of strokes, it is determined whether or not the stroke has been made up to the last point of one stroke. If it is the last check point of the stroke (step S907: Yes), the process proceeds to step S908. On the other hand, if it is not the last check point of the stroke (step S907: No), the guiding information is moved and displayed to the next point (step S909), and the process returns to step S903.

[0155] Next, it is determined whether all the strokes have been input (step S908). For example, when a character has multiple strokes, it is determined whether the last point of the last stroke has been drawn. If all the strokes have not been input (step S908: No), the process returns to the process of step S902. On the other hand, if all the strokes have been input (step S908: Yes), an effect matching the display shape of all the points is played (step S910), and the above series of processes ends.

[0156] In step S910, for example, if the display shape of all the points is ☆, an effect is played in which the entire character is traced in the stroke order and the normal pen pressure is equal to or higher than the threshold value (see, for example, FIG. 8). On the other hand, if the display shape of some of the points is 〇, an effect is played in which the entire character is traced in the stroke order, but some of the pen pressure is low. In this case, as the effect playback, for example, a message prompting re-writing is output via the display 225a or the speaker 227.

[0157] FIG. 10 is a flowchart showing another example of the processing procedure for character learning. The processing in FIG. 10 adds the processing when the user separates a predetermined operation member 130 such as a digitizer from the display 225a during the stroke, in addition to the processing described in FIG. 9. That is, the determination process for one-stroke writing for each stroke (one stroke) is added.

[0158] In the flowchart of FIG. 10, first, based on the problem content, a model 401 of a handwritten character (problem) requiring writing and an answer input frame 402 are displayed on the display 225a (step S1001). Next, guidance information (for example, ☆ in FIG. 4) is displayed at the first point of the character stroke in the answer input frame 402 displayed in step S1001 (step S1002).

[0159] Next, it receives the input of a stroke (writing of a stroke) by a predetermined operation member 130 such as a digitizer, and determines whether the input of the stroke continues (step S1003). For example, it determines whether the displayed guiding information part has a normal pen pressure higher than a threshold value.

[0160] If, as a result of the determination in step S1003, the input of the stroke continues (step S1003: Yes), the process proceeds to the process of step S1004. On the other hand, if the input of the stroke does not continue (step S1003: No), the process proceeds to the process of step S1005.

[0161] In step S1004, it determines whether the input of the stroke hits the guiding information (step S1004). For example, it determines whether the displayed guiding information part has been traced. If, as a result of the determination in step S1004, the input of the stroke hits the guiding information (step S1004: Yes), the process proceeds to the process of step S1007. If the input of the stroke does not hit the guiding information (step S1004: No), the process returns to the process of step S1003.

[0162] In step S1005, since the input of the stroke does not continue, it outputs a message prompting the rewriting of the character (step S1005), erases the stroke input immediately before (step S1006), and returns to the process of step S1002.

[0163] In step S1007, it determines the pen pressure of the stroke at the hit point (step S1007). Next, it determines the display shape at the current point (step S1008). For example, if the pen pressure is higher than the threshold value, it determines to keep the display as the guiding information (☆), and if the pen pressure is lower than the threshold value, it determines to display it in a shape (〇) indicating that the pen pressure is low, and displays the stroke in the determined display shape (step S1009).

[0164] Next, it is determined whether it is the last checkpoint of the stroke (step S1010). For example, when a character has a plurality of strokes, it is determined whether the stroke has reached the last point of one stroke. If it is the last checkpoint of the stroke (step S1010: Yes), the process proceeds to the process of step S1012. On the other hand, if it is not the last checkpoint of the stroke (step S1010: No), the guidance information is moved to the next point and displayed (step S1011), and the process returns to the process of step S1003.

[0165] Next, it is determined whether the input of all strokes has been received (step S1012). For example, when a character has a plurality of strokes, it is determined whether the stroke has reached the last point of the last stroke. If the input of all strokes has not been received (step S1012: No), the process returns to the process of step S1002. On the other hand, if the input of all strokes has been received (step S1012: Yes), an effect matching the display shape of all points is reproduced (step S1013), and the above series of processes is terminated.

[0166] In step S1013, for example, if the display shape of all points is ☆, an effect indicating that the entire character is traced in accordance with the writing order and the pen pressure is normal at or above the threshold value is reproduced (see, for example, FIG. 8). On the other hand, if the display shape of some points is 〇, an effect indicating that the entire character is traced in accordance with the writing order but the pen pressure of some parts is low is reproduced. In this case, as the effect reproduction, for example, a message prompting rewriting is output via the display 225a or the speaker 227.

[0167] As described above, the learning support program, learning support device, and learning support method according to the embodiment of the present invention request the user to take notes, receive the input of the user's handwritten characters, recognize the input handwritten characters or the strokes of the handwritten characters, determine the writing order in the recognized handwritten characters or the strokes of the handwritten characters, and output information regarding the determination result.

[0168] According to the present invention, it is possible to convey to the user the handwritten characters or the writing order in the strokes of the handwritten characters. Thereby, the user can be made aware of writing the characters in the appropriate writing order.

[0169] In addition, the learning support program, learning support device, and learning support method according to the embodiments of the present invention may include a process of displaying a guiding object that guides the writing order of handwritten characters when requesting the user to take notes. The guiding object may include, for example, guiding information that is displayed superimposed on the handwritten characters and guides the position of tracing the characters from the starting position of writing to the ending position of writing. Further, the guiding information may be, for example, information that is displayed superimposed on the handwritten characters and sequentially guides a plurality of points for tracing the characters from the starting position of writing to the ending position of writing, and may repeat displaying the guiding information of the next point according to the state of the user tracing the characters on the position of one piece of point guiding information. Also, the guiding object may be displayed on the side of the handwritten characters and may include direction information indicating the direction of the writing order of the characters.

[0170] According to the present invention, it is possible to visually and clearly convey to the user the handwritten characters or the writing order in the strokes of the handwritten characters. Thereby, it is possible to more surely make the user aware of writing the characters in the correct writing order.

[0171] In addition, the output process of the learning support program, learning support device, and learning support method according to the embodiments of the present invention may be to output information regarding the determination result by displaying the recognized handwritten characters or the strokes of the handwritten characters in the writing order of the handwritten characters or the strokes of the handwritten characters.

[0172] According to the present invention, after the user writes the handwritten characters or strokes the handwritten characters, by displaying the correct writing order, it is possible to more surely make the user aware of writing the characters in the correct writing order.

[0173] In addition, in the learning support program, learning support device, and learning support method according to the embodiment of the present invention, the output process may output information regarding the determination result by displaying information corresponding to the recognized handwritten character or the stroke of the handwritten character according to the pen pressure of the handwritten character or the stroke of the handwritten character.

[0174] According to the present invention, it is possible to visually and easily convey to the user the pen pressure in the handwritten character or the stroke of the handwritten character. As a result, it is possible to more surely make the user aware of writing characters with an appropriate pen pressure.

[0175] In addition, in the learning support program, learning support device, and learning support method according to the embodiment of the present invention, the output process may output including reproduction of an effect corresponding to the determination result of the writing order and pen pressure of the recognized handwritten character or the stroke of the handwritten character.

[0176] According to the present invention, by reproducing an effect corresponding to the determination result of the writing order and pen pressure in the handwritten character or the stroke of the handwritten character, it is possible to visually and easily convey it. As a result, it is possible to more surely make the user aware of writing characters with an appropriate writing order and pen pressure.

[0177] In addition, in the learning support program, learning support device, and learning support method according to the embodiment of the present invention, the determination process compares the pen pressure of the recognized handwritten character or the stroke of the handwritten character at a plurality of points with a predetermined pen pressure, and the output process may include performing a display indicating that the point portion corresponding to the low pen pressure is the low pen pressure.

[0178] According to the present invention, it is possible to visually and easily convey to the user the point portion where the pen pressure is low in the handwritten character or the stroke of the handwritten character. As a result, it is possible to more surely make the user aware of writing characters with an appropriate pen pressure.

[0179] In addition, in the learning support program, learning support device, and learning support method according to the embodiments of the present invention, the determination process compares the recognized handwritten character or the pen pressure in the stroke of the handwritten character with a predetermined threshold value set for the handwritten character or stroke, determines the pen pressure, and the output process may be such that when the recognized handwritten character or the pen pressure in the stroke of the handwritten character is lower than the threshold value, the display of the immediately preceding handwritten character or stroke is erased, and information requesting the rewriting of the immediately preceding handwritten character or stroke is output.

[0180] According to the present invention, when the recognized handwritten character or the pen pressure in the stroke of the handwritten character is lower than the threshold value for writing determination, by requesting the rewriting of the handwritten character or stroke, it is possible to convey to the user that the pen pressure is low and to promote repeated learning so as to achieve the correct pen pressure.

[0181] In addition, in the learning support program, learning support device, and learning support method according to the embodiments of the present invention, the output process may output information regarding the determination result by outputting a voice notifying the determination result.

[0182] According to the present invention, by notifying the determination result by voice, in addition to the touch for handwriting, the sense of hearing can be stimulated. For young users such as infants and lower-grade children, it is easy to make them aware of increasing the pen pressure by verbally conveying a message corresponding to the determination result of the writing order and pen pressure. Thereby, in particular, it is possible to effectively make young users aware of increasing the pen pressure.

[0183] There is a deep correlation between the strength of the fingers and the development of the frontal lobe of the brain, and it is known that the brain can be activated by appropriate stimulation. Also, it is known that by enhancing the strength of the fingers, the development of the ability to comprehensively judge things can be promoted. According to this invention, by prompting handwritten characters to be written in an appropriate writing order and writing pressure, in addition to acquiring the ability to write characters by hand, it is possible to expect activation of the brain and improvement of the ability to comprehensively judge things.

[0184] In addition, the learning support method described in this embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, or a DVD, and is executed by being read from the recording medium by the computer. Also, this program may be a transmission medium that can be distributed via a network such as the Internet.

Industrial Applicability

[0185] As described above, the learning support program, learning support device, and learning support method according to this invention are useful for a learning support program, learning support device, and learning support method that support learning, and in particular, are suitable for a learning support program that inputs answers using handwritten characters, a learning support method, and a learning support device that support learning.

Explanation of Reference Numerals

[0186] 100 Communication Education System 110 Server 120 Operation Terminal 225 Touch Screen 225a Display 225b Touch Panel 301 Processing Unit 302 Storage Unit 303 Control Unit 304 Output Unit 305 Input section 401 Model (problem) 402 Answer input frame 403 Guidance information 404 Direction information

Claims

1. Receiving input of handwritten characters of a user in response to a request for writing to the user, recognizing the input handwritten characters or strokes of the handwritten characters, determining the writing order in the recognized handwritten characters or strokes of the handwritten characters, outputting information regarding the determination result, A learning support program characterized by causing a computer to execute the processing.

2. When requesting writing to the user, displaying a guiding object for guiding the writing order of the handwritten characters, The learning support program according to claim 1, comprising the processing.

3. The guiding object, Is displayed superimposed on the handwritten characters, and includes guiding information for guiding a position for tracing the characters from a writing start position to a writing end position. The learning support program according to claim 2.

4. The guiding information, Is information that is displayed superimposed on the handwritten characters and sequentially guides a plurality of points for tracing the characters from a writing start position to a writing end position, The learning support program according to claim 3, characterized in that, in response to the state in which the user traces the characters on the position of the guiding information before one point, the guiding information of the next point is repeatedly displayed.

5. The guiding object, Is displayed on a side portion of the handwritten characters and includes direction information indicating the direction of the writing order of the characters. The learning support program according to claim 2.

6. The processing for outputting, Outputs information regarding the determination result by displaying the recognized handwritten characters or strokes of the handwritten characters in the writing order of the handwritten characters or strokes of the handwritten characters. The learning support program according to claim 1, characterized in that.

7. The processing for outputting, Outputs information regarding the determination result by displaying the recognized handwritten characters or strokes of the handwritten characters in information corresponding to the writing pressure of the handwritten characters or strokes of the handwritten characters. The learning support program according to claim 1, characterized in that.

8. The processing for outputting, Outputs including reproduction of an effect corresponding to the determination result of the writing order and writing pressure of the recognized handwritten characters or strokes of the handwritten characters. The learning support program according to claim 1, characterized in that.

9. The processing for determining, Compare the recognized handwritten character or the stroke of the handwritten character with a predetermined pen pressure at a plurality of points of the pen pressure of the handwritten character or the stroke of the handwritten character, The process of outputting is, including performing a display indicating that the point portion corresponding to the low pen pressure is the low pen pressure, The learning support program according to claim 1, characterized in that.

10. The process of determining is, Compare the pen pressure in the recognized handwritten character or the stroke of the handwritten character with a predetermined threshold value set for the handwritten character or the stroke, and determine the pen pressure, The process of outputting is, When the pen pressure in the recognized handwritten character or the stroke of the handwritten character is lower than the threshold value, erase the display of the handwritten character or the stroke input immediately before, and output information requesting a rewrite of the handwritten character or the stroke input immediately before. The learning support program according to claim 9, characterized in that.

11. The process of outputting is, Output information regarding the determination result by outputting a voice notifying the determination result. The learning support program according to any one of claims 1 to 10, characterized in that.

12. Receive the input of the user's handwritten characters for which the user has been requested to take notes, Recognize the input handwritten character or the stroke of the handwritten character, Determine the writing order in the recognized handwritten character or the stroke of the handwritten character, Output information regarding the determination result, A learning support device characterized by comprising a control unit.

13. Receive the input of the user's handwritten characters for which the user has been requested to take notes, Recognize the input handwritten character or the stroke of the handwritten character, Determine the writing order in the recognized handwritten character or the stroke of the handwritten character, Output information regarding the determination result, A learning support method characterized in that a computer executes the process.

Images