Stroke practice support device and program

Abstract

To provide a pen movement practice support technique that can improve the practice motivation of a learner by appropriately supporting the practice of pen movement by the learner.SOLUTION: A reception unit 110 generates pen movement trajectory data representing the pen movement trajectory of a learner on the basis of position information of an input pen PN. A first detection unit 131 detects whether or not the pen movement trajectory deviates from the allowable width Wc of a model line Lm or whether or not the pen movement trajectory returns to the allowable width by comparing the model data of the model line Lm with the pen movement trajectory data representing the pen movement trajectory of the learner. A second display control unit 142 displays a line according to the pen movement trajectory of the learner on a touch panel TP on the basis of the pen movement trajectory data and the detection result of the first detection unit 131.SELECTED DRAWING: Figure 3B

Description

Technical Field

[0001] The present invention relates to a writing practice support device and a program.

Background Art

[0002] In recent years, in order to practice the way of moving a pen (so-called writing stroke) when writing characters, lines, etc., a tablet terminal equipped with a touch pen or the like has been utilized. For example, Patent Document 1 discloses a system that enables writing stroke practice by displaying a writing stroke video or the like serving as a model of characters or lines on a monitor while a learner writes characters or lines with a touch pen or the like while looking at the model.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above system, the learner does not actually trace the model of characters or lines directly for writing stroke practice. For this reason, just by looking at the practice result (that is, the characters or lines input using a touch pen or the like), the learner cannot well understand whether the correct writing stroke is made as per the model, and there is a problem that it is difficult to maintain the motivation to practice.

[0005] The present invention has been made in view of the circumstances described above, and an object thereof is to provide a writing stroke practice support technique capable of improving the learner's motivation to practice by appropriately supporting the learner's writing stroke practice.

Means for Solving the Problems

[0006] The writing practice support device according to one aspect of the present invention includes a first display control unit that displays a model line having a predetermined allowable width on a display device based on model data, a reception unit that receives an input of writing trajectory data representing a writing trajectory when a learner traces the model line, a first detection unit that detects whether the writing trajectory by the learner deviates from the allowable width of the model line based on a comparison result between the model data and the writing trajectory data, and a second display control unit that displays a line corresponding to the writing trajectory of the learner on the display device based on the writing trajectory data. The second display control unit is characterized in that, when it is detected that the deviation from the allowable width of the model line has been detected by the first detection unit and then it is detected that the learner has returned within the allowable width of the model line again, a line connecting the deviation point and the return point of the writing trajectory is displayed on the display device as an assist line.

Advantages of the Invention

[0007] According to the present invention, by appropriately supporting the writing practice by the learner, it is possible to improve the learner's motivation to practice.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 3C

Figure 4A

Figure 4B

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0009] Hereinafter, this embodiment will be described with reference to the accompanying drawings. For ease of understanding of the description, the same reference numerals are attached to the same components in each drawing as much as possible, and duplicate descriptions are omitted.

[0010] A. This Embodiment (1) Configuration FIG. 1 is a diagram showing a schematic configuration of a stroke practice support system 1000 according to this embodiment. The stroke practice support system 1000 includes a user terminal 100 having a touch panel TP used when each learner practices stroke, and an input pen PN such as a stylus.

[0011] In this embodiment, a tablet terminal capable of touch operation is assumed as the user terminal 100, but it is not limited to this. For example, it can be applied to any device capable of touch operation, such as a personal computer (PC), a notebook PC, a handheld computer device, a wearable terminal, a mobile phone, and a smartphone. Also, instead of an input pen PN such as a stylus, a learner's finger or the like may be used as an input means.

[0012] The user terminal 100 manages a user ID for uniquely identifying a learner within the system 1000. An operation writing practice support app AP1 is installed on the user terminal 100. The "operation writing practice support app" is application software for supporting the operation writing practice of each learner, and has an operation writing related assist function and an operation writing related notification function as main functions. The operation writing practice support app AP1 can be installed at the time of manufacturing and shipping of the user terminal 100, etc., but may also be installed separately from various storage media (such as semiconductor memories). Further, the operation writing practice support app AP1 may be configured such that some or all of the functions of the software are provided from an external server (not shown) etc. via a communication network (so-called SaaS (Software as a Service), etc.).

[0013] Figures 2 to 4 are explanatory diagrams for explaining the main functions of the operation writing practice support app AP1. As shown in Figure 2, a model line Lm for operation writing practice having a predetermined allowable width Wc is displayed on the touch panel TP of the user terminal 100. Between the start point Ps and the goal point Pg of this model line Lm, a plurality of confirmation points Pc1, Pc2 are set. The confirmation points Pc1, Pc2 are fixed points through which the handwriting (that is, the operation writing trajectory) should pass when the learner traces the model line Lm with the input pen PN (described later). The learner practices the operation writing when drawing lines and characters by tracing the model line Lm using the input pen PN. In Figure 2, a retry button B1 for the learner to retry the operation writing practice is illustrated, but such a button may not be provided.

[0014] <Operation writing related assist function> When the learner traces the model line Lm using the input pen PN, a line corresponding to the operation writing trajectory when tracing the model line Lm with the input pen PN is displayed on the touch panel TP. Here, as shown in Figure 3A, if the operation writing trajectory of the learner is within the allowable width of the model line Lm, a line (for example, a black handwritten line) Lw along the operation writing trajectory is displayed on the touch panel TP.

[0015] However, in reality, as shown in FIG. 3B, the learner's writing trajectory may deviate from the allowable width Wc of the model line Lm (i.e., deviate). Even if the writing trajectory deviates from the allowable width Wc of the model line Lm, when the writing trajectory returns to within the range of the allowable width Wc of the model line Lm again, a line (e.g., a pink assist line) La connecting the deviation point Pd and the return point Pr is displayed on the touch panel TP.

[0016] Furthermore, as shown in FIG. 3C, during the writing practice, the operation of tracing the model line Lm by the learner may be interrupted (i.e., the input pen PN leaves the touch panel TP). Even if the operation of tracing the model line Lm is interrupted once, when the operation of tracing the model line Lm is resumed, a line (e.g., a pink assist line) La connecting the interruption point Pi and the resumption point Pe of the operation is displayed on the touch panel TP.

[0017] The above is the writing-related assist function. According to such a function, even if the writing trajectory deviates from the allowable width Wc of the model line Lm and the practice stumbles, by performing operations such as returning to the allowable width Wc again, the assist line La connected to the handwritten line Lw is displayed. Therefore, the learner can continue the writing practice without reducing the motivation for practice. In addition, since the handwritten line Lw and the assist line La are color-coded and displayed on the touch panel TP, a monitor (e.g., if the child is the learner, their parent) can immediately grasp where the learner stumbled in the practice by checking the display on the touch panel TP.

[0018] <Writing-related notification function> The writing-related notification function is a function that notifies the learner that they have passed by emitting a notification sound (e.g., "Good job!", "Keep it up!") when the learner's writing trajectory passes through each confirmation point Pc1, Pc2.

[0019] In this embodiment, the order in which each verification point Pc1 and Pc2 should be passed (hereinafter referred to as the specified order) is set in advance. Specifically, the verification point Pc1 is set as the first passing point, and the verification point Pc2 is set as the second passing point (however, only the first pass of any verification point is valid).

[0020] Therefore, as shown in FIG. 4A, when the learner's writing trajectory passes the verification point Pc2 after the verification point Pc1 in the specified order, a notification sound is emitted at each passing timing.

[0021] On the other hand, as shown in FIG. 4B, when the learner's writing trajectory returns to the verification point Pc1 again without heading towards the goal point after passing the verification point Pc2, even if it passes Pc1 or Pc2 again later, since it is not the first pass, the notification sound is not emitted. According to such a function, the learner tries to pass each verification point Pc1 and Pc2 set in the middle of the model line Lm in the correct order, so that it is possible to continue the writing practice without getting bored. Note that the number, position, specified order, etc. of the verification points Pc1 and Pc2 may be appropriately set and changed by the operator of the system 1000 or the like. Also, the specified order may not be provided.

[0022] Returning to FIG. 1, the user terminal 100 has a hardware configuration similar to that of a general tablet terminal, and includes a control device composed of a CPU or the like, a storage device composed of a semiconductor memory, a hard disk, etc., a display device composed of a touch panel TP, etc., an input device equipped with a position sensor, etc., an output device composed of a speaker, a sound source chip, etc., an imaging device equipped with a camera, etc., a communication device composed of various communication interfaces, etc. Note that the information of each learner using the user terminal 100 (for example, the personal information of the learner including the user ID, the history information related to the writing practice, etc.) may be configured to be managed by a management server (not shown). Hereinafter, the functional configuration of the user terminal 100 will be described with reference to FIG. 5 and the like.

[0023] FIG. 5 is a block diagram showing the main functional modules of the user terminal 100. The user terminal (calligraphy practice support device) 100 includes a reception unit 110, a management unit 120, a detection unit 130, a display control unit 140, and a notification unit 150. Each of these units is realized by the cooperation of each hardware resource installed in the user terminal 100 with software such as the calligraphy practice support application AP1.

[0024] The reception unit 110 receives input operations by the learner and is configured to include a position sensor or the like. The position sensor detects the position of the input pen PN on the touch panel TP (including the presence or absence of contact). For example, as shown in FIG. 3A or the like, when the learner traces the model line Lm displayed on the touch panel (display device) TP using the input pen PN, the reception unit 110 generates calligraphy trajectory data representing the calligraphy trajectory of the learner based on the position information of the input pen PN detected by the position sensor, and receives this as input data.

[0025] The management unit 120 manages various data related to the calligraphy practice support application AP1 and includes a model database DB1, a calligraphy history database DB2, and the like.

[0026] A plurality of model data for displaying a model line Lm having a predetermined allowable width Wc are stored in the model database DB1. As already described, between the start point Ps and the goal point Pg of the model line Lm, a plurality of confirmation points Pc having a prescribed order are scattered (see, for example, FIG. 2).

[0027] Here, the model line Lm presented to the learner may be automatically determined by the user terminal 100 based on, for example, the progress of the learner's calligraphy practice (history data related to calligraphy practice), or the learner may be able to select it himself / herself. Also, the allowable width Wc of the model line Lm may be set and changed each time on the user terminal 100 side according to, for example, the progress of the learner's calligraphy practice or the learner's request.

[0028] The stroke history database DB2 stores the history data related to the learner's stroke practice. The history data includes information representing, for example, the learner's user ID, the practice status of the stroke (practice time, difficulty level of the model line Lm practiced, practice results, etc.).

[0029] The detection unit 130 includes a first detection unit 131, a second detection unit 132, and a third detection unit 133. The first detection unit 131 compares the model data of the model line Lm that the learner is practicing with the stroke trajectory data representing the learner's stroke trajectory, and detects whether the stroke trajectory deviates from or returns to the allowable width Wc of the model line Lm. The first detection unit 131 notifies the display control unit 140 of the detection result.

[0030] The second detection unit 132 detects whether the learner has interrupted or resumed the operation of tracing the model line Lm based on the stroke trajectory data. In other words, the second detection unit 132 detects whether the input pen PN has left the touch panel TP or has contacted the touch panel TP again based on the stroke trajectory data. The second detection unit 132 notifies the display control unit 140 of the detection result.

[0031] In this embodiment, it is assumed that when the learner traces the model line Lm within the allowable width, it is detected whether the input pen PN has left the touch panel TP or has contacted the touch panel TP again, but the present invention is not limited thereto. Whether within the allowable width or not, when the learner traces the model line Lm, it may be detected whether the input pen PN has left the touch panel TP or has contacted the touch panel TP again.

[0032] The third detection unit 133 compares the model data with the stroke trajectory data, and detects whether the learner's stroke trajectory has passed through each confirmation point Pc in the specified order. The third detection unit 133 notifies the notification unit 150 of the detection result.

[0033] The display control unit 140 includes a first display control unit 141 and a second display control unit 142. The first display control unit 141 displays a model line Lm for posing questions to the learner on the touch panel TP based on the model data. As an example, the first display control unit 141 refers to the history data related to the learner's writing practice and determines the difficulty level of the model line Lm suitable for the learner. The first display control unit 141 extracts the model data suitable for the learner from the model database DB1 based on the determined difficulty level, and displays the model line Lm corresponding to the extracted model data on the touch panel TP (see, for example, FIG. 2).

[0034] The second display control unit 142 displays a line corresponding to the learner's writing trajectory on the touch panel TP based on the writing trajectory data and the detection results of the respective detection units 131, 132, and 133. This will be specifically described below.

[0035] When the second display control unit 142 determines, based on the writing trajectory data and the detection result of the first detection unit 131, that the learner's writing trajectory does not deviate from the allowable width Wc of the model line Lm, the second display control unit 142 displays a handwritten line Lw along the learner's writing trajectory on the touch panel TP (see FIG. 3A).

[0036] On the other hand, when the second display control unit 142 determines, based on the writing trajectory data and the detection result of the first detection unit 131, that the learner's writing trajectory has deviated from the allowable width Wc of the model line Lm but then has returned to the allowable width Wc of the model line Lm, the second display control unit 142 displays an assist line La connecting the deviation point Pd and the return point Pr of the writing trajectory on the touch panel TP (see FIG. 3B).

[0037] However, the second display control unit 142 displays the assist line La on the touch panel TP only when the distance between the deviation point Pd and the return point Pr is less than the set first threshold value. In other words, the second display control unit 142 does not display the assist line La on the touch panel TP when the distance between the deviation point Pd and the return point Pr exceeds the first threshold value.

[0038] Further, when the second display control unit 142 determines that the operation of tracing the model line Lm by the learner has been interrupted based on the traced trajectory data and the detection result of the second detection unit 132, but then the operation of tracing the model line Lm is resumed, the assist line La connecting the interruption point and the resumption point of the operation is displayed on the touch panel TP (see Fig. 3C).

[0039] However, the second display control unit 142 displays the assist line La on the touch panel TP only when the distance between the interruption point and the resumption point is less than the set second threshold. In other words, when the distance between the interruption point and the resumption point exceeds the second threshold, the second display control unit 142 does not display the assist line La on the touch panel TP. Each threshold can be arbitrarily set and changed. Also, the color and line type of each assist line can be arbitrarily set and changed.

[0040] The notification unit 150 emits a notification sound when it determines that the traced trajectory of the learner has passed through each confirmation point Pc1, Pc2 based on the traced trajectory data and the detection result of the third detection unit 133. As already explained, since the passing order of each confirmation point Pc1, Pc2 is defined in advance, the notification sound will not be emitted unless the traced trajectory of the learner passes in the defined passing order. The confirmation points, the types of notification sounds, etc. can be arbitrarily set and changed. For example, a store icon or illustration can be displayed as a confirmation point, and when this confirmation point is passed, a voice message such as "Welcome!" can be output as the notification sound. Also, from the perspective of multilingual learning, voice messages in English, Japanese, etc. (e.g., "Welcome! いらっしゃいませ!") can be output.

[0041] (2) Operations Hereinafter, the operations of the user terminal 100 when the learner performs pen tracing practice will be described with reference to the drawings. It is assumed that an instruction to start pen tracing practice has been input.

[0042] FIG. 6 is a flowchart showing the writing practice support process executed by the user terminal 100. In step S110, when the reception unit 110 receives an instruction to start writing practice, it starts the writing practice by the learner. The instruction to start writing practice is input, for example, when the learner touches a practice start button (not shown).

[0043] In step S120, the first display control unit 141 extracts the model data of the model line Lm to be presented to the learner from the model database DB1, and based on the extracted model data, displays the model line Lm on the touch panel TP (see FIG. 2).

[0044] In step S130, the reception unit 110 generates writing trajectory data representing the writing trajectory of the learner based on the position information of the input pen PN detected by the position sensor, and receives this as input data.

[0045] In step S140, the first detection unit 131 compares the model data of the model line Lm with the input writing trajectory data of the learner, and detects whether the writing trajectory has deviated from or returned to the allowable width Wc of the model line Lm. The first detection unit 131 notifies the display control unit 140 of the detection result.

[0046] In step S150, the second display control unit 142 displays the handwritten line Lw or the assist line La corresponding to the writing trajectory on the touch panel TP based on the detection result by the first detection unit 131 (see FIGS. 3A and 3B). However, in this embodiment, the assist line La is displayed on the touch panel TP only when the distance between the deviation point Pd and the return point Pr is less than the set first threshold value, but the present invention is not limited to this. For example, it may be determined whether to display the assist line La on the touch panel TP according to the time until the deviation point Pd and the return point Pr are detected.

[0047] In step S160, the second detection unit 132 detects whether or not the operation of tracing the model line Lm by the learner has been interrupted or resumed based on the writing trajectory data. In other words, the second detection unit 132 detects whether or not the input pen PN has left the touch panel TP or whether or not the input pen PN has come into contact with the touch panel TP again based on the writing trajectory data. The second detection unit 132 notifies the display control unit 140 of the detection result.

[0048] In step S170, the second display control unit 142 displays the handwritten line Lw or the assist line La corresponding to the writing trajectory on the touch panel TP based on the detection result by the second detection unit 132 (see FIGS. 3A and 3C). However, in the present embodiment, the assist line La is displayed on the touch panel TP only when the distance between the interruption point Pi and the resumption point Pe is less than the set second threshold value, but the present invention is not limited to this. For example, it may be determined whether or not to display the assist line La on the touch panel TP according to the time until the interruption point Pi and the resumption point Pe are detected.

[0049] In step S180, the third detection unit 133 detects whether or not the writing trajectory of the learner has passed through each confirmation point Pc in the specified order based on the writing trajectory data. The third detection unit 133 notifies the notification unit 150 of the detection result.

[0050] In step S190, the notification unit 150 notifies a notification sound based on the detection result by the third detection unit 133. When the writing trajectory of the learner has passed through in the specified order, a notification sound is emitted, while when it has not passed through in the specified order, no notification sound is emitted.

[0051] In step S200, the reception unit 110 determines whether or not the writing practice by the learner has ended. As an example, when the reception unit 110 detects that the writing trajectory of the learner has reached the goal point Pg of the model line Lm, or when it detects that a forced end button (not shown) displayed on the touch panel TP or the like has been tapped, it determines that the writing practice has ended and ends the processing described above.

[0052] B. Others The present invention is not limited to the above-described embodiments, and can be implemented in various other forms without departing from the gist of the present invention. Therefore, the above embodiments are merely illustrative in every respect and should not be construed in a limiting sense. For example, the above-described processing steps can be arbitrarily changed in order or executed in parallel as long as there is no contradiction in the processing content. Further, in the above embodiment, when it is determined that the learner's writing trajectory has passed through each confirmation point Pc1, Pc2, the mode of notification by sound is exemplified. However, in addition to (or instead of) this, the learner may be notified by displaying a message or giving vibration. Further, in the above embodiment, the mode of displaying the handwritten line Lw and the assist line La in different colors is exemplified, but the present invention is not limited to this. In short, as long as the learner or the like can distinguish the handwritten line Lw and the assist line La, for example, the line thickness may be changed between the handwritten line Lw and the assist line La (such as 3 pt and 0.5 pt), or the line type may be changed (such as a solid line and a dotted line).

Explanation of Reference Numerals

[0053] 1000… Writing support system, 100… User terminal, 110… Reception unit, 120… Management unit, 130… Detection unit, 131… First detection unit, 132… Second detection unit, 133… Third detection unit, 140… Display control unit, 141… First display control unit, 142… Second display control unit, 150… Notification unit, DB1… Model database, DB2… Writing history database, TP… Touch panel, PN… Input pen, AP1… Writing practice support application, Lm… Model line, Wc… Allowable width, Lw… Handwritten line, La… Assist line, Ps… Start point, Pg… Goal point, Pi… Interruption point, Pe… Resume point, Pc1, Pc2… Confirmation point

Claims

1. A first display control unit that displays a model line having a predetermined tolerance on a display device based on model data; A reception unit that receives an input of writing trajectory data representing a writing trajectory when a learner traces the model line; A first detection unit that detects whether or not the writing trajectory by the learner deviates from the tolerance of the model line based on a comparison result between the model data and the writing trajectory data; A writing practice support device comprising: a second display control unit that displays a line corresponding to the writing trajectory of the learner on the display device based on the writing trajectory data, wherein The second display control unit, When it is detected that, after the first detection unit detects a deviation from the tolerance of the model line, the learner has returned within the tolerance of the model line again, a line connecting the deviation point and the return point of the writing trajectory is displayed on the display device as an assist line. A writing practice support device.

2. The second display control unit, When the first detection unit does not detect a deviation from the tolerance of the model line, a handwritten line according to the writing trajectory by the learner is displayed on the display device, and the handwritten line and the assist line are displayed in a distinguishable manner. The writing practice support device according to claim 1.

3. The second display control unit, When the distance between the deviation point and the return point is less than a set first threshold value, the assist line is displayed on the display device. The writing practice support device according to claim 1.

4. A first display control unit that displays a model line having a predetermined tolerance on a display device based on model data; A reception unit that receives an input of writing trajectory data representing a writing trajectory when a learner traces the model line; A second detection unit that detects an interruption and resumption of an operation of tracing the model line by the learner based on the writing trajectory data; A writing practice support device comprising: a second display control unit that displays a line corresponding to the writing trajectory of the learner on the display device based on the writing trajectory data, wherein The second display control unit, When it is detected that, after the second detection unit detects an interruption of the operation of tracing the model line, the operation of tracing the model line is resumed, a line connecting the interruption point and the resumption point of the operation is displayed on the display device as an assist line. A writing practice support device.

5. The second display control unit, When the second detection unit does not detect an interruption in the operation of tracing the model line, the handwriting line along the writing trajectory of the learner is displayed on the display device, and the handwriting line and the assist line are displayed in a distinguishable manner. The writing practice support device according to claim 4.

6. The second display control unit When the distance between the interruption point and the restart point is less than a set second threshold value, the assist line is displayed on the display device. The writing practice support device according to claim 4.

7. One or more confirmation points are set between the start and the goal of the model line, A third detection unit that detects whether the writing trajectory by the learner has passed the confirmation point based on the comparison result between the model data and the writing trajectory data; When the third detection unit detects that the writing trajectory by the learner has passed the confirmation point, a notification unit that notifies the passing. The writing practice support device according to any one of claims 1 to 6.

8. A plurality of confirmation points with a prescribed order to be passed are set between the start and the goal of the model line, The third detection unit detects whether the writing trajectory by the learner has passed the confirmation point in the prescribed order, When the third detection unit detects that the confirmation point has been passed in the prescribed order, the notification unit notifies the passing. The writing practice support device according to claim 7.

9. A computer A first display control unit that displays a model line having a predetermined allowable width on a display device based on model data; A reception unit that receives an input of writing trajectory data representing a writing trajectory when the learner traces the model line; A first detection unit that detects whether the writing trajectory by the learner has deviated from the allowable width of the model line based on the comparison result between the model data and the writing trajectory data; A program for causing the computer to function as a second display control unit that displays a line corresponding to the writing trajectory of the learner on the display device based on the writing trajectory data, The second display control unit When it is detected that, after the first detection unit detects a deviation from the allowable width of the model line, the learner has returned within the allowable width of the model line again, a line connecting the deviation point and the return point of the writing trajectory is displayed on the display device as an assist line. A program.

Images