Virtual calligraphy evaluation method and calligraphy system in virtual space

Abstract

To provide a virtual calligraphy evaluation method and a calligraphy system in a virtual space that can perform objective evaluation.SOLUTION: A virtual calligraphy evaluation method utilizing a calligraphy system 10 in a virtual space, comprising a haptic interface device 1 with a stylus 2, a display unit 3, and an information processing device 5, includes: a step of displaying virtual Japanese writing paper 3a and a character 3e being a model within the Japanese writing paper 3a on the display unit 3; a step of acquiring the position of the stylus 2 when a user P of the calligraphy system 10 traces the character 3e being the model and detecting the reaction force from the Japanese writing paper 3a when a brush portion 3d of a virtual brush 3c based on the stylus 2 contacts the Japanese writing paper 3a; a step of calculating the degree of match between the character 3h written by the user P using the virtual brush 3c and the character 3e being the model; a step of calculating a score determined on the basis of the degree of match; a step of displaying the score on the display unit 3; and a step of updating the character 3e being the model.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a virtual calligraphy evaluation method and a calligraphy system in a virtual space. [Background technology]

[0002] In a remote calligraphy system using a haptic interface device, subjective evaluation is performed on the impact of network delays and packet losses on the user's Quality of Experience (QoE). In Non-Patent Document 1, the inventors clarify the impact of network delay fluctuations and packet losses on QoE depending on the work content, the transmission rate of location information, etc., through a survey using QoE evaluation. In the remote calligraphy system 20 (see FIG. 5) using the haptic interface device 1', the output quality of the reaction force presented to the user via the brush with which the user writes calligraphy is evaluated by subjective evaluation.

[0003] Patent Document 1 discloses a calligraphy learning support system for providing effective brush learning for learners of calligraphy characters. In this calligraphy learning support system, model calligraphy character data is displayed on a display device, and when writing begins, a three-dimensional haptic device reads the brush movement parameters for each time, and a brush character processing unit of a personal computer successively generates calligraphy characters and displays them on the display device. The personal computer's haptic processing unit calculates haptic data from the brush parameters and the like, and feeds back the haptic feedback to the three-dimensional haptic device. When writing is completed, brush movement expression data is created and compared with the model brush movement expression data, and is displayed on the display device.

[0004] Patent document 2 discloses a brush writing device that moves a brush in the XY direction relative to the paper surface and controls its movement in the Z direction to write characters on the paper surface with the brush, and obtains an image from a character model as digitally converted dot data. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2004-205962 A [Patent Document 2] Japanese Patent Application Publication No. 4-216079 [Non-patent literature]

[0006] [Non-Patent Document 1] Hiroyuki Kaneoka, Seiji Kameyama, Hisao Asano, Yutaka Ishibashi, "Subjective assessment of media output quality in a remote calligraphy system using haptic media," IEICE Technical Report, CQ2005-75, Nov. 2005. Summary of the Invention [Problem to be solved by the invention]

[0007] However, the quality of the characters actually written by the user is not evaluated, and there is a problem that it is difficult to obtain an objective evaluation. For example, in the evaluation in Non-Patent Document 1, the teacher needs to look at the characters actually written. Therefore, the present invention provides a virtual calligraphy evaluation method and a calligraphy system in a virtual space that can perform an objective evaluation. [Means for solving the problem]

[0008] The present invention that solves the above problems is as follows. [1] A virtual calligraphy evaluation method that uses a calligraphy system in a virtual space equipped with a tactile interface device having a stylus, a display unit, and an information processing device, comprising the steps of: displaying a virtual piece of writing paper and a model character on the writing paper on the display unit; acquiring the position of the stylus by a user of the calligraphy system tracing the model character, and detecting a reaction force from the writing paper by a brush portion of a virtual brush based on the stylus touching the writing paper; calculating a degree of similarity between a character written by the user with the virtual brush and the model character; calculating a score determined by the degree of similarity; displaying the score on the display unit; and updating the model character. [2] The virtual calligraphy evaluation method according to [1], wherein the model character is displayed on the display unit so that the thickness and center line of the character can be seen. [3] The virtual calligraphy evaluation method described in [2] is a method for evaluating calligraphy in which the score is calculated from the degree of similarity between the character written by the user and the model character, based on the difference in thickness Dw (mm) between the two, the difference in center lines Dc (mm) between the two, and the proportion of lines that extend beyond the center lines of the two. [4] The virtual calligraphy evaluation method described in [3], wherein the degree of agreement based on the proportion of lines that extend beyond the center line is based on a coverage rate Rc, which is the proportion that is insufficient in the longitudinal direction of the center line, and an over rate Ro, which is the proportion that extends beyond the center line. [5] The virtual calligraphy assessment method according to [4], wherein the score further includes the time (in seconds) it took the user to write the character. [6] When the degree of agreement is S, the degree of agreement S is expressed by equation (1) in the virtual calligraphy evaluation method described in [5]. (Number 1) JPEG2025078154000002.jpg10104 (However, 0≦S≦100, if S is below 0, 0 points will be given, and if S is above 100, 100 points will be given. The values ​​subtracted from the variables A, B, C, D, E, and F, as well as Dw, Dc, Rc, Ro, and T, are as follows: the first and second terms take values ​​from 0 to 40, the third and fourth terms take values ​​from 0 to 10, and the fifth and sixth terms take values ​​from -5 to 0 together. A, B, C, D, E, and F, as well as D 1 , D 2 , R 1 , R 2 and T 1 is a predetermined constant.) [7] The virtual calligraphy evaluation method described in [1] further includes a step of changing the thickness of the characters written by the user depending on the degree to which the stylus is pressed down toward the writing paper, and displaying the degree of the reaction force on the display unit. [8] A calligraphy system in a virtual space comprising a tactile interface device having a stylus, a display unit, and an information processing device, wherein the display unit displays a piece of writing paper and a model character on the writing paper, the tactile interface device acquires the position of the stylus as a user of the calligraphy system traces the model character, and detects a reaction force from the writing paper as a brush portion of a virtual brush based on the stylus hits the writing paper, and the information processing device calculates a score determined by calculating the degree of similarity between the character written by the user, which is determined by the position of the stylus, and the model character. [9] The information processing device is the calligraphy system described in [8], wherein the strength of the writing pressure of the virtual brush changes depending on the degree to which the stylus is pressed down toward the writing paper, the thickness of the characters written by the user changes depending on the strength of the writing pressure, and the display unit further includes a portion that distinguishes and displays the degree of the magnitude of the reaction force. Effect of the Invention

[0009] The present invention allows for an overall objective evaluation of the shape of a character using a score, something that is not possible with current technology. In addition, because the difference between each stroke and a model character can be calculated, it also allows for a partial evaluation of which specific parts of the character need improvement. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram showing a calligraphy system in a virtual space that realizes a virtual calligraphy evaluation method according to one embodiment of the present invention. [Diagram 2] FIG. 11 is another diagram showing the configuration of a calligraphy system in a virtual space that realizes the virtual calligraphy evaluation method. [Diagram 3] FIG. 1 shows (a) a model character and a character being written by tracing the model character, etc., displayed on a display (display unit), and (b) the completed character and its score, etc. [Figure 4] FIG. 1 is a diagram showing the evaluation flow of the virtual calligraphy evaluation method. [Diagram 5] FIG. 1 is a diagram showing the configuration of a remote calligraphy system using a prior art haptic interface device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the present invention will be described with reference to the drawings. The present invention is not limited to the following embodiments, and changes, modifications, and improvements can be made without departing from the scope of the invention.

[0012] (Virtual space calligraphy system) As shown in FIG. 1, a virtual calligraphy system 10 in a virtual space that realizes the virtual calligraphy evaluation method includes a haptic interface device 1 having a stylus 2, a display (display unit) 3, and a PC (personal computer, information processing device) 5 (see FIG. 2). The haptic interface device 1 has a base unit 1a, an operating unit 1b, an arm unit 1c, and an inkwell 1d, and the stylus 2 has a shaft portion 2a and a brush portion 2b. The brush portion 2b of the stylus 2 is held at the tip of the arm unit 1c provided on the operating unit 1b, and can move in the x direction by the operation of the operating unit 1b and in the y direction and z direction by the operation of the arm unit 1c according to the operation of the shaft portion 2a held by the user P. For example, 3D Systems Touch can be used as the haptic interface device 1. Note that the shaft portion 2a is held by the hand of the user P, but for convenience, the hand of the user P will be described as the user P.

[0013] The inkwell 1d has a function for calibrating the position of the stylus 2. In other words, when the haptic interface device 1 is used (when the power is turned on), the stylus 2 is placed in the inkwell 1d and a specific program stored in the PC 5 is run for initial settings. In Figure 2, the writing brush part 2b of the stylus 2 is placed in the inkwell 1d. As will be described later, on the display 3, a virtual piece of paper 3a is displayed, within which there are a model character 3e and a virtual pen 3c based on the position of the stylus 2. Further, when the user P traces the model character 3e, characters 3h written by the user P with the virtual pen 3c are displayed according to the position of the stylus 2 (see Fig. 3).

[0014] Also, the height of the display (display unit) 3 can be adjusted by a display stand (display unit stand) 4 installed below the display (display unit) 3. And the virtual calligraphy system 10 may have, in addition to the display (display unit) 3, another display unit, for example, the display 5a of the PC 5 (see Fig. 2). Note that the tactile interface device 1, the display stand (display unit) 4, and the PC 5 are respectively placed on the desk 15, and both the tactile interface device 1 and the display (display unit) 3 are communicably connected to the PC 5, and necessary power is supplied to each of them.

[0015] As shown in Fig. 3(a), the display (display unit) 3 has an area of a virtual piece of paper 3a in the virtual space and an area 3b outside the virtual piece of paper 3a. Therefore, first, the display regarding the virtual piece of paper 3a will be described. Inside the piece of paper 3a, a model character 3e, a virtual pen 3c, characters 3h written by the user P, and a virtual paperweight 3i for holding down the virtual piece of paper 3a are displayed. The model character 3e has a character thickness 3f and a center line 3g. The position where the virtual pen 3c is displayed is determined based on the position of the stylus 2. When the user P traces the model character 3e with the brush part 2b of the stylus 2, characters 3h are drawn and displayed by the brush part 3d of the virtual pen 3c. In this figure, both the model character 3e and the characters 3h written by the user P are the Chinese character "Yong".

[0016] When user P presses down on stylus 2, that is, moves it in the -y direction, the brush part 3d of the virtual brush hits the virtual writing paper 3a, and the thickness of character 3h changes according to the strength of the pen pressure. Moreover, the reaction force becomes stronger according to the depth to which the tip of virtual brush 3c sinks into virtual writing paper 3a, and character 3h also becomes thicker. At this time, the reaction force from virtual writing paper 3a is transmitted to user P through haptic interface device 1.

[0017] Next, the display related to the area 3b other than the virtual writing paper 3a will be described. In the area 3b, displays such as "Finish", "Copy", "Start from the beginning" and "Score", a score determined by calculating the degree of agreement between the model character 3e and the character 3h written by the user P, and a contact lamp 3k which distinguishes and displays the reaction force from the virtual writing paper 3a are displayed. In order to clarify the area of ​​the virtual writing paper 3a, a writing paper underlay 3j, for example in black, is displayed around the virtual writing paper 3a.

[0018] As shown in the left area of ​​Fig. 3(a), "Finish", "Copy", "From the beginning" and "Score" are displayed from the beginning. User P selects "Finish" when finishing calligraphy, "Copy" when making an electronic copy of the written characters into a file, "Score" when wanting to see the score for the written characters, and "From the beginning" when making a mistake and wanting to rewrite.

[0019] As shown in the center area on the right side of FIG. 3(b), the score display includes a number determined by calculating the degree of similarity between the character 3h written by the user P and the model character 3e, and displays, for example, "Your score was 92 points." The contact lamp 3k, which is a part that distinguishes and displays the magnitude of the reaction force from the virtual writing paper 3a, visually indicates the moment when the virtual brush 3c touches the writing paper 3a. When the virtual brush 3c is not in contact with the writing paper 3a, the contact lamp 3k starts, for example, black, and lights up in the order of green, yellow, and red as the magnitude of the reaction force presented to the user P increases while in contact. In FIG. 3(a), the virtual brush 3c touches the writing paper 3a and the contact lamp 3k lights up yellow, but in FIG. 3(b), the contact point of the virtual brush 3c moves from the writing paper 3a to the virtual paperweight 3i and is no longer in contact with the writing paper 3a, so the contact lamp 3k returns to black.

[0020] (Virtual calligraphy evaluation method) The virtual calligraphy evaluation method using the virtual calligraphy system 10 includes the following steps: a step (S1) of displaying a model character 3e in a virtual piece of paper 3a, a step (S2) of acquiring the position of the stylus 2 by the user P using the stylus 2 and detecting the reaction force from the piece of paper 3a, a step (S3) of calculating the degree of agreement S between the character 3h written by the user P and the model character 3e, a step (S4) of calculating a score determined by the degree of agreement S, a step (S5) of displaying the calculated score, and a step (S6) of updating the model character 3e.

[0021] In S2, the position of the stylus 2 can be obtained by a user P of the calligraphy system 10 in the virtual space tracing the model character 3e, and the reaction force from the writing paper 3a can be detected as follows. When the user P holds the shaft portion 2a of the stylus 2 and presses down on the stylus 2, the writing brush portion 3d of the virtual brush 3c based on the stylus 2 comes into contact with the writing paper 3a. The strength of the writing pressure of the virtual brush 3c changes according to the degree to which the stylus 2 is pressed down toward the writing paper 3a, and the thickness of the character 3h written by the user P changes according to the strength of the writing pressure. At this time, the reaction force from the writing paper 3a is transmitted to the user P through the haptic interface device 1.

[0022] In S1, the model character 3e is preferably displayed on the display 3 so that the thickness 3f and center line 3g of the character can be seen. In S3, the score is preferably calculated by comparing the character 3h written by the user P with the model character 3e, based on the difference in thickness Dw (mm) between the two, the difference in center lines Dc (mm) between the two, and the proportion of lines that extend beyond the center line 3g between the two.

[0023] The degree of match S based on the proportion of lines that extend beyond the center line Dc is preferably based on the coverage rate Rc, which is the proportion of lines that are insufficient in the length direction of the center line Dc, and the over rate Ro, which is the proportion of lines that extend beyond the center line Dc. The score preferably further includes the time T (seconds) required by the user P to write the character.

[0024] The degree of agreement S is preferably calculated by the formula expressed by equation (1). (Number 1) TIFF2025078154000003.tif11107 (However, 0≦S≦100, if S is below 0, 0 points will be given, and if S is above 100, 100 points will be given. The values ​​subtracted from the variables A, B, C, D, E, and F, as well as Dw, Dc, Rc, Ro, and T, are as follows: the first and second terms take values ​​from 0 to 40, the third and fourth terms take values ​​from 0 to 10, and the fifth and sixth terms take values ​​from -5 to 0 together. A, B, C, D, E, and F, as well as D1 , D 2 , R 1 , R 2 and T 1 is a predetermined constant.)

[0025] In calculating the scores, the influence of the difference in thickness Dw (mm) and the difference in center line Dc (mm) between the model character 3e and the character 3h written by user P was considered to be large, so the maximum score was set at 40 points for each, and the maximum score for the coverage rate Ro and the over rate Rc was set at 10 points each. Also, since it is not desirable for the writing to be significantly delayed, a small amount of points were deducted. Based on this idea, the scores for A, B, C, D, E and F were 44.44, 16.00, 22.20, 68.00, 0.07 and 5.00 respectively, and D 1 , D 2 , R 1 , R 2 , T 1 are particularly preferably 1.50, 4.00, 0.50, 0.15 and 100.00, respectively. These values ​​are the worst possible values, obtained by preliminary experiments, and can be changed at any time. [Industrial Applicability]

[0026] The present invention can provide a score for the shape of characters written by a user, and can be used for early detection, prevention, and recovery of the decline of upper limb function in elderly people. In addition, the type and size of the characters written can be changed according to the score, making it possible to tailor the writing, and it is expected to improve the motivation of the user. Furthermore, the present invention can be applied not only to calligraphy in virtual space, but also to various fields and industries, such as hard pen writing, practicing beautiful handwriting, and drawing pictures. [Explanation of symbols]

[0027] 1, 1´: Haptic interface device 1a: Base part 1b: Operating part 1c: Arm section 1d: Inkwell 2: Stylus 2a: Stylus shaft 2b: The brush part of the stylus 3: Display (display unit) 3a: Virtual paper 3b: Virtual non-paper area 3c: Virtual brush 3d: The brush part of the virtual brush 3e: Model Characters 3f: Model letter thickness 3g: Center line of model letters 3h: Characters written by the user 3i: Virtual Paperweight 3j: Writing paper underlay 3k: Contact lamp 4: Display stand (display unit stand) 5: PC (personal computer, information processing device) 5a: Another display (PC display) 10: Calligraphy system in virtual space 15: desk 20: Remote calligraphy system P:User

Claims

1. A virtual calligraphy evaluation method that uses a calligraphy system in a virtual space equipped with a tactile interface device having a stylus, a display unit, and an information processing device, the virtual calligraphy evaluation method including the steps of: displaying a virtual piece of writing paper and a model character within the piece of writing paper on the display unit; acquiring the position of the stylus by a user of the calligraphy system tracing the model character, and detecting a reaction force from the piece of writing paper by a brush portion of a virtual brush based on the stylus touching the piece of writing paper; calculating a degree of similarity between a character written by the user with the virtual brush and the model character; calculating a score determined by the degree of similarity; displaying the score on the display unit; and updating the model character.

2. The virtual calligraphy evaluation method according to claim 1 , wherein the model character is displayed on the display unit so that the thickness and center line of the character can be seen.

3. 3. The virtual calligraphy evaluation method according to claim 2, wherein the score is calculated from a degree of similarity between the character written by the user and the model character, based on a difference in thickness Dw (mm) between the two, a difference Dc (mm) between the center lines of the two, and a proportion of lines that extend beyond the center lines of the two.

4. 4. The virtual calligraphy evaluation method according to claim 3, wherein the degree of agreement based on the proportion of lines that extend beyond the center line is a degree of agreement based on a coverage rate Rc, which is the proportion that is insufficient in the length direction of the center line, and an over rate Ro, which is the proportion of lines that extend beyond the center line.

5. 5. The virtual calligraphy assessment method of claim 4, wherein the score further includes the time (in seconds) it took the user to write the character.

6. 6. The virtual calligraphy evaluation method according to claim 5, wherein the degree of agreement is S, and the degree of agreement S is expressed by the following formula (1). (Equation 1) (However, 0≦S≦100, if S is below 0, 0 points will be given, and if S is above 100, 100 points will be given. The values ​​subtracted from the variables A, B, C, D, E, and F, as well as Dw, Dc, Rc, Ro, and T, are as follows: the first and second terms take values ​​from 0 to 40, the third and fourth terms take values ​​from 0 to 10, and the fifth and sixth terms take values ​​from -5 to 0 together. A, B, C, D, E, and F, as well as D １ , D ２ , R １ , R ２ and T １ is a predetermined constant.)

7. The virtual calligraphy evaluation method according to claim 1, further comprising a step of changing the thickness of the characters written by the user depending on the degree to which the stylus is pressed down toward the writing paper, and displaying the degree of the reaction force on the display unit.

8. A calligraphy system in a virtual space comprising a tactile interface device having a stylus, a display unit, and an information processing device, wherein the display unit displays a piece of writing paper and a model character within the paper, the tactile interface device acquires the position of the stylus as a user of the calligraphy system traces the model character, and detects a reaction force from the writing paper as a calligraphy portion of a virtual brush based on the stylus hits the writing paper, and the information processing device calculates a score determined by calculating the degree of similarity between the character written by the user, which is determined by the position of the stylus, and the model character.

9. The calligraphy system of claim 8, wherein the information processing device changes the strength of the writing pressure of the virtual brush depending on the degree to which the stylus is pressed down toward the writing paper, and the thickness of the characters written by the user changes depending on the strength of the writing pressure, and the display unit further includes a portion that displays the degree of the magnitude of the reaction force.

Images