Handwriting input device, handwriting input system, handwriting input method, and program

Abstract

To enable capital letters and small letters in a character string inputted by handwriting to be discriminated with high accuracy by considering the size of an input field displayed on a screen.SOLUTION: A handwriting input device includes conversion means for converting a handwritten character into character data by performing character recognition, display control means for displaying the converted character data in a prescribed input field instead of a handwritten character, first determination means for determining whether a prescribed character in which a capital letter and a small letter are stored in advance as similar letters is included in the character data, and second determination means for determining whether a handwritten character is a capital letter or a small letter on the basis of a size in the height direction of the prescribed input field and a size of the height direction of the handwritten character in the case that the prescribed character with the capital letter and the small letter stored in advance as similar letters is included in the character data. The display control means displays a handwritten character as character data of a capital letter or a small letter in the prescribed input field in accordance with a determination result of the second determination means.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a handwriting input device, a handwriting input system, a handwriting input method, and a program. [Background technology]

[0002] The following Patent Document 1 discloses a technique in which a handwriting input device recognizes handwritten content as a plurality of candidate character strings, displays the recognized candidate character strings, and accepts a character string selection from a user, thereby converting the content handwritten by the user into the selected character string and displaying it. There is also a technique in which the content handwritten by the user is converted into a character string of uppercase and lowercase letters and displayed using the horizontal and vertical sizes of the content handwritten by the user. Summary of the Invention [Problem to be solved by the invention]

[0003] However, in the conventional technology, when a user inputs handwritten text into an input field displayed on a screen, the size of the input field is not taken into consideration to distinguish between uppercase and lowercase letters. Therefore, when the content input by handwriting from a user includes characters whose uppercase and lowercase letters are similar (e.g., "s" and "S," "a" and "a," "o" and "o," etc.), there is a risk that the character will be mistakenly recognized as either uppercase or lowercase.

[0004] In view of the above-mentioned problems, an object of the present invention is to make it possible to distinguish between uppercase and lowercase letters, taking into consideration the size of an input field displayed on the screen. [Means for solving the problem]

[0005] In view of the above-mentioned problems, a handwriting input device according to one embodiment is a handwriting input device capable of handwriting input, and includes: a conversion means for converting handwritten characters that are handwritten and displayed in a predetermined input field displayed on a screen into character data by character recognition; a display control means for displaying the character data converted by the conversion means in place of the handwritten characters in the predetermined input field; a first determination means for determining whether the character data includes a predetermined character that is pre-stored as a character whose uppercase and lowercase characters are similar; and a second determination means for determining whether the handwritten characters are uppercase or lowercase based on the height size of the predetermined input field and the height size of the handwritten characters when the character data includes a predetermined character that is pre-stored as a character whose uppercase and lowercase characters are similar. The display control means displays the handwritten characters in the predetermined input field as uppercase or lowercase character data depending on the determination result of the second determination means. [Effects of the Invention]

[0006] According to the handwriting input device of one embodiment, it is possible to distinguish between uppercase and lowercase letters in consideration of the size of the input field displayed on the screen. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing an example of the overall configuration of a handwriting input device according to a first embodiment; [Figure 2] FIG. 1 is a diagram showing an example of a hardware configuration of a handwriting input device according to a first embodiment; [Figure 3] FIG. 1 is a diagram showing an example of the functional configuration of a handwriting input device and a pen according to a first embodiment; [Figure 4] FIG. 1 is a diagram showing an example (first example) of a form displayed on a display provided in a handwriting input device according to a first embodiment; [Figure 5] FIG. 10 is a diagram showing an example (second example) of a form displayed on a display provided in the handwriting input device according to the first embodiment; [Figure 6] FIG. 10 is a diagram showing an example of display of character data for a form displayed on a display provided in the handwriting input device according to the first embodiment; [Figure 7] FIG. 1 is a diagram for explaining an outline of a character string conversion method by a handwriting input device according to a first embodiment; [Figure 8] FIG. 1 is a diagram for explaining an outline of a character string conversion method by a handwriting input device according to a first embodiment; [Figure 9] FIG. 1 is a diagram for explaining an outline of a character string conversion method by a handwriting input device according to a first embodiment; [Figure 10] FIG. 1 is a diagram for explaining an outline of a character string conversion method by a handwriting input device according to a first embodiment; [Figure 11] 1 is a flowchart showing an example of a procedure for character string conversion processing by the handwriting input device according to the first embodiment; [Figure 12] FIG. 10 is a diagram showing an example of the functional configuration of a handwriting input device according to a second embodiment; [Figure 13] 10 is a flowchart showing an example of a procedure for setting condition change processing by a handwriting input device according to a second embodiment. [Figure 14] FIG. 10 is a diagram showing an example of a display screen displayed by a display accepting unit included in the handwriting input device according to the second embodiment; DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, as an example of an embodiment of the present invention, a handwriting input device 100 and a handwriting input method performed by the handwriting input device 100 will be described with reference to the drawings.

[0009] [First embodiment] (Overall configuration of handwriting input device 100) Fig. 1 is a diagram showing an example of the overall configuration of a handwriting input device 100 according to the first embodiment. In the example shown in Fig. 1, the handwriting input device 100 is a so-called electronic whiteboard. Note that, although the handwriting input device 100 in the example shown in Fig. 1 is freestanding, it is not limited to this and may be wall-mounted, for example.

[0010] 1, the handwriting input device 100 has a display 120. A user U can input (draw) characters and the like by handwriting on the display 120 using a pen 10.

[0011] Here, the handwriting input device 100 can convert a handwritten character string handwritten and input by the user U using the pen 10 into character data by performing character recognition, and display the character data on the display 120. A handwritten character string is a handwritten character input by the user. A handwritten character string is assumed to be composed of multiple handwritten characters, but may also be composed of a single character. Character data is data that can be processed as a character string by a computer, and has a character code for each character.

[0012] In this embodiment, a pen 10 is used as an example of an "input means." In addition, in this embodiment, a so-called active pen that has a built-in power source and can send commands to the handwriting input device 100 is used as the pen 10. The pen 10 has one physical switch at the tip, one at the end, and two on the side of the pen. The switch at the tip is for writing. The switch at the end is for erasing. The switch on the side of the pen is for allocating user functions.

[0013] (An example of the hardware configuration of the handwriting input device 100) 2 is a diagram showing an example of a hardware configuration of the handwriting input device 100 according to the first embodiment. As shown in FIG. 2, the handwriting input device 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, and an SSD (Solid State Drive) 104.

[0014] The CPU 101 controls the overall operation of the handwriting input device 100. The ROM 102 stores the CPU 101 and programs used to drive the CPU 101, such as an IPL (Initial Program Loader). The RAM 103 is used as a work area for the CPU 101. The SSD 104 stores various data, such as an OS and programs for the handwriting input device 100. Note that this program may be an application program that runs on an information processing device equipped with a general-purpose OS (Windows (registered trademark), Mac OS (registered trademark), Android (registered trademark), iOS (registered trademark), etc.). In other words, the handwriting input device 100 may be an information processing device.

[0015] The handwriting input device 100 also includes a display controller 113 , a touch sensor controller 115 , a touch sensor 116 , a display 120 , a power switch 122 , and a bus line 110 .

[0016] The display controller 113 controls and manages the screen display in order to output an output image to the display 120, etc. The touch sensor 116 detects that the pen 10, the user's hand, etc. (the pen and the user's hand are input means) has come into contact with the display 120.

[0017] The touch sensor controller 115 controls the processing of the touch sensor 116. The touch sensor 116 inputs and detects coordinates.

[0018] For example, if the touch sensor 116 is an optical type, two light receiving and emitting devices installed at both ends of the upper side of the display 120 emit a plurality of infrared rays parallel to the display 120. The infrared rays are reflected by a reflecting member provided around the periphery of the display 120. The touch sensor 116 receives, by a light receiving element, light returning along the same optical path as the emitted light.

[0019] The touch sensor 116 outputs position information of the infrared rays that are blocked by the object among the multiple infrared rays emitted by the two light receiving and emitting devices to the touch sensor controller 115, and the touch sensor controller 115 identifies the coordinate position that is the contact position of the object.

[0020] The touch sensor 116 is not limited to an optical type, and various detection means may be used, such as a capacitive touch panel that identifies the contact position by detecting changes in capacitance, a resistive touch panel that identifies the contact position by voltage changes across two opposing resistive films, or an electromagnetic induction touch panel that identifies the contact position by detecting electromagnetic induction caused by an object touching the display unit. The touch sensor 116 may be of a type that does not require an electronic pen to detect whether or not the pen tip is touching. In this case, a fingertip or a pen-shaped rod can be used to perform a touch operation. The pen 10 does not have to be a long, thin pen-shaped panel.

[0021] The power switch 122 is a switch for switching ON / OFF the power supply of the handwriting input device 100. The bus line 110 is an address bus, a data bus, etc. for electrically connecting the components such as the CPU 101 shown in FIG.

[0022] (An example of the functional configuration of the handwriting input device 100) FIG. 3 is a diagram showing an example of the functional configuration of the handwriting input device 100 and the pen 10 according to the first embodiment.

[0023] As shown in FIG. 3, the handwriting input device 100 includes a handwriting input unit 131, a display unit 132, a handwriting input display control unit 133, a candidate display timer control unit 134, a handwriting input storage unit 135, a handwriting recognition control unit 136, a handwriting recognition dictionary unit 137, a character string conversion control unit 138, a character string conversion dictionary unit 139, a predictive conversion control unit 140, a predictive conversion dictionary unit 141, an operation command recognition control unit 142, an operation command definition unit 143, a handwritten signature authentication control unit 146, and a handwritten signature data storage unit 147.

[0024] Each function of the handwriting input device 100 is a function or means realized by any of the components shown in Figure 2 operating in accordance with instructions from the CPU 101 in accordance with a program expanded from the SSD 104 onto the RAM 103.

[0025] The handwriting input unit 131 is realized by the touch sensor 116 or the like, accepts handwriting input by the user, and receives a pen ID from the pen 10. The handwriting input unit 131 converts the user's pen input into pen operation data (pen up, pen down, or pen coordinate data) to which the pen ID is assigned, and transmits the data to the handwriting input display control unit 133. The pen coordinate data is periodically transmitted as discrete values, and coordinates between the discrete values ​​are interpolated.

[0026] Display unit 132 is realized by display 120 or the like, and displays handwritten objects, operation menus, etc. Display unit 132 converts the drawing data written to the video memory by handwriting input display control unit 133 into data according to the characteristics of display 120, and transmits the data to display 120.

[0027] The handwriting input display control unit 133 performs overall control over handwriting input and display. The handwriting input display control unit 133 processes pen operation data from the handwriting input unit 131 and transmits it to the display unit 132 for display. The handwriting input display control unit 133 also identifies the operated operation menu (button) based on the pen operation data transmitted from the handwriting input unit 131 and performs control according to the identified operation menu. The handwriting input display control unit 133 has a function of a first acquisition unit (first acquisition means) that acquires the height size of an input field input by handwriting. The handwriting input display control unit 133 also has a function of a second acquisition unit (second acquisition means) that acquires the height size of each handwritten character included in a handwritten character string input by handwriting. The handwriting input display control unit 133 also has a function of a first determination unit (first determination means) that determines whether a predetermined character stored in advance as a character whose uppercase and lowercase characters are similar is included in the character data. Furthermore, handwriting input display control unit 133 has a function of a second determination unit (second determination means) that, when it is determined that a predetermined character that is pre-stored as a character whose uppercase and lowercase characters are similar is included in the character data, determines whether the ratio of the height of the input field to the height of the input field is equal to or less than a predetermined threshold. Furthermore, handwriting input display control unit 133 displays the handwritten character as uppercase or lowercase character data in the predetermined input field according to the determination result of the second determination unit. Note that handwriting input display control unit 133 is configured to have the functions of a first acquisition unit, a second acquisition unit, a first determination unit, and a second determination unit, but each of these functions may be configured as a function separate from handwriting input display control unit 133.

[0028] The candidate display timer control unit 134 is a timer for controlling the display of selectable candidates. The candidate display timer control unit 134 starts or stops the timer to generate the timing for starting the display of selectable candidates and the timing for erasing the display. The selectable candidates are character strings, operation commands, etc., that are displayed on the display unit 132 so that the user can select them. The candidate display timer control unit 134 receives a timer start request (or a timer stop request) from the handwriting input display control unit 133, and transmits a timeout event to the handwriting input display control unit 133.

[0029] Handwriting input saving unit 135 holds user data (handwriting objects / character string objects) transmitted from handwriting input display control unit 133. Furthermore, handwriting input saving unit 135 transmits the held user data to handwriting input display control unit 133 in response to a request from handwriting input display control unit 133.

[0030] The handwriting recognition control unit 136 is a recognition engine that performs online handwriting recognition. The handwriting recognition control unit 136 recognizes letters, numbers, symbols, figures, etc. in parallel with the user's pen operation. Various algorithms have been devised for the recognition method used by the handwriting recognition control unit 136, but a detailed description will be omitted since this embodiment can use known techniques.

[0031] The handwriting recognition control unit 136 receives pen operation data from the handwriting input display control unit 133. The handwriting recognition control unit 136 also generates handwriting-recognized character string candidates by performing handwriting recognition on the pen operation data. The handwriting recognition control unit 136 also converts the handwriting-recognized character string candidates into linguistically likely language character string candidates by referring to the handwriting recognition dictionary unit 137 (dictionary data for language conversion in handwriting recognition).

[0032] The character string conversion control unit 138 receives the handwriting-recognized character string and the language character string candidate from the handwriting recognition control unit 136. Then, the character string conversion control unit 138 converts the handwriting-recognized character string and the language character string candidate into a conversion character string candidate by referring to the character string conversion dictionary unit 139 (dictionary data for character string conversion). The conversion character string candidate is a character string that is likely to be generated by including the handwriting-recognized character string or the language character string.

[0033] The predictive conversion control unit 140 receives the handwriting-recognized character string and the language character string candidate from the handwriting recognition control unit 136. The predictive conversion control unit 140 also receives the conversion character string candidate from the character string conversion control unit 138. Then, the predictive conversion control unit 140 converts each of the handwriting-recognized character string, the language character string candidate, and the conversion character string candidate into a predicted character string candidate with reference to the predictive conversion dictionary unit 141 (dictionary data for predictive conversion). The predictive conversion character string is a character string that is likely to be generated by including the handwriting-recognized character string, the language character string, or the conversion character string.

[0034] The operation command recognition control unit 142 receives the handwriting recognition character string and the language character string candidates from the handwriting recognition control unit 136. The operation command recognition control unit 142 also receives the conversion character string candidates from the character string conversion control unit 138. Then, the operation command recognition control unit 142 transmits an operation command conversion request to the operation command definition unit 143 for each of the handwriting recognition character string, the language character string candidate, and the conversion character string candidate, and receives operation command candidates from the operation command definition unit 143.

[0035] If the operation command conversion request received from the operation command recognition control unit 142 partially matches the operation command definition, the operation command definition unit 143 transmits operation command candidates to the operation command recognition control unit 142 .

[0036] Handwritten signature data storage unit 147 stores handwritten signature data. The format of the handwritten signature data depends on the algorithm used by handwritten signature authentication control unit 146 to authenticate the handwritten signature.

[0037] The handwritten signature authentication control unit 146 authenticates the user based on the handwritten signature data stored in the handwritten signature data storage unit 147. Various algorithms have been devised for authenticating users based on handwritten signature data, but this embodiment uses a technology that can recognize the user with a recognition rate that is practically acceptable. For example, the handwritten signature authentication control unit 146 compares the feature vector of the handwritten signature data stored in the handwritten signature data storage unit 147 with the feature vector of the signature data handwritten and input by the user when signing in, and determines that authentication is successful if the degree of match between the two is equal to or greater than a predetermined threshold, and determines that authentication is unsuccessful if the degree of match between the two is less than the predetermined threshold. The handwritten signature authentication control unit 146 also stores the user authentication result.

[0038] 3, the pen 10 includes a pen event transmission unit 11. The pen event transmission unit 11 assigns a pen ID to event data of pen-up, pen-down, and pen coordinates, and transmits the event data to the handwriting input device 100.

[0039] (An example of a form displayed on the display 120) Fig. 4 is a diagram showing an example (first example) of a form displayed on the display 120 of the handwriting input device 100 according to the first embodiment. Fig. 5 is a diagram showing an example (second example) of a form displayed on the display 120 of the handwriting input device 100 according to the first embodiment.

[0040] A form 400 shown in FIG. 4 and a form 400-2 shown in FIG. 5 are examples of forms that are displayed on the display 120 of the handwriting input device 100, and the user can freely change the layout.

[0041] Form 400 and form 400-2 are configured with multiple input fields 401 arranged in a matrix. An input field is a grid-like area displayed on the screen where a user enters handwritten input. As an example, the input field 401 may be a rectangular area separated by two horizontal lines and two vertical lines, as shown in FIG. 4. The height direction of the input field is the vertical direction of the input field when the user faces the input field. The height size of the input field is the distance from the bottom to the top of the input field in the vertical direction when the user faces the input field. Form 400 and form 400-2 allow the user to freely adjust the height and width of each input field 401. For example, in form 400, each input field 401 has a horizontally long rectangular shape, which can be adjusted by the user. In form 400-2, each input field 401 has an approximately square shape, which can be adjusted by the user.

[0042] The handwriting input device 100 according to the first embodiment allows a user U to input a handwritten character string by hand with a pen 10 into each input field 401 of forms 400 and 400-2 displayed on a display 120. The handwriting input device 100 according to the first embodiment can convert the handwritten character string input into the input field 401 into character data by performing character recognition.

[0043] Furthermore, the handwriting input device 100 according to the first embodiment can replace the handwritten character string with character data obtained by converting the handwritten character string and display the handwritten character string in the handwritten input field 401. At this time, the handwriting input device 100 according to the first embodiment can display the character data in the input field 401 in a display format (for example, left justified, right justified, centered, top justified, bottom justified, etc.) according to attribute information previously set for the input field 401.

[0044] (Example of character data displayed on the display 120) FIG. 6 is a diagram showing an example of display of character data for a form displayed on the display 120 provided in the handwriting input device 100 according to the first embodiment.

[0045] In the example shown in Figure 6, the text data "Disc brake failure" is displayed in the input field 401 (the "Content" field of the "Summary" item) of the report 400 displayed on the display 120, indicating the location of the failure discovered during inspection.

[0046] Also, in the example shown in Figure 6, the character data "sv-1" representing the part number of the faulty part is displayed in the input field 401 (the "Notes" column of the "Summary" item) of the form 400 displayed on the display 120.

[0047] These pieces of character data "disc brake failure" and "sv-1" are obtained by the handwriting input device 100 performing character recognition on the handwritten character string input by handwriting into the input field 401 with the pen 10.

[0048] (Overview of string conversion methods) An outline of the character string conversion method by the handwriting input device 100 according to the first embodiment will be described below with reference to Fig. 7 to Fig. 10. Fig. 7 to Fig. 10 are diagrams for explaining an outline of the character string conversion method by the handwriting input device 100 according to the first embodiment.

[0049] 7, a handwritten character string "sv-1" is handwritten by a user U using the pen 10 into an input field 401 of a form 400, and the handwritten character string "sv-1" is displayed in the input field 401. The handwritten input of such a handwritten character string is realized by the user U pressing the tip of the pen 10 against the display 120 and continuously moving the tip of the pen 10.

[0050] When the handwritten character string "sv-1" is input in this manner, the handwriting input device 100 first identifies a rectangular area 401A that surrounds the handwritten character string "sv-1" as shown in FIG. 7, and performs character recognition on the rectangular area 401A.

[0051] Furthermore, as shown in FIG. 8, the handwriting input device 100 specifies, for each character in the handwritten character string "sv-1", a rectangular area 401B surrounding the character.

[0052] Next, the handwriting input device 100 determines, for each character in the handwritten character string "sv-1," whether the character is a predetermined character whose uppercase and lowercase letters are similar, based on the result of character recognition. Similar uppercase and lowercase characters mean that the shapes of the uppercase and lowercase characters are similar. Examples include "S" and "s," "a" and "a," and "o" and "o." For example, the handwriting input device 100 determines whether the recognized character is a predetermined character whose uppercase and lowercase letters are similar, by referring to a table showing a list of predetermined characters. The table showing the list of predetermined characters is stored in the handwriting recognition dictionary unit 137. Note that the table may not be stored in the handwriting recognition dictionary unit 137, but may also be stored in the character string conversion dictionary unit 139 in the handwriting input device 100 or in a memory unit in the handwriting input device 100. The table showing the list of predetermined characters includes, for example, "S," "V," "C," "W," "X," "Z," "a," "tsu," "o," etc.

[0053] For example, in the example shown in FIG. 8, the handwriting input device 100 determines that the character "s" and the character "v" are predetermined characters whose uppercase and lowercase characters are similar.

[0054] Then, for characters that are determined to be predetermined characters in which uppercase and lowercase characters are similar, the handwriting input device 100 performs a predetermined determination process to determine whether the character is an uppercase or lowercase character.

[0055] Specifically, as shown in Fig. 9, the handwriting input device 100 calculates the ratio between the height H1 of the input field 401 and the height H2 of a predetermined character. The height of a handwritten character is the direction in which the handwritten character faces vertically when the user faces the handwritten character. The height of a handwritten character is the distance from the bottom to the top of the handwritten character in the direction in which the handwritten character faces vertically when the user faces the handwritten character.

[0056] Then, the handwriting input device 100 determines that the handwritten character is a lowercase letter if the calculated ratio is equal to or less than a predetermined threshold (for example, 40%), and determines that the handwritten character is an uppercase letter if the calculated ratio is greater than the predetermined threshold. A handwritten character refers to one character in a string of characters handwritten by a user. A handwritten character included in a handwritten string of characters is a handwritten character that is in the string of characters handwritten by a user. Examples include "s" and "v" handwritten by a user.

[0057] Next, as shown in FIG. 10, the handwriting input device 100 replaces the handwritten character string "sv-1" with the character data "sv-1" obtained by character recognition and displays the character data "sv-1" in the input field 401, replacing the handwritten character string "sv-1" displayed in the input field 401.

[0058] Here, for characters determined to be uppercase, the handwriting input device 100 displays character data of the uppercase letters in the input field 401. Furthermore, for characters determined to be lowercase, the handwriting input device 100 displays character data of the lowercase letters in the input field 401. For example, in the example shown in FIG. 10, the characters "s" and "v" are determined to be lowercase, and therefore the character data of the lowercase letters is displayed in the input field 401.

[0059] Note that, for characters that are determined not to be predetermined characters in which uppercase and lowercase letters are similar, the handwriting input device 100 does not distinguish between uppercase and lowercase letters and displays the character data obtained by character recognition as is in the input field 401. For example, in the example shown in Fig. 10, the character "-" and the character "1" are determined not to be predetermined characters in which uppercase and lowercase letters are similar, and therefore the character data obtained by character recognition is displayed as is in the input field 401.

[0060] In this way, when a handwritten string handwritten into the input field 401 contains a specified character whose uppercase and lowercase characters are similar, the handwriting input device 100 according to the first embodiment can recognize with high accuracy whether the specified character is an uppercase or lowercase character based on the ratio between the height of the input field 401 and the height of the specified character.

[0061] Therefore, the handwriting input device 100 according to the first embodiment can prevent, for example, the handwritten character string "sv-1" input by hand into the input field 401 from being mistakenly recognized as "SV-1," "Sv-1," "sV-1," etc.

[0062] In this example, the handwriting input device 100 inputs character data obtained by character recognition into the input field 401, but this is not limited thereto. For example, the handwriting input device 100 may display character data obtained by character recognition on the display 120 as selectable candidates, and when the character data is selected by the user, the character data may be input into the input field 401.

[0063] (An example of the string conversion process) FIG. 11 is a flowchart showing an example of the procedure of the character string conversion process by the handwriting input device 100 according to the first embodiment.

[0064] First, the user U handwrites a character string into an input field of a form or the like displayed on the display 120. In response, the handwriting input unit 131 of the handwriting input device 100 accepts the character string handwritten and input by the user (step S501).

[0065] Next, the handwriting input display control unit 133 acquires the size in the height direction of the input field into which the handwriting input was made in step S501 (step S502).

[0066] Next, the handwritten input display control unit 133 acquires the size in the height direction of each handwritten character included in the handwritten character string handwritten input in step S501 (step S503).

[0067] Next, the handwriting recognition control unit 136 performs character recognition on the handwritten character string handwritten and input in step S501 while referring to the handwriting recognition dictionary unit 137, thereby converting the handwritten character string into character data (step S504).

[0068] Next, the handwriting input display control unit 133 determines whether or not the character data obtained in step S504 includes predetermined characters whose uppercase and lowercase characters are similar (step S505).

[0069] If it is determined in step S505 that the predetermined character is not included (step S505: NO), the handwriting input display control unit 133 confirms the character data obtained in step S504 as is (step S511), and displays the character data confirmed in step S511 as a selectable candidate on the display 120 (step S512). After that, the handwriting input device 100 ends the series of processes shown in FIG.

[0070] If it is determined in step S505 that a predetermined character is included (step S505: YES), the handwriting input display control unit 133 selects one predetermined character (step S506).Then, the handwriting input display control unit 133 determines whether the ratio between the height of the input field acquired in step S502 and the height of the predetermined character selected in step S506 acquired in step S503 is equal to or less than a predetermined threshold (step S507).

[0071] If it is determined in step S507 that the value is equal to or less than the predetermined threshold value (step S507: YES), the handwriting input display control unit 133 determines that the predetermined character selected in step S506 is a lowercase letter (step S508), and proceeds to step S510.

[0072] If it is determined in step S507 that the value is not equal to or less than the predetermined threshold (step S507: NO), the handwriting input display control unit 133 determines that the predetermined character selected in step S506 is an uppercase letter (step S509), and proceeds to step S510.

[0073] In step S510, the handwriting input display control unit 133 determines whether or not all predetermined characters included in the character data obtained in step S504 have been determined (step S510).

[0074] In step S510, if it is determined that all the predetermined characters have not been determined (step S510: NO), the handwriting input display control unit 133 returns the process to step S506.

[0075] If it is determined in step S510 that all the predetermined characters have been determined (step S510: YES), the handwriting input display control unit 133 determines the character data obtained in step S504 by reflecting the determination result of whether each predetermined character is an uppercase or lowercase character (step S511), and displays the character data determined in step S511 on the display 120 as a selectable candidate (step S512). After that, the handwriting input device 100 ends the series of processes shown in Fig. 11. Note that the processes of steps S502 and S503 may be performed before step S507 is performed. As an example, the processes of steps S502 and S503 may be performed after a predetermined character is selected in step S506.

[0076] Second Embodiment (An example of the functional configuration of the handwriting input device 100-2) 12 is a diagram showing an example of the functional configuration of a handwriting input device 100-2 according to the second embodiment. Hereinafter, regarding the handwriting input device 100-2 according to the second embodiment, changes from the handwriting input device 100 according to the first embodiment will be described.

[0077] The functional configuration of the handwriting input device 100-2 shown in FIG. 12 differs from the functional configuration of the handwriting input device 100 shown in FIG.

[0078] The analysis unit 144 analyzes the result of the determination made by the device itself as to whether a character is uppercase or lowercase. For example, the analysis unit 144 acquires the results of the previous determinations made by the device itself as to whether a character is uppercase or lowercase (for example, 10 times) from a memory or the like included in the handwriting input device 100-2.

[0079] The display accepting unit 145 displays the analysis results by the analysis unit 144 on the display 120 (display unit), and accepts changes to the setting conditions of the device (in this embodiment, a predetermined threshold for determining whether a character is uppercase or lowercase) based on the analysis results by the analysis unit 144.

[0080] (Example of procedure for changing setting conditions) FIG. 13 is a flowchart showing an example of the procedure of the setting condition change process by the handwriting input device 100-2 according to the second embodiment.

[0081] First, the handwriting input device 100-2 determines whether the user has been authenticated by the device itself (step S601).

[0082] In step S601, if it is determined that the user has not been authenticated by the handwriting input device 100-2 (step S601: NO), the handwriting input device 100-2 ends the series of processes shown in Fig. 13. As a result, since it is assumed that the handwriting input device 100-2 is used in common by a plurality of users, the handwriting input device 100-2 can prevent the setting conditions from being changed by an unauthenticated user.

[0083] In step S601, if it is determined that the user has been authenticated by the own device (step S601: YES), the analysis unit 144 checks the number of judgments for a specific input field (step S602). Then, the handwriting input device 100-2 determines whether the number of judgments checked in step S602 is 10 or more (step S603).

[0084] In step S603, if it is determined that the number of determinations is not 10 or more (step S603: NO), the handwriting input device 100-2 ends the series of processes shown in FIG.

[0085] In step S603, if it is determined that the number of determinations is 10 or more (step S603: YES), the display receiving unit 145 displays a display screen (see FIG. 14) showing past determination results on the display 120 (step S603).

[0086] Next, the display receiving unit 145 determines whether the past determination result displayed in step S603 is the result intended by the user (step S603). For example, the display screen displayed in step S603 allows the user to select whether the result is the result intended by the user. In this case, the display receiving unit 145 determines whether the past determination result is the result intended by the user in accordance with the user's selection.

[0087] In step S605, if it is determined that the previous determination result is the result intended by the user (step S605: YES), the handwriting input device 100-2 ends the series of processes shown in FIG.

[0088] In step S605, if it is determined that the previous determination result is not the result intended by the user (step S605: NO), the handwriting input device 100-2 changes the setting condition (in this embodiment, a predetermined threshold for determining whether the character is an uppercase or lowercase) for the next time onward (step S606). After that, the handwriting input device 100-2 ends the series of processes shown in FIG.

[0089] (An example of a display screen displayed by the display receiving unit 145) FIG. 14 is a diagram showing an example of a display screen displayed by the display accepting unit 145 included in the handwriting input device 100-2 according to the second embodiment.

[0090] 14 is an example of a display screen displayed on the display 120 by the display receiving unit 145. On the display screen 420, the results of the last 10 judgments as to whether a character is uppercase or lowercase are displayed in a list together with the handwritten date and time and the corresponding input field.

[0091] Additionally, on the display screen 420, as an example of the notification to the user, the following string is displayed: "The results of the last 10 judgments regarding whether a character is uppercase or lowercase will be displayed. Are the judgment results the results the user intended?"

[0092] Also displayed on the display screen 420 are a "Yes" button and a "No" button that can accept a selection from the user.

[0093] For example, if the user selects the "Yes" button, the judgment result displayed on the display screen 420 is the judgment result intended by the user, and therefore the handwriting input device 100-2 does not change the setting conditions for determining whether the character is uppercase or lowercase.

[0094] Also, if the user selects the "No" button, the judgment result displayed on the display screen 420 is not the judgment result intended by the user, so the handwriting input device 100-2 changes the setting conditions for determining whether the character is uppercase or lowercase.

[0095] For example, the handwriting input device 100-2 reduces the predetermined threshold value for determining whether a predetermined character is an uppercase or lowercase from the current value (e.g., 40%) to a value lower than the current value (e.g., 30%). This enables the handwriting input device 100-2 to determine that a handwritten character input in smaller size is a lowercase character, thereby achieving the determination result intended by the user.

[0096] The method for changing the setting conditions is not limited to this. For example, when the "No" button is selected by the user, an input field for the setting conditions (e.g., threshold value) may be displayed on the screen, and the user may directly input a changed value for the setting conditions (e.g., threshold value). In addition, to further improve the accuracy of learning, the user may provide feedback on the judgment results for each round (whether the judgment of uppercase or lowercase letters was more appropriate). As an example, correction options may be displayed in each row of a table showing the judgment results for each round, and the user may input the correction details.

[0097] The best mode for carrying out the present invention has been described above using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0098] For example, in this embodiment, an electronic whiteboard is used as an example of the "handwriting input device," but the present invention is not limited to this, and other devices may be used as the "handwriting input device" as long as they are capable of at least handwriting input. For example, the "handwriting input device" may be an output device such as a PJ (Projector), digital signage, a HUD (Head Up Display) device, industrial machinery, an imaging device, a sound collection device, medical equipment, network appliances, a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, a desktop PC, or the like.

[0099] Furthermore, for example, the handwriting input devices 100, 100-2 and a server may constitute a "handwriting input system," and part of the processing that is performed by the handwriting input devices 100, 100-2 in the present embodiment may be performed by the server. For example, the handwriting input devices 100, 100-2 may transmit a handwritten character string to the server, and have the server recognize the handwritten characters. At this time, the server may perform processing to determine whether each character included in the handwritten character string is an uppercase letter or a lowercase letter. Then, the handwriting input devices 100, 100-2 may obtain character data, which is the result of character recognition of the handwritten characters, from the server and display the character data.

[0100] Furthermore, in this embodiment, the coordinates of the pen tip of the pen 10 are detected by the touch sensor 116, but the present invention is not limited to this. For example, the coordinates of the pen tip of the pen 10 may be detected by ultrasonic waves. In this case, for example, the pen 10 emits light and emits ultrasonic waves, and the handwriting input device 100 calculates the distance based on the arrival time of the ultrasonic waves from the pen 10. Then, the handwriting input device 100 can identify the coordinates of the pen tip of the pen 10 based on the direction and distance.

[0101] Furthermore, in this embodiment, the pen 10 is used as an example of the "input means," but the "input means" is not limited to this, and may be, for example, a human finger, a rod-shaped member, etc., as long as it is capable of at least handwritten input.

[0102] 3 and 12 are divided into main functions to facilitate understanding of the processing by the handwriting input device 100. The present invention is not limited by the division method or names of the processing units. The processing of the handwriting input devices 100 and 100-2 can be divided into more processing units depending on the processing content. Furthermore, the processing can be divided so that one processing unit includes more processes.

[0103] Furthermore, each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0104] Handwriting input display control unit 133 is an example of a "display control means," and handwriting recognition control unit 136 is an example of a "conversion means." [Explanation of symbols]

[0105] 10 pens 100,100-2 Handwriting input device 120 Display 131 Handwriting input section 132 Display section 133 Handwriting input display control unit 134 Candidate display timer control section 135 Handwriting input storage unit 136 Handwriting recognition control unit 137 Handwriting Recognition Dictionary 138 String conversion control section 139 String Conversion Dictionary 140 Predictive conversion control unit 141 Predictive conversion dictionary section 142 Operation command recognition control unit 143 Operation command definition section 144 Analysis Department 145 Display Reception Department 146 Handwritten signature authentication control unit 147 and handwritten signature data storage unit 400,400-2 Report 401 Input field 401A,401B Rectangular area 420 display screen H1, H2 Height size U User [Prior art documents] [Patent documents]

[0106] [Patent Document 1] Japanese Patent Publication No. 2020-64625

Claims

1. A handwriting input device capable of handwriting input, a conversion means for converting the handwritten characters input by hand and displayed in a predetermined input field displayed on a screen into character data by performing character recognition; a display control means for displaying the character data converted by the conversion means in the predetermined input field in place of the handwritten characters; a first determination means for determining whether a predetermined character stored in advance as a character having similar uppercase and lowercase characters is included in the character data; a second determination means for determining whether a handwritten character is an uppercase letter or a lowercase letter based on a height size of the input field and a height size of the handwritten character when the character data includes the predetermined character that is stored in advance as a character whose uppercase and lowercase letters are similar; and The display control means displays the handwritten characters in the predetermined input field as the character data in uppercase or lowercase depending on the determination result of the second determination means. A handwriting input device characterized by:

2. a first acquisition means for acquiring a size in a height direction of the predetermined input field; a second acquiring means for acquiring a size of the handwritten character in a height direction; The handwriting input device according to claim 1 , further comprising:

3. The second determination means Whether the handwritten characters are uppercase or lowercase is determined based on the ratio between the height of the predetermined input field and the height of the handwritten characters.

3. The handwriting input device according to claim 2.

4. The second determination means If the ratio is equal to or less than a predetermined threshold, the handwritten character is determined to be a lowercase letter; If the ratio is greater than a predetermined threshold, the handwritten character is determined to be an uppercase letter.

4. The handwriting input device according to claim 3.

5. an analysis unit that analyzes the determination result of the device itself; a display receiving unit that displays the analysis result by the analysis unit on a display unit and receives changes to setting conditions in the device based on the analysis result; 5. The handwriting input device according to claim 1, further comprising:

6. A handwriting input system including a handwriting input device capable of handwriting input and a server, The server a conversion means for converting the handwritten characters input by hand and displayed in a predetermined input field displayed on a screen into character data by performing character recognition; a display control means for displaying the character data converted by the conversion means in the predetermined input field in place of the handwritten characters; a first determination means for determining whether a predetermined character stored in advance as a character having similar uppercase and lowercase characters is included in the character data; a second determination means for determining whether a handwritten character is an uppercase letter or a lowercase letter based on a height size of the input field and a height size of the handwritten character when the character data includes the predetermined character that is stored in advance as a character whose uppercase and lowercase letters are similar; and The display control means displays the handwritten characters in the predetermined input field as the character data in uppercase or lowercase depending on the determination result of the second determination means. A handwriting input system characterized by:

7. A program for a handwriting input device capable of handwriting input, Computer, a conversion means for converting the handwritten characters input by hand and displayed in a predetermined input field displayed on a screen into character data by character recognition; a display control means for displaying the character data converted by the conversion means in the predetermined input field in place of the handwritten characters; a first determination means for determining whether a predetermined character stored in advance as a character having similar uppercase and lowercase characters is included in the character data; , and a second determination means for determining whether a handwritten character is an uppercase letter or a lowercase letter based on the height of the input field and the height of the handwritten character when the character data includes the predetermined character that is stored in advance as a character whose uppercase and lowercase letters are similar; It functions as The display control means displays the handwritten characters in the predetermined input field as the character data in uppercase or lowercase depending on the determination result of the second determination means. A program characterized by:

8. A handwriting input method using a handwriting input device capable of handwriting input, comprising: a conversion step of converting the handwritten characters input by hand and displayed in a predetermined input field displayed on a screen into character data by performing character recognition; a display control step of displaying the character data converted by the conversion step in the predetermined input field in place of the handwritten characters; a first determination step of determining whether a predetermined character stored in advance as a character whose uppercase and lowercase characters are similar is included in the character data; a second determination step of determining whether the handwritten character is an uppercase letter or a lowercase letter based on the height of the input field and the height of the handwritten character when the character data includes the predetermined character that is pre-stored as a character whose uppercase and lowercase letters are similar; Including, The display control step displays the handwritten characters as uppercase or lowercase character data in the predetermined input field according to the determination result of the second determination step. A handwriting input method comprising:

Images