Information processing apparatus and control method

By dividing and classifying handwritten strokes into character elements and adjusting stroke shapes based on brush and pressure characteristics, the device effectively displays clear and aesthetically pleasing characters while preserving the quality of handwriting.

JP2024159237AActive Publication Date: 2024-11-08LENOVO IRELAND INTERNATIONAL LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023075091
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08
Estimated Expiration
2043-04-28

AI Technical Summary

Technical Problem

Conventional information processing devices struggle to display clear characters while maintaining the quality of handwriting, particularly for complex characters like kanji, due to difficulties in adjusting ink thickness and preserving the aspect ratio and size of handwritten strokes on hard and slippery surfaces.

Method used

The device employs a division processing unit to divide handwritten strokes at corners, a classification processing unit to classify partial strokes into character elements using a classification model, and a rendering processing unit to adjust stroke shapes based on brush information and pen pressure characteristics, ensuring accurate classification and rendering of characters.

Benefits of technology

This approach allows for the display of beautiful characters, especially kanji, while maintaining the quality of handwriting by accurately adjusting stroke shapes and thickness, thus preserving the freedom of handwriting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024159237000001_ABST
    Figure 2024159237000001_ABST
Patent Text Reader

Abstract

To display beautiful characters while maintaining the taste of handwriting in handwriting input.SOLUTION: An information processing apparatus comprises: a division processing unit that divides an input handwriting stroke at a corner portion to create partial strokes obtained through the division; a classification processing unit that classifies each of the partial strokes obtained through the division performed by the division processing unit into any one of a plurality of character elements being basic patterns constituting a Chinese character; and a rendering processing unit that adjusts the shape of each of the partial strokes on the basis of brush information and handwriting pressure characteristics corresponding to the character element into which the partial stroke is classified by the classification processing unit, and displays the partial strokes on a display. The classification processing unit classifies each of the partial strokes on the basis of an allowable range of a stroke angle being an angle indicating a drawing direction of each of the partial strokes in the character element and the connection relationship between the partial strokes, by using filtering processing of removing classification into an inadequate character element.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] In recent years, information processing devices such as tablet terminals that allow handwritten character input have become widespread (see, for example, Patent Document 1). In such conventional information processing devices, a technique is known that recognizes handwritten input characters and converts them into a specified font. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-43851 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional information processing device, it is possible to display beautiful characters by converting handwritten input characters into a predetermined font. However, in the conventional information processing device, by replacing characters with a predetermined font, the user's handwriting is lost, and the freedom of handwriting, such as the aspect ratio of the characters and the size of the characters, is lost, and the goodness of handwriting is lost. On the other hand, in the conventional information processing device, it is also possible to adjust the rendering thickness of the drawing ink based on the pen pressure and display characters drawn with a pen. However, in such cases, drawings that require delicate adjustment of the ink thickness, such as the tome, hane, and harai, which are often necessary especially for complex characters such as kanji, are very difficult on tablet terminals, which have a hard and slippery surface compared to paper. In other words, in the conventional information processing device, it was difficult to display beautiful characters while maintaining the goodness of handwriting.

[0005] The present invention has been made to solve the above problems, and its object is to provide an information processing device and control method that can display beautiful characters, particularly kanji, while maintaining the quality of handwriting when inputting handwritten characters. [Means for solving the problem]

[0006] In order to solve the above problems, one aspect of the present invention includes a segmentation processing unit that divides an input handwritten stroke at its corners to generate divided partial strokes, a classification processing unit that classifies the partial strokes divided by the segmentation processing unit into one of a plurality of character elements which are basic patterns constituting a Kanji character, and a rendering processing unit that adjusts the shape of the partial stroke based on brush information and pen pressure characteristics corresponding to the character element classified by the classification processing unit, and displays the partial stroke on a display unit, wherein the classification processing unit is an information processing device that classifies the partial strokes using a filtering process that excludes classification into inappropriate character elements based on an allowable range of stroke angles, which is an angle that indicates the drawing direction of the partial stroke in the character element, and on the connection relationship before and after the partial stroke.

[0007] In addition, one aspect of the present invention is that in the above-mentioned information processing device, a filter information storage unit is provided that stores the character elements in association with connection feasibility information indicating whether the partial stroke can be connected to the previous or next stroke, and whether the partial stroke can be used alone, for each range of stroke angles, and the classification processing unit may perform the filtering process based on the connection feasibility information associated with the character elements stored in the filter information storage unit.

[0008] Furthermore, in one aspect of the present invention, in the above-mentioned information processing device, the classification processing unit may be a classification model generated by executing a learning process on learning data in which the partial strokes of a pre-specified character handwritten by a user correspond to the character elements, and the classification processing unit may classify the partial strokes into the character elements by combining a shape classification process that classifies shapes of the partial strokes based on the classification model that classifies the character elements from the partial strokes and the filtering process.

[0009] In another aspect of the present invention, in the above-mentioned information processing device, the classification processing unit extracts a plurality of candidates for the character element by the shape classification process based on the classification model, removes inappropriate character elements from the plurality of candidates by the filtering process, and classifies the partial stroke into the character element that is the highest confidence level among the remaining candidates and has a confidence level equal to or above a threshold.

[0010] In addition, one aspect of the present invention is an information processing device as described above, which includes a brush information storage unit that stores the character elements in correspondence with brush information including the size, aspect ratio, and angle of the brush used, and a pen pressure characteristics storage unit that stores the character elements in correspondence with a pressure curve that indicates the relationship between a stroke position in the character element and pen pressure, and the rendering processing unit may obtain the brush information corresponding to the classified character elements from the brush information storage unit, obtain the pressure curve corresponding to the classified character element from the pen pressure characteristics storage unit, and adjust a shape of the partial stroke based on the obtained brush information and pressure curve.

[0011] In addition, one aspect of the present invention is an information processing device as described above, which includes the display unit, a touch sensor unit that detects the contact and contact position of an operating medium on a detection surface on a screen of the display unit, and an input processing unit that detects the input of the handwritten stroke based on the contact position of the operating medium detected by the touch sensor unit, wherein the input processing unit detects the input of the handwritten stroke and displays a movement trajectory of the contact position of the operating medium on the display unit as the input handwritten stroke, and the rendering processing unit replaces the input handwritten stroke with the handwritten stroke whose shape has been adjusted and displays it on the display unit.

[0012] Moreover, one aspect of the present invention is a control method for an information processing device, the control method including: a division processing step in which a division processing unit divides an input handwritten stroke at corners to generate divided partial strokes; a classification processing step in which a classification processing unit classifies the partial strokes divided by the division processing unit into any of a plurality of character elements which are basic patterns constituting a Kanji character; and a rendering processing step in which a rendering processing unit adjusts a shape of the partial stroke based on brush information and pen pressure characteristics corresponding to the character element classified by the classification processing unit, and displays the partial stroke on a display unit, wherein in the classification processing step, the classification processing unit classifies the partial strokes using a filtering process that excludes classification into inappropriate character elements based on an allowable range of stroke angles, which are angles that indicate the drawing direction of the partial stroke in the character element, and on the connection relationship before and after the partial stroke. Effect of the Invention

[0013] According to the above-described aspects of the present invention, in handwritten input, it is possible to display beautiful characters (especially kanji characters) while maintaining the quality of the handwritten text. [Brief description of the drawings]

[0014] [Figure 1] 1 is an external view showing an example of a tablet terminal and an information processing system according to an embodiment of the present invention. [Diagram 2] 1 is a diagram illustrating an example of a main hardware configuration of a tablet terminal and an information processing system according to an embodiment of the present invention. [Diagram 3] 1 is a block diagram showing an example of a functional configuration of a tablet terminal and an information processing system according to an embodiment of the present invention. [Figure 4] 5A and 5B are diagrams illustrating an example of data in a brush information storage unit according to the embodiment. [Diagram 5] 3A and 3B are diagrams illustrating examples of character elements according to the present embodiment. [Figure 6] 5A and 5B are diagrams illustrating an example of data in a writing pressure characteristics storage unit according to the embodiment. [Figure 7] 5 is a diagram illustrating an example of data in a filter information storage unit in the present embodiment. FIG. [Figure 8] FIG. 4 is a diagram showing an example of a stroke angle in the present embodiment. [Figure 9] FIG. 2 is a diagram showing an overview of handwriting input processing of the tablet terminal according to the embodiment. [Figure 10] 10 is a flowchart illustrating an example of a handwriting input process of the tablet terminal according to the present embodiment. [Figure 11] 10 is a flowchart showing details of classification processing of a tablet terminal according to the present embodiment. [Figure 12] 10 is a flowchart showing an example of a learning process of the tablet terminal according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An information processing apparatus and a control method according to an embodiment of the present invention will be described below with reference to the drawings.

[0016] FIG. 1 is an external view showing an example of a tablet terminal 1 and an information processing system 100 according to the present embodiment. 1, the information processing system 100 includes a tablet terminal 1 and a pen 30. In this embodiment, the tablet terminal 1 will be described as an example of an information processing device.

[0017] The tablet terminal 1 has a touch screen 20 installed on one main surface of a housing CS1, and an application program such as a memo pad or drawing program is executed using a pen 30. The tablet terminal 1 is capable of handwritten input using the pen 30. Note that the pen 30 can be set to various types of brushes when inputting handwritten text.

[0018] The touch screen 20 includes a display unit 21 and a touch sensor unit 22, and the display unit 21 displays various types of information on a display screen DF. The touch sensor unit 22 is disposed over the display unit 21, and detects when the pen 30 touches the display screen DF of the display unit 21, and detects the touch position of the pen 30. The touch screen 20, the display unit 21, and the touch sensor unit 22 will be described in detail later.

[0019] Next, the main hardware configuration of the tablet terminal 1 and the information processing system 100 will be described with reference to FIG. FIG. 2 is a diagram showing an example of the main hardware configuration of the tablet terminal 1 and the information processing system 100 according to this embodiment.

[0020] 2, the information processing system 100 includes a tablet terminal 1 and a pen 30. The tablet terminal 1 also includes a processor 11, a main memory 12, a flash memory 13, a touch screen 20, a peripheral device 23, an audio system 24, a microphone 25, a speaker 26, a baseband chip 27, a wireless unit 28, and a wireless communication unit 29.

[0021] The processor 11 is, for example, an application processor including a CPU (Central Processing Unit). The processor 11 controls the entire tablet terminal 1.

[0022] The main memory 12 is a writable memory used as a read area for the execution program of the processor 11 or as a work area for writing processing data for the execution program. The main memory 12 is composed of, for example, a plurality of DRAM (Dynamic Random Access Memory) chips. The execution program includes an OS (Operating System), various device drivers for operating the hardware of peripheral devices, various services / utilities, application programs (application software), and the like.

[0023] The flash memory 13 is, for example, a flash EEPROM (Electrically Erasable Programmable Read Only Memory), and stores the OS, various drivers, various services / utilities, application programs (hereinafter sometimes referred to as applications), and various data.

[0024] The display unit 21 is, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and displays a display screen based on drawing data (display data) output from the processor 11. The display unit 21 is capable of displaying, for example, the movement trajectory (drawing trajectory) of the pen 30.

[0025] The touch sensor unit 22 detects the position of an operation medium such as the pen 30 on the screen of the display unit 21 (on the display screen DF) and the contact of the pen 30 with the screen. The touch sensor unit 22 detects the contact position of the pen 30 on the screen of the display unit 21.

[0026] The peripheral device 23 is, for example, a Wireless Local Area Network (WLAN) module, a Global Positioning System (GPS) module, and sensors such as an acceleration sensor.

[0027] The audio system 24 is, for example, an audio IC (Integrated Circuit), and inputs, records, plays back, and outputs sound data. For example, a microphone 25 and a speaker 26 are connected to the audio system 24. For example, the audio system 24 outputs sound data collected by the microphone 25 to the processor 11 or the baseband chip 27. In addition, the audio system 24 converts sound data acquired from the processor 11 or the baseband chip 27 into a sound signal, and outputs the sound signal to the speaker 26.

[0028] The microphone 25 picks up sounds around the tablet terminal 1. For example, the microphone 25 picks up sounds such as the user's voice when audio integration with another terminal is performed. The speaker 26 outputs various sounds to the outside of the tablet terminal 1. For example, the speaker 26 outputs (emits) sounds received from other terminals when performing audio integration with other terminals.

[0029] The baseband chip 27 is a dedicated IC that controls wireless communication such as 4G (fourth generation mobile communication system) and 5G (fourth generation mobile communication system). The baseband chip 27 outputs, for example, audio data received using the wireless unit 28 to the speaker 26 via the audio system 24. The baseband chip 27 also acquires, for example, audio data collected from the microphone 25 via the audio system 24, and outputs the data by the mobile communication system using the wireless unit 28. The baseband chip 27 also communicates input / output data of data communication by the mobile communication system with the processor 11.

[0030] The radio unit 28 is a wireless communication device including an antenna for performing wireless communication in a mobile communication system. The wireless communication unit 29 is, for example, a Bluetooth (registered trademark) module, and performs wireless communication with the pen 30. The wireless communication unit 29 receives, for example, sensor information detected by the pen 30 (contact pressure, angle of the pen 30, etc.) from the pen 30.

[0031] The pen 30 is a pen-shaped operating medium, such as a touch pen, a stylus pen, etc. The pen 30 is capable of communicating with the tablet terminal 1 by wireless communication such as Bluetooth (registered trademark). The pen 30 includes a wireless communication unit 31, a sensor unit 32, a memory 33, and an MCU 34.

[0032] The wireless communication unit 31 is, for example, a Bluetooth (registered trademark) module, and performs wireless communication between the tablet terminal 1 and the pen 30. The wireless communication unit 31 transmits, for example, sensor information detected by the sensor unit 32 to the tablet terminal 1. The sensor unit 32 detects sensor information such as the contact pressure (writing pressure) of the pen 30, the angle of the pen 30, and the like.

[0033] The memory 33 is composed of, for example, a RAM, and stores part of the control program for the pen 30 and processing data for the MCU 34. Note that the memory 33 may include a flash memory, a ROM, and the like in addition to the RAM.

[0034] The MCU (Micro Controller Unit) 34 includes a CPU, memories such as ROM and RAM, and I / O related components, and generally controls the pen 30. The MCU 34 controls data communication with the tablet terminal 1 via the wireless communication unit 31. The MCU 34 transmits, for example, sensor information detected by the sensor unit 32 to the tablet terminal 1 via the wireless communication unit 31.

[0035] Next, the functional configuration of the information processing system 100 according to the present embodiment will be described with reference to FIG. FIG. 3 is a block diagram showing an example of the functional configuration of the tablet terminal 1 and the information processing system 100 according to this embodiment.

[0036] As shown in FIG. 3, the information processing system 100 includes a tablet terminal 1 and a pen 30. The tablet terminal 1 includes a control unit 10, a touch screen 20, and a storage unit 40.

[0037] The touch screen 20 includes a display unit 21 and a touch sensor unit 22 . The touch sensor unit 22 detects the contact and contact position of an operating medium (pen 30) on a detection surface on the screen of the display unit 21. The touch sensor unit 22 detects, for example, the contact position of the pen 30 on the screen of the display unit 21 as a pen input. The touch sensor unit 22 detects, for example, contact position information indicating two-dimensional coordinates on the display screen DF of the display unit 21 as the contact position of the pen 30. The touch sensor unit 22 outputs the contact position information to the control unit 10.

[0038] The memory unit 40 is a memory unit realized, for example, by the main memory 12 or the flash memory 13, and includes a brush information memory unit 41, a pen pressure characteristic memory unit 42, a CE classification information memory unit 43, a filter information memory unit 44, a handwritten stroke memory unit 45, a partial stroke memory unit 46, and a learning data memory unit 47.

[0039] The brush information storage unit 41 is, for example, a storage unit realized by the main memory 12, and stores brush information corresponding to character elements (CE: Character Elements) which are basic parts (basic patterns constituting a kanji character) obtained by dividing a kanji character. Here, an example of data in the brush information storage unit 41 will be described with reference to FIG. 4.

[0040] FIG. 4 is a diagram showing an example of data stored in the brush information storage unit 41 in this embodiment. As shown in FIG. 4, the brush information storage unit 41 stores a CEID (character element ID), a brush size, an aspect ratio, a standard brush angle, and a standard stroke angle in association with each other.

[0041] CEID is character element identification information that identifies a character element. Brush size indicates the size of the brush. Aspect ratio indicates the aspect ratio of the brush, that is, the ratio of width to height. Standard brush angle indicates the standard (reference) brush angle of the character element, and standard stroke angle indicates the standard (reference) angle of the stroke of the character element.

[0042] 4 shows that the brush size of the character element with CEID "CE001" is "R1" and the aspect ratio is "XX1:YY1". It also shows that the standard brush angle of the character element is "α1" and the standard stroke angle is "β1".

[0043] Now, with reference to FIG. 5, the character elements will be described. Fig. 5 is a diagram showing an example of character elements in this embodiment, in which character elements constituting the Chinese character "eternal" will be described.

[0044] As shown in Fig. 5, the Chinese character "eternity" is decomposed into character elements CE1 to CE8. Character elements CE1 to CE8 include strokes such as a stop, a swing, and a line, and corresponding brush information is defined for each of character elements CE1 to CE8 as shown in Fig. 4 above.

[0045] In this embodiment, a plurality of character elements including the above-mentioned character elements CE1 to CE8, which are determined from various kanji characters, are defined, and rendering (drawing) is performed for each defined character element, thereby achieving beautiful drawing of characters when handwriting inputting kanji characters. It should be noted that "beautiful characters" here refers to characters that are rendered similarly to a preferred font, for example.

[0046] Returning to the explanation of Fig. 3, the writing pressure characteristic storage unit 42 is, for example, a storage unit realized by the main memory 12, and stores a pressure curve (writing pressure characteristic) indicating the relationship between the stroke position and writing pressure in a character element. The writing pressure characteristic storage unit 42 stores, for example, identification information of a character element and the writing pressure characteristic in association with each other. Here, an example of data in the writing pressure characteristic storage unit 42 will be explained with reference to Fig. 6.

[0047] FIG. 6 is a diagram showing an example of data in the writing pressure characteristics storage unit 42 in this embodiment. As shown in FIG. 6, the writing pressure characteristic storage unit 42 stores the CEID and the writing pressure characteristic in association with each other.

[0048] For example, in the example shown in Fig. 6, the pen pressure characteristic corresponding to CEID "CE001" is a pressure curve like waveform W1. Note that the horizontal axis of the graph showing waveform W1 indicates stroke position, and the vertical axis indicates pen pressure (pressure). The pressure curve indicates that the higher the pen pressure, the thicker the stroke line will be when rendered, and the lower the pen pressure, the thinner the stroke line will be when rendered.

[0049] The pen pressure characteristics (waveform W1) corresponding to CEID "CE001" indicates a character element (character element CE1 shown in FIG. 5) in which the stroke line becomes thicker as the stroke position advances and then suddenly thins at the end.

[0050] For example, the pen pressure characteristic corresponding to CEID "CE002" indicates a pressure curve like waveform W2. The pen pressure characteristic (waveform W2) corresponding to CEID "CE002" indicates a character element (character element CE2 shown in FIG. 5) in which the stroke line becomes thin once as the stroke position advances and then thickens again.

[0051] Returning to the description of Fig. 3, the CE classification information storage unit 43 is, for example, a storage unit realized by the main memory 12, and stores information for classifying character elements. The CE classification information storage unit 43 is, for example, a trained model generated by machine learning, and stores a classification model for classifying a partial stroke, which will be described later, into one of a plurality of character elements. The CE classification information storage unit 43 is an example of a model storage unit.

[0052] The filter information storage unit 44 is a storage unit realized by, for example, the main memory 12, and stores filter information for filtering processing when classifying character elements, which will be described later. The filtering processing includes angle filtering processing for restricting stroke angles of character elements, and connection filtering processing for restricting connection relationships. The filter information storage unit 44 stores filter information indicating the allowable range of stroke angles and connection relationships before and after partial strokes. Details of partial strokes will be described later.

[0053] The filter information storage unit 44 stores, for example, character elements and connection / non-connection information indicating whether a partial stroke can be connected to the previous or next partial stroke and whether a partial stroke can be used alone for each range of stroke angles in association with each other. Here, an example of data stored in the filter information storage unit 44 will be described with reference to FIG. 7.

[0054] FIG. 7 is a diagram showing an example of data in the filter information storage unit 44 in this embodiment. As shown in FIG. 7, the filter information storage unit 44 stores the CEID in association with whether or not a partial stroke can be connected to the previous or next partial stroke within each stroke angle range, and whether or not the partial stroke can be used alone.

[0055] Here, "previous connection" indicates whether a partial stroke can be connected before the partial stroke in question, with "YES" indicating that it can be connected and "NO" indicating that it cannot be connected. Also, "successive connection" indicates whether a partial stroke can be connected after the partial stroke in question, with "YES" indicating that it can be connected and "NO" indicating that it cannot be connected. Also, "not connected" indicates whether the partial stroke in question can exist alone, with "YES" indicating that it can exist alone and "NO" indicating that it cannot exist alone.

[0056] As shown in FIG. 8, the stroke angle is the angle of a straight line indicating the start point to the end point of a partial stroke, and is an angle β measured counterclockwise with the positive X-axis as 0 degrees (reference).

[0057] FIG. 8 is a diagram showing an example of a stroke angle in this embodiment. In Fig. 8, the origin of the XY coordinate system is the start point SP of the partial stroke SS, and the angle β in the direction from the start point SP to the end point EP is defined as the stroke angle. In other words, the stroke angle is the angle of a straight line that shows the start point to the end point of the partial stroke. Note that the standard angle of the stroke angle β is set as the standard stroke angle for each character element.

[0058] The stroke angle may be an angle indicating the drawing direction of the partial stroke at the start point of the partial stroke, or an angle indicating the drawing direction of the partial stroke at the end point of the partial stroke.

[0059] Returning to the explanation of Fig. 7, in the example shown in Fig. 7, the character element with CEID "CE001" indicates that when the stroke angle is in the range of "0 degrees <= β< 30 degrees", "Connection before", "Connection after", and "No connection" are "YES", and in other stroke angle ranges, they are all "NO". In this case, it indicates that when the stroke angle of the partial stroke is in the range of "0 degrees <= β< 30 degrees", the character element is permitted, and is excluded in other cases.

[0060] Returning to the explanation of Fig. 3, the handwritten stroke storage unit 45 is, for example, a storage unit realized by the main memory 12, and stores handwritten stroke data detected by the touch sensor unit 22 using the pen 30. The handwritten stroke storage unit 45 stores, as handwritten strokes, collection data of time-series detection points detected by the touch sensor unit 22 when handwriting inputting a Chinese character, for example. Note that the handwritten stroke storage unit 45 stores, for example, position information of the time-series detection points in association with contact pressure (pen pressure).

[0061] The partial stroke storage unit 46 is a storage unit realized by, for example, the main memory 12, and stores data of partial strokes generated from handwritten strokes. The partial strokes will be described in detail later.

[0062] The learning data storage unit 47 is, for example, a storage unit realized by the main memory 12, and stores learning data for generating the above-mentioned classification model. The learning data storage unit 47 stores learning data in which partial strokes of a pre-specified character handwritten by a user are associated with character elements.

[0063] The control unit 10 is a functional unit realized, for example, by the processor 11 executing a program stored in the main memory 12 or the flash memory 13, and executes various processes based on an OS (for example, Android (registered trademark)). The control unit 10 includes an input processing unit 101, a division processing unit 102, a classification processing unit 103, a rendering processing unit 104, a display processing unit 105, and a learning processing unit 106.

[0064] The input processing unit 101 is a functional unit that is realized by the processor 11 executing a program stored in the main memory 12 or the flash memory 13. The input processing unit 101 is, for example, a device driver that controls an input by the touch sensor unit 22, and detects the position and contact of the pen 30 on the screen of the display unit 21 (on the display screen DF) by the input from the touch sensor unit 22.

[0065] Furthermore, the input processing unit 101 may acquire, for example, contact pressure (writing pressure) and angle information of the pen 30 from the pen 30. In this embodiment, the input processing unit 101 detects position information of detection points in time series and the corresponding contact pressure (writing pressure).

[0066] The input processing unit 101 detects the input of a handwritten stroke based on the contact position of an operation medium (for example, the pen 30) detected by the touch sensor unit 22. That is, the input processing unit 101 associates time-series position information of a detection point, which is contact position information (position coordinates) of the detected pen 30, with a contact pressure (writing pressure) as a handwritten stroke, and stores the information in the handwritten stroke storage unit 45.

[0067] In addition, a handwritten stroke, or simply a stroke, refers to a collection of data of detection points of the trajectory of the pen tip from the time the pen 30 makes contact (touch) to the time the pen 30 releases contact (up), and may include a display of the trajectory of the pen tip on the screen of the display unit 21 (on the display screen DF).

[0068] Furthermore, the input processing unit 101 detects the input of handwritten strokes, and displays the movement trajectory of the contact position of the operation medium as the input handwritten strokes on the display unit 21. The input processing unit causes the display unit 21 to temporarily display the input handwritten strokes via the display processing unit 105, which will be described later.

[0069] The division processing unit 102 is a functional unit that is realized when the processor 11 executes a program stored in the main memory 12 or the flash memory 13. The division processing unit 102 divides handwritten strokes input by a user at corners to generate divided partial strokes. The division processing unit 102 divides handwritten strokes stored in the handwritten stroke storage unit 45 by the input processing unit 101 into partial strokes.

[0070] Specifically, as shown in step S11 in FIG. 9, the division processing unit 102 divides a handwritten stroke ST1 having two corners at the corners to generate partial strokes SS1, SS2, and SS3. The division processing unit 102 stores the divided partial strokes in the partial stroke storage unit 46.

[0071] The classification processing unit 103 is a functional unit realized by the processor 11 executing a program stored in the main memory 12 or the flash memory 13. The classification processing unit 103 classifies the partial strokes divided by the division processing unit 102 into one of a plurality of character elements which are basic patterns constituting a Kanji character. The classification processing unit 103 classifies the partial strokes using a filtering process that excludes classification into inappropriate character elements based on the allowable range of stroke angles, which are angles indicating the drawing direction of the partial stroke in the character element, and the connection relationship before and after the partial stroke.

[0072] The classification processing unit 103 classifies partial strokes into character elements by combining a shape classification process and a filtering process. In the shape classification process, the classification processing unit 103 classifies the shapes of partial strokes into character elements based on a classification model that classifies character elements from partial strokes. Here, the classification model is a trained model generated by executing a learning process on training data in which partial strokes of a character handwritten by a user and character elements are associated with each other. Note that the classification processing unit 103 can output a plurality of character element candidates together with, for example, a confidence level by the shape classification process.

[0073] The classification processing unit 103 also executes a filtering process based on the connection availability information associated with the character elements stored in the filter information storage unit 44. The classification processing unit 103 excludes classification of inappropriate character elements from among a plurality of character element candidates based on the connection availability information. The classification processing unit 103 excludes inappropriate character elements from among the plurality of candidates by the filtering process, and classifies the partial stroke into, for example, a character element candidate with the highest certainty among the remaining candidates, the certainty of which is equal to or higher than a threshold value.

[0074] 9, the classification processor 103 classifies, for example, the partial stroke SS1 into a character element CE2 and the partial stroke SS2 into a character element CE3 by performing a shape classification process using the classification model and a filtering process based on the allowable range of stroke angles and the connection relationship before and after the partial stroke, and also classifies, for example, the partial stroke SS3 into a character element CE4 using the classification model.

[0075] When a handwritten stroke does not have any corners and is not divided into partial strokes, the classification processing unit 103 classifies the entire handwritten stroke into character elements in the same manner as for partial strokes.

[0076] The rendering processing unit 104 is a functional unit that is realized when the processor 11 executes a program stored in the main memory 12 or the flash memory 13. The rendering processing unit 104 adjusts the shape of a partial stroke based on the brush information and writing pressure characteristics corresponding to the character element classified by the classification processing unit 103, and displays the partial stroke on the display unit 21.

[0077] The rendering processing unit 104, for example, acquires brush information corresponding to character elements from the brush information storage unit 41, and also acquires pen pressure characteristics (pressure curve) corresponding to character elements from the pen pressure characteristics storage unit 42. The rendering processing unit 104 adjusts and renders the shape of the partial stroke based on the brush information and the pen pressure characteristics (pressure curve). The rendering processing unit 104 sets the brush size, aspect ratio, and brush angle according to the brush information, adjusts the line thickness according to the pen pressure characteristics (pressure curve), and displays the partial stroke on the display unit 21.

[0078] The rendering processor 104 recombines the partial strokes with the adjusted brush angle and line thickness to generate an adjusted handwritten stroke. The rendering processor 104 causes the display unit 21 to display the adjusted handwritten stroke via the display processor 105, which will be described later.

[0079] Specifically, as shown in step S13 of FIG. 9, the rendering processor 104 adjusts and recombines the partial strokes SS1, SS2, and SS3 to generate the rendered handwritten stroke CST1. The rendering processing unit 104 replaces the input handwritten stroke with a handwritten stroke based on the adjusted partial stroke, and displays the handwritten stroke on the display unit 21.

[0080] When the rendering processing unit 104 cannot classify the entire handwritten stroke or a partial stroke into a character element, the rendering processing unit 104 adjusts the shape of the handwritten stroke or the partial stroke based on the writing pressure when the stroke was input, and displays it on the display unit 21. In this case, the rendering processing unit 104 adopts, for example, the brush most commonly used for Chinese characters, and adjusts the shape so that the higher the writing pressure, the thicker the stroke, and the faster the stroke drawing speed, the thinner the stroke.

[0081] The display processing unit 105 is a functional unit that is realized by the processor 11 executing a program stored in the main memory 12 or the flash memory 13. The display processing unit 105 causes the display unit 21 to display a movement trajectory on the screen where the pen 30 has come into contact with the screen and moved, based on the contact position of the pen 30 detected by the touch sensor unit 22.

[0082] The display processing unit 105 temporarily displays the input handwritten stroke on the display unit 21, and then replaces the input handwritten stroke with a handwritten stroke whose shape has been adjusted, and displays the handwritten stroke on the display unit 21.

[0083] The learning processing unit 106 is a functional unit realized by the processor 11 executing a program stored in the main memory 12 or the flash memory 13. The learning processing unit 106 executes a learning process on the learning data stored in the learning data storage unit 47 to generate a classification model.

[0084] Here, the learning data is a correspondence between partial strokes of a character handwritten by a user of a pre-specified character and character elements, and is generated based on handwritten strokes input by handwriting multiple times for multiple characters including character elements. The learning processing unit 106 stores the generated classification model (learning result) in the CE classification information storage unit 43.

[0085] Next, the operation of the tablet terminal 1 according to this embodiment will be described with reference to the drawings. FIG. 9 is a diagram showing an overview of handwriting input processing of the tablet terminal 1 in this embodiment.

[0086] 9, the tablet terminal 1 divides the handwritten stroke at the corners to generate partial strokes (step S11). The division processing unit 102 of the tablet terminal 1 divides the handwritten stroke to generate partial strokes.

[0087] Next, the tablet terminal 1 classifies the divided partial strokes into simple character elements using the classification model (step S12). The classification processing unit 103 of the tablet terminal 1 executes a classification process to classify the partial strokes into character elements using the classification model stored in the CE classification information storage unit 43 and the connection availability information stored in the filter information storage unit 44.

[0088] The tablet terminal 1 adjusts the shape of the handwritten stroke based on the classified character element, and displays the partial stroke on the display unit 21 (step S13).

[0089] FIG. 10 is a flowchart showing an example of handwriting input processing of the tablet terminal 1 in this embodiment.

[0090] 10, the tablet terminal 1 first determines whether or not a handwritten stroke has been detected (step S101). The input processing unit 101 of the tablet terminal 1 determines whether or not a handwritten stroke has been detected by the touch sensor unit 22. If the input processing unit 101 detects a handwritten stroke (step S101: YES), the process proceeds to step S102. If the input processing unit 101 does not detect a handwritten stroke (step S101: NO), the process returns to step S101.

[0091] In step S102, the input processing unit 101 temporarily displays the handwritten strokes on the display unit 21. The rendering used at this time is performed with a thickness according to the conventional writing pressure, or with a uniform thickness regardless of the writing pressure. That is, the input processing unit 101 displays the detected handwritten strokes on the display unit 21 via the display processing unit 105. The input processing unit 101 acquires the writing pressure corresponding to the detection point of each position from the pen 30, and stores the writing pressure and the handwritten stroke in association with each other in the handwritten stroke storage unit 45.

[0092] Next, the input processing unit 101 determines whether the pen 30 has been removed from the screen of the display unit 21 (step S103). That is, the input processing unit 101 determines whether the input of the single handwritten stroke has been completed. If the pen 30 has been removed from the screen of the display unit 21 (the input of the handwritten stroke has been completed) (step S103: YES), the input processing unit 101 advances the process to step S104. If the pen 30 has not been removed from the screen of the display unit 21 (the input of the handwritten stroke has not been completed) (step S103: NO), the input processing unit 101 returns the process to step S102.

[0093] In step S104, the division processing unit 102 of the tablet terminal 1 divides the handwritten stroke at the corners to generate partial strokes. The division processing unit 102 divides the handwritten stroke to generate partial strokes, for example, as in step S11 shown in FIG. 7. The division processing unit 102 stores the generated partial strokes in the partial stroke storage unit 46.

[0094] Next, the classification processing unit 103 of the tablet terminal 1 classifies the partial strokes into character elements (step S105). The classification processing unit 103 classifies the partial strokes stored in the partial stroke storage unit 46 into character elements by combining a shape classification process and a filtering process (see step S12 in FIG. 7). Details of the process of step S105 by the classification processing unit 103 will be described later with reference to FIG. 11.

[0095] Next, the rendering processing unit 104 of the tablet terminal 1 adjusts the shape of the partial stroke based on the brush information and pressure curve corresponding to the classified character element, and displays the handwritten stroke with the adjusted shape on the display unit 21 (step S106). That is, the rendering processing unit 104 selects a brush corresponding to the classified character element, adjusts the thickness of the partial stroke based on the character element, and displays the handwritten stroke with the adjusted shape on the display unit 21. The rendering processing unit 104 acquires brush information corresponding to the classified character element from the brush information storage unit 41, adjusts the shape of the partial stroke based on the acquired brush information, and acquires a pressure curve corresponding to the classified character element from the pen pressure characteristic storage unit 42, and adjusts the thickness of the partial stroke based on the acquired pressure curve.

[0096] The rendering processing unit 104 then recombines the adjusted partial strokes, and causes the display unit 21 to display the handwritten strokes whose shape has been adjusted via the display processing unit 105 (see step S13 in FIG. 7).

[0097] After the process of step S106, the rendering processing unit 104 returns the process to step S101.

[0098] Next, with reference to FIG. 11, the process of step S105 in FIG. 10 will be described in detail. FIG. 11 is a flowchart showing details of the classification process of the tablet terminal 1 according to this embodiment.

[0099] 11, the classification processing unit 103 of the tablet terminal 1 first extracts candidates for character elements corresponding to partial strokes using a classification model (step S111). The classification processing unit 103 executes a shape classification process using the classification model stored in the CE classification information storage unit 43, and extracts candidates for character elements corresponding to partial strokes.

[0100] Next, the classification processing unit 103 excludes candidates having inappropriate stroke angles and connection relationships based on the filter information stored in the filter information storage unit 44 from the character element candidates (step S112). The classification processing unit 103 obtains connection availability information associated with the character element from the filter information storage unit 44, and if the stroke angle is outside the allowable range or the connection relationship is not allowed, determines that the candidate is an inappropriate character element and excludes the candidate.

[0101] For example, when the "previous connection" of the connection information is "NO" but another partial stroke exists before the partial stroke, the classification processing unit 103 excludes the classification of the character element from the candidates. Also, when the "non-connection" of the connection information is "NO" but the partial stroke exists alone, the classification processing unit 103 excludes the classification of the character element from the candidates.

[0102] Next, the classification processing unit 103 classifies the partial stroke into the character element candidate that has the highest degree of certainty among the remaining character element candidates and whose degree of certainty is equal to or greater than a threshold value (step S113).

[0103] Next, the classification processing unit 103 determines whether there is a partial stroke to be classified next (step S114). If there is a partial stroke to be classified next (step S114: YES), the classification processing unit 103 returns the process to step S111 and executes classification processing for the next partial stroke. If there is no partial stroke to be classified next (step S114: NO), the classification processing unit 103 ends the process.

[0104] Next, the learning process of the tablet terminal 1 will be described with reference to FIG. FIG. 12 is a flowchart showing an example of the learning process of the tablet terminal 1 in this embodiment.

[0105] 12, the learning processing unit 106 of the tablet terminal 1 acquires handwritten strokes of a specific character multiple times for multiple users (step S201). The learning processing unit 106 acquires handwritten strokes of a specific character multiple times for multiple users via the input processing unit 101. Note that the specific characters are preferably multiple characters that can learn multiple predetermined character elements.

[0106] Next, the learning processing unit 106 divides each handwritten stroke to generate partial strokes, and labels the corresponding character elements to obtain learning data (step S202). The learning processing unit 106 stores the learning data in which the partial strokes and the labeling of the character elements are associated with each other in the learning data storage unit 47.

[0107] Next, the learning processing unit 106 performs machine learning using the learning data to generate a classification model that classifies character elements from the partial strokes (step S203). The learning processing unit 106 executes machine learning processing using the learning data stored in the learning data storage unit 47, and generates a classification model as a learning result.

[0108] Next, the learning processing unit 106 stores the classification model, which is a result of the learning, in the CE classification information storage unit 43 (step S204). After the process of step S204, the learning processing unit 106 ends the learning process.

[0109] As described above, the tablet terminal 1 (information processing device) according to this embodiment includes a division processing unit 102, a classification processing unit 103, and a rendering processing unit 104. The division processing unit 102 divides an input handwritten stroke at its corners to generate divided partial strokes. The classification processing unit 103 classifies the partial strokes divided by the division processing unit 102 into one of a plurality of character elements that are basic patterns constituting a kanji character. The rendering processing unit 104 adjusts the shape of the partial stroke based on the brush information and writing pressure characteristics corresponding to the character element classified by the classification processing unit 103, and displays the partial stroke on the display unit 21. The classification processing unit 103 classifies the partial stroke using a filtering process that excludes classification into an inappropriate character element based on the allowable range of the stroke angle, which is an angle indicating the drawing direction of the partial stroke in the character element, and the connection relationship before and after the partial stroke.

[0110] As a result, the tablet terminal 1 according to this embodiment classifies partial strokes obtained by dividing a handwritten stroke into character elements, and adjusts the shape of each partial stroke based on the brush information and pen pressure characteristics corresponding to the character element, so that when inputting handwritten characters, it is possible to display beautiful characters (especially kanji) while maintaining the quality of the handwriting.

[0111] Furthermore, when a technology for classifying partial strokes by recognizing shapes is used, for example, impossible stroke angles or connection relationships may be classified as incorrect character elements because they are classified based only on their shapes. In this case, because the classification of the character elements is incorrect, shape adjustment is not performed accurately, and characters are displayed with an unnatural feel. In contrast, the tablet terminal 1 according to the present embodiment uses a filtering process to exclude classification into inappropriate character elements, so that incorrect classification of character elements as described above can be suppressed and beautiful characters can be displayed.

[0112] In addition, the tablet terminal 1 according to the present embodiment adjusts the shape of partial strokes in accordance with character elements based on handwritten strokes, so that it is possible to display beautiful characters while maintaining the size and position of handwritten strokes. Unlike conventional techniques that simply replace a given font, the tablet terminal 1 according to the present embodiment does not erase the user's handwriting, and does not lose the freedom of handwriting, such as the aspect ratio of free handwritten characters and the size.

[0113] The tablet terminal 1 according to the present embodiment also includes a filter information storage unit 44 that stores character elements in association with connection availability information indicating whether a partial stroke can be connected to the previous or next partial stroke and whether a partial stroke can be used alone for each stroke angle range. The classification processing unit 103 executes a filtering process based on the connection availability information associated with the character elements stored in the filter information storage unit 44.

[0114] As a result, the tablet terminal 1 according to this embodiment can easily and appropriately exclude classification of inappropriate character elements using the connection availability information of the filter information storage unit 44, and can display even neater characters using character elements from which inappropriate ones have been excluded.

[0115] In this embodiment, the classification processing unit 103 classifies partial strokes into character elements by combining a shape classification process for classifying the shapes of partial strokes based on a classification model with a filtering process. The classification model is generated by executing a learning process on learning data in which partial strokes of a character handwritten by a user and a character element are associated with each other, and classifies character elements from partial strokes.

[0116] As a result, the tablet terminal 1 according to this embodiment can use the classification model, which is the result of machine learning, to accurately classify partial strokes into character elements, and the accurately classified character elements can display even neater characters.

[0117] Furthermore, in this embodiment, the classification processing unit 103 extracts multiple candidates for character elements by shape classification processing based on the classification model, eliminates inappropriate character elements from the multiple candidates by filtering processing, and classifies the partial stroke into the character element candidate with the highest confidence level among the remaining candidates, the confidence level of which is equal to or higher than a threshold value. As a result, the tablet terminal 1 according to the present embodiment can exclude inappropriate character elements and accurately and appropriately classify partial strokes into character elements.

[0118] Moreover, the tablet terminal 1 according to this embodiment includes a learning processing unit 106 that executes learning processing on the learning data to generate a classification model, and a CE classification information storage unit 43 (model storage unit) that stores the classification model generated by the learning processing unit 106. The classification processing unit 103 classifies the partial strokes divided by the division processing unit 102 into character elements based on the classification model stored in the CE classification information storage unit 43. As a result, the tablet terminal 1 according to this embodiment can accurately classify partial strokes into character elements using the classification model.

[0119] Moreover, the tablet terminal 1 according to this embodiment includes a brush information storage unit 41 that stores character elements in association with brush information including the size, aspect ratio, and angle of the brush to be used, and a pen pressure characteristics storage unit 42 that stores character elements in association with pressure curves indicating the relationship between the stroke position and pen pressure in the character elements. The rendering processing unit 104 acquires brush information corresponding to the classified character elements from the brush information storage unit 41, acquires pressure curves corresponding to the classified character elements from the pen pressure characteristics storage unit 42, and adjusts the shape of the partial stroke based on the acquired brush information and pressure curve.

[0120] As a result, the tablet terminal 1 according to this embodiment can change the brush according to the character element using the brush information corresponding to the character element to appropriately adjust the shape of the partial stroke (for example, the shape of the corners at the beginning and end of writing, the tame, the flick, etc.). Also, the pressure curve corresponding to the character element can appropriately adjust the thickness of the partial stroke (for example, the change in thickness in the middle of the partial stroke) according to the stroke position.

[0121] Moreover, the tablet terminal 1 according to this embodiment includes a display unit 21, a touch sensor unit 22 that detects the contact and contact position of an operation medium on a detection surface on the screen of the display unit 21, and an input processing unit 101 that detects the input of a handwritten stroke based on the contact position of the operation medium detected by the touch sensor unit 22. The input processing unit 101 detects the input of a handwritten stroke, and displays a movement trajectory of the contact position of the operation medium (e.g., the pen 30) on the display unit 21 as the input handwritten stroke. The rendering processing unit 104 replaces the input handwritten stroke and displays the handwritten stroke with its shape adjusted on the display unit 21.

[0122] As a result, the tablet terminal 1 according to this embodiment first displays the handwritten strokes that are input, making it possible to input handwritten characters while checking the display, making handwritten input easier, and by replacing the handwritten strokes with handwritten strokes whose shape has been adjusted, it is possible to display neat characters.

[0123] The control method according to the present embodiment is a control method for the tablet terminal 1, and includes a division processing step, a classification processing step, and a rendering processing step. In the division processing step, the division processing unit 102 divides the input handwritten stroke at the corners to generate divided partial strokes. In the classification processing step, the classification processing unit 103 classifies the partial strokes divided by the division processing unit 102 into one of a plurality of character elements that are basic patterns constituting a kanji character. In the rendering processing step, the rendering processing unit 104 adjusts the shape of the partial stroke based on the brush information and the pen pressure characteristics corresponding to the character element classified by the classification processing unit 103, and displays the partial stroke on the display unit 21. In the classification processing step, the classification processing unit 103 classifies the partial stroke using a filtering process that excludes classification into an inappropriate character element based on the allowable range of the stroke angle, which is an angle indicating the drawing direction of the partial stroke in the character element, and the connection relationship before and after the partial stroke.

[0124] As a result, the control method according to this embodiment has the same effect as the tablet terminal 1 described above, and when inputting handwritten text, it is possible to display beautiful characters (especially kanji characters) while maintaining the quality of the handwritten text.

[0125] The present invention is not limited to the above-described embodiment, and can be modified without departing from the spirit of the present invention. For example, in the above embodiment, the information processing device is a tablet terminal 1, but the present invention is not limited to this. The information processing device may be, for example, a smartphone or a notebook personal computer equipped with a tablet mode.

[0126] In addition, in the above embodiment, an example of the OS used is described using Android (registered trademark), but this is not limited to this and may be applied to other OS such as iOS (registered trademark).

[0127] In the above embodiment, the processes of the division processing unit 102, classification processing unit 103, and rendering processing unit 104 may be realized by an application program, or part of the processes may be realized by a device driver or the like.

[0128] Furthermore, when the information processing device is a notebook personal computer, part of the processing of the division processing unit 102, the classification processing unit 103, and the rendering processing unit 104 may be performed by an embedded controller.

[0129] In the above embodiment, an example has been described in which the tablet terminal 1 includes the learning processing unit 106, but the present invention is not limited to this, and for example, the tablet terminal 1 may not include the learning processing unit 106. In this case, for example, an external device such as a server device connectable to the tablet terminal 1 may include the learning processing unit 106.

[0130] In addition, in the above embodiment, an example has been described in which the classification processing unit 103 excludes inappropriate classifications of stroke angles and inappropriate classifications of connection relationships in the filtering process, but this is not limited to this, and processing may be performed to exclude either inappropriate classifications of stroke angles or inappropriate classifications of connection relationships. In the above embodiment, the classification processing unit 103 may automatically detect the direction of character input as the user inputs characters, and adjust the value of the angle filter processing.

[0131] Each of the components of the tablet terminal 1 described above has an internal computer system. A program for implementing the functions of each of the components of the tablet terminal 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each of the components of the tablet terminal 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" referred to here includes hardware such as an OS and peripheral devices.

[0132] Furthermore, a "computer system" may include multiple computer devices connected via a network including the Internet, WAN, LAN, dedicated lines, and other communication lines. Furthermore, a "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into a computer system. In this way, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

[0133] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined with each component of the tablet terminal 1, or each divided program may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network. The above program may be a recording medium for realizing part of the above-mentioned functions. Furthermore, the recording medium may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0134] In addition, some or all of the above-mentioned functions may be realized as an integrated circuit such as LSI (Large Scale Integration). Each of the above-mentioned functions may be individually processed, or some or all of the functions may be integrated into a processor. The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, if an integrated circuit technology that can replace LSI appears due to advances in semiconductor technology, an integrated circuit based on that technology may be used. [Explanation of symbols]

[0135] 1. Tablet device 10 Control section 11 Processors 12. Main memory 13. Flash Memory 20. Touchscreen 21 Display section 22 Touch sensor section 23 Peripheral Devices 24 Audio System 25. Mike 26 Speaker 27 Baseband chip 28 Radio Section 29, 31 Wireless Communication Department 30 pens 32 Sensor section 33 Memory 34 MCU 40 Storage section 41 Brush information storage unit 42 Pen pressure characteristics memory section 43 CE classification information storage unit 44 Filter information storage unit 45 Handwritten stroke memory 46 Partial Stroke Memory Unit 47 Learning data storage unit 100 Information Processing Systems 101 Input processing unit 102 Division processing unit 103 Classification Processing Unit 104 Rendering Processing Unit 105 Display processing unit 106 Learning processing unit

Claims

1. a division processing unit for dividing an input handwritten stroke at a corner portion and generating divided partial strokes; a classification processing unit that classifies the partial strokes divided by the division processing unit into any one of a plurality of character elements that are basic patterns constituting a Chinese character; a rendering processing unit that adjusts a shape of the partial stroke based on brush information and writing pressure characteristics corresponding to the character element classified by the classification processing unit, and displays the partial stroke on a display unit; Equipped with The classification processing unit classifies the partial strokes by using a filtering process that excludes classification of the partial strokes into inappropriate character elements based on an allowable range of a stroke angle, which is an angle indicating a drawing direction of the partial stroke in the character element, and a connection relationship between the partial stroke and a preceding or succeeding character element. Information processing device.

2. a filter information storage unit that stores the character elements in association with connection / non-connection information that indicates whether the partial stroke can be connected to the preceding or succeeding partial stroke and whether the partial stroke can be used independently for each range of stroke angles, The classification processing unit executes the filtering process based on the connection availability information associated with the character elements stored in the filter information storage unit. The information processing device according to claim 1 .

3. The classification processing unit classifies the partial strokes into the character elements by combining a shape classification process for classifying shapes of the partial strokes and the filtering process based on a classification model generated by executing a learning process on learning data in which the partial strokes of a character handwritten by a user and the character elements are associated with each other, the classification model classifying the partial strokes into the character elements. The information processing device according to claim 2 .

4. The classification processing unit extracts a plurality of candidates for the character element by the shape classification processing based on the classification model, removes inappropriate character elements from the plurality of candidates by the filtering processing, and classifies the partial stroke into the character element of the remaining candidates whose certainty is equal to or greater than a threshold and has the highest certainty. The information processing device according to claim 3 .

5. a brush information storage unit that stores the character elements in association with the brush information including a size, an aspect ratio, and an angle of a brush to be used; a writing pressure characteristic storage unit that stores the character elements in association with a pressure curve that indicates a relationship between a stroke position in the character element and writing pressure; Equipped with The rendering processing unit acquires the brush information corresponding to the classified character element from the brush information storage unit, acquires the pressure curve corresponding to the classified character element from the pen pressure characteristic storage unit, and adjusts a shape of the partial stroke based on the acquired brush information and pressure curve. The information processing device according to claim 1 .

6. The display unit; a touch sensor unit that detects a contact and a contact position of an operation medium on a detection surface on a screen of the display unit; an input processing unit that detects an input of the handwritten stroke based on a contact position of the operation medium detected by the touch sensor unit; Equipped with the input processing unit detects the input of the handwritten stroke, and displays a movement trajectory of a contact position of the operation medium on the display unit as the input handwritten stroke; The rendering processing unit replaces the input handwritten stroke with the handwritten stroke whose shape has been adjusted, and displays the handwritten stroke on a display unit. The information processing device according to claim 5 .

7. A method for controlling an information processing device, comprising: a division processing step in which a division processing unit divides an input handwritten stroke at a corner portion to generate divided partial strokes; a classification processing step in which a classification processing unit classifies the partial stroke divided by the division processing unit into any one of a plurality of character elements which are basic patterns constituting a Chinese character; a rendering processing step in which a rendering processing unit adjusts a shape of the partial stroke based on brush information and writing pressure characteristics corresponding to the character element classified by the classification processing unit, and displays the partial stroke on a display unit; Including, In the classification processing step, the classification processing unit classifies the partial strokes by using a filtering process that excludes classification of the partial strokes into inappropriate character elements based on an allowable range of a stroke angle, which is an angle indicating a drawing direction of the partial stroke in the character element, and a connection relationship before and after the partial stroke. Control methods.

Citation Information

Patent Citations

  • Information processing device, information processing system, information processing method and information processing program

    JP2021043851A