Input display device and display method

Abstract

An input display device and a display method, wherein the input display device is provided with: an accepting unit (1) which accepts input of a trajectory; a trajectory image generating unit (4) which generates a trajectory image representing the trajectory accepted by the accepting unit (1); and a character string acquiring unit (5) which acquires a character string, wherein a display control unit (9) displays the character string acquired by the character string acquiring unit (5) in a superimposed manner on the trajectory image, and when the character string is acquired by the character string acquiring unit (5) before accepting input of the trajectory, the display control unit (9) waits for the character string to be displayed.

Description

[0001] This application is a divisional application of the invention patent application with the application date of May 28, 2015, application number 201580080158.7, and invention name “Input display device and display method”. Technical Field

[0002] The present invention relates to an input display device and a display method for displaying a character string representing a speech recognition result on a display. Background Art

[0003] The following Patent Document 1 discloses an input display device that displays a character string indicating a voice recognition result on a display.

[0004] In this input display device, when a user uses the pen-type input device to draw a line, the starting point and the end point of the line are detected, and a straight line connecting the starting point and the end point is drawn on the display.

[0005] Then, when the user inputs speech using the microphone, the speech recognition process is performed, and a character string indicating the speech recognition result is displayed along the drawn straight line.

[0006] Prior art literature

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Publication No. 2012-88969 ( Figure 2 , Figure 3 , Figure 6 ) Summary of the invention

[0009] Problems to be solved by the invention

[0010] The existing input display device is constructed as described above. Therefore, if the user uses the pen-type input device to draw a line, a straight line connecting the starting point and the end point of the line is drawn on the display. Therefore, before the user uses the microphone to input the voice, the position of the character string representing the voice recognition result can be known in advance. However, the line drawn on the display is limited to the straight line connecting the starting point and the end point. Therefore, there is a problem that the character string representing the voice recognition result cannot be displayed according to the user's free design.

[0011] The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide an input display device and a display method capable of displaying a character string indicating a speech recognition result according to a user's free design.

[0012] Means for solving problems

[0013] The input display device of the present invention is provided with: an accepting unit, which accepts the input of a trajectory; a trajectory image generating unit, which generates a trajectory image representing the trajectory accepted by the accepting unit; and a character string acquiring unit, which acquires a character string, and a display control unit displays the character string acquired by the character string acquiring unit in an overlapping manner on the trajectory image, and when the character string is acquired by the character string acquiring unit before accepting the input of the trajectory, the display control unit waits for the display of the character string.

[0014] Effects of the Invention

[0015] According to the present invention, the device is configured to include: an accepting unit that accepts input of a trajectory; a trajectory image generating unit that generates a trajectory image representing the trajectory accepted by the accepting unit; and a character string acquiring unit that acquires a character string, and a display control unit displays the character string acquired by the character string acquiring unit on the trajectory image in a superimposed manner, and when the character string acquiring unit acquires a character string before accepting input of the trajectory, the display control unit waits for the character string to be displayed. Therefore, it is possible to display a character string representing a speech recognition result according to a user's free design. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a diagram showing the configuration of an input display device according to Embodiment 1 of the present invention.

[0017] Figure 2 This is a hardware configuration diagram of the input display device according to Embodiment 1 of the present invention.

[0018] Figure 3 This is a hardware configuration diagram when the input display device is composed of a computer.

[0019] Figure 4 This is a flowchart (part 1) showing the processing contents of the input display device according to the first embodiment of the present invention, that is, the input display method.

[0020] Figure 5 This is a flowchart (part 2) showing the processing contents of the input display device according to the first embodiment of the present invention, that is, the input display method.

[0021] Figure 6 2 is an explanatory diagram showing a character attribute table stored in the character management DB.

[0022] Figure 7 It is an explanatory diagram showing a display process when a trajectory image is generated before a character string indicating a speech recognition result is generated.

[0023] Figure 8 This is an explanatory diagram showing a display process when a character string indicating a voice recognition result is generated before a trajectory image is generated.

[0024] Fig. 9This is a diagram showing the structure of an input display device according to Embodiment 2 of the present invention.

[0025] Fig.10 This is a hardware configuration diagram of an input display device according to Embodiment 2 of the present invention.

[0026] Fig.11 This is a flowchart showing the processing contents of the input display device according to the second embodiment of the present invention, that is, the input display method.

[0027] Fig.12 This is an explanatory diagram showing a trajectory image in which the line width is set according to the pen pressure of the user.

[0028] Fig.13 This is an explanatory diagram showing a trajectory image in which the line width is set according to the writing speed.

[0029] Fig.14 This is an explanatory diagram showing a trajectory image in which the line width is set according to the pen pressure or drawing speed of the user which changes during the drawing.

[0030] Fig.15 This is a diagram showing the structure of an input display device according to Embodiment 3 of the present invention.

[0031] Fig.16 This is a hardware configuration diagram of an input display device according to Embodiment 3 of the present invention.

[0032] Fig.17 This is a flowchart showing the processing contents of the input display device according to the third embodiment of the present invention, that is, the input display method.

[0033] Fig.18 It is an explanatory diagram showing the color of the trajectory image corresponding to the language of the speech.

[0034] Fig.19 This is a diagram showing the structure of an input display device according to Embodiment 4 of the present invention.

[0035] Fig. 20 This is a hardware configuration diagram of an input display device according to Embodiment 4 of the present invention.

[0036] Fig.21 1 is a flowchart showing the processing contents when the operation accepted by the operation accepting unit 1 is switched.

[0037] Fig. 22 1 is an explanatory diagram showing an example of an operation for switching an operation accepted by the operation accepting unit 1 .

[0038] Fig.23 This is an explanatory diagram showing an example of an image of a picture generated according to the content of the drawing operation. DETAILED DESCRIPTION

[0039] Hereinafter, in order to explain the present invention in more detail, a mode for carrying out the present invention will be described with reference to the accompanying drawings.

[0040] Implementation Method 1

[0041] Figure 1 is a diagram showing the structure of an input display device according to Embodiment 1 of the present invention, Figure 2 This is a hardware configuration diagram of the input display device according to Embodiment 1 of the present invention.

[0042] exist Figure 1 and Figure 2 In the embodiment, the operation accepting unit 1 is realized by the pointing device 21 and performs processing for accepting a drawing operation as a user operation.

[0043] In this embodiment 1, a touch panel is assumed to be used as the indicating device 21, but it is not limited to a touch panel, and for example, a joystick, an indicating stick (track point), a touchpad, a stylus, a data glove, a trackball, a handwriting tablet, a mouse, a light pen, a handle, etc. can be used.

[0044] The character management DB2 is implemented by a memory 22 such as a RAM or a hard disk, and stores a character attribute table indicating the correspondence between character types, character sizes, character heights, and character widths.

[0045] The character management unit 3 is implemented by, for example, a character management processing circuit 23 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a CPU (Central Processing Unit). The character management unit 3 performs the following processing: the size of the character displayed on the display 29 is set in advance, and the character attribute table stored in the character management DB2 is referred to, and the character attribute information indicating the character height corresponding to the character size is output to the trajectory image generation unit 4.

[0046] The trajectory image generating unit 4 is implemented by, for example, an image generating processing circuit 24 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a GPU (Graphics Processing Unit). The trajectory image generating unit 4 performs the following processing: based on the drawing operation accepted by the operation accepting unit 1, the trajectory of the line drawn by the drawing is determined, and a trajectory image representing the trajectory is generated. At this time, a trajectory image corresponding to the character height indicated by the character attribute information output from the character management unit 3 is generated.

[0047] The character string acquisition unit 5 is composed of a voice detection unit 6, a voice recognition dictionary DB 7, and a voice recognition unit 8, and performs processing for acquiring a character string indicating a voice recognition result.

[0048] The voice detection unit 6 is implemented by, for example, a microphone 25 and detects the user's voice.

[0049] The speech recognition dictionary DB7 is implemented by the memory 26 such as a RAM or a hard disk, and is composed of, for example, a sound model that describes the sound characteristics of phonemes, which are small units of human speech, and a recognition dictionary that describes words to be speech recognized.

[0050] The voice recognition unit 8 is realized by a voice recognition processing circuit 27 composed of, for example, a semiconductor integrated circuit or a one-chip microcomputer on which a CPU is mounted, and is equipped with a voice recognition engine that recognizes the voice detected by the voice detection unit 6 .

[0051] That is, the speech recognition unit 8 implements the following processing: analyzes the speech detected by the speech detection unit 6, calculates the sound features of the speech, searches for words having sound features closest to the calculated sound features from the words recorded in the recognition dictionary of the speech recognition dictionary DB7, and outputs the character string representing the word as a character string representing the speech recognition result to the display control unit 9.

[0052] exist Figure 1 In FIG. 1 , an example is shown in which the voice recognition dictionary DB 7 and the voice recognition unit 8 are implemented in the character string acquisition unit 5 . However, a data transmission and reception unit may be implemented instead of the voice recognition dictionary DB 7 and the voice recognition unit 8 .

[0053] The data transmission and reception unit is a network communication device such as a network card that can transmit and receive data to and from a speech recognition server (not shown) via a communication path such as the Internet or a LAN, and transmits data representing the speech detected by the speech detection unit 6 to the speech recognition server.

[0054] The speech recognition server is equipped with a speech recognition engine for recognizing speech. When receiving data representing speech sent from the data sending and receiving unit, the speech recognition server recognizes the speech and sends a character string representing the speech recognition result to the data sending and receiving unit.

[0055] The data transmission and reception unit receives a character string indicating a result of speech recognition transmitted from the speech recognition server, and then outputs the character string to the display control unit 9 .

[0056] The display control unit 9 is implemented by a display processing circuit 28 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a GPU, for example. The display control unit 9 performs processing such as displaying the trajectory image generated by the trajectory image generating unit 4 on the display 29 and superimposing the character string acquired by the character string acquiring unit 5 on the trajectory image.

[0057] That is, the display control unit 9 performs the following processing: when the trajectory image is generated by the trajectory image generating unit 4 before the character string is output from the voice recognition unit 8 of the character string acquisition unit 5, after the trajectory image is displayed on the display 29, the character string output from the voice recognition unit 8 of the character string acquisition unit 5 is superimposed on the trajectory image. On the other hand, when the character string is output from the voice recognition unit 8 of the character string acquisition unit 5 before the trajectory image is generated by the trajectory image generating unit 4, the display control unit 9 waits until the trajectory image is generated by the trajectory image generating unit 4, and when the trajectory image is generated by the trajectory image generating unit 4, the trajectory image is displayed on the display 29, and the character string is superimposed on the trajectory image.

[0058] Then, the display control unit 9 performs a process of displaying the character string in a superimposed manner on the trajectory image and then removing the display of the trajectory image.

[0059] The character string temporary storage unit 10 is implemented by a memory 30 such as a RAM or a hard disk, and temporarily stores the character string output from the voice recognition unit 8 of the character string acquisition unit 5 .

[0060] exist Figure 1 In the figure, it is assumed that the operation accepting unit 1, character management DB 2, character management unit 3, trajectory image generating unit 4, character string acquiring unit 5, display control unit 9 and character string temporary storage unit 10, which are structural elements of the input display device, are respectively composed of dedicated hardware, but the input display device can also be composed of a computer.

[0061] Figure 3 This is a hardware configuration diagram when the input display device is composed of a computer.

[0062] When the input display device is composed of a computer, a character management DB2, a voice recognition dictionary DB7 and a character string temporary storage unit 10 are constructed on the computer's memory 41, and a program that records the processing contents of the operation acceptance unit 1, the character management unit 3, the trajectory image generation unit 4, the voice detection unit 6, the voice recognition unit 8 and the display control unit 9 is stored in the memory 41, and the processor 42 executes the program stored in the memory 41.

[0063] Figure 4 and Figure 5 This is a flowchart showing the processing contents of the input display device according to Embodiment 1 of the present invention, that is, the input display method.

[0064] Next, the operation will be described.

[0065] Figure 6 2 is an explanatory diagram showing a character attribute table stored in the character management DB 2 .

[0066] exist Figure 6In the character attribute table, the character height and character width corresponding to the character size are described for each character type (such as bright font, bold font, etc.).

[0067] The character management unit 3 sets the size of the characters to be displayed on the display 29 in advance. The character management unit 3 refers to the character attribute table stored in the character management DB 2 and outputs the character attribute information indicating the character height corresponding to the character size to the trajectory image generation unit 4 ( Figure 4 Step ST1).

[0068] For example, if the character type of the character set in advance is “A” and the character size is “10”, character attribute information indicating that the character height is “5 mm” is output to the trajectory image generating unit 4 .

[0069] Furthermore, if the character type of the character set in advance is “B” and the character size is “5”, character attribute information indicating that the character height is “2 mm” is output to the trajectory image generating unit 4 .

[0070] Then, the character management unit 3 outputs character attribute information indicating the character height and character width corresponding to the character size to the display control unit 9 .

[0071] When receiving the character attribute information from the character management unit 3 , the trajectory image generation unit 4 sets the line width of the trajectory image to be generated to a line width corresponding to the character height indicated by the character attribute information (step ST2 ).

[0072] For example, when the character height indicated by the character attribute information is "10 mm", if the margins above and below the character are set to "0.5 mm", the line width of the trajectory image is set to "11 mm".

[0073] 11=10+0.5+0.5(mm)

[0074] Here, an example is shown in which margins are provided above and below the characters. However, the character height indicated by the character attribute information and the line width of the trajectory image may be made equal without providing margins.

[0075] In this embodiment 1, it is assumed that the indicating device 21 that implements the operation acceptance unit 1 is a touch panel. Therefore, when the user uses his or her own finger or an input pen for the touch panel to perform a writing operation on the touch panel (step ST3: "Yes" case), the operation acceptance unit 1 accepts the writing operation and outputs the writing operation content to the trajectory image generation unit 4 (step ST4).

[0076] The description of the operation content is equivalent to time series data representing the continuous change of the position (coordinates on the touch panel) of the finger or input pen in contact with the touch panel.

[0077] When receiving the drawing operation content from the operation accepting unit 1 , the trajectory image generating unit 4 determines the trajectory of the line drawn by the drawing based on the operation content (step ST5 ).

[0078] As described above, the content of the drawing operation indicates a continuous change in the contact position with respect to the touch panel. Therefore, by connecting the contact positions in time series, the trajectory of the line drawn by the drawing can be determined.

[0079] When the trajectory image generating unit 4 determines the trajectory of the line drawn by the drawing, it generates a trajectory image representing the trajectory and outputs the trajectory image to the display control unit 9 (step ST6 ).

[0080] The line width of the trajectory image is the line width set in step ST2 . In the above example, the line width of the trajectory image is set to “11 mm”, so a trajectory image with a line width of “11 mm” is generated.

[0081] When the voice detection unit 6 detects the user's voice (step ST7: "Yes" case), the voice recognition unit 8 of the character string acquisition unit 5 uses the voice recognition dictionary DB7 to perform recognition processing on the voice, thereby generating a character string (text) representing the recognition result of the voice, and outputs the character string to the display control unit 9 (step ST8).

[0082] The speech recognition processing performed by the speech recognition unit 8 is a well-known technology in itself, so detailed description is omitted. For example, the following method can be considered: analyze the speech detected by the speech detection unit 6, calculate the sound features of the speech, search for words with sound features closest to the calculated sound features from the words recorded in the recognition dictionary of the speech recognition dictionary DB7, and output the character string representing the word as the character string representing the speech recognition result.

[0083] In this first embodiment, for convenience of explanation, it is assumed that the user speaks “Spring is here, let’s go see the cherry blossoms”, and the speech recognition unit 8 outputs a character string indicating “Spring is here, let’s go see the cherry blossoms”.

[0084] here, Figure 7 It is an explanatory diagram showing a display process when a trajectory image is generated before a character string indicating a speech recognition result is generated.

[0085] and, Figure 8 This is an explanatory diagram showing a display process when a character string indicating a voice recognition result is generated before a trajectory image is generated.

[0086] When the trajectory image is output from the trajectory image generating unit 4 before the character string is output from the speech recognition unit 8 of the character string acquiring unit 5 ( Figure 5 Step ST11: "Yes" case), such as Figure 7 As shown in (a) of FIG. 1 , the display control unit 9 displays the trajectory image on the display 29 (step ST12 ).

[0087] Here, regarding the display of the trajectory image, the entire trajectory image may be displayed at once, or an animation may be performed in which the trajectory image is displayed sequentially from the beginning of the character string to be displayed later.

[0088] The display control unit 9 waits until the character string is output from the speech recognition unit 8 of the character string acquisition unit 5 (step ST13: No). Figure 7 As shown in (b), when the user speaks and the speech recognition unit 8 outputs a character string representing the speech recognition result (step ST13: "Yes" case), as shown in Figure 7 As shown in (c), the character string is superimposed and displayed on the trajectory image (step ST14). The size of the characters in the character string displayed on the trajectory image corresponds to the character height and character width indicated by the character attribute information output from the character management unit 3.

[0089] Here, the display of the character string may be performed by simultaneously displaying all characters constituting the character string, or by an animated display method in which characters are displayed sequentially from the first character of the character string to the last character.

[0090] like Figure 8 As shown in (a) of FIG. 1 , when the user speaks before performing the drawing operation and the speech recognition unit 8 of the character string acquisition unit 5 outputs a character string before the trajectory image is output from the trajectory image generation unit 4 ( Figure 5 In the case of step ST11: No), the display control unit 9 stores the character string in the character string temporary storage unit 10, and waits until the trajectory image is output from the trajectory image generation unit 4 (step ST15: No).

[0091] Then, when the user performs a drawing operation and the trajectory image is output from the trajectory image generating unit 4 (step ST15: Yes), the display control unit 9 reads the character string from the character string temporary storage unit 10, such as Figure 8 As shown in (b), the trajectory image is displayed on the display 29, and the character string is superimposed on the trajectory image. That is, the display control unit 9 displays the trajectory image and the character string superimposed at the same position (step ST16). However, the trajectory image and the character string may be displayed as a whole at the same time, or may be displayed in sequence from the beginning of the character string in an animated display.

[0092] After the display control unit 9 displays the character string on the trajectory image, Figure 7 (d)(e) and Figure 8 As shown in (c) and (d) of FIG. 1 , the trajectory image is removed and only the character string is displayed (step ST17 ).

[0093] Regarding the removal of the trajectory image, the entire trajectory image may be removed at once, or an animation may be performed in which the trajectory image is removed sequentially from the head of the character string.

[0094] Here, it is assumed that after the trajectory image and the character string are displayed in an overlapping manner, the trajectory image is removed after a certain period of time. However, the trajectory image may be removed immediately when the display of the character string is completed.

[0095] As can be seen from the above, according to the first embodiment, the input display device is configured to include: an operation accepting unit 1 that accepts a drawing operation; a trajectory image generating unit 4 that determines the trajectory of a line drawn by drawing based on the drawing operation accepted by the operation accepting unit 1 and generates a trajectory image representing the trajectory; and a character string acquiring unit 5 that acquires a character string representing a voice recognition result, and the display control unit 9 displays the trajectory image generated by the trajectory image generating unit 4 on the display 29, and displays the character string acquired by the character string acquiring unit 5 on the trajectory image in an overlapping manner. Therefore, an effect is achieved in which a character string representing a voice recognition result can be displayed according to a user's free design.

[0096] Furthermore, according to the first embodiment, when the trajectory image generating unit 4 generates a trajectory image before the voice recognition unit 8 of the character string acquisition unit 5 outputs a character string, the display control unit 9 displays the trajectory image on the display 29 and then displays the character string output from the voice recognition unit 8 of the character string acquisition unit 5 on the trajectory image. On the other hand, when the voice recognition unit 8 of the character string acquisition unit 5 outputs a character string before the trajectory image generating unit 4 generates a trajectory image, the display control unit 9 waits until the trajectory image generating unit 4 generates a trajectory image, and when the trajectory image generating unit 4 generates a trajectory image, the display 29 displays the trajectory image and displays the character string on the trajectory image. Therefore, when the user performs a tracing operation before speaking, the position where the character string indicating the voice recognition result is displayed can be grasped in advance. Therefore, the effect of the user being able to grasp the display image of the character string is achieved. Furthermore, when the user speaks before performing the tracing operation, the trajectory image and the character string are displayed on the same position in an overlapping manner immediately after the tracing operation is performed, so that the user can be given a highly responsive operation feeling.

[0097] Implementation Method 2

[0098] In the first embodiment, the line width of the trajectory image is set to a line width corresponding to the character height of the character size set in advance. However, the line width of the trajectory image may be set according to the state of the drawing operation performed by the user.

[0099] Fig. 9 is a diagram showing the structure of an input display device according to Embodiment 2 of the present invention. Fig.10This is a hardware configuration diagram of an input display device according to Embodiment 2 of the present invention.

[0100] exist Fig. 9 and Fig.10 In, with Figure 1 and Figure 2 The same reference numerals denote the same or corresponding parts, and thus their descriptions are omitted.

[0101] The operation state detection unit 11 is realized by, for example, an operation state detection processing circuit 31 composed of a semiconductor integrated circuit or a one-chip microcomputer having a CPU mounted thereon, and performs processing for detecting the state of the operation accepted by the operation acceptance unit 1 .

[0102] That is, the operation state detection unit 11 senses, for example, pressure (pen pressure) of a user's finger or an input pen on a touch panel as the pointing device 21 as the state of the operation accepted by the operation acceptance unit 1 .

[0103] The trajectory image generating unit 12 is implemented by, for example, an image generating processing circuit 32 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a GPU. Figure 1 Similarly to the trajectory image generating unit 4, the trajectory image generating unit 12 performs the following processing: based on the drawing operation received by the operation receiving unit 1, the trajectory of the line drawn by the drawing is determined, and a trajectory image representing the trajectory is generated. Figure 1 Unlike the trajectory image generating unit 4 , the trajectory image is generated with a line width corresponding to the state of the operation detected by the operation state detecting unit 11 .

[0104] The display control unit 13 is implemented by a display processing circuit 33 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a GPU, and performs the same as Figure 1 The display control unit 9 performs the same display processing.

[0105] Then, the display control unit 13 changes the character size of the characters constituting the character string acquired by the character string acquisition unit 5 according to the line width set by the trajectory image generation unit 12 , and displays the character string in a superimposed manner on the trajectory image with the changed character size.

[0106] exist Fig. 9 In the figure, it is assumed that the operation acceptance unit 1, character management DB2, character management unit 3, operation state detection unit 11, trajectory image generation unit 12, character string acquisition unit 5, display control unit 13 and character string temporary storage unit 10, which are structural elements of the input display device, are respectively composed of dedicated hardware, but the input display device can also be composed of a computer.

[0107] When the input display device is composed of a computer, Figure 3The memory 41 of the computer shown is composed of a character management DB2, a speech recognition dictionary DB7 and a character string temporary storage unit 10, and a program that records the processing contents of the operation acceptance unit 1, the character management unit 3, the operation status detection unit 11, the trajectory image generation unit 12, the speech detection unit 6, the speech recognition unit 8 and the display control unit 13 is stored in the memory 41, and the processor 42 executes the program stored in the memory 41.

[0108] Fig.11 and Figure 5 This is a flowchart showing the processing contents of the input display device according to the second embodiment of the present invention, that is, the input display method.

[0109] exist Fig.11 In, with Figure 4 The same step numbers indicate the same or corresponding parts.

[0110] Next, the operation will be described.

[0111] In this second embodiment, it is assumed that a writing pressure sensing sensor that senses writing pressure is mounted on a touch panel as the pointing device 21 .

[0112] The operation state detection unit 11 obtains the result of the pen pressure sensing from the pen pressure sensing sensor mounted on the pointing device 21, thereby detecting the pen pressure of the user on the touch panel as the pointing device 21 as the state of the operation accepted by the operation acceptance unit 1 ( Fig.11 Step ST21).

[0113] When the operation state detection unit 11 detects the user's pen pressure as the state of the operation accepted by the operation acceptance unit 1, the trajectory image generation unit 12 sets the line width of the trajectory image to be generated based on the user's pen pressure and the character height indicated by the character attribute information output from the character management unit 3 (step ST22).

[0114] For example, if the character height shown in the character attribute information is set as the baseline line width of the trajectory image, and the user's pen pressure is above the baseline value set in advance, the greater the pen pressure is above the baseline value, the larger the offset value is set, and the value obtained by adding the baseline line width and the offset value is determined as the final line width of the trajectory image.

[0115] The line width of the final trajectory image = baseline line width + offset value

[0116] On the other hand, if the user's pen pressure is less than a previously set reference value, a larger offset value is set as the pen pressure is less than the reference value, and the value obtained by subtracting the offset value from the reference line width is determined as the line width of the final trajectory image.

[0117] The line width of the final trajectory image = baseline line width - offset value

[0118] and Figure 1 Similarly, the display control unit 9 of the display control unit 13 is Figure 5 The trajectory image and the character string are displayed on the display 29.

[0119] However, in this second embodiment, the line width of the trajectory image is set according to the user's pen pressure. Therefore, when the trajectory image generating unit 12 makes the line width of the final trajectory image thicker than the baseline line width, the character size of the characters constituting the character string is increased according to the line width of the final trajectory image, and the character string is displayed on the trajectory image.

[0120] For example, when the baseline line width (= character height shown in the character attribute information) is "5mm", if the line width of the final trajectory image is set to "10mm", the character height of the characters constituting the character string is changed to "10mm", and the character string is displayed on the trajectory image. Here, an example is shown in which the character height and the line width of the trajectory image are consistent. However, in the case of setting blank space at the top and bottom of the character, for example, if the blank space at the top and bottom is set to "1mm", the character height of the characters constituting the character string is changed to "8mm", and the character string is displayed on the trajectory image.

[0121] When the trajectory image generating unit 12 makes the line width of the final trajectory image thinner than the reference line width, the display controlling unit 13 reduces the character size of characters constituting the character string according to the line width of the final trajectory image and displays the character string on the trajectory image.

[0122] For example, when the baseline line width (= character height shown in the character attribute information) is "5mm", if the line width of the final trajectory image is set to "3mm", the character height of the characters constituting the character string is changed to "3mm", and the character string is displayed on the trajectory image. Here, an example is shown in which the character height and the line width of the trajectory image are consistent. However, in the case of setting blank space at the top and bottom of the character, for example, if the blank space at the top and bottom is set to "0.5mm", the character height of the characters constituting the character string is changed to "2mm", and the character string is displayed on the trajectory image.

[0123] Fig.12 This is an explanatory diagram showing a trajectory image in which the line width is set according to the pen pressure of the user.

[0124] Fig.12 (a) shows a trajectory image in which a thicker line width is set because the user's pen pressure is above the reference value. Fig.12 (b) shows a trajectory image in which a thinner line width is set because the pen pressure of the user is less than the reference value.

[0125] In this second embodiment, an example is shown in which the operation status detection unit 11 detects the pen pressure of the user on the touch panel serving as the indication device 21 as the state of the operation accepted by the operation acceptance unit 1, but this is just an example. For example, the speed at which the user writes on the touch panel serving as the indication device 21 may also be detected as the state of the operation accepted by the operation acceptance unit 1.

[0126] If the operation state detection unit 11 identifies the continuous change of the contact position relative to the touch panel based on the content of the writing operation received by the operation reception unit 1, the writing speed on the touch panel can be obtained based on the change of the contact position relative to the touch panel per unit time.

[0127] When the operation state detection unit 11 detects the speed of writing on the touch panel as the state of the operation accepted by the operation acceptance unit 1, the trajectory image generation unit 12 sets the line width of the trajectory image to be generated based on the writing speed and the character height indicated by the character attribute information output from the character management unit 3.

[0128] For example, if the character height shown in the character attribute information is set as the baseline line width of the trajectory image, and the writing speed is above the baseline value set in advance, the faster the writing speed is than the baseline value, the larger the offset value is set, and the value obtained by adding the baseline line width and the offset value is determined as the line width of the final trajectory image.

[0129] The line width of the final trajectory image = baseline line width + offset value

[0130] On the other hand, if the drawing speed is slower than the reference value set in advance, a larger offset value is set as the drawing speed is slower than the reference value, and the value obtained by subtracting the offset value from the reference line width is determined as the line width of the final trajectory image.

[0131] The line width of the final trajectory image = baseline line width - offset value

[0132] Fig.13 This is an explanatory diagram showing a trajectory image in which the line width is set according to the writing speed.

[0133] Fig.13 (a) shows a trajectory image in which a thicker line width is set because the speed of the drawing is greater than the reference value. Fig.13 (b) shows a trajectory image in which a thinner line width is set because the writing speed is smaller than the reference value.

[0134] In the second embodiment, an example is shown in which the user's pen pressure or drawing speed is uniform. However, if the user's pen pressure or drawing speed changes during the process, the trajectory image generating unit 12 may generate a trajectory image in which the line width changes during the process.

[0135] Fig.14 This is an explanatory diagram showing a trajectory image in which the line width is set according to the pen pressure or drawing speed of the user which changes during the drawing.

[0136] Fig.14 (a) shows a trajectory image when the drawing speed is gradually increased or the pen pressure of the user is gradually increased, and the line width of the trajectory image is gradually thickened.

[0137] Fig.14 (b) shows a trajectory image when the drawing speed or the user's pen pressure changes irregularly, and the line width of the trajectory image is sometimes thick and sometimes thin.

[0138] As can be seen from the above, according to the second embodiment, the operation state detection unit 11 is provided to detect the state of the operation accepted by the operation acceptance unit 1, and the trajectory image generation unit 12 generates a trajectory image whose line width corresponds to the state of the operation detected by the operation state detection unit 11. Therefore, the effect of being able to realize the diversification of the display method of the character string is achieved.

[0139] In this embodiment 2, it is shown that the trajectory image generating unit 12 sets the line width of the trajectory image to be generated based on the state of the operation accepted by the operation accepting unit 1 detected by the operation state detecting unit 11 (for example, the user's pen pressure) and the character height indicated by the character attribute information output from the character management unit 3. However, it is also possible to set the line width of the trajectory image to be generated based only on the state of the operation accepted by the operation accepting unit 1 without using the character height indicated by the character attribute information output from the character management unit 3.

[0140] For example, the following method can be considered: prepare a table that stores the correspondence between the user's pen pressure (or writing speed) and the line width of the trajectory image, and the trajectory image generation unit 12 reads the line width corresponding to the user's pen pressure (or writing speed) from the table and sets the line width as the line width of the trajectory image.

[0141] In this second embodiment, a trajectory image is generated in which the line width corresponds to the state of the operation accepted by the operation accepting unit 1. However, the thickness of the characters displayed on the display 29 may be changed according to the state of the operation accepted by the operation accepting unit 1. For example, the following method may be considered: the stronger the pen pressure of the user or the faster the writing speed, the thicker the characters. Furthermore, the thickness of the characters displayed on the display 29 may be changed according to the state of the operation accepted by the operation accepting unit 1. For example, the following method may be considered: the stronger the pen pressure of the user or the faster the writing speed, the thicker the characters.

[0142] Furthermore, although the character height of the characters displayed superimposed on the trajectory image is changed according to the line width of the trajectory image generated by the trajectory image generating unit 12 , the character type of the characters constituting the character string may be changed according to the line width of the trajectory image.

[0143] For example, a method in which the character type is changed from character type A to character type B to character type C is conceivable when the line width of the trajectory image gradually becomes thicker.

[0144] Implementation 3

[0145] In the above-mentioned first and second embodiments, the display control unit 9 and 13 displays the trajectory image generated by the trajectory image generating unit 4 and 12 on the display 29. However, the language discrimination result of the speech may be obtained and the trajectory image may be displayed in a color corresponding to the language indicated by the discrimination result.

[0146] Fig.15 is a diagram showing the structure of an input display device according to Embodiment 3 of the present invention. Fig.16 This is a hardware configuration diagram of an input display device according to Embodiment 3 of the present invention.

[0147] exist Fig.15 and Fig.16 In, with Fig. 9 and Fig.10 The same reference numerals denote the same or corresponding parts, and thus their descriptions are omitted.

[0148] The language identification unit 14 of the character string acquisition unit 5 is implemented by, for example, a language identification processing circuit 34 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a CPU, performs language identification processing on the speech detected by the speech detection unit 6, and outputs the language identification result to the display control unit 15.

[0149] In this third embodiment, an example is shown in which the language identification unit 14 is implemented in the character string acquisition unit 5 . However, a data transmission and reception unit may be implemented in place of the language identification unit 14 .

[0150] The data transmission and reception unit is a network communication device such as a network card capable of transmitting and receiving data with a language identification server (not shown) via a communication path such as the Internet or a LAN, and transmits data representing the voice detected by the voice detection unit 6 to the language identification server.

[0151] The language identification server is equipped with a language identification engine for identifying the language of speech, and upon receiving data representing speech transmitted from the data transmission and reception unit, recognizes the speech and transmits a language identification result of the speech to the data transmission and reception unit.

[0152] The data transmission and reception unit outputs the language identification result of the speech transmitted from the language identification server to the display control unit 15 .

[0153] The display control unit 15 is implemented by a display processing circuit 35 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a GPU, for example, and performs the same Fig. 9 The display control unit 13 performs the same display processing.

[0154] Then, the display control unit 15 performs processing for displaying the trajectory image generated by the trajectory image generating unit 12 on the display 29 in a color corresponding to the language indicated by the determination result outputted from the language determination unit 14 .

[0155] exist Fig.15 In the figure, it is assumed that the operation acceptance unit 1, character management DB2, character management unit 3, operation state detection unit 11, trajectory image generation unit 12, character string acquisition unit 5, display control unit 15 and character string temporary storage unit 10, which are structural elements of the input display device, are respectively composed of dedicated hardware, but the input display device can also be composed of a computer.

[0156] When the input display device is composed of a computer, Figure 3 The memory 41 of the computer shown is composed of a character management DB2, a speech recognition dictionary DB7 and a character string temporary storage unit 10, and a program that records the processing contents of the operation acceptance unit 1, the character management unit 3, the operation status detection unit 11, the trajectory image generation unit 12, the speech detection unit 6, the speech recognition unit 8, the language determination unit 14 and the display control unit 15 is stored in the memory 41, and the processor 42 executes the program stored in the memory 41.

[0157] Fig.17 and Figure 5 This is a flowchart showing the processing contents of the input display device according to the third embodiment of the present invention, that is, the input display method.

[0158] exist Fig.17 In, with Fig.11 The same step numbers indicate the same or corresponding parts.

[0159] Next, the operation will be described.

[0160] When the voice detection unit 6 detects the user's voice, the language identification unit 14 of the character string acquisition unit 5 performs language identification processing on the voice and outputs the language identification result to the display control unit 15 ( Fig.17 Step ST9). The speech language identification process itself is a well-known technology, so detailed description is omitted.

[0161] and Fig. 9 Similarly, the display control unit 13 of the display control unit 15 is Figure 5 The trajectory image and the character string are displayed on the display 29.

[0162] However, with Fig. 9 Unlike the display control unit 13 , the display control unit 15 displays the trajectory image generated by the trajectory image generating unit 12 on the display 29 in a color corresponding to the language indicated by the determination result outputted from the language determination unit 14 .

[0163] In addition, before the voice detection unit 6 detects the voice of the user, the language identification unit 14 cannot identify the language of the voice. Therefore, when the trajectory image generation unit 12 generates the trajectory image before the voice detection unit 6 detects the voice of the user, the display control unit 15 does not display the trajectory image during the period before the voice detection unit 6 detects the voice of the user. In addition, the trajectory may be displayed in gray during the period before the voice detection unit 6 detects the voice of the user, and after the user's voice is detected and the language identification result is output, the trajectory image may be displayed in a color corresponding to the language.

[0164] Fig.18 It is an explanatory diagram showing the color of the trajectory image corresponding to the language of the speech.

[0165] Fig.18 (a) shows a case where the language of the speech is Chinese, and the trajectory image is displayed in blue, for example.

[0166] Fig.18 (b) shows a case where the language of the speech is English, and the trajectory image is displayed in red, for example.

[0167] Here, an example is shown in which a blue trajectory image is displayed if the language of the speech is Chinese, and a red trajectory image is displayed if the language of the speech is English. However, this is just an example, and it is of course possible to display in other colors.

[0168] As can be seen from the above, according to the third embodiment, the language discrimination unit 14 is configured to perform language discrimination processing on the voice detected by the voice detection unit 6 and output the discrimination result of the language, and the display control unit 15 displays the trajectory image generated by the trajectory image generation unit 12 on the display 29 in a color corresponding to the language indicated by the discrimination result output from the language discrimination unit 14. Therefore, an effect of being able to intuitively understand which language the characters are displayed is achieved.

[0169] Implementation 4

[0170] In the first to third embodiments, the trajectory image and the character string are displayed and then the trajectory image is removed so that only the character string is finally displayed on the display 29 . However, a picture image generated by a user's drawing operation may be displayed on the display 29 .

[0171] Fig.19 is a structural diagram showing an input display device according to a fourth embodiment of the present invention. Fig. 20This is a hardware configuration diagram of an input display device according to a fourth embodiment of the present invention.

[0172] exist Fig.19 and Fig. 20 In, with Fig.15 and Fig.16 The same reference numerals denote the same or corresponding parts, and thus their descriptions are omitted.

[0173] The operation switching unit 16 is realized by, for example, an operation switching processing circuit 36 ​​composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a CPU, and performs the following processing: for example, when a long press operation of the indicating device 21 is detected as an operation for switching the operation accepted by the operation accepting unit 1, the operation accepted by the operation accepting unit 1 is switched.

[0174] That is, the operation switching unit 16 performs the following processing: when the operation accepted by the operation accepting unit 1 is a drawing operation, when a long press operation of the pointing device 21 is detected, the operation accepted by the operation accepting unit 1 is switched to a drawing operation of drawing a picture on the display 29. On the other hand, the following processing is performed: when the operation accepted by the operation accepting unit 1 is a drawing operation, when a long press operation of the pointing device 21 is detected, the operation accepted by the operation accepting unit 1 is switched to a drawing operation.

[0175] The picture image generating unit 17 is realized, for example, by an image generating processing circuit 37 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a GPU, and performs the following processing: if the operation switched by the operation switching unit 16 is a drawing operation, a picture image is generated based on the drawing operation accepted by the operation accepting unit 1.

[0176] The display control unit 18 is implemented by, for example, a display processing circuit 38 composed of a semiconductor integrated circuit or a single-chip microcomputer equipped with a GPU, and if the operation switched by the operation switching unit 16 is a drawing operation, the display control unit 18 performs the same operation as described above. Fig.15 The display control unit 15 performs the same display processing.

[0177] The display control unit 18 performs processing for displaying the picture image generated by the picture image generating unit 17 on the display 29 if the operation switched by the operation switching unit 16 is a picture drawing operation.

[0178] exist Fig.19 In the figure, it is assumed that the operation acceptance unit 1, character management DB 2, character management unit 3, operation state detection unit 11, trajectory image generation unit 12, operation switching unit 16, picture image generation unit 17, character string acquisition unit 5, display control unit 18 and character string temporary storage unit 10, which are structural elements of the input display device, are respectively composed of dedicated hardware, but the input display device can also be composed of a computer.

[0179] When the input display device is composed of a computer, Figure 3 The memory 41 of the computer shown is composed of a character management DB2, a speech recognition dictionary DB7 and a character string temporary storage unit 10, and a program that records the processing contents of the operation acceptance unit 1, the character management unit 3, the operation status detection unit 11, the trajectory image generation unit 12, the operation switching unit 16, the picture image generation unit 17, the speech detection unit 6, the speech recognition unit 8, the language determination unit 14 and the display control unit 18 is stored in the memory 41, and the processor 42 executes the program stored in the memory 41.

[0180] Fig.21 1 is a flowchart showing the processing contents when the operation accepted by the operation accepting unit 1 is switched.

[0181] Next, the operation will be described.

[0182] When the operation switching unit 16 detects a long press operation as an operation for switching the operation accepted by the operation accepting unit 1 ( Fig.21 In the case of "Yes" in step ST31), a process of switching the operation accepted by the operation accepting unit 1 is implemented (step ST32).

[0183] Fig. 22 1 is an explanatory diagram showing an example of an operation for switching an operation accepted by the operation accepting unit 1 .

[0184] exist Fig. 22 , an example of an operation for switching the operation accepted by the operation accepting unit 1 is a long press operation, where, for example, the user's finger keeps in contact with the same location of the touch panel as the indicating device 21 for more than a predetermined time.

[0185] That is, when the operation currently accepted by the operation accepting unit 1 is a drawing operation, the operation switching unit 16 outputs a command to the operation accepting unit 1 to switch the operation accepted by the operation accepting unit 1 to a drawing operation when a long press operation of the pointing device 21 is detected.

[0186] On the other hand, when the operation currently accepted by the operation accepting unit 1 is a drawing operation, when a long press operation of the pointing device 21 is detected, an instruction to switch the operation accepted by the operation accepting unit 1 to a drawing operation is output to the operation accepting unit 1 .

[0187] The operation accepting unit 1 switches the operation to be accepted according to the instruction of the operation switching unit 16 .

[0188] Therefore, when the operation to be accepted is switched to the drawing operation (step ST33: Yes), the operation accepting unit 1 accepts the drawing operation and outputs the drawing operation content to the trajectory image generating unit 12 (step ST34) as in the above-mentioned first to third embodiments.

[0189] Then, in a state where the operation to be accepted is switched to a drawing operation (in the case of "No" in step ST33), the operation accepting unit 1 accepts the drawing operation and outputs the drawing operation content to the picture image generating unit 17 (step ST35).

[0190] When the operation accepting unit 1 accepts the drawing operation, the trajectory image generating unit 12 generates a trajectory image based on the content of the drawing operation, similarly to the second embodiment (step ST36 ).

[0191] When the operation accepting unit 1 accepts the drawing operation, the picture image generating unit 17 generates a picture image according to the content of the drawing operation (step ST37).

[0192] Fig.23 This is an explanatory diagram showing an example of an image of a picture generated according to the content of the drawing operation.

[0193] The processing of generating an image of a picture according to the drawing operation content is a known technology, so detailed description is omitted. In addition, the drawing operation content may include, in addition to the function of drawing a line, a function of changing the thickness and color of the line to be drawn, a function of removing an eraser of the line, etc.

[0194] The display control unit 18 performs the following processing: when the trajectory image generating unit 12 generates the trajectory image, Fig.15 Similarly, the display control unit 15 displays the trajectory image and the character string output from the character string acquisition unit 5 on the display 29 (step ST38).

[0195] Then, when the picture image generating unit 17 generates the picture image, the display control unit 18 displays the picture image on the display 29 (step ST39).

[0196] As can be seen from the above, according to the fourth embodiment, the structure includes: an operation switching unit 16 that switches the operation accepted by the operation accepting unit 1; and a picture image generating unit 17 that generates a picture image according to the drawing operation accepted by the operation accepting unit 1 if the operation switched by the operation switching unit 16 is a drawing operation, and generates a picture image according to the drawing operation accepted by the operation accepting unit 1 if the operation switched by the operation switching unit 16 is a drawing operation. Fig.15Similarly, the display control unit 15 of the display control unit 18 displays the trajectory image and the character string in an overlapping manner. On the other hand, if the operation switched by the operation switching unit 16 is a drawing operation, the display control unit 18 displays the image of the picture generated by the picture image generating unit 17. Therefore, an effect is achieved that the image of the picture can be displayed on the display 29 together with the character string.

[0197] In this embodiment 4, the following example is shown: when the operation accepted by the operation accepting unit 1 is a writing operation, the operation switching unit 16 switches the operation accepted by the operation accepting unit 1 to a drawing operation when a long press operation of the indicating device 21 is detected; on the other hand, when the operation accepted by the operation accepting unit 1 is a drawing operation, the operation switching unit 16 switches the operation accepted by the operation accepting unit 1 to a writing operation when a long press operation of the indicating device 21 is detected.

[0198] However, the switching method of the operation accepted by the operation accepting unit 1 is not limited to this, and the following switching method may be used.

[0199] For example, normally, the operation accepted by the operation acceptance unit 1 is set to a drawing operation. When a long press operation of the indicating device 21 is detected, the operation switching unit 16 outputs an instruction to the operation acceptance unit 1 to switch the operation accepted by the operation acceptance unit 1 to a description operation, and the operation acceptance unit 1 accepts the description operation.

[0200] When the description operation is completed, the operation accepted by the operation acceptance unit 1 automatically returns to the drawing operation, and then, when a long press operation of the indicator device 21 is detected, the operation switching unit 16 again outputs an instruction to the operation acceptance unit 1 to switch the operation accepted by the operation acceptance unit 1 to a description operation, and the operation acceptance unit 1 accepts the description operation.

[0201] In this fourth embodiment, the operation switching unit 16 switches the operation accepted by the operation accepting unit 1 when a long press operation of the indicating device 21 is detected. However, information indicating whether the operation currently accepted by the operation accepting unit 1 is a description operation or a drawing operation may be displayed on the display 29.

[0202] Furthermore, the present invention can freely combine the various embodiments, modify the arbitrary components of the various embodiments, or omit the arbitrary components of the various embodiments within the scope of the present invention.

[0203] Industrial Applicability

[0204] The input display device and the input display method of the present invention are suitable for the case where a character string representing a speech recognition result needs to be displayed according to a user's free design when the character string is displayed on a display.

[0205] Description of symbols

[0206] 1: Operation receiving unit; 2: Character management DB; 3: Character management unit; 4: Trajectory image generation unit; 5: String acquisition unit; 6: Voice detection unit; 7: Voice recognition dictionary DB; 8: Voice recognition unit; 9: Display control unit; 10: String temporary storage unit; 11: Operation status detection unit; 12: Trajectory image generation unit; 13: Display control unit; 14: Language identification unit; 15: Display control unit; 16: Operation switching unit; 17: Picture image generation unit; 18: Display control unit; 21: Indicator; 22: Storage 1: a device; 23: a character management processing circuit; 24: an image generation processing circuit; 25: a microphone; 26: a memory; 27: a speech recognition processing circuit; 28: a display processing circuit; 29: a display; 30: a memory; 31: an operation status detection processing circuit; 32: an image generation processing circuit; 33: a display processing circuit; 34: a language discrimination processing circuit; 35: a display processing circuit; 36: an operation switching processing circuit; 37: an image generation processing circuit; 38: a display processing circuit; 41: a memory; 42: a processor.

Claims

1. An input display device, wherein: The input display device comprises: An accepting unit, which accepts input of the trajectory of the curve; a trajectory image generating unit configured to generate a trajectory image representing the trajectory received by the receiving unit; a character string acquisition unit that acquires a character string; as well as a display control unit configured to display the character string acquired by the character string acquisition unit on the trajectory image in an overlapping manner, wherein the character string is displayed along the trajectory of the curve, and when the character string is acquired by the character string acquisition unit before accepting input of the trajectory, wait for the character string to be displayed, and when displaying the trajectory image, display the character string in an overlapping manner on the trajectory; Furthermore, the character string acquisition unit acquires a result of distinguishing a language of the speech when acquiring a character string representing a result of speech recognition. The display control unit displays the trajectory image generated by the trajectory image generating unit in a color corresponding to a language indicated by the determination result acquired by the character string acquiring unit.

2. The input display device according to claim 1, characterized in that: The trajectory accepted by the accepting unit is a continuous change in the contact position of the accepting unit.

3. The input display device according to claim 1, characterized in that: When the input of the trajectory is accepted before the character string acquisition unit acquires the character string, the display control unit displays the character string after displaying the trajectory.

4. The input display device according to claim 1, characterized in that: The display control unit removes the trajectory image after displaying the trajectory image and the character string in an overlapping manner.

5. The input display device according to claim 1, characterized in that: The display control unit sequentially displays from the first character to the last character of the character string acquired by the character string acquisition unit.

6. The input display device according to claim 1, characterized in that: The input display device includes a state detection unit that detects an input state of the trajectory accepted by the acceptance unit. The trajectory image generating unit generates a trajectory image having a line width corresponding to an input state of the trajectory detected by the state detecting unit.

7. The input display device according to claim 6, characterized in that: If the input state of the trajectory detected by the state detection unit changes midway, the trajectory image generation unit generates a trajectory image in which the line width changes midway.

8. The input display device according to claim 1, characterized in that: The input display device comprises: an operation switching unit that switches the operation accepted by the accepting unit; and a picture image generating unit that generates a picture image based on the drawing operation accepted by the accepting unit if the operation switched by the operation switching unit is an operation of drawing a picture on the display, When the operation switched by the operation switching unit is the input of the trajectory, the trajectory image generating unit generates a trajectory image representing the trajectory based on the input of the trajectory accepted by the accepting unit, If the operation after being switched by the operation switching unit is the drawing operation, the display control unit displays the image of the picture generated by the picture image generating unit on the display; if the operation after being switched by the operation switching unit is the input of the trajectory, the display control unit displays the trajectory image generated by the trajectory image generating unit on the display.

9. The input display device according to claim 1, characterized in that: The input display device further includes a display on which the display control unit displays an image.

10. A display method, in which: Accepts input of curve trajectory, generating a trajectory image of the accepted trajectory, Get the string, The obtained character string is displayed superimposed on the trajectory image, and the character string is displayed along the trajectory of the curve, wherein: When the character string is obtained before accepting the input of the trajectory, the character string is waited for to be displayed, and when the trajectory image is displayed, the character string is displayed overlapping the trajectory; Furthermore, the method further comprises: When a character string representing a recognition result of a speech is obtained, a result of distinguishing a language of the speech is obtained. The generated trajectory image is displayed in a color corresponding to the language indicated by the obtained discrimination result.

Images