Input display device, input display method, and input display program

Abstract

Provided are an input display device, an input display method, and an input display program that improve the operability of drawing a figure representing a position indicated by a character string. The input display device (100) according to the present disclosure includes an area setting unit (40) that sets a display area of a character string as a character string area, a locus input unit (51) that receives an input of a locus connecting an internal position of the character string area and an instruction position that is a position indicated by a character string located outside the character string area, and a display control unit (70) that generates an instruction figure representing the instruction position based on a locus located outside the character string area and causes the generated instruction figure to be displayed.

Description

Technical Field

[0001] The present disclosure relates to an input display device, an input display method, and an input display program.

Background Art

[0002] To represent the position indicated by a character string, there is an input display device that displays a figure such as a line, an arrow, or a balloon that represents the position indicated by the character string around the character string. For example, Patent Document 1 discloses a device that automatically displays a figure (balloon) with a predetermined shape around a character string.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The device described in Patent Document 1 has a problem that the operability of drawing a figure representing the position indicated by a character string is not good. For example, in the device described in Patent Document 1, since a figure with a predetermined shape is displayed, it is necessary to edit the once-displayed figure in order to represent the position indicated by the character string.

[0005] The present disclosure has been made to solve the above problems, and an object thereof is to provide an input display device, an input display method, and an input display program capable of improving the operability of drawing a figure representing the position indicated by a character string.

Means for Solving the Problems

[0006] The input display device according to the present disclosure includes a region setting unit that sets a display region of a character string as a character string region, and is located inside and outside the character string region and which is the position indicated by the character stringand there is something that the character string targets A locus input unit that receives an input of a locus connecting an instruction position that is a position with a string; and a locus that is located outside the string region and connects the intersection of the string region and the locus with the instruction position a part of A display control unit that generates an instruction graphic expressing the instruction position based on the locus and causes the generated instruction graphic to be displayed. The input display device according to the present disclosure a character string input unit that accepts input of a character string, and the input A region setting unit that sets a display region of a string as a string region; and a locus input unit that is located inside and outside the string region and receives an input of a locus connecting an instruction position that is a position indicated by the string and is the position indicated by the string and there is something that the character string targets A locus input unit that receives an input of a locus connecting an instruction position that is a position with a string; and a locus that is located outside the string region and connects the intersection of the string region and the locus with the instruction position A display control unit that generates an instruction graphic expressing the instruction position based on the locus and causes the generated instruction graphic to be displayed. selected The input display device according to the present disclosure and is the position indicated by the string and there is something that the character string targets A locus input unit that receives an input of a locus connecting an instruction position that is a position with a string; and a locus that is located outside the string region and connects the intersection of the string region and the locus with the instruction position

[0007] The input display method according to the present disclosure includes a region setting step of setting a display region of a string as a string region; and a locus input step of receiving an input of a locus connecting an instruction position that is a position indicated by the string and that is located inside and outside the string region and is the position indicated by the string and there is something that the character string targets A display control step of generating an instruction graphic expressing the instruction position based on a locus that is located outside the string region and connects the intersection of the string region and the locus with the instruction position and causing the generated instruction graphic to be displayed. a part of

[0008] The input display program according to the present disclosure causes a computer to have an area setting function for setting a display area of a character string as a character string area, and positions inside and outside the character string area and which is the position indicated by the character string and there is something that the character string targets a locus input function for receiving an input of a locus connecting the indicated position which is the position, and a locus located outside the character string area and connecting the intersection of the character string area and the locus and the indicated position a part of a display control function for generating an indication graphic representing the indicated position based on the locus and displaying the generated indication graphic.

Advantages of the Invention

[0009] According to the input display device, input display method, and input display program according to the present disclosure, the operability of drawing a graphic representing the position indicated by a character string can be improved.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Mode for Carrying Out the Invention

[0011] Hereinafter, an example of an input display device, an input display method, and an input display program according to the present disclosure will be described with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and the description thereof will not be repeated and will be omitted.

[0012] Embodiment 1. First, the input display device 100 according to Embodiment 1 of the present disclosure will be described with reference to FIGS. 1 and 2. FIG. 1 is a system block diagram of the input display device 100, and FIG. 2 is a hardware configuration diagram of the input display device 100.

[0013] The input display device 100 is a device that causes a display 201 to display a character string and a graphic (hereinafter referred to as an indication graphic S) that represents the position indicated by the character string (hereinafter referred to as an indication position P). As shown in FIG. 1, the input display device 100 includes a character string input unit 10, a character string acquisition unit 20, a character management unit 30, a character management DB (DataBase) 81, a region setting unit 40, an indication graphic shape DB 82, an operation reception unit 50, an operation switching unit 60, a display control unit 70, and a temporary storage unit 83.

[0014] First, among the configurations of the input display device 100, the configuration for causing the display 201 to display a character string will be described. The display of the character string is realized by the display processing unit 74 of the character string input unit 10, the character string acquisition unit 20, the character management unit 30, the character management DB (DataBase) 81, and the display control unit 70.

[0015] The character string input unit 10 is realized by, for example, the character string input processing circuit 202 shown in FIG. 2. The character string input unit 10 receives the input of the character string to be displayed on the display 201.

[0016] The character string acquisition unit 20 is realized by, for example, the character string acquisition processing circuit 203 shown in FIG. 2. The character string acquisition unit 20 acquires the character string information of the character string for which the character string input unit 10 has received the input. Here, the character string information is the number of characters, character arrangement, and the like.

[0017] The character management unit 30 is realized by, for example, the character management processing circuit 205 shown in FIG. 2. The character management unit 30 sets the character type and character size of the character string to be displayed on the display 201. Specifically, the character management unit 30 refers to the character attribute table stored in the character management DB 81 and acquires character attribute information including the character height and character width corresponding to the set character type and character size.

[0018] The character management DB81 is realized, for example, by the memory processing circuit 204 shown in FIG. 2. The character management DB81 stores a character attribute table indicating the correspondence relationship between character types, character sizes, character heights, and character widths. An example of the character attribute table stored in the character management DB81 is shown in FIG. 3. As shown in FIG. 3, in the character attribute table, for each character type (for example, Mincho font, Gothic font, etc.), the character height and character width corresponding to the character size are described.

[0019] For example, if the character type predetermined by the character management unit 30 is "A" and the character size is "10", the character management unit 30 acquires character attribute information indicating that the character height and character width are "5 mm". Also, if the character type predetermined by the character management unit 30 is "B" and the character size is "5", the character management unit 30 acquires character attribute information indicating that the character height is "2 mm" and the character width is "1.25 mm".

[0020] The display processing unit 74 of the display control unit 70 is realized, for example, by the display processing circuit 212 shown in FIG. 2. The display processing unit 74 causes the display 201 to display a character string based on the character string information acquired by the character string acquisition unit 20 and the character attribute information acquired by the character management unit 30.

[0021] Next, the configuration for displaying the instruction graphic S on the display 201 among the configurations of the input display device 100 will be described. The display of the instruction graphic S is realized by the character string acquisition unit 20, the character management unit 30, the character management DB (DataBase) 81, the area setting unit 40, the instruction graphic shape DB82, the operation reception unit 50, the operation switching unit 60, the display control unit 70, and the temporary storage unit 83.

[0022] As described above, the character string acquisition unit 20 acquires character string information from the character input unit 10 for displaying a character string. Also, for displaying the instruction graphic S, the character string acquisition unit 20 acquires the character string information displayed on the display 201 from the display processing unit 74 of the display control unit 70. Specifically, the character string acquisition unit 20 acquires character string information including the number of characters and the character string arrangement from the display processing unit 74 of the display control unit 70. Note that the character string acquisition unit 20 may acquire the character string information of a plurality of lines of character strings. The character string information of a plurality of lines of character strings includes, in addition to the number of characters and the character string arrangement, the number of lines of the character string, the number of characters per line, and the length between lines, etc.

[0023] As described above, the character management unit 30 sets the character type and character size of the character string to be displayed on the display 201, and refers to the character attribute table stored in the character management DB 81 to obtain character attribute information including the character height and character width corresponding to the set character type and character size.

[0024] The area setting unit 40 is realized by, for example, the area setting processing circuit 206 shown in FIG. 2. The area setting unit 40 sets the display area of the character string on the display 201 (hereinafter referred to as the character string area A). Specifically, the area setting unit 40 sets the character string area A based on the character string information acquired by the character string acquisition unit 20 and the character attribute information acquired by the character management unit 30. More specifically, the area setting unit 40 generates area information, which is the absolute coordinate information of the character string area A in the display area of the display 201, based on the number of characters, the character arrangement, the character height, and the character width. Here, the character string area A is an area including the display area of the character string, and may be an area including the margins around the character string.

[0025] An example in which the area setting unit 40 sets the area including the margins around the character string as the character string area A will be described. For example, when the character height indicated by the character attribute information is "5 mm" and the margin around the preset character string, that is, the margin above and below the character is "0.5 mm", the area setting unit 40 sets the height of the character string area A to "6 mm". When the number of characters indicated by the character string information is "10", the character width indicated by the character attribute information is "5 mm", and the margin around the preset character string, that is, the margin on the left and right of the character string is "0.5 mm", the area setting unit 40 sets the length of the character string area A to "51 mm". Although an example of providing margins around characters has been described, it is not necessary to provide margins. Also, the character string does not have to be linear and may be curved. When the character string is curved, the character string area A is set to have a constant width along the character string.

[0026] Note that the area setting unit 40 may set the display area of a plurality of lines of character strings as the character string area A. When setting the character string area A for a plurality of lines of character strings, the height of the character string area A is set based on the number of lines indicated by the character string information, the length of the line spacing, the character height indicated by the character attribute information, and the margins above and below the character string set in advance. For example, when the number of lines indicated by the character string information is "2", the length of the line spacing indicated by the character string information is "10 mm", the character height indicated by the character attribute information is "5 mm", and the margins around the character string set in advance, that is, the margins above and below the characters are "0.5 mm", the area setting unit 40 sets the height of the character string area A to "21 mm". Also, the length of the character string area A is set based on the maximum number of characters per line indicated by the character string information, the character width indicated by the character attribute information, and the margins around the character string set in advance. For example, when the maximum number of characters per line indicated by the character string information is "10", the character width indicated by the character attribute information is "5 mm", and the margins around the character string set in advance, that is, the margins on the left and right of the character string are "0.5 mm", the area setting unit 40 sets the length of the character string area A to "51 mm". In the above, an example of setting the length of the character string area A based on the maximum number of characters per line has been described. The length of the character string area A may be set based on the number of characters per line. That is, the character string area A for a plurality of lines of character strings may be set to have the same length for each line, or may be set to have different lengths based on the number of characters per line. Also, it is not necessary to provide margins around the characters. The character string does not have to be linear and may be curved.

[0027] The operation reception unit 50 is realized by, for example, the pointing device 207 shown in FIG. 2. The operation reception unit 50 receives the user's operation and outputs the content of the received operation to the display control unit 70. The user operations received by the operation reception unit 50 include an input operation of a locus (hereinafter referred to as locus L), a setting operation of the shape of the instruction figure S, a movement operation of the position of a character string or the instruction position P, and an editing operation of the shape of the instruction figure S, which are realized by a locus input unit 51, a shape setting unit 52, a movement unit 53 (described later), and a shape editing unit 54, respectively.

[0028] The locus input unit 51 receives, as the user's operation, an input operation of the locus L. Specifically, in order to display the instruction figure S on the display 201, the locus input unit 51 receives an input of the locus L that connects the inside of the character string area A and the instruction position P located outside the character string area A, and acquires locus information that is the absolute coordinate information of the locus L in the display area of the display 201 for the locus L. Here, the inside of the character string area A includes the area line that is the boundary line with the outside of the character string area A.

[0029] Also, the locus input unit 51 may receive an operation of selecting a character string for displaying the instruction figure S before receiving the input of the locus L. When receiving an operation of selecting a character string for displaying the instruction figure S, the locus input unit 51 receives an input of the locus L that connects the inside of the character string area A of the selected character string and the instruction position P located outside the character string area A of the selected character string.

[0030] Here, the flow of the input operation of the locus L by the locus input unit 51 will be described with reference to FIG. 4. FIG. 4 is an explanatory diagram of the operation of the locus input unit 51. In FIG. 4, the character string area A is shown by a dotted line and the locus L is shown by a broken line. Figure 4(a) shows the state just before the user performs an operation to select a string for displaying the instruction graphic S. The operation of selecting a string is, for example, an operation of touching the inside of the string area A. When the user selects a string, as shown in FIG. 4(b), a trajectory reception symbol M is displayed on the display 201. Specifically, when the trajectory input unit 51 receives an operation of selecting a string, it outputs a signal for displaying the trajectory reception symbol M to the display processing unit 74 of the display control unit 70, and the display processing unit 74 displays the trajectory reception symbol M. Here, the trajectory reception symbol M is a symbol displayed to assist in inputting a trajectory L that connects from the inside of the string area A to an external instruction position, and is displayed inside the string area A. After the trajectory reception symbol M is displayed, as shown in FIG. 4(c), when the user drags the trajectory reception symbol M, the trajectory L is input. Specifically, the trajectory input unit 51 acquires time-series data indicating a continuous change in the position of the trajectory reception symbol M as trajectory information.

[0031] Note that in FIG. 4(b), an example is shown in which the trajectory reception symbol M is displayed at the center of the string area A. However, as long as the trajectory reception symbol M is inside the string area A including the area line, the display position is not limited to the center of the string area A. Also, the trajectory reception symbol M may not be displayed. When the trajectory input unit 51 does not display the trajectory reception symbol M, the trajectory input unit 51 receives, as an input operation of the trajectory L, a drag operation from an arbitrary position inside the string area A instead of a drag operation of the trajectory reception symbol M.

[0032] The shape setting unit 52 receives, as a user operation, an operation for setting the shape of the instruction graphic S. Specifically, the shape setting unit 52 sets the shape of the instruction graphic S to be displayed on the display 201 by the display control unit 70 from among the shapes of a plurality of instruction graphics S stored in the instruction graphic shape DB82. For example, the user sets the shape of the instruction graphic S by touching the instruction graphic S to be set from among the plurality of instruction graphics S displayed on the display 201. By receiving the operation of setting the shape of the instruction graphic S, the shape setting unit 52 acquires setting shape information, which is relative coordinate information indicating the size, width, height, etc. of the instruction graphic S.

[0033] The instruction graphic shape DB82 is realized, for example, by the memory processing circuit 204 shown in FIG. 2. The instruction graphic shape DB82 stores information on the shapes of a plurality of instruction graphics S. An example of the shape of the instruction graphic S stored in the instruction graphic shape DB82 is shown in FIG. 5. As shown in FIG. 5, the instruction graphic shape DB82 stores, as the shape of the instruction graphic S, a line (FIG. 5(a)), an arrow (FIG. 5(b)), a speech balloon (FIG. 5(c)(d)(e)(f)), etc. Here, the speech balloon, which is an example of the shape of the instruction graphic, is a graphic composed of a speech balloon main body portion that surrounds the character string and a speech balloon instruction portion that indicates the instruction position P. FIGS. 5(c)(d) show an example in which the speech balloon instruction portion has a horn shape protruding from the speech balloon main body portion, and FIGS. 5(e)(f) show an example in which the speech balloon instruction portion has a linear shape. The speech balloon instruction portion may be displayed only outside the speech balloon main body portion, as shown in FIG. 5(e), or may be displayed so as to protrude from the inside to the outside of the speech balloon main body portion, as shown in FIG. 5(f).

[0034] Note that in FIG. 5(b), as an example of the case where the shape of the instruction graphic S is an arrow, an example in which an arrowhead symbol is displayed at the end of the line away from the character string is shown, but the position of the arrowhead symbol is not limited to this. The arrowhead symbol may be displayed at the end of the line close to the character string. Also, the arrowhead symbol may be displayed at both ends of the line. Further, in FIGS. 5(c)(d), as an example of the case where the shape of the instruction graphic S is a speech balloon, examples in which the shape of the speech balloon main body portion is an elliptical shape and a rectangular shape are shown, but the shape of the speech balloon main body portion is not limited to this. Furthermore, in FIGS. 5(e)(f), as an example of the case where the shape of the instruction graphic S is a speech balloon, an example in which the speech balloon instruction portion is a line is shown, but it is not limited to this. For example, the speech balloon instruction portion may be an arrow.

[0035] The operation switching unit 60 is implemented by the operation switching processing circuit 208 shown in FIG. 2. The operation switching unit 60 receives a user operation for switching the operation received by the operation reception unit 50, and switches the operation received by the operation reception unit 50. Specifically, the operation switching unit 60 switches the operation reception unit 50 to any one of the locus input unit 51, the shape setting unit 52, the moving unit 53 (described later), and the shape editing unit 54. The user operation for switching the operation received by the operation reception unit 50 is an operation corresponding to the contact time of the pointing device 207 or the contact position of the pointing device 207, which is predetermined for each operation of the operation reception unit 50.

[0036] The display control unit 70 causes the string and the instruction graphic S to be displayed on the display 201. The display control unit 70 includes an instruction graphic generation unit 71, a locus change unit 72 (described later), a string line feed unit 73 (described later), and a display processing unit 74.

[0037] The instruction graphic generation unit 71 is implemented by, for example, the image generation processing circuit 209 shown in FIG. 2. The instruction graphic generation unit 71 generates the instruction graphic S based on the area information indicating the string area A set by the area setting unit 40, the locus information indicating the locus L input by the locus input unit 51, and the set shape information indicating the shape of the instruction graphic S set by the shape setting unit 52. Specifically, the instruction graphic generation unit 71 generates the instruction graphic S based on the shape of the instruction graphic S set by the shape setting unit 52 and the locus L located outside the string area A. More specifically, based on the area information, the locus information, and the set shape information, graphic information, which is the absolute coordinate information of the instruction graphic S in the display area of the display 201, is generated. Here, the locus L located outside the string area A is the part of the locus L that connects the intersection of the string area A and the locus L and the instruction position P. When the locus L received by the locus input unit 51 is a locus L that connects the area line included in the string area A and the instruction position P located outside the string area A, the locus L located outside the string area A is the entire locus L received by the locus input unit 51. When the locus L received by the locus input unit 51 is a locus L that connects the inside of the string area A excluding the area line and the instruction position P located outside the string area A, the locus L located outside the string area A is a part of the locus L received by the locus input unit 51.

[0038] The flow of generating the instruction graphic S by the instruction graphic generation unit 71 will be described with reference to FIG. 6. In FIG. 6, the string area A is shown by a dotted line, the locus L is shown by a broken line, and the instruction graphic S is shown by a solid line. Here, although the string area A and the locus L are not displayed on the display 201, they are shown in FIG. 6 for clarity. Note that FIG. 6(a) shows the case where the shape of the instruction graphic S set by the shape setting unit 52 is a line, FIG. 6(b) shows the case where the shape of the instruction graphic S set by the shape setting unit 52 is an arrow, FIG. 6(c) shows the case where the shape of the instruction graphic S set by the shape setting unit 52 is a balloon having a horn-shaped balloon instruction part, and FIG. 6(d) shows the case where the shape of the instruction graphic S set by the shape setting unit 52 is a balloon having a linear balloon instruction part. When the shape of the instruction graphic S set by the shape setting unit 52 is a line (Fig. 5(a)), as shown in Fig. 6(a), the instruction graphic generation unit 71 generates the locus L connecting the intersection of the character string area A and the locus L and the instruction position P as the instruction graphic S. When the shape of the instruction graphic S set by the shape setting unit 52 is an arrow (Fig. 5(b)), as shown in Fig. 6(b), the instruction graphic generation unit 71 generates, as the instruction graphic S, a graphic obtained by adding an arrowhead symbol to the locus L connecting the intersection of the character string area A and the locus L and the instruction position P. Here, the arrowhead symbol is synthesized with at least one of the intersection of the character string area A and the locus L and the instruction position P. When the shape of the instruction graphic S set by the shape setting unit 52 is a balloon having a balloon instruction part in the shape of a horn (Fig. 5(c)(d)), as shown in Fig. 6(c), the instruction graphic generation unit 71 generates, as the instruction graphic S, a graphic surrounding the locus L connecting the intersection of the character string area A and the locus L and the instruction position P and the character string area A. Further, when the shape of the instruction graphic S set by the shape setting unit 52 is a balloon having a balloon instruction part in a linear shape (Fig. 5(e)(f)), as shown in Fig. 6(d), the instruction graphic generation unit 71 generates, as the instruction graphic S, a graphic obtained by combining the locus connecting the intersection of the character string area A and the locus L and the instruction position P with the graphic surrounding the character string area A.

[0039] In addition, when generating the instruction graphic S for a plurality of lines of character strings, as shown in Fig. 7, the instruction graphic S is generated based on the character string area A of the plurality of lines of character strings set by the area setting unit 40. Fig. 7(a) shows the case where the shape of the instruction graphic S set by the shape setting unit 52 is a line, Fig. 7(b) shows the case where the shape of the instruction graphic S set by the shape setting unit 52 is an arrow, and Fig. 7(c) shows the case where the shape of the instruction graphic S set by the shape setting unit 52 is a balloon having a balloon instruction part in the shape of a horn. The processing except for using the character string area A of the plurality of lines of character strings is the same as the flow of generating the instruction graphic S described in Fig. 6.

[0040] The display processing unit 74 performs processing for causing the display 201 to display the aforementioned character string, and also performs processing for causing the display 201 to display the instruction graphic S. Specifically, the display processing unit 74 causes the display 201 to display the instruction graphic S based on the graphic information generated by the instruction graphic generation unit 71.

[0041] The temporary storage unit 83 is realized by, for example, the storage processing circuit 204 shown in FIG. 2. The temporary storage unit 83 temporarily stores the content of the processing performed by the display control unit 70.

[0042] Subsequently, among the configurations of the input display device 100, a configuration in which, after the instruction graphic S is displayed, the instruction graphic S is regenerated and displayed based on the content of the operation received from the user will be described. The re-display of the instruction graphic S is such that the operation reception unit 50 is switched by the operation switching unit 60 to the shape setting unit 52, the movement unit 53, or the shape editing unit 54, and when the shape setting unit 52, the movement unit 53, or the shape editing unit 54 receives a shape setting operation of the instruction graphic S, a movement operation of the position of the character string or the instruction position P, or an editing operation of the shape of the instruction graphic S, the instruction graphic generation unit 71 regenerates the instruction graphic S based on the content of the operation received by the operation reception unit 50.

[0043] First, a configuration in which, after the instruction graphic S is displayed, a shape setting operation of the instruction graphic S is received from the user and the instruction graphic S is re-displayed will be described with reference to FIGS. 1 and 8 - 9. In FIGS. 8 - 9, the character string area A is shown as a dotted line, the locus L is shown as a dashed line, and the instruction graphic S is shown as a solid line. Here, the character string area A and the locus L are not displayed on the display 201, but are shown in FIGS. 8 - 9 for clarity.

[0044] The re-display of the instruction graphic S by the shape setting operation of the instruction graphic S is realized by the shape setting unit 52, the instruction graphic generation unit 71, and the display processing unit 74.

[0045] Even after the shape setting unit 52 displays the instruction graphic S on the display 201, the operation reception unit 50 receives an operation for setting the shape of the instruction graphic S. In other words, the shape setting unit 52 receives an operation for changing the instruction graphic S displayed on the display 201. As shown in FIGS. 8(a) to 9(a), when the shape setting unit 52 receives an operation in which the user touches the instruction position P, the shape setting unit 52 receives an operation for changing the instruction graphic S. When the user touches the instruction position P, options for the shape of the instruction graphic S are displayed in the vicinity of the instruction position P. The user can select the shape of the instruction graphic S by touching the shape of the instruction graphic S that the user wishes to change from among the options for the shape of the instruction graphic S displayed in the vicinity of the instruction position P.

[0046] Even after the instruction graphic generation unit 71 generates the instruction graphic S once, the instruction graphic generation unit 71 regenerates the instruction graphic S based on the set shape information received from the shape setting unit 52. Specifically, the instruction graphic generation unit 71 generates the instruction graphic S based on the area information indicating the character string area A, the trajectory information indicating the trajectory L, and the set shape information of the instruction graphic S received again.

[0047] Based on the graphic shape of the instruction graphic S regenerated by the instruction graphic generation unit 71, the display processing unit 74 causes the display 201 to display the instruction graphic S reflecting the change operation of the instruction graphic S as shown in FIGS. 8(b) to 9(b).

[0048] Next, after displaying the indication graphic S, a configuration in which a movement operation of the position of the character string or the indication position P is received from the user and the indication graphic S is displayed again will be described with reference to FIGS. 1 and 10 - 21. FIGS. 10(a1) - 21(a1) are diagrams showing the state before receiving the movement operation of the position of the character string or the indication position P. FIGS. 10(a2) - 21(a2) are diagrams for explaining the change of the locus L for receiving the movement operation of the position of the character string or the indication position P and redisplaying the indication graphic S. FIGS. 10(a3) - 21(a3) are diagrams showing the state after receiving the movement operation of the position of the character string or the indication position P and redisplaying the indication graphic S. Also, FIGS. 10(a1)(a2)(a3) - 21(a1)(a2)(a3) show the case where the shape of the indication graphic S is an arrow, and FIGS. 10(b) - 21(b) show the case where the shape of the indication graphic S is a balloon. In addition, in FIGS. 10 - 21, the character string area A is shown by a dotted line, the locus L is shown by a broken line, and the indication graphic S is shown by a solid line. Here, the character string area A and the locus L are not displayed on the display 201, but are shown in FIGS. 10(a2) - 21(a2) for clarity. Also,

[0049] The redisplay of the indication graphic S due to the movement operation of the position of the character string or the indication position P is performed by the movement unit 53, the locus change unit 72, the indication graphic generation unit 71, and the display processing unit 74.

[0050] The movement unit 53 receives, as a user operation after displaying the indication graphic S on the display 201, a movement operation of the position of the character string or the indication position P, and outputs position movement information which is the absolute coordinate information of the character string or the indication position P in the display area of the display 201.

[0051] The locus change unit 72 is realized by, for example, the locus change processing circuit 210 shown in FIG. 2. The locus change unit 72 changes at least one of the size and the position of the locus L so that the locus L becomes similar in response to the movement received by the movement unit 53. The change of the locus such that the locus L becomes similar means performing at least one of enlargement, reduction, inversion, and rotation. Specifically, the trajectory change unit 72 generates modified trajectory information by reflecting position movement information, which is absolute coordinate information output from the moving unit 53, on trajectory information that is absolute coordinate information of the trajectory L in the display area of the display 201 and is output from the trajectory input unit 51.

[0052] When the moving unit 53 accepts the movement of the position of the character string, as shown in FIGS. 10(a2)-15(a2), the trajectory change unit 72 changes at least one of the size and position of the trajectory L so that the relative position of one end of the trajectory L located inside the character string area A with respect to the character string area A of the instruction position P is the same before and after the change of the trajectory L. For example, as shown in FIGS. 10(a2)-11(a2), the trajectory change unit 72 may expand and invert the trajectory L before the change so that the trajectories are similar before and after the change. Also, as shown in FIGS. 12(a2)-15(a2), the trajectory change unit 72 may expand and rotate the trajectory L before the change so that the trajectories are similar before and after the change.

[0053] When the moving unit 53 accepts the movement of the instruction position P, as shown in FIGS. 16(a2)-21(a2), the trajectory change unit 72 changes at least one of the size and position of the trajectory L so that the position of one end of the trajectory L located inside the character string area A is the same before and after the change of the trajectory L. For example, as shown in FIGS. 16(a2)-18(a2), the trajectory change unit 72 may expand and invert the trajectory L before the change so that the trajectories are similar before and after the change. Also, as shown in FIGS. 19(a2)-21(a2), the trajectory change unit 72 may expand and rotate the trajectory L before the change so that the trajectories are similar before and after the change. Here, the instruction position P is the position of the other end of the trajectory L located outside the character string area A.

[0054] When the indication graphic generation unit 71 receives the position movement information generated by the movement unit 53 and the changed trajectory information generated by the trajectory change unit 72, it regenerates the indication graphic S based on the area information reflecting the position movement information, the changed trajectory information, and the set shape information. Here, the area information reflecting the position movement information is the absolute coordinate information of the character string area A in the display area of the display 201. When the movement unit 53 receives the movement of the character string, the character string area A moves along with the movement of the character string. Therefore, based on the area information which is the absolute coordinate information output by the area setting unit 40 and the area information reflecting the position movement information which is the absolute coordinate information output from the movement unit 53, by regenerating the indication graphic S, an indication graphic S corresponding to the operation received by the movement unit 53 can be generated.

[0055] Based on the graphic shape of the indication graphic S regenerated again by the indication graphic generation unit 74, as shown in FIGS. 10(a3)-21(a3), the display processing unit 74 causes the display 201 to display the indication graphic S reflecting the change operation of the indication graphic S.

[0056] In the above, the case where the shape of the indication graphic S indicated by the set shape information is an arrow has been described. However, when the shape of the indication graphic S indicated by the set shape information is a speech bubble, as shown in FIGS. 10(b)-21(b), a speech bubble deformed corresponding to the movement of the position of the character string or the indication position P is redisplayed.

[0057] Subsequently, after the indication graphic S is displayed, a configuration in which an editing operation of the shape of the indication graphic S is received from the user and the indication graphic S and the character string are redisplayed will be described with reference to FIGS. 1 and 22. In FIG. 22, the character string areas A (A1, A2) are shown by dotted lines, and the indication graphics S (S1, S2) are shown by solid lines. Here, the character string area A is not displayed on the display 201, but is shown in FIG. 22 for clarity. The redisplay of the indication graphic S due to the editing operation of the shape of the indication graphic S is performed by the shape editing unit 54, the character string line break unit 73, the indication graphic generation unit 71, and the display processing unit 74.

[0058] After the shape editing unit 54 displays the instruction graphic S on the display 201, as an operation of the user, the shape editing unit 54 accepts an editing operation of the shape of the instruction graphic S. Here, the editing of the shape of the instruction graphic S includes changing the size of the instruction graphic S once displayed, changing the aspect ratio, and the like. The editing operation of the shape of the instruction graphic S is realized, for example, by long-pressing the instruction graphic S to be edited to select it and dragging the default shape of the selected instruction graphic S.

[0059] The shape editing unit 54 outputs editing setting shape information, which is shape information of the instruction graphic S for which editing has been accepted, to the instruction graphic generation unit 71 and the character string line feed unit 73 of the display control unit 70. Here, the editing setting shape information is relative coordinate information indicating the size, width, height, etc. of the instruction graphic S, and reflects the changes in the size, width, and height of the instruction graphic included in the setting shape information stored in the instruction graphic shape DB 82.

[0060] The instruction graphic generation unit 71 regenerates the instruction graphic S based on the editing setting shape information generated by the shape editing unit 54. Specifically, the instruction graphic generation unit 71 regenerates the instruction graphic S based on the area information, the trajectory information, and the editing setting shape information. For example, as shown in Fig. 22(a), after the speech bubble S1 is displayed as the instruction graphic S, if the shape editing unit 54 accepts an operation of changing the aspect ratio of the speech bubble S1 as an editing operation of the shape of the instruction graphic S, as shown in Fig. 22(b), the instruction graphic generation unit 71 regenerates the speech bubble S2 corresponding to the shape editing operation.

[0061] The character string line break section 73 is realized, for example, by the character string line break processing circuit 211 shown in FIG. 2. The character string line break section 73 breaks the line of the character string in response to the editing operation of the shape of the instruction graphic S received by the shape editing section 54. Specifically, when the shape of the instruction graphic S is a speech bubble and a character string is displayed outside the speech bubble, the character string line break section 73 generates line break information for breaking the line of the character string displayed outside the speech bubble so that the character string is displayed inside the speech bubble. In other words, when the character string does not fit in the speech bubble main body part that surrounds the character string in the speech bubble, line break information for breaking the line of the character string so that the character string fits in the speech bubble main body part is generated. For example, as shown in FIG. 22(b), as a result of the regeneration of the speech bubble S2, when the character string does not fit inside the speech bubble main body part of the regenerated speech bubble S2 and the character string is displayed outside the speech bubble S2, the character string line break section 73 breaks the line of the character string so that the character string is displayed inside the speech bubble. That is, the character string line break section 73 changes the character string area A from the character string area A1 having a height for one line without line breaks to the character string area A2 having a height for two lines after line breaks.

[0062] Based on the graphic shape of the instruction graphic S regenerated by the instruction graphic generation section 71 again, the display processing section 74 causes the display 201 to display, as shown in FIG. 22(c), the instruction graphic S reflecting the change operation of the instruction graphic S and the line - broken character string.

[0063] In FIG. 1, each of the components of the input display device 100, namely the character string input unit 10, the character string acquisition unit 20, the character management DB 81, the character management unit 30, the area setting unit 40, the instruction graphic shape DB 82, the operation reception unit 50, the operation switching unit 60, the instruction graphic generation unit 71, the locus change unit 72, the character string line feed unit 73, the display processing unit 74, and the temporary storage unit 83, is realized by dedicated hardware shown in FIG. 2. That is, the input display device 100 is assumed to be realized by a display 201, a character string input processing circuit 202, a character string acquisition processing circuit 203, a storage processing circuit 204, a character management processing circuit 205, an area setting processing circuit 206, a pointing device 207, an operation switching processing circuit 208, an image generation processing circuit 209, a locus change processing circuit 210, a character string line feed processing circuit 211, and a display processing circuit 212.

[0064] Here, the storage processing circuit 204 corresponds to, for example, non-volatile or volatile semiconductor memories such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), magnetic disks, flexible disks, optical disks, compact disks, mini disks, DVDs (Digital Versatile Disc), etc.

[0065] The pointing device 207 is, for example, a touch panel. Note that the pointing device 207 is not limited to a touch panel and may be a joystick, a pointing stick (track point), a touch pad, a stylus, a data glove, a trackball, a pen tablet, a mouse, a light pen, a joy pad, etc.

[0066] The text management processing circuit 205, the area setting processing circuit 206, the operation switching processing circuit 208, the image generation processing circuit 209, the locus change processing circuit 210, the character string line feed processing circuit 211, and the display processing circuit 212 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel-programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.

[0067] Also, the components of the input display device 100 are not limited to those realized by dedicated hardware, and the input display device 100 may be realized by software, firmware, or a combination of software and firmware. Software or firmware is stored in a computer's memory as a program. A computer means the hardware that executes the program, and examples include a CPU (Central Processing Unit), a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a processor, a DSP (Digital Signal Processor), etc.

[0068] The hardware configuration when the input display device 100 is realized by software or firmware or the like will be described with reference to FIG. 23. FIG. 23 is a hardware configuration diagram of a computer. As shown in FIG. 23, when the input display device 100 is realized by software or firmware or the like, a character management DB 81, an instruction graphic shape DB 82, and a temporary storage unit 83 are configured on the memory 213 of the computer. Also, a program for causing the computer to execute the processing procedures of the character string input unit 10, the character string acquisition unit 20, the character management unit 30, the area setting unit 40, the operation reception unit 50, the operation switching unit 60, the instruction graphic generation unit 71, the locus change unit 72, the character string line feed unit 73, and the display processing unit 74 is stored in the memory 213. Then, the processor 214 may execute the program stored in the memory 213.

[0069] Also, FIG. 2 shows an example where each component of the input display system is implemented by dedicated hardware, and FIG. 23 shows an example where the input display system is implemented by software or firmware or the like. However, this is only an example, and some components in the input display system may be implemented by dedicated hardware, and the remaining components may be implemented by software or firmware or the like. For example, it is possible to implement the character input unit 10, the operation reception unit 50, and the operation switching unit 60 by dedicated hardware, and implement the character string acquisition unit 20, the character management DB 81, the character management unit 30, the area setting unit 40, the instruction graphic shape DB 82, the instruction graphic generation unit 71, the locus change unit 72, the character string line feed unit 73, the display processing unit 74, and the temporary storage unit 83 by software or firmware or the like. However, the combination of dedicated hardware and software or the like is arbitrary.

[0070] Subsequently, an input display method using the input display device 100 according to Embodiment 1 of the present disclosure will be described with reference to FIG. 24. FIG. 24 is a flowchart showing the procedure of the input display method according to Embodiment 1.

[0071] As shown in FIG. 24, first, the display processing unit 74 causes the display 201 to display the character string input by the character input unit 10 (step ST1). Specifically, the display processing unit 74 causes the display 201 to display the character string based on the character string information acquired by the character input unit 10 receiving the input and the character attribute information output from the character management unit 30.

[0072] Subsequently, the character string acquisition unit 20 acquires the character string information, which is the information of the character string displayed on the display 201 (step ST2). Specifically, the character string acquisition unit 20 acquires the character string information including the number of characters and the arrangement of the character string from the display control unit 70.

[0073] Subsequently, the character management unit 30 acquires character attribute information (step ST3). The character attribute information is the character height and the character width. The character management unit 30 refers to the character attribute table stored in the character management DB 81 and acquires character attribute information including the character height and the character width corresponding to the character type and the character size of the character string displayed on the display 201.

[0074] The area setting unit 40 sets the character string area A based on the character string information acquired by the character string acquisition unit 20 and the character attribute information acquired by the character management unit 30 (step ST4). Specifically, the area setting unit 40 sets, as the character string area A, an area corresponding to the number of characters indicated by the character string information and the arrangement of the characters, and the character height and the character width indicated by the character attribute information.

[0075] Subsequently, the shape setting unit 52 determines whether or not it has received a setting operation for the shape of the indication graphic S (step ST5). When the shape setting unit 52 has received a setting operation for the shape of the indication graphic S (Yes in step ST5), the shape setting unit 52 sets to display the shape of the indication graphic S for which the setting operation has been received on the display 201 (step ST6). When the shape setting unit 52 has not received a setting operation for the shape of the indication graphic S (No in step ST5), the shape setting unit 52 does not change the shape of the indication graphic S and sets to display the shape of the indication graphic S in the initial setting on the display 201. For example, when an arrow is set as the indication graphic S in the initial setting, if the user wants to display an indication graphic S other than the arrow on the display 201, a setting operation is performed, and if the user wants to display the arrow on the display 201, no particular operation is performed.

[0076] After setting the character string area A (steps ST2 - ST4) and setting the shape of the indication graphic S (steps ST5 - ST6), the locus input unit 51 receives an input of the locus L (steps ST7 - ST9).

[0077] First, the trajectory input unit 51 determines whether it has received an operation to select a character string for displaying the instruction graphic S (step ST7). The operation to select a character string for displaying the instruction graphic S is executed, for example, by touching the inside of the character string area A with a touch panel. The trajectory input unit 51 waits until it receives an operation to select a character string (No in step ST7). When the trajectory input unit 51 receives an operation to select a character string (Yes in step ST7), the trajectory input unit 51 outputs a signal for causing the trajectory reception symbol M to be displayed on the display 201 to the display processing unit 74, and the display processing unit 74 causes the trajectory reception symbol M to be displayed on the display 201 (step ST8).

[0078] After the trajectory reception symbol M is displayed on the display 201, the trajectory input unit 51 determines whether it has received an input of the trajectory L (step ST9). Here, the trajectory L that the trajectory input unit 51 receives an input for is a trajectory L that connects the inside of the character string area A and the instruction position P located outside the character string area A. The trajectory input unit 51 waits until it receives an input operation of the trajectory L (No in step ST9). When the trajectory input unit 51 receives an input operation of the trajectory L (Yes in step ST9), an instruction graphic S is generated based on the trajectory L located outside the character string area (step ST10).

[0079] Specifically, the instruction graphic generation unit 71 generates the instruction graphic S based on the character string area A set by the area setting unit 40, the locus L received by the locus input unit 51, and the shape of the instruction graphic S set by the shape setting unit 52. For example, when the shape of the instruction graphic S set by the shape setting unit 52 is a line (Fig. 5(a)), as shown in Fig. 6(a), the instruction graphic generation unit 71 generates, as the instruction graphic S, a locus L that connects the intersection of the character string area A and the locus L and the instruction position P. When the shape of the instruction graphic S set by the shape setting unit 52 is an arrow (Fig. 5(b)), as shown in Fig. 6(b), the instruction graphic generation unit 71 generates, as the instruction graphic S, a graphic obtained by adding an arrowhead symbol to the locus L that connects the intersection of the character string area A and the locus L and the instruction position P. Here, the arrowhead symbol is synthesized with at least one of the intersection of the character string area A and the locus L and the instruction position P. When the shape of the instruction graphic S set by the shape setting unit 52 is a balloon having a horn-shaped balloon instruction part (Figs. 5(c)(d)), as shown in Fig. 6(c), the instruction graphic generation unit 71 generates, as the instruction graphic S, a graphic that encloses the locus L that connects the intersection of the character string area A and the locus L and the instruction position P and the character string area A. Further, when the shape of the instruction graphic S set by the shape setting unit 52 is a balloon having a linear balloon instruction part (Figs. 5(e)(f)), as shown in Fig. 6(d), the instruction graphic generation unit 71 generates, as the instruction graphic S, a graphic obtained by combining a graphic that encloses the character string area A with the locus that connects the intersection of the character string area A and the locus L and the instruction position P.

[0080] The display processing unit 74 causes the display 201 to display the character string acquired by the character string acquisition unit 20 and the instruction graphic S generated by the instruction graphic generation unit 71 (step ST11).

[0081] As described above, the input display method according to Embodiment 1 includes an area setting step (steps ST3-ST4) of setting the display area of the character string as the character string area A, a locus input step (steps ST7-ST9) of receiving an input of a locus L connecting the inside of the character string area A and an instruction position P located outside the character string area A, and a display control step (steps ST10-ST11) of generating an instruction graphic S representing the instruction position P based on the locus L located outside the character string area A and displaying the generated instruction graphic S. According to the above input display method, the instruction graphic S can be generated based on the locus L input by the user. Therefore, the instruction graphic S can be generated without performing an operation of editing the instruction graphic S having a preset shape, and the operability of drawing the instruction graphic S, that is, the graphic representing the position indicated by the character string, can be improved. Also, according to the above input display method, since the instruction graphic S can be generated based on the locus L input by the user, for example, the instruction graphic S can be generated and displayed based on a complex locus L as shown in FIG. 9. Therefore, according to the above input display method, the instruction graphic S having a complex shape can be drawn by a simple operation.

[0082] Note that, in the above, an example in which the area setting unit 40 uses the number of characters, the arrangement of characters, the character height, and the character width to set the character string area A has been described, but the present invention is not limited thereto. The area setting unit 40 only needs to be able to set the display area of the character string as the character string area A, and a known technique may be used to set the character string area. Also, in the above, an example in which the character string acquisition unit 20 and the character management unit 30 output the number of characters, the arrangement of characters, the character height, and the character width to the area setting unit 40 has been described, but the character string acquisition unit 20 may acquire the number of characters, the arrangement of characters, the character height, and the character width and output them to the area setting unit 40. When the character string acquisition unit 20 acquires the number of characters, the arrangement of characters, the character height, and the character width, the input display device 100 does not necessarily include the character management unit 30 and the character management DB. Furthermore, in the above description, an example was given in which the character management unit 30 acquires the character height and width corresponding to the character type and number of characters predetermined by the character management unit 30. However, the character management unit 30 may acquire the character height and width corresponding to the character type and character size included in the character string information acquired by the character string acquisition unit 20.

[0083] In addition, in the above description, an example was shown in which the area setting unit 40 sets the character string area A for the character string acquired by the character string acquisition unit 20. However, the area setting unit 40 may set the character string area A only for the selected character string. Also, when the area setting unit 40 sets the character string area A only for the selected character string, the locus input unit 51 may display the locus reception symbol M inside the character string for which the character string area A is set without receiving the selection of the character string.

[0084] Also, in the above description, an example was shown in which the processing is performed in the order of setting the character string area A (steps ST2 - ST4), setting the shape of the instruction graphic S (steps ST5 - ST6), and receiving the input of the locus (steps ST7 - ST9). However, it is not limited to this. Before the instruction graphic generation unit 71 generates the instruction graphic S, it is sufficient if the instruction graphic generation unit 71 can output the character string area A, the locus L, and the instruction graphic S. Therefore, the setting of the character string area A (steps ST2 - ST4), the setting of the shape of the instruction graphic S (steps ST5 - ST6), and the reception of the input of the locus L (steps ST7 - ST9) may be executed in parallel or in a changed order.

[0085] Next, after finishing the display control step (steps ST10 - ST11), that is, after displaying the instruction graphic S on the display 201, the input display method when changing the shape of the instruction graphic S will be described with reference to FIG. 25. FIG. 25 is a flowchart showing the input display method when changing the shape of the instruction graphic S after the display of the instruction graphic S.

[0086] As shown in FIG. 25, after completing the display control steps (steps ST10 - ST11), the shape setting unit 52 determines whether it has received an operation to change the setting of the shape of the instruction graphic S (step ST12). The operation to change the setting of the shape at the instruction position is executed, for example, by touching the shape option of the instruction graphic S displayed near the instruction position P when touching the instruction position P, to touch the shape of the instruction graphic S for which a change is desired. When the shape setting unit 52 has not received an operation to change the setting of the shape at the instruction position P (No in step ST12), the character string and the instruction graphic S displayed in step ST11 are displayed without being changed. When the shape setting unit 52 has received an operation to change the setting of the shape of the instruction graphic S (Yes in step ST12), the instruction graphic generation unit 71 regenerates the instruction graphic S based on the setting of the shape of the instruction position P changed by the shape setting unit 52 (step ST13). The display processing unit 74 displays the character string and the regenerated instruction graphic S on the display 201 (step ST14). Note that the specific processing contents of the instruction graphic generation unit 71 and the display processing unit 74 are the same as those in steps ST10 and ST11.

[0087] As described above, according to the input display method for changing the shape of the instruction graphic realized by the shape setting unit 52, the instruction graphic generation unit 71, and the display control unit 70, even after the instruction graphic S is displayed on the display 201, the shape of the instruction graphic S can be appropriately changed and displayed without performing an operation to edit the instruction graphic S displayed on the display 201. Therefore, according to the above input display method, the operability of drawing the instruction graphic S can be further improved.

[0088] Subsequently, after completing the display control steps (steps ST10 - ST11), that is, after displaying the instruction graphic S on the display 201, an input display method for moving the position of the character string or the instruction position P will be described with reference to FIG. 26. FIG. 26 is a flowchart showing the input display method for moving the position of the character string or the instruction position P after the display of the instruction graphic S.

[0089] As shown in FIG. 26, after completing the display control steps (steps ST10 - ST11), the moving unit 53 determines whether it has received a movement operation of the position of the character string or the instruction position P (step ST15). The movement operation of the position of the character string or the instruction position P is executed, for example, by long - pressing the position of the character string or the instruction position P to be moved. When the moving unit 53 does not receive the movement operation of the position of the character string or the instruction position P (No in step ST15), the character string and the instruction figure S displayed on the display 201 in step ST11 are displayed without being changed. When the moving unit 53 receives the movement of the position of the character string or the instruction position P (Yes in step ST15), the trajectory changing unit 72 changes at least one of the size and the position of the trajectory L so that the trajectory L becomes similar corresponding to the movement received by the moving unit 53 (step ST16).

[0090] Specifically, when the moving unit 53 receives the movement of the position of the character string, the trajectory changing unit 72 changes at least one of the size and the position of the trajectory L so that the relative position of the instruction position P and one end of the trajectory L located inside the character string area A with respect to the character string area A remains the same before and after the change of the trajectory L. Also, when the moving unit 53 receives the movement of the instruction position P, the trajectory changing unit 72 changes at least one of the size and the position of the trajectory L so that the position of one end of the trajectory L located inside the character string area A remains the same before and after the change of the trajectory L.

[0091] When at least one of the size and the position of the trajectory L is changed by the trajectory changing unit 72, the instruction figure generating unit 71 regenerates the instruction figure S based on the changed trajectory L (step ST17). The display processing unit 74 displays the character string and the regenerated instruction figure S on the display 201 (step ST18). Note that the specific processing contents of the instruction figure generating unit 71 and the display processing unit 74 are the same as those in steps ST10 and ST11.

[0092] According to the input display method for moving the position of the character string or the indication position P realized by the moving unit 53, the locus changing unit 72, and the indication graphic generating unit 71 as described above, even when the position of the character string or the indication position P is changed after the indication graphic S is displayed on the display 201, the indication graphic S corresponding to the movement of the position of the character string or the indication position P can be automatically displayed without performing an operation of editing the indication graphic S displayed on the display 201. Therefore, according to the above input display method, the operability of drawing the indication graphic S can be further improved.

[0093] Subsequently, after completing the display control steps (steps ST10 - ST11), that is, after the indication graphic S is displayed on the display 201, the input display method for editing the shape of the indication graphic S will be described with reference to FIG. 29. FIG. 27 is a flowchart showing the input display method for editing the shape of the indication graphic S after the indication graphic S is displayed.

[0094] As shown in FIG. 27, after the display control steps (steps ST10 - ST11) are completed, the shape editing unit 54 determines whether it has received an edit of the shape of the instruction graphic S (step ST19). The edit of the shape of the instruction graphic S is executed, for example, by long - pressing the instruction graphic S to be edited. If the shape editing unit 54 has not received an edit of the shape of the instruction graphic S (No in step ST19), the character string and the instruction graphic S displayed on the display 201 in step ST11 are displayed without being changed. If the shape editing unit 54 has received an edit of the shape of the instruction graphic S (Yes in step ST19), the instruction graphic S is regenerated based on the shape edit information of the instruction graphic S output from the shape editing unit 54 (step ST20). Subsequently, the character string line - break unit 73 determines whether the shape of the instruction graphic S output from the shape setting unit 52 is a speech bubble (step ST21). If the shape of the instruction graphic S is a speech bubble (Yes in step ST21), the character string line - break unit 73 determines whether a character string is displayed outside the speech bubble (step ST22). If the character string line - break unit 73 determines that a character string is displayed outside the speech bubble (Yes in step ST22), the character string line - break unit 73 outputs information for line - breaking the character string so that the character string is displayed inside the speech bubble to the display processing unit 74 (step ST23). The display processing unit 74 displays the line - broken character string and the edited instruction graphic S so that they are displayed inside the speech bubble based on the character string line - break information output from the character string line - break unit 73 and the changed instruction graphic information output from the instruction graphic generation unit 71 (step ST24). If the character string line - break unit 73 determines that the shape of the instruction graphic S is not a speech bubble (No in step ST21), the display processing unit 74 displays the same character string as in step ST11 and the instruction graphic with the size changed based on the character string information output from the character string acquisition unit 20 and the changed instruction graphic information output from the instruction graphic generation unit 71 (step ST25).

[0095] As described above, according to the input display method realized by the shape editing unit 54, the character string line break unit 73, and the instruction graphic generation unit 71, even when the shape of the instruction graphic S is edited after the instruction graphic S is displayed on the display 201, it is possible to automatically display a character string corresponding to the size of the instruction graphic S without editing the arrangement of the character string displayed together with the instruction graphic S.

[0096] The operations and effects of the input display device 100, the input display method, and the input display program according to Embodiment 1 of the present disclosure will be described.

[0097] The input display device 100 according to Embodiment 1 of the present disclosure includes an area setting unit 40 that sets the display area of the character string as a character string area A, a locus input unit 51 that receives an input of a locus L connecting the inside of the character string area A and an instruction position P that is the position indicated by the character string located outside the character string area A, and a display control unit 70 that generates an instruction graphic S representing the instruction position P based on the locus L located outside the character string area A and displays the generated instruction graphic S.

[0098] The input display method according to Embodiment 1 of the present disclosure includes an area setting step of setting the display area of the character string as a character string area A, a locus input step of receiving an input of a locus L connecting the inside of the character string area A and an instruction position P that is the position indicated by the character string located outside the character string area A, and a display control step of generating an instruction graphic S representing the instruction position P based on the locus L located outside the character string area A and displaying the generated instruction graphic S.

[0099] The input display program according to Embodiment 1 of the present disclosure causes a computer to realize an area setting function of setting the display area of the character string as a character string area A, a locus input function of receiving an input of a locus L connecting the inside of the character string area A and an instruction position P that is the position indicated by the character string located outside the character string area A, and a display control function of generating an instruction graphic S representing the instruction position P based on the locus L located outside the character string area A and displaying the generated instruction graphic S.

[0100] According to the input display device 100, input display method, and input display program according to Embodiment 1 of the present disclosure, an instruction graphic S can be generated based on the trajectory input by the user. Therefore, the instruction graphic S can be generated without performing an operation of editing the instruction graphic S having a preset shape. That is, according to the input display device 100, input display method, and input display program according to Embodiment 1 of the present disclosure, a graphic representing the position indicated by the character string can be displayed with a small number of operation steps, and the operability of drawing the graphic representing the position indicated by the character string can be improved.

[0101] Furthermore, according to the input display device 100, input display method, and input display program according to Embodiment 1 of the present disclosure, since the instruction graphic S can be generated based on the trajectory input by the user, for example, a complicatedly shaped instruction graphic S as shown in FIG. 9 can be generated without performing an operation of editing the instruction graphic S having a preset shape.

[0102] The input display device 100 according to Embodiment 1 of the present disclosure further includes a shape setting unit 52 that sets the shape of the instruction graphic S to be displayed by the display control unit 70 from a plurality of preset shapes of the instruction graphic S. According to the input display device 100 described above, even after the instruction graphic S is generated once, the shape of the instruction graphic S can be appropriately changed and displayed without performing an operation of editing the instruction graphic S once displayed on the display 201.

[0103] Furthermore, the input display device 100 according to Embodiment 1 of the present disclosure further includes a moving unit 53 that accepts the movement of the position of the character string or the instruction position P, and the display control unit 70 changes at least one of the size and position of the trajectory L so that the trajectory L becomes similar in response to the movement accepted by the moving unit 53, and displays the instruction graphic S based on the changed trajectory L. According to the input display device 100 described above, even when the position of the character string or the instruction position P is changed after the instruction graphic S is generated once, the instruction graphic S can be displayed without performing an operation of editing the displayed instruction graphic S.

[0104] The input display device 100 according to Embodiment 1 of the present disclosure further includes a shape editing unit 54 that accepts editing of the shape of the instruction graphic S. When the instruction graphic S is a speech bubble and the character string does not fit in the portion surrounding the character string in the speech bubble, the display control unit 70 causes the line-wrapped character string to be displayed corresponding to the size of the portion surrounding the character string in the speech bubble. According to the input display device 100 described above, even when the shape of the instruction graphic S is edited, it is possible to display a character string corresponding to the size of the instruction graphic S without the user performing an editing operation on the arrangement of the displayed character string.

[0105] In the above description, an example is shown in which the character string area A and the locus L are not displayed on the display 201, and only the character string and the instruction graphic S are displayed on the display 201. However, the character string area A and the locus L may be displayed on the display 201. Further, the display processing unit 74 may display the character string area A and the locus L on the display 201 only for a certain period of time. By displaying the character string area A and the locus L on the display 201, the process for displaying the instruction graphic S can be made visible, so that the operability of drawing the instruction graphic S can be further improved.

[0106] Modification example. In Embodiment 1, the input display device 100 that displays the character string and the instruction graphic S on the display 201 has been described. In a modification example of Embodiment 1, an input display device 101 that can display a character string in a free layout of the user and display it on the display 201 together with the instruction graphic S corresponding to the character string will be described.

[0107] The input display device 101 according to the modification of Embodiment 1 is different from the input display device 100 according to Embodiment 1 in that it includes a display control unit 70a that generates a trajectory image indicating the trajectory L received by the trajectory input unit 51 and superimposes and displays a character string on the generated trajectory image. The configuration of the input display device 101 according to the modification of Embodiment 1 will be described with reference to FIGS. 28 and 29. FIG. 28 is a system block diagram of the input display device 101, and FIG. 29 is a hardware configuration diagram of the input display device 101. The input display device 101 according to the modification of Embodiment 1 differs from the input display device 100 according to Embodiment 1 in that the internal configurations and operations of the character string input unit 10a, the operation reception unit 50a, the operation switching unit 60a, and the display control unit 70a are different, but the other configurations and operations are the same.

[0108] As shown in FIG. 28, the character string input unit 10a included in the input display device 101 acquires a character string indicating the recognition result of voice as a character string to be displayed. Then, similar to the character string input unit 10 according to Embodiment 1, the character string input unit 10a outputs the character string received by the character string input unit 10a to the character string acquisition unit 20.

[0109] As shown in FIG. 28, the character input unit 10a included in the input display device 101 includes a voice detection unit 11, a voice recognition dictionary DB84, and a voice recognition unit 12. The voice detection unit 11 is realized by, for example, a microphone 215 shown in FIG. 29. The voice detection unit 11 detects the user's voice and outputs the detected voice to the voice recognition unit 12. The voice recognition dictionary DB84 is realized by, for example, a memory processing circuit 204 shown in FIG. 29. The voice recognition dictionary DB84 includes, for example, an acoustic model in which acoustic features of phonemes, which are small units of human vocalization, are described, and a recognition dictionary in which words to be voice-recognized are described. The voice recognition unit 12 is realized by, for example, a voice recognition processing circuit 216 shown in FIG. 29. The voice recognition unit 12 is equipped with a voice recognition engine that recognizes the voice detected by the voice detection unit 11. The voice recognition unit 12 analyzes the voice detected by the voice detection unit 11, calculates the acoustic features of the voice, and searches for a word having the acoustic features closest to the calculated acoustic features from among the words described in the recognition dictionary of the voice recognition dictionary DB84. The voice recognition unit 12 outputs a character string indicating the searched word to the display processing unit 74a of the display control unit 70a as a character string indicating the recognition result of the voice.

[0110] Note that although the character input unit 10a shown in FIG. 28 implements the voice recognition dictionary DB84 and the voice recognition unit 12, the character input unit 10a may implement a data transmission / reception unit instead of the voice recognition dictionary DB84 and the voice recognition unit 12. Here, the data transmission / reception unit is a network communication device such as a network card that can transmit and receive data with a voice recognition server (not shown) via a communication path such as the Internet or a LAN (Local Area Network). The data transmission / reception unit transmits data indicating the voice detected by the voice detection unit 11 to the voice recognition server. The voice recognition server is equipped with a voice recognition engine that recognizes voices. When receiving data indicating the voice transmitted from the data transmission / reception unit, the voice recognition server recognizes the voice indicated by the received data and transmits a character string indicating the recognition result of the voice to the data transmission / reception unit. When receiving a character string indicating the recognition result of the voice transmitted from the voice recognition server, the data transmission / reception unit outputs the character string to the display processing unit 74a of the display control unit 70a.

[0111] In addition to the user operations received by the operation reception unit 50 according to Embodiment 1, the operation reception unit 50a receives an operation for inputting a locus L for generating a locus image for superimposing and displaying character strings. Specifically, the locus input unit 51a of the operation reception unit 50a receives the input of the locus L for generating a locus image for superimposing and displaying character strings, in addition to the locus for generating the instruction graphic S. The operation reception unit 50a outputs the information of the received locus L to the display control unit 70a. Specifically, when the locus input unit 51a receives a locus L that connects the locus for generating the instruction graphic S, that is, the instruction positions located inside and outside the character string area A, the operation reception unit 50a outputs the information of the received locus L to the instruction graphic generation unit 71. Also, when the locus input unit 51a receives a locus L for generating a locus image for superimposing and displaying character strings, the operation reception unit 50a outputs the information of the received locus L to the locus image generation unit 75 of the display control unit 70a.

[0112] In addition to the operations switched by the operation switching unit 60 according to Embodiment 1, the operation switching unit 60a switches between the input operation of the locus L for generating the instruction graphic S, which is the operation received by the locus input unit 51a, and the input operation of the locus L for generating a locus image for superimposing and displaying character strings. For example, when the operation switching unit 60a detects a long press operation of the pointing device 207, the operation switching unit 60a performs a process of switching the operation received by the locus input unit 51a.

[0113] In addition to the configuration of the display control unit 70 according to Embodiment 1, the display control unit 70a includes a locus image generation unit 75. The locus image generation unit 75 is realized by, for example, the image generation processing circuit 209 shown in FIG. 2. The locus image generation unit 75 generates a locus image indicating the locus L from the input operation of the locus L for generating a locus image for superimposing and displaying the character string received by the locus input unit 51a. Similar to the area setting unit 40, the locus image generation unit 75 generates a locus image with a line width corresponding to the character height indicated by the character attribute information output from the character management unit 30.

[0114] The display processing unit 74a, in addition to the processing performed by the display processing unit 74 according to the first embodiment, performs processing to display the trajectory image generated by the trajectory image generation unit 75 on the display 201 and to display the character string acquired by the character string input unit 10a overlaid on the trajectory image. Further, the display control unit 70a may perform processing to erase the display of the trajectory image after displaying the character string overlaid on the trajectory image.

[0115] Subsequently, an input display method by the input display device 101 will be described with reference to FIG. 27. FIG. 27 is a flowchart showing the procedure of the input display method according to a modification of the first embodiment.

[0116] In the input display method by the input display device 101, instead of ST1 in FIG. 6, ST26 - ST31 in FIG. 30 are executed. As shown in FIG. 30, first, the operation switching unit 60a switches the operation received by the locus input unit 51a to the input operation of the locus L for generating a locus image (step ST26). Specifically, the operation switching unit 60a detects a long-press operation by the user and switches to the input operation of the locus L for generating a locus image. Next, the locus input unit 51a determines whether it has received the input operation of the locus L for generating a locus image (step ST27). The locus input unit 51a waits until it receives the input operation of the locus L for generating a locus image (No in step ST27). When the locus input unit 51a receives the input operation of the locus L for generating a locus image (Yes in step ST27), the locus image generation unit 75 generates a locus image (step ST28). Specifically, a locus image with a line width corresponding to the character height indicated by the character attribute information output from the character management unit 30 is generated. Subsequently, the voice detection unit 11 of the character string input unit 10 determines whether it has detected the user's voice (step ST29). When the voice detection unit 11 detects the user's voice (Yes in step ST29), the voice recognition unit 12 uses the voice recognition dictionary DB84 to perform voice recognition processing, generates a character string indicating the voice recognition result, and outputs the character string to the display control unit 70a (step ST30). The display processing unit 74a of the display control unit 70a superimposes and displays the locus image output from the locus image generation unit 75 and the character string output from the character string input unit 10 on the display 201 (step ST31).

[0117] The operation switching unit 60a waits until a long-press operation is detected (No in step ST32). After a character string is displayed on the display 201, when a long-press operation is detected by the operation switching unit 60a (Yes in step ST32), the operation received by the locus input unit 51a is switched to the operation for generating a command graphic (step ST33). After the switching, similar to the input display method by the input display device 100 according to the first embodiment, a command graphic S is generated based on the operation for generating a command graphic received by the locus input unit 51a. That is, steps ST2 - ST11 in FIG. 6 are executed.

[0118] The operation and effect of the input display device 101 according to the modification of Embodiment 1 of the present disclosure will be described.

[0119] The input display device 101 according to Embodiment 1 of the present disclosure further includes, in addition to the input display device 100 according to Embodiment 1 of the present disclosure, a character string acquisition unit 20a that receives input of a character string, and a trajectory image generation unit 75 that generates a trajectory image indicating the trajectory received by the trajectory input unit 51a. The display control unit 70a causes the character string received by the character string input unit to be displayed superimposed on the trajectory image.

[0120] According to the input display device 101 according to the modification of Embodiment 1, a character string can be displayed in a free layout of the user, and an instruction graphic S corresponding to the character string displayed in the free layout can be automatically displayed. In addition, since the input operation of the character string and the generation operation of the instruction graphic S can be easily switched by a long-press operation of the user, the character string input operation and the graphic generation operation can be performed with a small number of steps.

[0121] As described above, the present disclosure has been described based on each embodiment, but the present disclosure is not limited to each embodiment. Also, appropriately combining each embodiment, modifying or omitting it, etc. are also included in the scope of the technical idea of the present disclosure.

Description of Reference Numerals

[0122] 10, 10a Character string input unit 20 Character string acquisition unit 30, 30a Character management unit 40 Region setting unit 50, 50a Operation reception unit 51, 51a Trajectory input unit 52 Shape setting unit 53 Movement unit 54 Shape editing unit 60, 60a Operation switching unit 70, 70a Display control unit 71 Instruction graphic generation unit 72 Trajectory change unit 73 String line break section 74, 74a Display processing unit 75 Locus image generation unit 81 Character management DB 82 Instruction graphic shape DB 83 Temporary storage unit 84 Speech recognition dictionary DB 100, 101 Input display device 201 Display 202 Character input processing circuit 203 String acquisition processing circuit 204 Memory processing circuit 205 Character management processing circuit 206 Region setting processing circuit 207 Pointing device 208 Operation switching processing circuit 209 Image generation processing circuit 210 Locus change processing circuit 211 String line break processing circuit 212 Display processing circuit 213 Memory 214 Processor 215 Microphone 216 Speech recognition processing circuit

Claims

1. A region setting unit that sets the display area for a string as a string area, A trajectory input unit that receives input of a trajectory connecting the inside of the string area and an indicated position which is the position pointed to by the string located outside the string area, A display control unit generates an indicator figure that represents the indicated position based on the trajectory which is located outside the string area and connects the intersection point of the string area and the trajectory to the indicated position, and displays the generated indicator figure. An input display device equipped with the following features.

2. The system further includes a shape setting unit for setting the shape of the instruction figure to be displayed, The display control unit generates the instruction figure based on the shape of the instruction figure set by the shape setting unit. The input display device according to claim 1.

3. The shape of the instruction figure set by the shape setting unit is a line. The display control unit causes the trajectory connecting the intersection of the string area and the trajectory to the indicated position to be displayed as the indicated figure. The input display device according to claim 2.

4. The shape of the indicator figure set by the shape setting unit is an arrow. The display control unit causes the display control unit to display a figure as the instruction figure, which is the trajectory connecting the intersection point of the string area and the trajectory to the instruction position, with an arrowhead symbol added to it. The arrowhead symbol is displayed at least one of the intersection point of the string area and the trajectory, and the indicated position. The input display device according to claim 2.

5. The shape of the instruction figure set by the shape setting unit is a callout. The display control unit displays the trajectory connecting the intersection of the string area and the trajectory to the indicated position, and the figure enclosing the string area as the indicated figure. The input display device according to claim 2.

6. The shape of the instruction figure set by the shape setting unit is a callout. The display control unit causes the indicator figure to display a figure that combines the figure enclosing the text area with the figure that connects the intersection point of the text area and the trajectory to the indicator position. The input display device according to claim 2.

7. The system further includes a moving unit that accepts movement of the position of the string or the indicated position, The display control unit, in response to the movement received by the movement unit, changes at least one of the size and position of the trajectory so that the trajectory is similar, and displays the instruction figure based on the changed trajectory. The input display device according to any one of claims 1 to 6.

8. The moving unit receives a request to move the position of the string, The display control unit modifies at least one of the size and position of the trajectory so that the indicated position located outside the string area and the relative position of one end of the trajectory located inside the string area are the same before and after the modification of the trajectory, and displays the indicated figure based on the modified trajectory. The input display device according to claim 7.

9. The moving unit receives the movement of the indicated position, The display control unit modifies at least one of the size and position of the trajectory so that the position of one end of the trajectory located within the string area is the same before and after the modification of the trajectory, and displays the indicator figure based on the modified trajectory. The input display device according to claim 7.

10. The system further includes a shape editing unit that accepts editing of the shape of the aforementioned instruction figure, The display control unit, when the instruction figure is a callout, displays the string inside the callout by adding a line break to the string displayed outside the callout. The input display device according to claim 1.

11. A string input unit that accepts the aforementioned string input, A trajectory image generation unit generates a trajectory image showing the trajectory received by the trajectory input unit, Furthermore, The display control unit overlays the string received by the string input unit onto the trajectory image and displays it. The input display device according to claim 1.

12. A region setting step that sets the display area for the string as a string area, A trajectory input step that accepts input of a trajectory connecting the inside of the string area and an indicated position which is the position pointed to by the string located outside the string area, A display control step of generating an indicator figure that represents the indicated position based on the trajectory which is located outside the string area and connects the intersection point of the string area and the trajectory to the indicated position, and displaying the generated indicator figure, An input display method that includes this.

13. On the computer, A region setting function that sets the display area for a string as a string area, A trajectory input function that accepts input of a trajectory connecting the inside of the string area and an indicated position which is the position pointed to by the string located outside the string area, A display control function that generates an indicator figure representing the indicated position based on the trajectory which is located outside the string area and connects the intersection point of the string area and the trajectory to the indicated position, and displays the generated indicator figure, An input display program to achieve this.

Images