Information processing device, recording medium and information processing method

Abstract

An information processing device, a recording medium and an information processing method are provided. The information processing device comprises: a display unit for displaying an image; an indication unit for indicating to an operator information to be input; a detection unit for detecting a designated position in the display unit displaying the image; and an input unit for inputting input information corresponding to the information to be input indicated by the indication unit within a range determined by a start designated position and an end designated position in the image.

Description

Technical Field

[0001] The present invention relates to an information processing device, a recording medium and an information processing method. Background Art

[0002] For example, Patent Document 1 discloses an image forming device, which includes: an application form selection acceptance unit, which accepts the selection of an application form having a column for entering personal information; a personal authentication information input acceptance unit, which accepts the input of personal authentication information; a personal information acquisition unit, which unlocks the IC card according to the input personal authentication information to acquire the personal information recorded in the IC card; an application form generation unit, which generates an application form based on the selected application form template and the personal information acquired from the IC card; and an application form output unit, which outputs the generated application form.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2016-206926 Summary of the invention

[0004] Conventionally, there is a system for inputting operator information such as personal information in a form such as an application. In this system, for example, when an operator specifies an input field in a form such as an application, the operator's information corresponding to the specified input field is input using information stored in a terminal, etc. However, since the information of the form such as an application needs to be registered in advance in the system, it does not correspond to a case where the operator's information is input in a form created by handwriting as an image display.

[0005] An object of the present invention is to enable input of information to be input without pre-registering information of a style.

[0006] The invention described in Option 1 is an information processing device, which comprises: a display unit that displays an image; an indication unit that indicates to the operator the information to be input; a detection unit that detects a designated position in the display unit that displays the image; and an input unit that inputs input information corresponding to the information to be input indicated by the indication unit within a range determined by a start designated position and an end designated position in the image.

[0007] The invention described in claim 2 is characterized in that in the information processing device described in claim 1, the input unit inputs the input information after determining the start designated position and the end designated position.

[0008] The invention described in Scheme 3 is characterized in that in the information processing device described in Scheme 2, when there are characters within the range determined by the start designated position and the end designated position, the input unit inputs the input information within the range without characters.

[0009] The invention described in Scheme 4 in the information processing device described in Scheme 3 is characterized in that, when the character is a character that satisfies a predetermined condition, the input unit divides the range with the character and inputs the input information separately for each divided range.

[0010] The invention described in Scheme 5 is characterized in that in the information processing device described in Scheme 4, the character satisfying the predetermined condition is a character contained in the input information, the input unit divides the input information with the character, removes the character from the input information and inputs the input information separately for each divided range.

[0011] The invention described in Scheme 6 in the information processing device described in Scheme 1 is characterized in that, when a predetermined operation is performed when the designated position moves from the start designated position to the end designated position, the input unit interrupts the designation of the range by starting the operation, and restarts the designation of the range by ending the operation.

[0012] The invention described in Scheme 7 is characterized in that in the information processing device described in Scheme 6, the predetermined operation is an operation performed after the designated position moves from the starting designated position along a predetermined direction to move the designated position in a direction forming an angle greater than a specific size with the direction.

[0013] The invention described in claim 8 is characterized in that in the information processing device described in claim 1, the input information is input by the input unit while the designated position is moved from the start designated position.

[0014] The invention described in claim 9 is characterized in that in the information processing device described in claim 8, when an operation of withdrawing the designated position toward the start designated position is performed, the input unit deletes the input information that has been input.

[0015] The invention described in Scheme 10 is a recording medium, which records a program for enabling a computer to implement the following functions: a function of indicating to an operator the information to be input; a function of detecting a designated position in a display unit that displays an image; and a function of inputting input information corresponding to the indicated information to be input within a range determined by a start designated position and an end designated position in the image.

[0016] The invention described in Scheme 11 is an information processing method, which includes the following steps: a display step of displaying an image; an indication step of indicating to the operator the information to be input; a detection step of detecting a designated position in the display unit displaying the image; and an input step of inputting input information corresponding to the information to be input indicated by the indication unit within a range determined by the start designated position and the end designated position in the image.

[0017] Effects of the Invention

[0018] According to the first aspect of the present invention, information to be input can be input without pre-registering information of the style.

[0019] According to the second aspect of the present invention, information to be input can be input more reliably.

[0020] According to the third aspect of the present invention, even when there are characters at the location designated by the operator, the information to be input can be input.

[0021] According to the fourth aspect of the present invention, compared with a case where information to be input is input without dividing the range determined by the start designated position and the end designated position, erroneous input of information to be input can be suppressed.

[0022] According to the fifth aspect of the present invention, compared with a case where information to be input is input without deleting a predetermined character, erroneous input of information to be input can be suppressed.

[0023] According to the sixth aspect of the present invention, even when the input portion is divided into two or more parts, for example, it is possible to input information.

[0024] According to the seventh aspect of the present invention, information to be input can be input more reliably.

[0025] According to the eighth aspect of the present invention, the operator can confirm the input information while moving the designated position.

[0026] According to the ninth aspect of the present invention, the input information can be deleted more easily than in the case where an operation of deleting the input information is performed after the operation of the operator designating the display means is completed.

[0027] According to the tenth aspect of the present invention, a function of inputting information to be input when information of a style is not registered in advance can be realized by a computer.

[0028] According to the eleventh aspect of the present invention, information to be input can be input without pre-registering information of the style. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Embodiments of the present invention will be described in detail with reference to the following drawings.

[0030] Figure 1 is a diagram showing an example of the overall configuration of an information processing system according to the present embodiment;

[0031] Figure 2 is a diagram showing an example of a hardware configuration of an operation terminal according to the present embodiment;

[0032] Figure 3 is a block diagram showing an example of a functional configuration of an operation terminal according to the present embodiment;

[0033] Figure 4 is a diagram showing an example of coordinates in a display unit;

[0034] Figure 5 is a flowchart showing an example of the processing sequence of the operation terminal;

[0035] Figure 6 middle, Figure 6 (A)~ Figure 6 (C) is a diagram for explaining a specific example of processing of the operation terminal;

[0036] Figure 7 middle, Figure 7 (A) Figure 7 (B) is a diagram for explaining a specific example of processing of the operation terminal;

[0037] Figure 8 This is a diagram showing an example of a situation where there are characters within the input range;

[0038] Fig. 9 is a diagram showing an example of an operation of bypassing characters;

[0039] Fig.10 middle, Fig.10 (A)~ Fig.10 (C) is a diagram for explaining an example of a case where the input field has two or more rows and the finger is not released from the display unit to perform designation;

[0040] Fig.11 middle, Fig.11 (A) Fig.11 (B) is a diagram showing an example of a process of inputting input information while moving the contact position from the start designation position; Fig.11 (C) is a diagram showing an example of a process of deleting input information when an operation of withdrawing the contact position toward the start designation position is performed.

[0041] Explanation of symbols

[0042] 1-information processing system, 100-operation terminal, 111-style image acquisition unit, 112-display unit, 113-display control unit, 114-input information indication unit, 115-designated position detection unit, 116-input information database, 117-input information input unit, 118-print indication unit. DETAILED DESCRIPTION

[0043] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0044] <Overall structure of information processing system>

[0045] Figure 1 1 is a diagram showing an example of the overall configuration of an information processing system 1 according to the present embodiment. As shown in the figure, the information processing system 1 according to the present embodiment includes an operation terminal 100 and a printer 200. The operation terminal 100 and the printer 200 are connected to a network 300.

[0046] The operation terminal 100, which is an example of an information processing device, is a computer device that accepts operations from an operator, and can be, for example, a portable information terminal such as a smartphone or a tablet terminal, or a PC (Personal Computer). The operation terminal 100 is used by the operator to input information in a form such as an application. The operation terminal 100, for example, displays an image of a form such as an application (hereinafter referred to as a "form image"), or instructs the operator on information to be input, and inputs information in the form image according to the operator's operation, and the details will be described later.

[0047] The printing device 200 is a device that prints by forming an image on a paper as an example of a recording medium. The printing device 200 may be a printing device having only a printing function, or may be a printing device having other image processing functions such as a copy function, a scanning function, and a fax function in addition to the printing function.

[0048] The network 300 is a communication unit for information communication between the operation terminal 100 and the printing device 200, and is, for example, the Internet, a public line, or a LAN (Local Area Network). The network 300 may be a network based on wired communication or a network based on wireless communication.

[0049] <Hardware structure of the operation terminal>

[0050] Figure 2 It is a diagram showing a hardware configuration example of the operation terminal 100 according to the present embodiment.

[0051] The operation terminal 100 involved in this embodiment has a CPU (Central Processing Unit) 101 and a main memory 102 and a flash memory 103 as a storage unit. The CPU 101 executes various software such as an OS (Operating System) or an application program to perform various functions described below. In addition, the main memory 102 is a storage area for storing various software or data used in the execution thereof. The flash memory 103 is a storage area for storing input data for various programs or output data from various programs.

[0052] The operation terminal 100 further includes a communication interface (communication I / F) 104 for communicating with the outside, a display unit 105 for displaying images, a camera 106 for photographing a subject, a speaker 107 for emitting sounds, and a microphone 108 for collecting sounds.

[0053] Here, the display mechanism 105 displays images and accepts operations from the operator. The display mechanism 105 includes a display panel composed of a liquid crystal display, a touch panel arranged on the display panel and detecting whether the operator has made contact, a physical key pressed by the operator, etc. In addition, the display mechanism 105, for example, displays various images on the display panel, or accepts operations from the operator through the touch panel and the physical key.

[0054] In addition, as a means for detecting contact in the touch panel, any means such as a means for detecting based on contact pressure or a means for detecting based on static electricity of a contacted object can be used.

[0055] In the following description, the operation of the operator's finger touching the touch panel is described as the touch operation, but the touch operation is not limited to the operation of the operator's finger touching. For example, the touch operation can also be performed by a stylus pen held by the operator.

[0056] The operation terminal 100 may further include an input device such as a keyboard or a mouse.

[0057] <Functional structure of the operation terminal>

[0058] Figure 3 It is a block diagram showing a functional configuration example of the operation terminal 100 according to the present embodiment.

[0059] The operation terminal 100 according to the present embodiment includes a pattern image acquisition unit 111 , a display unit 112 , a display control unit 113 , an input information instruction unit 114 , a designated position detection unit 115 , an input information database 116 , an input information input unit 117 , and a print instruction unit 118 .

[0060] The pattern image acquisition unit 111 acquires a pattern image of a pattern captured by the camera 106 .

[0061] Here, when the operator enters information such as his / her name and address on a form paper such as an application form, the operator photographs the form paper with the camera 106. Then, the form image acquisition unit 111 acquires a form image of the photographed paper.

[0062] The display unit 112 is a display panel of the display mechanism 105 and displays various images. For example, the display unit 112 displays the pattern image acquired by the pattern image acquisition unit 111 .

[0063] The display control unit 113 generates a control signal for controlling display on the display unit 112 to control the display on the display unit 112. For example, the display control unit 113 performs control so that the pattern image acquired by the pattern image acquisition unit 111 is displayed on the display unit 112.

[0064] The input information instruction unit 114 instructs the operator on information to be input. The input information instruction unit 114 instructs the operator on information to be input, for example, while a pattern image is displayed on the display unit 112. However, when the input information instruction unit 114 instructs on information to be input, an image other than the pattern image may be displayed on the display unit 112.

[0065] Generally, in the application form, there are many common information such as name, address, date of birth, etc. Therefore, the items of information to be input are determined in advance, and the input information instruction unit 114 instructs input of the information of the predetermined items.

[0066] In addition, when there are multiple items of information to be input, the order of input instructions can also be predetermined. For example, when name, address, and date of birth are determined as the information to be input, it is predetermined that the name is input first, the address is input next, and the date of birth is input last.

[0067] The designated position detection unit 115 detects a position designated by the operator on the display unit 112 while the pattern image is displayed on the display unit 112. For example, the designated position detection unit 115 detects a position touched on the display unit 112 by a touch operation of the operator.

[0068] More specifically, for example, when the operator's finger contacts the display unit 112, the designated position detection unit 115 acquires position information (i.e., coordinate information) of the contacted position in the display unit 112 by considering the orthogonal coordinate system. In other words, when the operator's finger contacts the display unit 112, the designated position detection unit 115 detects whether a contact operation has been performed, and acquires position information of the position where the contact was performed.

[0069] Figure 4 is a diagram showing an example of coordinates on the display unit 112. Figure 4 In the example shown, an orthogonal coordinate system is set in the display unit 112, with the center of the display unit 112 as the origin O1 (0, 0), the horizontal direction of the display unit 112 as the X-axis (the right side is positive in the figure), and the vertical direction as the Y-axis (the upper side is positive in the figure). For example, based on the shape of the display unit 112, the horizontal frame of the display unit 112 is the X-axis, and the vertical frame of the display unit 112 is the Y-axis. In addition, the unit of the coordinate value is the number of pixels from the origin O1. If the finger touches the display unit 112, the designated position detection unit 115 detects the X coordinate (X1) and the Y coordinate (Y1) of the touched point.

[0070] Furthermore, the designated position detection unit 115 discriminates the types of contact operations such as “click”, “drag”, and “flick”. “Click” refers to an operation in which the operator’s finger touches the screen in a manner of tapping. If a click operation is performed, the designated position detection unit 115 accepts the designation of the clicked position. Furthermore, “drag” refers to an operation in which the operator continues to move his finger while the operator’s finger is in contact with the screen. “Flick” refers to an operation in which the operator removes his finger in a flicking manner while the finger is in contact with the display unit 112. If a drag operation or a flick operation is performed, the designated position detection unit 115 accepts the designation of the contacted position when the contact operation is performed.

[0071] In addition, hereinafter, in the pattern image, the position where the operator starts to designate (i.e., the position where the operator starts to touch) is sometimes referred to as the "start designation position". In other words, the start designation position is the position where the operator starts to touch on the display unit 112. Also, in the pattern image, the position where the operator ends designation (i.e., the position where the operator ends the touch) is sometimes referred to as the "end designation position". In other words, the end designation position is the position where the operator removes the finger from the display unit 112.

[0072] The input information database 116 is a database that stores information corresponding to the information to be input indicated by the input information indicating unit 114 (hereinafter, the information corresponding to the information to be input is referred to as "input information"). Here, in the input information database 116, the operator's input information is pre-registered for each item of information to be input. For example, in the case where the information to be input is "name", "Fujitaro" is registered as the operator's name. And, for example, in the case where the information to be input is "address", "Tokyo A District B Street" is registered as the operator's address.

[0073] The input information input unit 117 inputs input information corresponding to the information instructed to be input by the input information instruction unit 114 within a range determined by the start designated position and the end designated position in the pattern image.

[0074] Here, regarding the input information, the input information corresponding to the information to be inputted indicated by the input information indicating unit 114 is acquired from the input information database 116. For example, when the information to be inputted is "name", the name "Fujitaro" of the operator is acquired. Then, in the pattern image, "Fujitaro" is inputted within the range determined by the start designated position and the end designated position.

[0075] In this way, the input information input unit 117 inputs input information within the range determined by the start designation position and the end designation position in the pattern image. Hereinafter, the range determined by the start designation position and the end designation position in the pattern image may be referred to as an "input range".

[0076] The print instruction unit 118 instructs the printing device 200 to print the style image in which the input information is input. For example, when the instruction of the input information instruction unit 114 is completed, a print instruction button for accepting the instruction to print the style is displayed on the display unit 112. When the operator instructs printing on the print instruction button, the print instruction unit 118 instructs the printing device 200 to print the style image in which the input information is input. Here, the print instruction unit 118 sends the image data of the style image in which the input information is input to the printing device 200.

[0077] Upon receiving the print instruction and the image data of the pattern image from the print instruction unit 118 , the printing apparatus 200 forms the pattern image on paper based on the received image data and performs printing.

[0078] Furthermore, each functional unit constituting the operation terminal 100 is implemented through the cooperation of software and hardware resources. Figure 2 When the operation terminal 100 is implemented by the hardware structure shown in the figure, the CPU 101 executes various programs stored in the main memory 102 or the flash memory 103, etc., to implement Figure 3 The functional units shown are a pattern image acquisition unit 111, a display control unit 113, an input information instruction unit 114, a designated position detection unit 115, an input information input unit 117, a print instruction unit 118, etc. In addition, the display unit 112 is implemented by the display mechanism 105. In addition, the input information database 116 is implemented by the flash memory 103, for example.

[0079] In this embodiment, the display unit 112 is used as an example of display means. The input information indicating unit 114 is used as an example of instruction means. The designated position detecting unit 115 is used as an example of detection means. The input information input unit 117 is used as an example of input means.

[0080] <Processing sequence of the operation terminal>

[0081] Next, the processing procedure of the operation terminal 100 will be described. Figure 5 This is a flowchart showing an example of the processing procedure of the operation terminal 100 .

[0082] In addition, below, the processing step may be marked with a symbol "S".

[0083] For example, the operator starts an application for inputting input information into a form image in the operation terminal 100. When the application is started, the display control unit 113 displays a screen urging the operator to take a picture of a form such as an application on the display unit 112 (S101).

[0084] Next, the pattern image acquisition unit 111 determines whether the image has been taken by the camera 106 (S102). Here, if the operator takes a picture of a pattern paper such as an application form with the camera 106, for example, an affirmative judgment (Yes) is made in S102. If an affirmative judgment (Yes) is made in S102, the pattern image acquisition unit 111 acquires a pattern image of the pattern taken by the camera 106 (S103). On the other hand, if a negative judgment (No) is made in S102, the processing of S102 is continued.

[0085] Next, the display control unit 113 displays the pattern image acquired by the pattern image acquisition unit 111 on the display unit 112 (S104). Next, the input information instruction unit 114 instructs the operator on the information to be input (S105). Next, the designated position detection unit 115 determines whether the operator has performed a contact operation on the display unit 112 (S106).

[0086] When a negative determination (NO) is made in S106 , the process of S106 is continued.

[0087] On the other hand, if a positive determination (yes) is made in S106, the designated position detection unit 115 obtains position information of the position where the operator performs a contact operation on the display unit 112 (S107). Here, while the operator's finger contacts the display unit 112, the designated position detection unit 115 continues to obtain position information of the contacted position.

[0088] Next, the designated position detection unit 115 determines whether the contact operation performed by the operator on the display unit 112 has ended (S108). Here, after the contact operation of the operator has started, when the operator's finger contacts the display unit 112, a negative judgment (No) is made in S108. On the other hand, if the operator's finger is removed from the display unit 112, it is considered that the contact operation performed by the operator has ended, and an affirmative judgment (Yes) is made in S108.

[0089] When a negative determination (No) is made in S108, the process of S107 is continued.

[0090] On the other hand, if an affirmative judgment (yes) is made in S108, the input information input unit 117 obtains input information corresponding to the information to be input indicated by the input information indicating unit 114 from the input information database 116 (S109). Next, the input information input unit 117 inputs the obtained input information within the range (i.e., input range) determined by the start designated position and the end designated position in the pattern image (S110). At this time, the input information input unit 117 inputs the input information after determining the start designated position and the end designated position in the pattern image.

[0091] Next, the input information indicating unit 114 determines whether the indication of the information to be input has been completed (S111). Here, if there are multiple items of information to be input and there is information that has not been indicated to be input, a negative judgment (no) is made. On the other hand, if the input is indicated for all information, an affirmative judgment (yes) is made.

[0092] If a negative judgment (No) is made in S111, the process proceeds to S105. On the other hand, if an affirmative judgment (Yes) is made in S111, the print instruction unit 118 determines whether to print the form (S112). For example, if the print instruction button displayed on the display unit 112 indicates not to print or does not indicate printing, a negative judgment (No) is made in S112. On the other hand, if, for example, the print instruction button indicates printing, an affirmative judgment (Yes) is made in S112.

[0093] If a negative determination (No) is made in S112, the process flow ends. On the other hand, if an affirmative determination (Yes) is made in S112, the print instruction unit 118 instructs the printing device 200 to print the style image having the input information input (S113). Then, the process flow ends.

[0094] <Specific example of processing by operation terminal>

[0095] Next, the processing of the operation terminal 100 will be described using a specific example. Figure 6 and Figure 7 1 is a diagram for explaining a specific example of the processing of the operation terminal 100. In this example, as an example of a form, the form of the application form 11 for applying for a residence permit is used for explanation.

[0096] In addition, the steps shown below (i.e., symbol S) are Figure 5 The corresponding steps.

[0097] First, a screen urging the operator to shoot a style is displayed (S101), and Figure 6 As shown in (A), the operator photographs the application 11. Figure 6 As shown in (B) of FIG. 1 , when the application form 11 is photographed, the sample image 12 of the photographed application form 11 is displayed on the display unit 112 (Yes in S102 , S103 , S104 ).

[0098] Next, the input information indicating unit 114 indicates the information to be input to the operator (S105). For example, the input information indicating unit 114 instructs the operator to input a name as the information to be input. Specifically, the input information indicating unit 114 emits a voice such as "Please input a name" from the speaker 107. In addition, the input information indicating unit 114 may also display a message such as "Please input a name" on the display unit 112.

[0099] Next, the operator places a finger on the display unit 112 so as to trace the name input field according to the instruction of the input information instruction unit 114. Figure 6 In the style image 12 shown in (B), the name is input in the input field 13. Figure 6 As shown in (C), the operator touches the input field 13 by tracing a part or all of the input field 13. By this touch operation, the designated position detection unit 115 detects the touched position and acquires position information of the touched position (Yes in S106, S107).

[0100] And, if the operator removes the finger from the display unit 112 (Yes in S108), the contact operation ends. Figure 6 In the example shown in (C), position 14 is the start designation position, and position 15 is the end designation position. In addition, area 16 is the area where the operator touches the finger. When the touch operation ends, the input information input unit 117 obtains the operator's name from the input information database 116 as input information corresponding to the information to be input indicated by the input information indication unit 114 (S109). In this example, "Fujitaro" is registered in the input information database 116 as the operator's name, and the input information indication unit 114 obtains "Fujitaro".

[0101] Next, the input information input unit 117 inputs "Fujitaro" within the input range determined by the position 14 as the start designation position and the position 15 as the end designation position in the pattern image 12 (S110). Here, the input information input unit 117 uses, for example, the area 16 where the operator's finger touches as the input range. And the input information input unit 117 inputs "Fujitaro" so that it falls within the area 16.

[0102] In other words, the intervals between characters only need to be such that the input characters fall within the input range (in this example, area 16). For example, the input information input unit 117 evenly distributes the characters "Fuji Taro" within area 16 for input. Also, for example, the relationship between the length of the input range and the intervals between characters can be determined in advance, and the intervals between characters corresponding to the horizontal length X of area 16 (refer to Figure 6 of (C)) can be calculated. Moreover, for example, standard intervals between characters can be determined, and as long as they fall within area 16, the characters can be input with the standard intervals between characters.

[0103] Also, in the case of a name, a space can be set between the given name and the surname. For example, in the case of "Fuji Taro", the input information input unit 117 inputs it in such a way that the interval between "Shi" and "Tai" is greater than the intervals between other characters (for example, the interval between "Fu" and "Shi", the interval between "Tai" and "Lang").

[0104] Moreover, the sizes of the characters only need to be such that the input characters fall within the input range (in this example, area 16). For example, the input information input unit 117 can determine the relationship between the height of the input range and the sizes of the characters in advance, and calculate the sizes of the characters corresponding to the vertical height Y of area 16 (refer to Figure 6 of (C)). Also, for example, the relationship between the area of the input range and the sizes of the characters can be determined in advance, and the sizes of the characters corresponding to the area of area 16 can be set. Moreover, for example, standard sizes of the characters can be determined, and as long as they fall within area 16, the characters can be input with the standard sizes of the characters.

[0105] In this example, as shown in Figure 7 (A) of, "Fuji Taro" is input into the input field 13.

[0106] Next, when information other than the name is determined to be the information to be input (No in S111), the input information indicator 114 continues to indicate to the operator the information to be input. In this example, the address and date of birth are determined to be information other than the name.

[0107] Therefore, the input information indicator 114 indicates to input the address as the information to be input. Preferably, the operator touches with a finger in such a way as to trace the input field 17 for the address (refer to Figure 7 (A) of). Next, the input information indicator 114 indicates to input the date of birth as the information to be input. Preferably, the operator touches with a finger in such a way as to trace the input field 18 for the date of birth (refer to Figure 7 (A) of). As a result, as shown in Figure 7 (B) of, the operator's address and the operator's date of birth are respectively input into the input field 17 and the input field 18.

[0108] When the operator instructs to input all the information (Yes in S111), it is determined whether to print the style (S112). Here, if the operator instructs to print the style image 12 (Yes in S112), the print instruction unit 118 instructs the printing device 200 to print the style image 12 with the input information input. Here, the print instruction unit 118 sends the image data of the style image 12 with the input information input to the printing device 200. Then, the printing device 200 prints the style image 12 with the input information input.

[0109] In this example, it is preferred that the operator apply for a residence certificate using a printed paper.

[0110] In this example, the input range is set to the area 16 where the operator touches the finger, but the present invention is not limited to this structure.

[0111] For example, the input field is sometimes larger than the area that the operator places his finger in contact with. Figure 6 In the example shown in (C), the name input field 13 is larger than the area 16. Therefore, the input information input unit 117 can set the input range to a range larger than the area 16. The range larger than the area 16 refers to, for example, an area that enlarges the area 16 at a predetermined ratio, or an area with a specific height or a specific length added to the area 16. In addition, for example, the input information input unit 117 can perform image analysis on the periphery of the area 16, and when there is an area that includes the area 16 and is divided by grid lines, the area can also be used as the input range. In this case, the input field 13 becomes the input range.

[0112] Furthermore, the input information input unit 117 may change the size of characters of the input information according to the pressure of the operator's contact.

[0113] For example, the input information input unit 117 predetermines the relationship between the contact pressure and the size of the character, and calculates the size of the character corresponding to the pressure when the operator makes the finger contact. Here, as described above, the size of the input character can be changed by considering the contact pressure together with the height or area of ​​the area where the operator makes the finger contact.

[0114] <Processing when there are characters within the input range>

[0115] According to the style, it is also possible to consider the case where there are characters in the input range in advance. In this case, the input information input unit 117 inputs the input information in the range without characters in the input range. That is, the input information input unit 117 inputs the input information in the input range in a manner that does not overlap with the existing characters. The following describes the processing when there are characters in the input range.

[0116] (Processing to enter input information by determining characters that exist in the input range)

[0117] When there are characters within the input range, the input information input unit 117 performs character recognition processing, such as by optical character recognition (OCR), and determines what characters are within the input range to input the input information. OCR is a technology that analyzes characters existing on image data and converts them into character data processed in a computer.

[0118] Figure 8 This is a diagram showing an example of a case where there are characters within the input range.

[0119] exist Figure 8 In the illustrated pattern image 19, the characters "Tokyo" and "Ku" are included in the address input field 20. In addition, the area 21 is the area where the operator touches and traces the input field 20 with a finger. When the area 21 is set as the input range, the characters "Tokyo" and "Ku" are included in the input range.

[0120] Here, when input information is input, the input information input unit 117 performs image analysis and determines whether there are characters within the input range. In addition, when it is determined that there are characters within the input range, the input information input unit 117 further performs character recognition processing to determine the characters within the input range. In this example, the characters within the input range are determined to be "Tokyo" and "Ku".

[0121] Next, the input information input unit 117 compares the characters existing in the input range with the input information, and specifies the characters included in the input information from among the characters existing in the input range.

[0122] In this example, characters such as "Tokyo" and "Ku" are included in the input range. On the other hand, input information such as "Tokyo A District B Street" is registered as the operator's address. At this time, "Tokyo" and "Ku" are determined as characters included in the input information.

[0123] Next, the input information input unit 117 divides the input information based on the determined characters "Tokyo" and "Ku". As a result, the input information "Tokyo A-Ku B-Street" is divided into four characters, "Tokyo", "A", "Ku", and "B-Street". The input information input unit 117 removes "Tokyo" and "Ku" that are within the input range from these four characters, and inputs the remaining "A" and "B-Street" within the input range. That is, "A" is input between "Tokyo" and "Ku" that are within the input range, and "B-Street" is input behind "Ku".

[0124] In other words, a "zone" is a character that exists within the input range and is also included in the input information. Moreover, in the input information, there are characters such as "A" and "B Street" on the front and back sides of the "zone". That is to say, the "zone" can be regarded as a character that is included in the input information and has other characters on its front and back sides. Therefore, the input information input unit 117 divides the input range using the "zone" and inputs "A" and "B Street" into the divided input ranges respectively. Here, the "zone" is used as an example of a character that satisfies a pre-determined condition.

[0125] In this way, the input information input unit 117 compares the characters existing within the input range with the input information, thereby determining the character that divides the input range, such as the "zone". And the "zone" can be pre-registered as the character for dividing the input range when inputting an address.

[0126] As the character for dividing the input range, in addition to the "zone", there is, for example, a "city" such as Yokohama City or Kawasaki City. Therefore, the "city" can be pre-registered as the character for dividing the input range when inputting an address. When there is a "city" in the input field, the input range is divided, and the input information is input into the spaces on the front and back sides of the "city".

[0127] And, for example, sometimes Figure 8 in the input field 23 for date of birth, there are characters such as "year", "month", and "day". Here, the "year" and "month" can be pre-registered as the characters for dividing the input range when inputting the date of birth. When there is a "year" in the input field for the date of birth, the input range is divided, and the input information is input into the spaces on the front and back sides of the "year". The same applies to the "month".

[0128] In this way, the character for dividing the input range can be pre-registered according to the item of the information to be input.

[0129] And, Figure 8 in the input field 22 for name, there is the character "Mr. / Ms.". Here, when the operator traces the input field 22, if the area in front of "Mr. / Ms." is traced but "Mr. / Ms." itself is not traced, the input information input unit 117 does not perform character recognition processing and inputs the name of the operator (for example, "Taro Fuji") in front of "Mr. / Ms.". On the other hand, when the operator traces the input field 22 and traces both the area in front of "Mr. / Ms." and "Mr. / Ms.", the input information input unit 117 performs character recognition processing to determine the character "Mr. / Ms.".

[0130] "Mr. / Ms." is a character that is not included in the input information "Fujitaro". Therefore, the input information input unit 117 selects to input the input information in front of "Mr. / Ms." or in the back of "Mr. / Ms.". Here, in the input field 22, there is space for inputting characters in front of "Mr. / Ms.", but there is no space for inputting characters in the back of "Mr. / Ms.". Therefore, the input information input unit 117 selects to input "Fujitaro" in front of "Mr. / Ms.".

[0131] In other words, for example, a threshold is predetermined regarding the size of the range in which input information can be input. The input information input unit 117 inputs input information to a range with a size greater than the threshold, and does not input input information to a range with a size less than the threshold. In this example, the range in front of "Mr. / Ms." is a range with a size greater than the threshold, and the range in the back of "Mr. / Ms." is a range with a size less than the threshold.

[0132] In this way, when a character not included in the input information exists within the input range, the input information input unit 117 inputs the input information according to the size of the space in front and behind the character.

[0133] Furthermore, when inputting a name to "Mr. / Ms.", it is possible to pre-register in such a way that the input information is input in front of "Mr. / Ms." and not in the back of "Mr. / Ms.". In this case, the input information input unit 117 inputs "Fujitaro" in front of "Mr. / Ms." based on the information registered for "Mr. / Ms.".

[0134] Furthermore, for example, when "your name" is also input in the same manner, it is possible to register in advance in such a manner that the input information is input before "your name" and the input information is not input after "your name".

[0135] Furthermore, for example, the input field 20 (refer to Figure 8 ), when inputting an address by using the character "address" on the left side of "address", it is possible to pre-register in a manner that the input information is not input on the front side of "address" but on the back side of "address".

[0136] In this way, it is possible to pre-register in which area on the front or rear side the input information is to be input for each character according to the item of information to be input.

[0137] (Processing of input information according to the operation input of bypass characters)

[0138] When there are characters in the input field, the operator can move the contact position so as to bypass the characters. In this case, the input information input unit 117 determines that there are characters in the input field based on the operator's operation and inputs the input information.

[0139] Fig. 9 This is a diagram showing an example of an operation of bypassing characters.

[0140] exist Fig. 9 In the style image 24 shown, the input field 25 of the address contains characters such as "Tokyo" and "Ku". Here, when tracing the input field 25, the operator bypasses the characters such as "Tokyo" and "Ku", and moves the contact position by touching the finger to an area other than the area. Specifically, as shown by the arrow in the figure, after the operator touches the finger to the area 27 on the right side of "Tokyo", the finger moves to the upper side of the style image 24 so as not to trace the character "Ku". Furthermore, after tracing the area on the upper side of "Ku", in order to trace the input field 25 again, the finger is moved to the lower side of the style image 24 and the finger touches the area 28 on the right side of "Ku".

[0141] In other words, as a basic operation of the operator, an operation of moving the contact position along the X-axis direction is pre-registered. And, as an operation of bypassing characters (hereinafter referred to as "character bypass operation"), the following operation is pre-registered: after the contact position is moved in a direction different from the moving direction of the basic operation after the basic operation, the contact position is returned to the area extending to the right side (i.e., the positive direction of the X-axis) of the contact position of the previous basic operation. In the case where the character bypass operation is performed after the basic operation is performed, the input information input unit 117 determines that there are characters between the contact area before the contact position is moved in a direction different from the basic operation and the contact area when the contact position is moved again by the basic operation. Fig. 9 In the example shown, the input information input unit 117 determines that there is a character in the area 26 between the area 27 which is the contact area before the contact position is moved in a direction different from the basic operation and the area 28 which is the contact area when the contact position is moved again by the basic operation.

[0142] Here, when the input information "Tokyo-do A-ku B-street" is registered as the operator's address, the input information is divided into four pieces of "Tokyo-do", "A", "ku", and "B-street" in advance. Furthermore, when it is determined that the characters of "Tokyo-do", "A", "ku", and "B-street" are present in the input field, it is predetermined that "A" and "B-street" are input in sequence. Furthermore, when it is determined that the characters are present in area 26, the input information input unit 117 inputs "A" and "B-street" in the input information "Tokyo-do A-ku B-street" in sequence. Specifically, the input information input unit 117 inputs "A" in area 27 and "B-street" in area 28.

[0143] In other words, the input range in this example is, for example, a range defined by the regions 26 to 28 (or a range defined by the regions 27 and 28). The input information input unit 117 inputs input information separately to the regions 27 and 28 divided by the region 26, for example.

[0144] Thus, by determining in advance which part of the address to start inputting, the input information can be inputted sequentially. However, depending on the style, for example, there are cases where inputting starts from the name of a prefecture, and there are cases where inputting starts from a district or a city. Therefore, it is possible to instruct the operator which part of the address to start inputting.

[0145] For example, the display unit 112 displays items such as "Enter from prefecture name", "Enter from district name", and "Enter from city name". In the case of a style in which the address is entered from the district name, the operator selects "Enter from district name". If the operator selects "Enter from district name", the input information input unit 117 sequentially inputs "A" and "B Street" in the input information "Tokyo A District B Street".

[0146] In addition, the moving direction of the contact position in the basic operation is not limited to the X-axis direction. For example, it can be a direction inclined a certain degree from the X-axis direction. Moreover, for example, the direction along the grid lines surrounding the input bar 25 can be used as the moving direction of the contact position in the basic operation based on the input bar 25. In addition, with respect to the basic operation, a threshold value can be set for the moving distance of the contact position. For example, when the moving distance of the contact position is greater than the threshold value, it can be judged as a basic operation, and when the moving distance of the contact position is less than the threshold value, it can be judged as not a basic operation.

[0147] In the present embodiment, the X-axis direction of the basic operation is used as an example of the predetermined direction.

[0148] Furthermore, the character bypass operation may be referred to as, for example, an arc-shaped operation or a convex operation. Furthermore, the character bypass operation may be referred to as, for example, an operation of moving the contact position from the right side of the style image 24 (i.e., the positive direction of the X-axis) and the upper side of the style image 24 (i.e., the positive direction of the Y-axis) to the lower side (i.e., the negative direction of the Y-axis) . Furthermore, for example, it may be an operation of moving the contact position from the right side of the style image 24 (i.e., the positive direction of the X-axis) and the lower side of the style image 24 (i.e., the negative direction of the Y-axis) to the upper side (i.e., the positive direction of the Y-axis) . Furthermore, the character bypass operation may be referred to as, for example, an operation of returning the contact position to a portion that overlaps in whole or in part with the Y coordinate of the contact position of the previous basic operation. In Fig. 9 In the example shown, the Y coordinate of the region 28 overlaps entirely or partially with the Y coordinate of the region 27 .

[0149] Moreover, when it is determined that there are characters through character bypass operation, the input information input unit 117 can perform character recognition processing. In Fig. 9 In the example shown, the input information input unit 117 performs character recognition processing on the area 26. Also, character recognition processing is performed on the area 29 in front of the area 27. And, the input information input unit 117 determines "Ward" for the area 26 and "Tokyo Metropolis" for the area 29. At this time, the input information input unit 117 removes "Tokyo Metropolis" and "Ward" determined by character recognition from the input information "Tokyo Metropolis, Ward A, Street B", and inputs the remaining "A" and "Street B" into the areas 27 and 28.

[0150] <Processing of Inputting Input Information in the Date of Birth Input Field>

[0151] When inputting the date of birth, there are cases of inputting in the Western calendar and cases of inputting in the Japanese era name. And, when inputting in the Japanese era name, as in Figure 8 the input field 23, sometimes a mark is placed on the era name. At this time, the input information input unit 117 places a mark on the character corresponding to the era name of the input information by surrounding the character with a circle or a quadrilateral in the input field 23.

[0152] For example, if the operator traces "Mei Da Shohei" in Figure 8 the input field 23, the input information input unit 117 determines that there are characters in the input range and performs character recognition processing. In this example, the characters determined to exist in the input range are "Mei", "Da", "Sho", and "hei". Here, since "Mei", "Da", "Sho", and "hei" are characters for the era name, the input information input unit 117 decides to input in the Japanese era name. In addition, as long as there are at least 2 out of the 4 characters "Mei", "Da", "Sho", and "hei" and not all 4, it is possible to decide to input in the Japanese era name.

[0153] Here, for example, the input information "January 1, 1985" is registered as the operator's date of birth. At this time, the input information input unit 117 places a mark on the character "Sho" among "Mei", "Da", "Sho", and "hei" by surrounding it with a circle or a quadrilateral.

[0154] In addition, for example, when the input information is registered in the Western calendar as "January 1, 1985", the input information input unit 117 converts the date of birth of the input information from the Western calendar to the Japanese era name. That is, it converts "January 1, 1985" to "January 1, 1985". And, a mark is placed on the character "Sho" in "Mei Da Shohei".

[0155] Next, if the operator is in Figure 8If the parts inscribed with "year", "month", and "day" are traced in the input field 23, the input information input unit 117 determines that there are characters within the input range and performs character recognition processing. In this example, the characters existing within the input range are determined to be "year", "month", and "day". Also, in the same manner as the processing of the input information for entering an address in the input field 20 of Figure 8 the input information input unit 117 inputs the input information of the date of birth. In this example, in the input information of "January 1, 1985", excluding the era name "Showa", "year", "month", and "day", the remaining "60", "1", and "1" are input within the input range.

[0156] Here, sometimes characters related to the Gregorian calendar or Japanese era names such as "Gregorian calendar", "Japanese era name", and "Heisei" are inscribed in the date of birth input field. Therefore, when the input information指示部114指示输入出生日期的情况下,可以通过操作者描摹“西历”或“日本年号”、“平成”等字符,由输入信息输入部117判定输入西历及日本年号中的哪一个。并且,即使操作者不描摹这种字符,输入信息输入部117也可以对操作者所描摹的区域的周边进行字符识别处理,搜索与西历或日本年号相关的字符。在判定为用日本年号输入的情况下,输入信息输入部117例如在“明”、“大”、“昭”、“平”中的任一字符上标注记号,并输入如“昭和60年1月1日”那样包含年号的出生日期。

[0157] Also, when the input information指示部114指示输入出生日期的情况下,可以向操作者询问输入西历及日本年号中的哪一个。此时,例如优选操作者在显示部112上指示用西历及日本年号中的哪一个进行输入之后,使手指接触于出生日期的输入栏来进行描摹。

[0158] In addition, regarding the date of birth, as the default (i.e., initial setting) input form, it is预先决定有用西历及日本年号中的哪一个进行输入。日本的情况下,在样式中未记载“明”、“大”、“昭”、“平”、“西历”、“日本年号”等字符的情况下,用默认的输入形式进行输入。日本年号的情况下,输入如“昭和60年1月1日”那样还包含年号的出生日期。

[0159] It should be noted that there seems to be an unclear part in the original text where "输入信息指示部114" is not fully translated. Please check and clarify the original text for a more accurate translation.Also, in this example, the process of marking the year number of the date of birth has been described. However, for example, the same process can also be applied to the "Prefecture" in the address field. In the case of Japan, for example, in the address field, sometimes a mark is made on any one of the characters "Tokyo", "Hokkaido", "Osaka", or "Prefecture". At this time, if the operator traces "Tokyo", "Hokkaido", "Osaka", or "Prefecture", the input information input unit 117 performs character recognition processing to determine the characters "Tokyo", "Hokkaido", "Osaka", or "Prefecture". And the process of marking a mark on any one of the characters is performed. For example, in the case where the input information registered as the operator's address is "Kanagawa Prefecture", the input information input unit 117 encloses the "Prefecture" in "Tokyo", "Hokkaido", "Osaka", or "Prefecture" with a circle or a quadrilateral to mark the "Prefecture" character. And the input information input unit 117 inputs the input information "Kanagawa" in the space in front of the "Prefecture".

[0160] In the case of the United States, for example, if the operator traces characters such as "Rd", "St", "Blvd", or "Ave", the input information input unit 117 performs character recognition processing to determine the characters "Rd", "St", "Blvd", or "Ave". For example, in the case where the input information registered as the operator's address is "Russell", the input information input unit 117 inputs the input information "Russell" in the space in front of the "St". If the operator traces characters such as "Road" or "Street", the input information input unit 117 performs character recognition processing to determine the characters "Road" or "Street".

[0161] In the case of China, for example, in the case where the input information registered as the operator's address is "Wisteria", the input information input unit 117 inputs the input information "Wisteria" in the space in front of the "Road".

[0162] <Processing in the case where there are two or more rows of input fields>

[0163] Depending on the style, there may be two or more rows of input fields. In the case where there are two or more rows of input fields, for example, by an operation of the operator specifying two or more rows of input fields without removing the finger from the display unit 112 or an operation of removing the finger and pressing the row designation of the input field, input information is input to two or more rows of input fields.

[0164] (Operation specified without removing the finger)

[0165] Fig.10 Is an example diagram for explaining the case of specifying without removing the finger from the display unit 112 in the case where there are two or more rows of input fields.

[0166] In addition, in Fig.10In the example shown, the case where the input fields are in two rows is described as an example, but even when the input fields are in three or more rows, the same processing is performed, thereby inputting input information into the input fields in three or more rows.

[0167] exist Fig.10 In the style image 30 shown in (A) of FIG. 1 , the address input field 31 is composed of two rows of an input field 31A and an input field 31B.

[0168] Here, if Fig.10 As shown in (B), the operator starts the contact operation from position 32 of the input field 31A, and after moving the contact position in the X-axis direction, changes the moving direction of the contact position at position 33. Specifically, the operator changes the moving direction of the contact position at position 33 to the direction from position 33 to position 34. Furthermore, after the operator moves the contact position to position 34, the operator changes the moving direction of the contact position again to the X-axis direction at position 34, and moves the contact position in the input field 31B. Furthermore, the operator removes the finger from the display unit 112 at position 35 and ends the contact operation.

[0169] In other words, Fig. 9 Similar to the example, as a basic operation of the operator, an operation of moving the contact position in the X-axis direction is pre-registered. And, as an operation used when specifying 2 rows of input fields (hereinafter referred to as "2-row specifying operation"), an operation of moving the contact position in a direction that makes an angle greater than a specific size with the X-axis direction is pre-registered. When the 2-row specifying operation is performed after the basic operation is performed and the basic operation is started again, the input information input unit 117 determines that there are more than 2 rows of input fields. And, the input information is entered separately in the 2 or more rows of input fields. In this example, as Fig.10 As shown in (C) of FIG. 1 , the input information input unit 117 inputs the input information separately in the input field 31A and the input field 31B.

[0170] exist Fig.10In the example shown in (B), the input information input unit 117 determines that the 2-row designation operation has started by starting the operation from position 33 toward position 34 after the contact position has moved from position 32 in the X-axis direction. And, by starting the 2-row designation operation, the input information input unit 117 interrupts the designation of the input range. And, by changing the moving direction of the contact position to the X-axis direction at position 34, the input information input unit 117 determines that the 2-row designation operation has ended. By ending the 2-row designation operation, the input information input unit 117 restarts the designation of the input range. And, by ending the moving operation at position 35, the input information input unit 117 ends the designation of the input range. By performing such processing, the input information input unit 117 inputs the input information separately in the input field 31A and the input field 31B with position 32 as the start designation position and position 35 as the end designation position.

[0171] The two-row designation operation is an operation of moving the contact position in a direction that forms an angle greater than or equal to a specific value with the moving direction of the contact position in the basic operation. The angle greater than or equal to the specific value is, for example, an angle greater than or equal to 5 degrees.

[0172] In other words, the 2-row designation operation may be, for example, an operation of moving the contact position in a direction oblique to the X-axis direction. The oblique direction may be, for example, a direction to the lower side (i.e., the negative direction of the Y-axis) and the left side (i.e., the negative direction of the X-axis) of the pattern image 30.

[0173] However, the two-row designation operation is not limited to the operation of moving the contact position in one direction. In the two-row designation operation, for example, the moving direction of the contact position may be changed, or the trajectory of the contact position may be made into a curve.

[0174] Furthermore, in this example, the case where the two-row designation operation is performed in a structure where the input fields are arranged one above the other, such as the input fields 31A and 31B, is described, but the two-row designation operation may also be performed in a structure where the input fields are not arranged one above the other. For example, if the two-row designation operation is performed on the input fields that are arranged separately, the input information input unit 117 separately inputs the input information to the input fields that are arranged separately. Furthermore, for example, Fig. 9 The character bypass operation of the example is included in the 2-row specified operation. Specifically, Fig. 9 As shown, the operator bypasses "Tokyo" and "district" to trace the input field 25 (reference Fig. 9 ), the input information input unit 117 determines that the 2-row designation operation has been performed. Then, the input information is input separately within the input range determined by the area 27 and the area 28.

[0175] In the present embodiment, the 2-row designation operation is used as an example of a predetermined operation.

[0176] (Remove your finger from the input field to perform the specified operation)

[0177] Furthermore, in the case of removing the finger from the input field to designate a row, the operation of restarting the touch within a predetermined time after the touch ends is regarded as a 2-row designation operation. The predetermined time is, for example, 1 second. In addition, this operation can also be performed in a structure where the input fields are not arranged up and down.

[0178] Specifically, in Fig.10 In the example shown in (B), the operator starts the movement operation from position 32 of input field 31A, moves the contact position in the X-axis direction, and then removes the finger from display unit 112 at position 33. Furthermore, the operator starts the movement operation from position 34 of input field 31B within a predetermined time, moves the contact position in the X-axis direction, and then removes the finger from display unit 112 at position 35, thereby completing the movement operation.

[0179] Here, after the contact position moves from position 32 in the X-axis direction, the finger is removed at position 33, and the contact is resumed within a predetermined time, the input information input unit 117 determines that the 2-row designation operation has been performed. And, by removing the finger at position 33, the input information input unit 117 interrupts the designation of the input range. And, by resuming contact at position 34, the input information input unit 117 determines that the 2-row designation operation has ended. By ending the 2-row designation operation, the input information input unit 117 resumes the designation of the input range. And, after removing the finger at position 35, the contact is not resumed within a predetermined time, so the input information input unit 117 regards that the 2-row designation operation has not been performed here and the movement operation has ended, thereby ending the designation of the input range. By performing such processing, the input information input unit 117 inputs the input information separately in the input field 31A and the input field 31B with position 32 as the start designation position and position 35 as the end designation position.

[0180] (Other operation examples)

[0181] Furthermore, as another example, an operation of simultaneously designating two input fields may be regarded as a two-row designation operation. In addition, this operation can also be performed in a structure where input fields are not arranged one above the other.

[0182] For example, in Fig.10 In the example shown in (B), the operator places a finger in contact with position 32 of input field 31A and moves the finger in the X-axis direction, and then places another finger in contact with position 34 of input field 31B and moves the finger in the X-axis direction. Furthermore, the operator removes the finger at position 33 in input field 31A and removes the other finger at position 35 in input field 31B.

[0183] In this way, when the operation of designating two input fields is performed, the input information input unit 117 determines that the two-row designation operation has been performed. In addition, in the input field 31A, the position 32 is designated as the start position, and the position 33 is designated as the end position. In addition, in the input field 31B, the position 34 is designated as the start position, and the position 35 is designated as the end position. In addition, the input information input unit 117 sets the input range in the input field 31A and the input field 31B, respectively, and inputs the input information separately in the input field 31A and the input field 31B.

[0184] In this operation, as long as there is a time to designate two input fields at the same time, the two input fields may not be touched at the same time or may not be touched at the same time.

[0185] As described above, the operator indicates the pattern image according to the instruction of the input information indicating unit 114, and the operation terminal 100 involved in this embodiment inputs input information within the range determined by the start designated position and the end designated position. It is not necessary to pre-register what kind of information is input in the input field of the pattern in the operation terminal 100, so that, for example, the input information can be input to the pattern created by handwriting.

[0186] <Modification>

[0187] Next, a modification of the present embodiment will be described.

[0188] (Example of inputting input information while moving the contact position)

[0189] In the above example, the input information input unit 117 inputs the input information after determining the start designated position and the end designated position. However, the input information input unit 117 may input the input information while moving the operator's contact position from the start designated position. In other words, the input information input unit 117 may input the input information while moving the contact position.

[0190] Fig.11 (A) Fig.11 (B) is a diagram showing an example of a process of inputting input information while moving the contact position from the start designation position.

[0191] exist Fig.11 In the example shown in (A) of FIG. 1 , the operator starts the movement operation from the start designation position 37 in the name input field 36. In addition, "Fujitaro" is registered as the name of the operator.

[0192] Here, when the moving operation starts, the input information input unit 117 inputs "Fujitaro" within the range determined by the start designation position 37 and the contact position of the operator. Fig.11In the example shown in (A), "Fuji Taro" is input within the range determined by start specified positions 37 and 38.

[0193] And, in Fig.11 the example shown in (B), the operator further moves the contact position from the state shown in (A) of Fig.11 and is in a state where the contact position is moved to position 39. At this time, the input information input unit 117 inputs "Fuji Taro" within the range determined by start specified positions 37 and 39.

[0194] If comparing Fig.11 (A) and Fig.11 (B), then compared with the example shown in (A) of Fig.11 , in the example shown in (B) of Fig.11 , the characters of "Fuji Taro" are large, and the intervals between the characters of "Fuji Taro" are wide.

[0195] In this way, the size of the characters of the input information or the intervals between the characters can be adjusted in accordance with the movement of the contact position.

[0196] Here, the input information input unit 117 can, for example, also change the intervals between the characters of the input information while moving the contact position, while on the other hand not changing the size of the characters.

[0197] And, for example, it can also input the input information while moving the contact position, and change the size of the input characters according to the change in the contact pressure of the operator.

[0198] Moreover, when inputting the input information while moving the contact position, when performing an operation of retracting the contact position toward the start specified position, the input information input unit 117 can delete the input input information.

[0199] Fig.11 (C) is a diagram showing an example of the process of deleting the input information when performing an operation of retracting the contact position toward the start specified position 37.

[0200] Fig.11 The example shown in (C) represents the case where the operator performs an operation of retracting the contact position from the state of (B) of Fig.11 toward the start specified position 37. Here, the operator retracts the contact position toward the start specified position 37 and moves the contact position to position 40 beyond the part where "ro" was originally displayed in the input field 36 of (B) of Fig.11 . By performing such an operation, the input information input unit 117 deletes the character "ro" from the input input information.

[0201] Here, if the operator further operates to retract the contact position towards the start designated position 37, the input information entered is sequentially deleted in accordance with the movement of the contact position. That is, the characters entered change from "Fujitai" to "Fujitsu", and then to "Fu".

[0202] In addition, when the operator operates to retract the contact position towards the start designated position at a specific position and then operates to move the contact position towards a specific position, the deleted input information can be entered again. For example, if the operator moves the contact position from position 39 (refer to Fig.11 in (B)) to position 40 (refer to Fig.11 in (C)), the input information input unit 117 deletes "Lang" as shown in Fig.11 in (C). After that, if the operator moves the contact position from position 40 to position 39, the input information input unit 117 re-enters the deleted "Lang" as shown in Fig.11 in (B).

[0203] Moreover, when operating to retract the contact position towards the start designated position, the input information input unit 117 can delete all the characters of the input information, rather than sequentially deleting characters as shown in Fig.11 in (C). For example, in the example shown in Fig.11 in (B), if the operator operates to retract the contact position from position 39 towards the start designated position 37, the input information input unit 117 deletes "Fujitaro".

[0204] Furthermore, when the operator operates to retract the contact position towards the start designated position at a specific position and then operates to move the contact position towards a specific position, the deleted input information can be entered again. For example, if the operator moves the contact position from position 39 (refer to Fig.11 in (B)) towards the start designated position 37, the input information input unit 117 deletes "Fujitaro". After that, if the operator moves the contact position towards position 39, the input information input unit 117 re-enters the deleted "Fujitaro" as shown in Fig.11 in (B).

[0205] Also, when the operator operates to retract the contact position towards the start designated position at a specific position and then removes the finger from the display unit 112 and touches it again, the input information input unit 117 can re-enter the deleted input information.

[0206] For example, if the operator moves the contact position from position 39 (refer to Fig.11 in (B)) to position 40 (refer to Fig.11 in (C)), the input information input unit 117 is as shown in Fig.11Delete "Lang" as shown in (C). After that, if the operator moves the finger away from the display unit 112 and then touches the display unit 112 again to move the contact position, the input information input unit 117 re-enters the deleted "Lang" with the contact position as a reference. And, for example, if the operator performs an operation of retracting the contact position from position 39 (refer to Fig.11 of (B)) towards the start designation position 37, the input information input unit 117 deletes "Fuji Taro". After that, if the operator moves the finger away from the display unit 112 and then touches the display unit 112 again to move the contact position, the input information input unit 117 re-enters "Fuji Taro" with the position where the contact starts as the start designation position.

[0207] Moreover, in the case of performing an operation of retracting the contact position towards the start designation position, the input range can be narrowed only without deleting the input information. For example, when the operator performs an operation of retracting the contact position from Fig.11 the state of (B) towards the start designation position 37, it can be made into Fig.11 the state of (A). That is, compared with the case of Fig.11 (B), the input information input unit 117 reduces the "Fuji Taro" characters or narrows the intervals between the "Fuji Taro" characters.

[0208] In addition, as another example of deleting the input information, for example, after the input information input unit 117 inputs the input information, if the operator indicates the input information on the screen, a screen for accepting a selection of whether to delete the input information is displayed. If the operator selects to delete the input information, the input information input unit 117 deletes the input information selected for deletion.

[0209] (Example of character recognition processing before the operator designates the input field)

[0210] The input information input unit 117 can perform character recognition processing on the style image before the operator performs an operation of designating the input field.

[0211] For example, if the style image acquisition unit 111 acquires the style image, the input information input unit 117 performs character recognition processing on the entire style image. And, for example, if the input information indicator 114 indicates the information to be input by the operator, the input information input unit 117 performs character recognition processing on the entire style image. In this way, by performing character recognition processing before the operator designates the input field, for example, the characters existing in the designated input field can be determined at the time when the operator designates the input field.

[0212] (Other modification examples)

[0213] In the above example, the items of information to be input are predetermined, but the present invention is not limited to this structure. For example, the input information instruction unit 114 may recognize a character at a location indicated by the operator in the pattern image to indicate the information to be input.

[0214] For example, the operator places a finger on a portion of the pattern image where "name" is written and traces it. The input information instruction unit 114 performs character recognition processing on the indicated portion to determine that there is a character "name". At this time, the input information instruction unit 114 instructs the operator to input "name".

[0215] Furthermore, items of information to be input may be displayed on the display unit 112 for selection by the operator.

[0216] For example, items such as “name”, “address”, and “date of birth” are displayed on the display unit 112 .

[0217] When the operator selects “name”, the input information instruction unit 114 instructs the operator to input “name”.

[0218] Furthermore, in the above example, the operation terminal 100 is provided with a touch panel, and the operator performs the operation by touching the display unit 112, but the configuration is not limited to this. For example, the operation terminal 100 may be provided with a pointing device such as a mouse, and the designated position detection unit 115 may detect the position designated by the operator using the pointing device in the display unit 112. In this case, the position where the operator starts to designate based on the pointing device becomes the start designated position, and the position where the operator ends to designate based on the pointing device after moving the designated position becomes the end designated position.

[0219] Similarly, for example, the operation terminal 100 may include input means such as physical keys, and the designated position detection unit 115 may detect a position designated by the operator using the physical keys on the display unit 112 .

[0220] Furthermore, in the above example, a paper of a form such as an application form is photographed by the operation terminal 100, but the present invention is not limited to this structure. The form image may not be an image of the form photographed by the operation terminal 100. For example, the operation terminal 100 may obtain a form image photographed by another device or obtain a form image created by the operator operating the operation terminal 100.

[0221] Furthermore, in the present embodiment, part of the functions of the operation terminal 100 may be realized by other devices.

[0222] For example, the input information database 116 may be provided in another device, and the input information input unit 117 may obtain input information from the input information database 116 of the other device. Also, for example, the input information instruction unit 114 may be provided in another device, and the other device may instruct the operator on information to be input.

[0223] Furthermore, the program for realizing the embodiment of the present invention may be provided via a communication unit or may be provided by being stored in a recording medium such as a CD-ROM.

[0224] In addition, although various embodiments and modified examples have been described above, it is of course possible to configure the embodiments and modified examples in combination with each other.

[0225] Furthermore, the present disclosure is not limited to the above-described embodiments, and various modes can be implemented within the scope not departing from the gist of the present disclosure.

[0226] The above-mentioned embodiments of the present invention are provided for the purpose of illustration and description. In addition, the embodiments of the present invention do not fully and exhaustively include the present invention, and do not limit the present invention to the disclosed methods. Obviously, various modifications and changes are self-evident to those skilled in the art to which the present invention belongs. The present embodiment is selected and described in order to most easily understand the principles of the present invention and its application. Thus, other technicians in the art can understand the present invention through various variations optimized for specific uses assumed to be various embodiments. The scope of the present invention is defined by the above claims and their equivalents.

Claims

1. An information processing device comprising: A display unit that displays an image including a pattern of an input field; an instructing unit for instructing an operator on information to be input into the input field; a detection unit for detecting a contact position from the operator in the display unit displaying the image; and The input unit inputs input information corresponding to the information to be input indicated by the indication unit within a range determined by a start designated position and an end designated position when the operator performs a touch operation of tracing the input bar, wherein the start designated position is the touch position where the touch operation starts, and the end designated position is the touch position where the touch operation ends.

2. The information processing device according to claim 1, characterized in that The input unit inputs the input information after determining the start designated position and the end designated position.

3. The information processing device according to claim 2, characterized in that: When there are characters within a range defined by the start designation position and the end designation position, the input unit inputs the input information within the range without any characters.

4. The information processing device according to claim 3, characterized in that: When the character satisfies a predetermined condition, the input unit divides the range by the character and inputs the input information separately for each of the divided ranges.

5. The information processing device according to claim 4, characterized in that The characters satisfying the predetermined condition are characters included in the input information, The input unit divides the input information by the character, removes the character from the input information, and separately inputs the input information for each of the divided ranges.

6. The information processing device according to claim 1, characterized in that When a predetermined operation is performed while the designated position moves from the start designation position to the end designation position, the input unit interrupts the designation of the range by starting the operation, and restarts the designation of the range by ending the operation.

7. The information processing device according to claim 6, characterized in that: The predetermined operation is an operation performed after the designated position has moved from the start designated position in a predetermined direction to move the designated position in a direction forming an angle greater than or equal to a specific value with the direction.

8. The information processing device according to claim 1, characterized in that: The input information is input by the input unit while the designated position is moved from the start designated position.

9. The information processing device according to claim 8, characterized in that: When an operation of withdrawing the designated position toward the start designated position is performed, the input unit deletes the input information that has been input.

10. A recording medium, which records a program for causing a computer to implement the following functions: a function of instructing an operator on information to be input into an input field; a function of detecting a contact position from the operator in a display unit that displays an image including the style of the input field; and a function of inputting input information corresponding to the indicated information to be input within a range determined by a start designated position and an end designated position when the operator performs a contact operation of tracing the input field, wherein the start designated position is the contact position where the contact operation starts, and the end designated position is the contact position where the contact operation ends.

11. An information processing method comprising the following steps: A displaying step of displaying an image including a style of an input field; an instructing step of instructing the operator on information to be input into the input field; a detection step of detecting a contact position from the operator in the display step of displaying the image; and An input step, when the operator performs a touch operation of tracing the input bar, input information corresponding to the information to be input indicated by the indication unit is input within a range determined by a start designated position and an end designated position, wherein the start designated position is the touch position where the touch operation starts, and the end designated position is the touch position where the touch operation ends.

Images