Information processing device and program

Abstract

To improve the convenience of operation for a user to capture and digitize images formed on multiple sheets of manuscript, and improve the quality of the digitized images more than before.SOLUTION: A user terminal 10 as an information processing device includes a control unit 11. A display control unit 101 in the control unit 11 exercises control to display on a display unit of a local device a guideline that indicates the outer edge of a first sheet of manuscript among multiple sheets of manuscript to be imaged, and when a predetermined operation is performed on the local device by an operation determination unit 102, a position fixing unit 103 fixes the position of the displayed guideline and an imaging control unit 104 exercises control to capture an image of the first sheet of manuscript. When a condition determination unit 105 determines that the fixed position of the guideline and the outer edge position of an n-th sheet (n=integer of 2 or greater) of manuscript among the multiple sheets of manuscript satisfy a predetermined condition, an imaging assistance control unit 106 exercises control for capturing an image of the n-th sheet of manuscript.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and a program.

Background Art

[0002] Even when a user wants to digitize an image formed on a sheet of paper serving as a document, there are situations where a device having an image reading function (e.g., a scanner device or a multifunction peripheral) cannot be used. In such a situation, the user may digitize the document by freely hand-capturing the document using an imaging function of a smartphone or the like. However, since freehand imaging can cause a slight shift in position due to the influence of finger movement during imaging, when there are multiple sheets of documents, imaging data of non-uniform imaging images with different imaging conditions such as the imaging angle and size for each document is generated. This problem can be solved by fixing a smartphone or the like, but dedicated equipment for fixing is required, and the applicable scenes are limited. Also, although the data of the captured image can be corrected and adjusted, there is a risk that the text size and the like will become non-uniform for each document as the data of the captured image is enlarged or reduced. Regarding such problems, there is also a technique for displaying guidelines according to the printing size (e.g., Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, if the guidelines are ignored for reasons such as avoiding reflection of illumination and reflection of shadows, it becomes difficult to capture a plurality of documents with uniform sizes. Thus, with the conventional methods, the convenience intended by the user and the quality of the captured image cannot be ensured.

[0005] The objective of this invention is to improve the convenience of the operation in which a user can capture and digitize images formed on multiple original documents, and to improve the quality of the digitized images compared to conventional methods. [Means for solving the problem]

[0006] The invention described in claim 1 comprises a processor, the processor controls the display unit of the machine to display a line or symbol indicating the outer edge of the first of a plurality of originals to be imaged, and the machine , an operation by the user to select imaging conditions for the first document, and a first gesture to confirm the selected imaging conditions. When this is done, the position of the displayed line or symbol is fixed, When the user performs a second gesture, The information processing device is characterized by performing control to image the first original document, and when the position of the fixed line or symbol and the position of the outer edge of the nth original document (where n is an integer value of 2 or more) among the multiple original documents satisfy predetermined conditions, it performs control to image the nth original document. Claim 2 The invention described herein is characterized in that the first gesture is an action of bringing a part of the user's body into contact with a predetermined symbol displayed on the display unit, and the second gesture is an action of moving away from the part of the body that is in contact with the symbol, claim 1 This is the information processing device described above. Claim 3 The invention described is Equipped with a processor, The aforementioned processor, The system controls the display unit to show a line or symbol indicating the outer edge of the first of several documents to be imaged, and when a predetermined operation is performed on the system, it controls the system to fix the position of the displayed line or symbol and image the first document, and when the fixed position of the line or symbol and the position of the outer edge of the nth document (where n is an integer of 2 or more) among the several documents satisfy predetermined conditions, This information processing device is characterized by performing a control to inform the user of information indicating that it is the appropriate timing for imaging the nth document, as a control for imaging the nth document. Claim 4 The invention described herein is characterized in that the processor changes the manner of displaying the lines or symbols as information indicating that it is the right timing to capture the nth original document, 3 This is the information processing device described above. Claim 5The invention described herein is characterized in that, when the processor is operated by pressing a hardware button or software button pre-installed on the machine, it performs control to image the nth document, claim 3 This is the information processing device described above. Claim 6 The invention described herein is characterized in that the processor controls the imaging of the nth document when a predetermined gesture is performed by the user, 3 This is the information processing device described above. Claim 7 The invention described herein is characterized in that the gesture is a series of actions that cause a part of the user's body to be displayed on the display unit in a predetermined manner, and then to prevent it from being displayed on the display unit, claim 6 This is the information processing device described above. Claim 8 The invention described herein includes a function that controls a computer to display a line or symbol on a display unit indicating the outer edge of the first of several originals to be imaged, The user performs an operation to select imaging conditions for the first document, and a first gesture confirms the selected imaging conditions. When this is done, the position of the displayed line or symbol is fixed, When the user performs a second gesture, This program implements a function to control the imaging of the first original document, and a function to control the imaging of the nth original document (where n is an integer of 2 or more) when the position of the fixed line or symbol and the position of the outer edge of the nth original document (where n is an integer of 2 or more) among the multiple original documents satisfy predetermined conditions. The invention described in claim 9 is a program for a computer that provides the following functions: a function to control the computer to display a line or symbol on a display unit indicating the outer edge of the first of a plurality of documents to be imaged; a function to fix the position of the displayed line or symbol and image the first document when a predetermined operation is performed; and a function to provide the computer with information indicating that it is a suitable time to image the nth document when the fixed position of the line or symbol and the position of the outer edge of the nth document (where n is an integer value of 2 or more) among the plurality of documents satisfy predetermined conditions. [Effects of the Invention]

[0007] According to the present invention as described in claim 1, it is possible to provide an information processing device that improves the convenience of the operation of a user capturing and digitizing images formed on multiple original documents, and also improves the quality of the digitized images compared to conventional methods. Furthermore, once the imaging conditions for the first document are selected and confirmed, the displayed line or symbol is fixed and imaging is performed. For subsequent documents, imaging is simply performed by aligning the outer edge with the fixed line or symbol. Alternatively, once the imaging conditions for the first document are confirmed by performing a predetermined gesture, the displayed line or symbol is fixed and imaging is performed. Furthermore, once the imaging conditions for the first document are confirmed by the first gesture, the displayed line or symbol is fixed, and imaging is performed by the second gesture. As a result, imaging conditions for multiple documents can be standardized. Claim 2According to the present invention, the displayed line or symbol can be fixed and imaged by the gesture of only one hand of the user. As a result, the imaging conditions of a plurality of original documents can be unified. [[ID=P1]] [[ID=P2]]Claim [[ID=P3]] 3 [[ID=P4]]According to the present invention, [[ID=P5]] This information processing device can provide an improved convenience for users to capture and digitize images formed on multiple documents, as well as an improved quality of the digitized images compared to conventional methods. [[ID=P6]]Since the user is notified of the timing suitable for imaging the n-th original document, the convenience for the user can be improved. [[ID=P7]] [[ID=P8]]Claim [[ID=P9]] 4 [[ID=P10]]According to the present invention, the timing suitable for imaging the n-th original document is notified to the user as a change in the color of the displayed line or symbol, so that the user can grasp the timing suitable for imaging the n-th original document at a glance. [[ID=P11]] [[ID=P12]]Claim [[ID=P13]] 5 [[ID=P14]]According to the present invention, by simply pressing a hardware button or a software button with the outer edge of the n-th original document aligned with the displayed line or symbol, the imaging conditions of the n-th original document can be adjusted to match the imaging conditions of the first original document for imaging. [[ID=P15]] [[ID=P16]]Claim [[ID=P17]] 6 [[ID=P18]]According to the present invention, by simply performing a predetermined gesture with the outer edge of the n-th original document aligned with the displayed line or symbol, the imaging conditions of the n-th original document can be adjusted to match the imaging conditions of the first original document for imaging. [[ID=P19]] [[ID=P20]]Claim [[ID=P21]] 7 [[ID=P22]]According to the present invention, by simply performing a predetermined gesture with the outer edge of the n-th original document aligned with the displayed line or symbol, the imaging conditions of the n-th original document can be adjusted to match the imaging conditions of the first original document for imaging. [[ID=P23]] [[ID=P24]]Claim [[ID=P25]] 8 [[ID=P26]]According to the present invention, a program can be provided that improves the convenience of the operation of imaging and digitizing the images formed on a plurality of original documents by the user, and the quality of the digitized images, compared to the prior art. [[ID=P27]] Furthermore, once the imaging conditions for the first document are selected and confirmed, the displayed line or symbol is fixed and imaging is performed. For subsequent documents, imaging is simply performed by aligning the outer edge with the fixed line or symbol. Alternatively, once the imaging conditions for the first document are confirmed by performing a predetermined gesture, the displayed line or symbol is fixed and imaging is performed. Furthermore, once the imaging conditions for the first document are confirmed by the first gesture, the displayed line or symbol is fixed, and imaging is performed by the second gesture. As a result, imaging conditions for multiple documents can be standardized. [[ID=P28]] [[ID=P29]] According to claim 9 of the present invention, a program is provided that improves the convenience of the operation of a user capturing and digitizing images formed on multiple original documents, and also improves the quality of the digitized images compared to conventional methods. Furthermore, since the user is notified of the optimal timing for capturing the nth original document, user convenience can be improved. [[ID=P30]] [[ID=P31]]

Brief Description of the Drawings

[0008] [[ID=P35]] [[ID=P36]] [Figure 1] [[ID=P37]]It is a diagram showing the hardware configuration of a user terminal as an information processing apparatus to which the present embodiment is applied. [[ID=P38]] [Figure 2] It is a diagram showing the functional configuration of the control unit of the user terminal as the information processing apparatus to which the present embodiment is applied. [Figure 3] It is a flowchart showing the processing flow of the user terminal when imaging conditions are determined, the first document is imaged, and the n-th document is imaged by pressing a hardware button or a software button provided in advance on the user terminal. [Figure 4] It is a flowchart showing the processing flow of the user terminal when imaging conditions are determined, the first document is imaged, and the n-th document is imaged by the user's gesture operation. [Figure 5] It is a flowchart showing the processing flow of the user terminal when the n-th document is automatically imaged. [Figure 6] It is a diagram showing a specific example of an operation of the user terminal by the user, specifically an example of an operation by a software button. [Figure 7] It is a diagram showing a specific example of an operation of the user terminal by the user, specifically an example of an operation by a software button. [Figure 8] It is a diagram showing a specific example of an operation of the user terminal by the user, specifically an example of an operation by a gesture. [Figure 9] It is a diagram showing a specific example of an operation of the user terminal by the user, specifically an example of an operation by a gesture.

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. (Hardware Configuration of User Terminal) FIG. 1 is a diagram showing the hardware configuration of the user terminal 10 as the information processing apparatus to which the present embodiment is applied. The user terminal 10 is an information processing device such as a smartphone or tablet that is operated by the user. The user terminal 10 has a control unit 11, a memory 12, a storage unit 13, a communication unit 14, an operation unit 15, a display unit 16, and an imaging unit 17. These units are connected by a data bus, an address bus, a PCI (Peripheral Component Interconnect) bus, etc.

[0010] The control unit 11 is a processor that controls the functions of the user terminal 10 through the execution of various software such as the OS (operating system) and application software. The control unit 11 is composed of, for example, a CPU (Central Processing Unit). The memory 12 is a storage area that stores various software and data used for its execution, and is used as a work area during calculations. The memory 12 is composed of, for example, RAM (Random Access Memory).

[0011] The storage unit 13 is a storage area that stores input data for various software and output data from various software. The storage unit 13 is composed of, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), or semiconductor memory used to store programs and various setting data. The storage unit 13 stores various databases for storing various information, such as an image DB 801 for storing captured images.

[0012] The communication unit 14 transmits and receives data between the user terminal 10 and the outside world via the network 90. ​​The operation unit 15 consists of, for example, a keyboard, mouse, mechanical buttons, and switches, and accepts input operations. The operation unit 15 also includes a touch sensor that, together with the display unit 16, forms a touch panel.

[0013] The display unit 16 consists of, for example, a liquid crystal display or an organic EL (=Electro-Luminescence) display used for displaying information, and displays image and text data. The display unit 16 also functions as a viewfinder for the camera of the imaging unit 17.

[0014] The imaging unit 17 consists of a camera and other components, and captures images of subjects displayed on the display unit 16, which functions as the camera's viewfinder, and acquires them as moving or still image data. Hereinafter, in the description of imaging by the camera function of the imaging unit 17 of the user terminal 10, the display unit 16 may be referred to as the "viewfinder."

[0015] (Functional configuration of the user terminal's control unit) Figure 2 shows the functional configuration of the control unit 11 of the user terminal 10, which is an information processing device to which this embodiment is applied. The control unit 11 of the user terminal 10 functions as follows: display control unit 101, operation determination unit 102, position fixing unit 103, image capture control unit 104, condition determination unit 105, and image capture support control unit 106.

[0016] The display control unit 101 controls the display of various types of information in the viewfinder. For example, the display control unit 101 controls the display of a line or symbol in the viewfinder that indicates the outer edge of the first of several originals to be imaged. "Original" refers to a sheet of paper on which images such as characters or figures are formed, and "formed" means "printed" on the printed surface of the original sheet of paper. Images may be formed only on the front surface of the original, or on both the front and back surfaces.

[0017] The lines or symbols displayed in the viewfinder move and change shape on the viewfinder to follow the changes in the display of the first document. "Changes in display" refers to changes in the display of the first document that occur due to changes in the orientation or position of the user terminal 10 performing the image capture. Specific examples of "changes in display" include changes in position and changes in scaling. Hereafter, the lines or symbols that follow the changes in the display of the first document will be referred to as "guidelines."

[0018] Furthermore, the display control unit 101 controls the display to show guidelines that follow the changes in the display of the first document, within a range where the image formed on the first document among multiple documents being captured can be recognized. In other words, when the display control unit 101 can no longer recognize the image formed on the first document, it controls the display so that the guidelines that were displayed in the viewfinder are no longer displayed.

[0019] The operation determination unit 102 determines whether the user has performed a predetermined operation. Examples of "predetermined operations" include pressing a hardware button or software button pre-installed on the user terminal 10, or performing a gesture. A "hardware button" refers to a mechanical button pre-installed on the user terminal 10, while a "software button" refers to a button displayed on the display unit 16 of the user terminal 10 in the form of an icon or the like.

[0020] For example, the operation determination unit 102 determines whether an operation to select imaging conditions has been performed. "Imaging conditions" refer to the conditions necessary to image the document displayed in the viewfinder, such as angle of view, size, and focus. In terms of specific operations, the user selects the imaging conditions by changing the orientation and position of the user terminal 10 while visually observing the first document displayed in the viewfinder and the guidelines that follow its outer edge. In other words, the imaging conditions are selected by changing the orientation and position of the user terminal 10, rather than by inputting numerical values ​​for parameters that define the imaging conditions. The operation determination unit 102 determines whether an operation to select imaging conditions by changing the orientation and position of the user terminal 10 has been performed.

[0021] Furthermore, for example, the operation determination unit 102 determines whether an operation to confirm the selected imaging conditions has been performed. As a specific operation, for example, the user presses a hardware button or software button when the position of the first document and guidelines displayed in the viewfinder is as intended. In this case, the operation determination unit 102 determines whether an operation to press a hardware button or software button on the user terminal 10 has been performed.

[0022] Furthermore, for example, the user performs a predetermined gesture when the position of the first document and guidelines displayed in the viewfinder becomes as intended. In this case, the operation determination unit 102 determines whether the user has performed the predetermined gesture. Examples of "predetermined gestures" include a gesture in which a part of the user's body is displayed in the viewfinder in a predetermined manner, or a gesture in which a part of the user's body is brought into contact with a symbol displayed in the viewfinder in a predetermined position and manner.

[0023] Among these, gestures that display a part of the user's body in the viewfinder in a predetermined manner include, for example, a gesture that displays one of the user's hands with a thumbs-up within the guideline area. Furthermore, gestures that involve the user touching a part of their body to a symbol displayed in a predetermined position and manner in the viewfinder include, for example, a gesture that involves the user touching the shutter icon, which is a symbol displayed in the viewfinder, with their finger. Specific examples of these gestures will be described later with reference to Figures 8 and 9.

[0024] Furthermore, the method used by the operation determination unit 102 to determine whether the user has performed a predetermined gesture is not particularly limited, and conventional methods can be used. For example, the system may analyze data from a video image of a part of the user's body displayed in the viewfinder to determine whether it corresponds to a predetermined gesture. Alternatively, the system may analyze sensing data detected from various sensors pre-installed on the user terminal 10 to determine whether it corresponds to a predetermined gesture.

[0025] The position fixing unit 103 fixes the position of the guideline that follows the position of the outer edge of the first document displayed in the viewfinder, based on the result of the operation determination unit 102's determination. This determines the imaging conditions. Specifically, the position fixing unit 103 fixes the position of the guideline displayed in the viewfinder when the result of the operation determination unit 102's determination is that "the user has performed an operation to determine the imaging conditions for the first document." The "guideline position" includes all elements that define the appearance of the guideline displayed in the viewfinder, such as its size, shape, and angle.

[0026] As described above, there are two operations for confirming the imaging conditions: pressing a hardware or software button and using a gesture. Of these, pressing a hardware or software button is performed while the user is holding the device in their hand, rather than fixing the user terminal 10 to a separate fixing device. Therefore, the user terminal 10 itself may move slightly when the user presses a hardware or software button. In this case, the position of the first document and the guidelines, which are aligned in the viewfinder, may change slightly due to the operation of selecting the imaging conditions, causing the position fixing unit 103 to fix the guidelines at an unintended time.

[0027] Alternatively, a timer can be used to set the timing for determining the imaging conditions. When a timer is used, the position fixing unit 103 fixes the position of the guideline when the set time arrives, eliminating the need for the user to press hardware or software buttons. However, when using a timer, the set time must be considered. That is, if the set time is short, the guideline may be fixed before it reaches the intended position, and if the timer is long, it must maintain the intended position until the set time arrives. In order to maintain the intended position, the orientation and position of the user terminal 10 cannot be changed, so depending on the weight of the user terminal 10, it may put a heavy burden on the user's arm, and there is a risk that the guideline may shift from the intended position and be fixed when the set time arrives.

[0028] In contrast, using gestures makes it possible to suppress subtle movements of the user terminal 10 itself when confirming the imaging conditions. Specifically, for example, the user selects imaging conditions by changing the orientation and position of the user terminal 10 while viewing the first document and the guideline that follows it displayed in the viewfinder. Then, at the moment when the position of the first document and the guideline displayed in the viewfinder becomes as intended, the user performs a predetermined gesture. The position fixing unit 103 then fixes the position of the guideline displayed in the viewfinder. This makes it possible to confirm the imaging conditions at the timing intended by the user. Specific examples of gestures will be described later.

[0029] The imaging control unit 104 controls the imaging means to image each of the multiple documents to be imaged. "Image control" refers to the control to cause the camera of the imaging unit 17 (see Figure 1) to capture a moving image. Specifically, when the position of the guideline is fixed by the position fixing unit 103 and a predetermined operation is performed by the user, the imaging control unit 104 controls the imaging of the first of the multiple documents to be imaged.

[0030] Examples of "pre-defined operations" during image capture of a document include pressing a hardware or software button pre-installed on the user terminal 10, or performing a pre-defined gesture. Of these, pressing a hardware or software button may be the same operation as the operation to confirm the imaging conditions described above.

[0031] In other words, when a hardware button or software button is pressed as an operation to confirm the imaging conditions, the first document may be imaged in conjunction with this operation. Alternatively, for example, there may be differences in the operation of pressing the hardware button or software button. In this case, for example, if the finger is released immediately after pressing the hardware button or software button, the imaging conditions may be confirmed, while if the finger is pressed and held without releasing, the confirmation of the imaging conditions and the image capture may be performed consecutively.

[0032] Furthermore, predefined gesture operations include, for example, gestures that follow the two types of gestures described above. Specifically, these include a gesture of moving one hand, which has been displayed within the guideline area to confirm the imaging conditions, outside the guideline area (frame-out), and a gesture of moving one hand, which has been in contact with the shutter icon displayed in the viewfinder to confirm the imaging conditions, away from the shutter icon. Specific examples of these gestures will be described later with reference to Figures 8 and 9.

[0033] Furthermore, when a predetermined operation is performed by the user, the imaging control unit 104 controls the imaging of the nth document (where n is an integer value of 2 or more) out of multiple documents to be imaged. Specifically, when the position fixing unit 103 fixes the position of the guideline as a result of the operation determination unit 102, the imaging control unit 104 controls the imaging of the nth document displayed in the viewfinder.

[0034] The "predetermined operations" referred to here include the operation of aligning the outer edge of the nth document displayed in the viewfinder with a fixed guideline on the viewfinder while changing the orientation and position of the user terminal 10, and the operation of capturing an image of the nth document (i.e., the operation of pressing the camera shutter). Among these, the operation of capturing an image of the nth document may include, for example, pressing a hardware button or a software button.

[0035] However, as mentioned above, pressing a hardware or software button may cause the user terminal 10 itself to move slightly. If the user terminal 10 moves, the position of the guideline, which was supposed to be aligned with the outer edge of the first document, will change slightly, and imaging may occur at an unintended time. Therefore, the imaging control unit 104 controls the imaging of the nth document in response to the user's gesture operation as a predetermined operation by the user. This makes it possible to suppress the user terminal 10 itself from moving slightly when imaging the nth document.

[0036] In terms of specific operations, the user observes the fixed guideline on the viewfinder and the nth document displayed in the viewfinder, and changes the orientation and position of the user terminal 10 so that the guideline aligns with the outer edge of the nth document. When the outer edge of the nth document and the guideline align, a predetermined gesture is performed, and it is determined that "a predetermined gesture has been performed," and the position of the guideline is fixed. At this point, the imaging control unit 104 controls the imaging of the nth document displayed in the viewfinder.

[0037] The "predefined gestures" referred to here include, for example, gestures similar to the two types of gestures mentioned above used to determine imaging conditions. Specifically, these include gestures such as placing one hand within the guideline area or touching the shutter icon displayed in the viewfinder with the user's finger. Specific examples of these gestures will be discussed later with reference to Figures 8 and 9.

[0038] Furthermore, the imaging control unit 104 can also be configured to take an image of the nth document when the position of the outer edge of the nth document aligns with the position of the fixed guideline. Specifically, the imaging control unit 104 takes an image of the nth document when the condition determination unit 105 (described later) determines that "the position of the outer edge of the nth document and the position of the fixed guideline satisfy predetermined conditions." This allows the nth document to be taken without any gesture operation by the user.

[0039] The condition determination unit 105 determines whether the position of the guideline fixed on the finder and the position of the outer edge of the nth document satisfy predetermined conditions. The "predetermined conditions" here refer to conditions such as the position of the guideline and the position of the outer edge of the nth document being perfectly aligned, or being deemed to be aligned within a predetermined margin of error even if they are not perfectly aligned.

[0040] If the conditions determined by the condition determination unit 105 are met, the imaging support control unit 106 controls the imaging of the nth document out of multiple documents to be imaged. "Control for imaging" refers to control that supports imaging, not control of the imaging itself. For example, one example of "control for imaging" is to provide information to the user or the imaging control unit 104 indicating that it is a suitable time to image the nth document.

[0041] One control method for informing the user that it is the right time to photograph the nth document is to change the display of the guidelines shown on the viewfinder. Specifically, this control involves changing the "display method" of the guidelines, such as changing the color, pattern, thickness, and brightness of the guidelines. As a result, the user who receives the notification can easily understand that it is the right time to photograph the nth document simply by glancing at the viewfinder. Consequently, the user can perform the operation to photograph the nth document at the optimal timing.

[0042] Furthermore, when control is performed to notify the imaging control unit 104 that it is the appropriate time to image the nth document, the imaging control unit 104, upon receiving the notification, immediately performs control to image the nth document. This enables automatic imaging with reduced user intervention that could cause misalignment between the outer edge of the nth document and the guideline. In this case, when the automatic imaging of the nth document is performed, the imaging support control unit 106 performs control to notify the user of information indicating that it has been performed. For example, the information indicating that automatic imaging has been performed may be notified to the user in a visible manner (e.g., text message or light) or audible manner (e.g., sound or voice message).

[0043] (Processing on the user terminal) Figure 3 is a flowchart showing the processing flow of the user terminal 10 when the user presses a hardware button or software button pre-installed on the user terminal 10 to confirm the imaging conditions, image the first document, and image the nth document. Based on user operations, the user terminal 10 displays a guideline in the viewfinder that follows the outer edge of the first of multiple documents to be imaged (step 601). Then, when the user performs an operation to select imaging conditions (YES in step 602), the user terminal 10 accepts that operation (step 603). On the other hand, if no operation to select imaging conditions has been performed (NO in step 602), the user terminal 10 repeats step 602 until an operation to select imaging conditions is performed.

[0044] Next, when a hardware button or software button for confirming imaging conditions is pressed (YES in step 604), the user terminal 10 accepts the operation and fixes the position of the guideline displayed in the viewfinder (step 605). If no hardware button or software button is pressed (NO in step 604), the user terminal 10 repeats step 604 until a hardware button or software button is pressed.

[0045] Next, when a hardware or software button for capturing the first document is pressed (YES in step 606), the user terminal 10 accepts the operation, captures the first document displayed in the viewfinder (step 607), and stores the captured image data in the database (step 608). Specifically, the captured image data is stored in the image DB 801 of the storage unit 13. If the hardware or software button is not pressed (NO in step 606), the user terminal 10 repeats step 606 until the hardware or software button is pressed. Note that the operation to confirm the imaging conditions and the operation to capture the first document may be the same. In this case, step 606 is skipped.

[0046] Next, based on the user's operation, the user terminal 10 displays the nth of the multiple documents to be imaged in the viewfinder (step 609). Then, when the user changes the orientation or position of the user terminal 10 and the outline of the nth document aligns with the guideline (YES in step 610), the user terminal 10 notifies the user that the outline of the nth document aligns with the guideline (step 611). For example, the user is notified that the outline of the nth document aligns with the guideline by changing the way the guideline is displayed. On the other hand, if the operation to align the outline of the nth document aligns with the guideline has not been performed (NO in step 610), the user terminal 10 repeats step 610 until the operation to align the outline of the nth document aligns with the guideline is performed.

[0047] Next, when a hardware or software button for capturing the nth document displayed in the viewfinder is pressed (YES in step 612), the user terminal 10 accepts the operation, captures the nth document (step 613), and stores the captured image data in the database (step 614). Specifically, the captured image data is stored in the image DB 801 of the storage unit 13. If the hardware or software button is not pressed (NO in step 612), the user terminal 10 repeats step 612 until the hardware or software button is pressed.

[0048] Figure 4 is a flowchart showing the processing flow of the user terminal 10 when the imaging conditions are determined, the first document is imaged, and the nth document is imaged based on the user's gestures. Note that the processing from steps 701 to 703 in Figure 8 is the same as the processing from steps 601 to 603 in Figure 7, and therefore the explanation is omitted.

[0049] When a gesture operation to confirm the imaging conditions is performed on the user terminal 10 (YES in step 704), the user terminal 10 accepts the operation and fixes the position of the guideline displayed in the viewfinder (step 705). Conversely, if no gesture operation is performed (NO in step 704), the user terminal 10 repeats step 704 until a gesture operation is performed. Specific examples of gesture operations to confirm imaging conditions are as described above.

[0050] Next, when the user terminal 10 performs a gesture operation to capture the first document (YES in step 706), it accepts the operation, captures the first document displayed in the viewfinder (step 707), and stores the captured image data in the database (step 708). Specifically, the captured image data is stored in the image DB 801 of the storage unit 13. Conversely, if no gesture operation is performed (NO in step 706), the user terminal 10 repeats step 706 until a gesture operation is performed. A specific example of the gesture operation to capture the first document is as described above.

[0051] Next, the user terminal 10 displays the nth of the multiple documents to be imaged in the viewfinder based on the user's operation (step 709). When the user changes the orientation or position of the user terminal 10 and the outer edge of the nth document aligns with the guideline (YES in step 710), the user terminal 10 notifies the user of this (step 711). Conversely, if the outer edge of the nth document does not align with the guideline (NO in step 710), the user terminal 10 repeats step 710 until the outer edge of the nth document aligns with the guideline. A specific example of the method for notifying the user that the outer edge of the nth document aligns with the guideline is as described above.

[0052] Next, when the user terminal 10 performs a gesture to capture the nth document displayed in the finder (YES in step 712), it accepts the gesture, captures the nth document (step 713), and stores the captured image data in the database (step 714). Specifically, the captured image data is stored in the image DB 801 of the storage unit 13. Conversely, if the gesture to capture the nth document has not been performed (NO in step 712), the user terminal 10 repeats step 712 until the gesture to capture the nth document is performed.

[0053] Figure 5 is a flowchart showing the processing flow of the user terminal 10 when the nth document is automatically scanned. Note that the processing from step 901 to step 910 in Figure 5 is the same as the processing from step 701 to step 710 in Figure 4. For this reason, the explanation of steps 901 to 908 will be omitted, and the explanation of steps 909 to 912 will be given.

[0054] Based on user operations, the user terminal 10 displays the nth document out of multiple documents to be imaged in the finder (step 909). When the user changes the orientation or position of the user terminal 10 so that the outer edge of the nth document aligns with the guideline (YES in step 910), the user terminal 10 images the nth document (step 911) and stores the image data in the database (step 912). The user terminal 10 also notifies the user that the nth document has been imaged (step 913). The image data captured by the user terminal 10 is stored in the image DB 801 of the storage unit 13. Conversely, if the outer edge of the nth document does not align with the guideline (NO in step 910), the user terminal 10 repeats step 910 until the outer edge of the nth document aligns with the guideline.

[0055] (Specific example) Figures 6 to 9 illustrate specific examples of user operation of the user terminal 10. Of these, Figures 6 and 7 illustrate specific examples of user operation of the user terminal 10 using software buttons. Figures 8 and 9 illustrate specific examples of user operation of the user terminal 10 using gestures.

[0056] The user adjusts the display position of the multiple documents G and guideline F displayed in the finder by changing the orientation and position of the user terminal 10 held in one hand. For example, as shown in Figure 6(A), the display size of the multiple documents G displayed in the finder may be small, and their display position may be biased to the upper left. In such cases, the user changes the orientation and position of the user terminal 10 (for example, the distance from the multiple documents G) to display the multiple documents G and guideline F in a position such as shown in Figure 6(B).

[0057] Next, with multiple originals G and guideline F positioned as shown in Figure 6(B), the user presses (for example, taps) the software button B1 displayed on a part of the viewfinder. This fixes the display position of guideline F on the viewfinder, and the first original G1 displayed within the area of ​​guideline F is captured. The data of the captured still image of the first original G1 is saved to the user terminal 10.

[0058] Figure 7(A) shows multiple originals G to be imaged, and a user terminal 10 with the second original (G2) of the multiple originals G displayed in the viewfinder. A guideline F with a fixed display position is also shown in the viewfinder. After the user has finished scanning the first document G1, they move only document G1 to the left and place it there. This makes the second document G2, which is placed on top of multiple documents G, visible. The user then adjusts the orientation and position of the user terminal 10 to align the position of the second document G2 with the fixed guideline F on the viewfinder.

[0059] For example, as shown in Figure 7(A), if the displayed size of multiple documents G in the viewfinder is small and their display position is biased towards the upper left, the orientation and position of the user terminal 10 can be adjusted to align the second document G2 with the guideline F, for example, as shown in Figure 7(B). The position of the guideline F fixed on the viewfinder is the position that sets the imaging conditions for the first document G1 as intended. By aligning the second document G2 with this guideline F, the imaging conditions for the second document can be easily set as intended. Although not shown in the illustration, the same applies to the third and subsequent documents; by aligning them with the guideline F, the imaging conditions for the third and subsequent documents can be easily set as intended.

[0060] The user aligns the second document G2 with the fixed guideline F on the viewfinder and then presses (for example, taps) the software button B1 displayed on a part of the viewfinder. This causes the second document G2, displayed within the area of ​​guideline F, to be imaged. The data of the captured still image of the second document G2 is saved to the user terminal 10.

[0061] In the specific examples shown in Figures 6 and 7 above, pressing the software button B1 displayed on the finder fixes the position of the guidelines on the display, captures the first document, and captures the nth document. However, as mentioned above, pressing the software button B1 may cause the user terminal 10 itself to move. Therefore, the position of the guidelines on the display, the capture of the first document, and the capture of the nth document can be performed using a predetermined gesture. A specific example of this will be explained with reference to Figures 8 and 9.

[0062] Figures 8 and 9 show specific examples of gesture-based operation as concrete examples of user operation of the user terminal 10. Figure 8 shows a specific example of a gesture that displays a part of the user's body in the Finder in a predetermined manner. As shown in the left diagram of Figure 8, the user aligns the first of multiple documents G1 with the guideline F by changing the orientation and position of the user terminal 10. Then, while maintaining this alignment, the user makes a gesture of placing their right hand, with their thumb extended, into the area of ​​guideline F. The user terminal 10 then detects the gesture and fixes the displayed position of guideline F. Next, as shown in the right diagram of Figure 8, the user moves their right hand, which was inside the area of ​​guideline F, outside the area of ​​guideline F (out of frame). The user terminal 10 then detects the gesture and captures an image of the first document G1 aligned with guideline F. The data of the captured still image of the first document G1 is saved in the user terminal 10.

[0063] Figure 9 shows a specific example of a gesture in which the user touches a part of their body to a symbol displayed in a predetermined position and orientation in the finder. As shown in the left diagram of Figure 9, the user aligns the first of multiple documents G1 with the guideline F by changing the orientation and position of the user terminal 10. Then, while maintaining this state, the user makes a gesture of touching the shutter icon button B2 displayed on the viewfinder with the finger of their right hand. The user terminal 10 then detects the gesture and fixes the displayed position of the guideline F.

[0064] Here, button B2, which is the icon for the shutter, is different from the software button B1 shown in Figures 6 and 7 above, which is a button that is pressed from above the viewfinder (for example, by tapping). Instead, it is a button that is touched by a finger displayed on the viewfinder. Therefore, since it does not involve an operation that physically touches the screen of the user terminal 10, it is possible to suppress the movement of the user terminal 10 itself.

[0065] Next, the user performs a gesture of moving their right hand fingers away from button B2, which is the icon for the shutter, as shown in the right diagram of Figure 9. The user terminal 10 then detects the gesture and captures an image of the first document G1 aligned with the guideline F. The data of the captured still image of the first document G1 is saved to the user terminal 10.

[0066] Although this embodiment has been described above, the present invention is not limited to this embodiment. Furthermore, the effects of the present invention are not limited to those described in this embodiment. For example, the hardware configuration of the user terminal 10 shown in Figure 1 and the functional configuration of the user terminal 10 shown in Figure 2 are merely examples for achieving the objectives of the present invention and are not particularly limited. The hardware configuration and functional configuration used to realize the above functions are not limited to the examples in Figures 1 and 2.

[0067] Furthermore, the order of the processing steps in the user terminal 10 shown in Figures 3 to 5 is merely illustrative and not particularly limiting. The processing does not necessarily have to be performed chronologically according to the illustrated step order; it may also be performed in parallel or individually. Similarly, the specific examples shown in Figures 6 to 9 are merely examples and not particularly limiting. [Explanation of symbols]

[0068] 10...User terminal, 11...Control unit, 90...Network, 101...Display control unit, 102...Operation determination unit, 103...Position fixing unit, 104...Imaging control unit, 105...Condition determination unit, 106...Imaging support control unit

Claims

1. Equipped with a processor, The aforementioned processor, The system controls the display to show a line or symbol on the machine's display unit that indicates the outer edge of the first of several documents to be imaged. When the user performs an operation to select imaging conditions for the first document and a first gesture to confirm the selected imaging conditions, the position of the displayed line or symbol is fixed, and when the user performs a second gesture, control is performed to image the first document. The system is characterized in that, when the position of the fixed line or symbol and the position of the outer edge of the nth (where n is an integer of 2 or more) document among the multiple documents satisfy predetermined conditions, control is performed to image the nth document. Information processing device.

2. The first gesture is an action in which the user brings a part of their body into contact with a predetermined symbol displayed on the display unit, and the second gesture is an action in which the part of the body that is in contact with the symbol is moved away from it. The information processing apparatus according to claim 1.

3. comprising a processor, The aforementioned processor, The system controls the display to show a line or symbol on the machine's display unit that indicates the outer edge of the first of several documents to be imaged. When a predetermined operation is performed on the aforementioned machine, the position of the displayed line or symbol is fixed, and control is performed to image the first original document. When the position of the fixed line or symbol and the position of the outer edge of the nth (where n is an integer of 2 or more) of the multiple originals satisfy predetermined conditions, the control for imaging the nth original is to notify the user of information indicating that it is a suitable time to image the nth original. Information processing device.

4. The processor is characterized by changing the display pattern of the lines or symbols as information indicating that it is the right timing to capture the nth original document. The information processing apparatus according to claim 3.

5. The processor is characterized in that, when an operation is performed to press a hardware button or software button pre-installed on the machine, it performs control to image the nth document. The information processing apparatus according to claim 3.

6. The processor is characterized in that, when a predetermined gesture is performed by the user, it controls the imaging of the nth document. The information processing apparatus according to claim 3.

7. The gesture is characterized by a series of actions that cause a part of the user's body to be displayed on the display unit in a predetermined manner, and then to be removed from the display unit. The information processing apparatus according to claim 6.

8. On the computer, A function to control the display unit to show a line or symbol indicating the outer edge of the first of multiple documents to be imaged, When the user performs an operation to select imaging conditions for the first document and a first gesture to confirm the selected imaging conditions, the function fixes the position of the displayed line or symbol, and when the user performs a second gesture, it controls the imaging of the first document. A function that controls the imaging of the nth document when the position of the fixed line or symbol and the position of the outer edge of the nth document (where n is an integer of 2 or more) among the multiple documents satisfy predetermined conditions, A program to achieve this.

9. A computer, A function to control the display unit to show a line or symbol indicating the outer edge of the first of multiple documents to be imaged, A function that, when a predetermined operation is performed, fixes the position of the displayed line or symbol and controls the imaging of the first original document, When the position of the fixed line or symbol and the position of the outer edge of the nth document (where n is an integer of 2 or more) among the multiple documents satisfy predetermined conditions, the system provides a control function to notify the user that it is the appropriate timing for imaging the nth document, as a control for imaging the nth document. A program to achieve this.

Images