Information processing device, information processing system, information processing method and program

Abstract

To provide a mechanism for properly storing an image photographed with a portable terminal.MEANS FOR SOLVING THE PROBLEM: When placed vertically, an information processing apparatus sets a first mode of storing an image of a subject obtained through photography as one image, and when placed horizontally, the information processing apparatus sets a second mode of dividing the image of the subject obtained through photography into a plurality of images before storage. The information processing apparatus controls to store the image of the subject obtained through photography while the first mode is set as one image, and store the image obtained through photography while the second mode is set as a plurality of images.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, an information processing method, and a program. [Background technology]

[0002] In recent years, pharmaceutical companies have been conducting pharmaceutical safety information management (PV) work, which is the task of managing information on "side effects of medicines." Specifically, as part of post-marketing surveillance, pharmaceutical company medical representatives (MRs) hand out questionnaires to doctors to fill out, which investigate side effects of drugs provided by the pharmaceutical company and infectious diseases suspected to be caused by the use of said drugs, and then visit hospitals to collect the questionnaires after a specified period.

[0003] The survey form is then sent by fax from, for example, a convenience store near the hospital to the head office, which then sends and registers the data to the Pharmaceuticals and Medical Devices Agency (Pdma (registered trademark)), an independent administrative institution, to report adverse drug reactions and infectious diseases to Pdma. If there is no fax terminal nearby, the doctor returns to the sales office and faxes the survey form data to the head office from the fax machine installed in the sales office. This survey and reporting work is carried out in accordance with the Pharmaceutical Affairs Law.

[0004] To save time and effort in finding a fax machine, some companies have adopted a system in which a survey form is photographed with a smart device and the photograph is sent to a server at the head office. For example, Patent Document 1 discloses a technology in which information on a survey form regarding the damage status of a building is entered and sent to a host computer equipped with a database of survey forms, together with an image taken with a mobile phone. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-167133 DISCLOSURE OF THE INVENTION [Problem to be solved by the invention]

[0006] The questionnaire is generally A4 size and may span multiple pages. When the questionnaire has many pages, it is bound into an A3 double-page spread and handed to the doctor. If you want to keep a photo of each page for reporting, you have to take a photo of each page on each side of the spread, which is time-consuming.

[0007] It is also possible to split a single image of a double-page spread into images of each page on one side, but in order to check whether the image captured remains a single image or has been split at the time of capture, it is necessary to display a list of captured images and display and check each image one by one, which is time-consuming.

[0008] The present invention provides Depending on the situation Divided image of the captured image or a single image as display The aim is to provide a mechanism that makes this possible. [Means for solving the problem]

[0009] The present invention comprises: an imaging means; an image capture control means for capturing one image of a paper sheet as a subject in one image capture; If the captured image is landscape and controlling the display of a guide including a dividing line, and displaying the image of the paper included in the photographed image along the dividing line. Divided into multiple regions Let R No. 1 process Mode and a second processing mode in which, when the captured image is vertically long, a guide not including the dividing line is displayed and the image of the paper included in the captured image is not divided; of have processing means; by the processing means Processing mode is first process In mode, a separator line The divided regions Paper image as different pages death, When the processing mode is the second processing mode, the image of the paper is displayed as a single page without being divided. a display control means for controlling the display to The present invention is characterized by having the following. [Effects of the Invention]

[0010] According to the present invention, Depending on the situation Divided image of the captured image or a single image as display We can provide a mechanism to do this. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating an example of a configuration of an information processing system according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of various devices in the first embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating an example of the functional configuration of various devices in the first embodiment of the present invention. [Figure 4] 5 is a flowchart showing the flow of a mode setting process according to the orientation of the information processing device in the first embodiment of the present invention. [Figure 5] 10 is a flowchart showing the flow of display processing of a guide image according to a mode in the first embodiment of the present invention. [Figure 6] 5 is a flowchart showing the flow of display and storage processing of a captured image according to a mode in the first embodiment of the present invention. [Figure 7] 3A to 3C are diagrams illustrating examples of various data configurations in the first embodiment of the present invention. [Figure 8] 2A to 2C are diagrams showing an example of the configuration of a shooting screen and a preview display screen in the first embodiment of the present invention. [Figure 9] 2A to 2C are diagrams showing an example of the configuration of a shooting screen and a preview display screen in the first embodiment of the present invention. [Figure 10] 3A to 3C are diagrams showing examples of the configuration of an image list screen and a transmission screen in the first embodiment of the present invention. [Figure 11] FIG. 2 is an explanatory diagram of image correction in the first embodiment of the present invention. [Figure 12] FIG. 3 is a diagram showing an example of acceleration values ​​in the first embodiment of the present invention. [Figure 13]FIG. 3 is a diagram showing an example of the relationship between the orientation of the mobile terminal and the acceleration value in the first embodiment of the present invention. [Figure 14] FIG. 10 is a diagram showing a processing flow in the second embodiment of the present invention. [Figure 15] FIG. 10 is a diagram showing a processing flow in the third embodiment of the present invention. [Figure 16] FIG. 10 is a diagram showing a processing flow in the fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0012] First, the problems and effects of the present invention will be described in detail.

[0013] For example, by dividing a photographed image into left and right halves, it is possible to capture an image of each page, which is a two-page spread of a survey form as the subject. Image division can be achieved, for example, by selecting the target image using an existing dedicated image division application and executing the division process.

[0014] On the other hand, it is not always necessary to divide all captured images. For example, when photographing the cover, there is no need to divide the image because only one page of the questionnaire is captured from the beginning. Also, if one side (one of the pages) of a two-page spread is blank, it is possible to photograph only the other page that is not blank. In this case, there is also no need to divide the image because the page of the questionnaire being photographed is only one page from the beginning.

[0015] In particular, when there are many captured images, it is time-consuming to find the image that you want to split into multiple images from among the captured images.

[0016] Therefore, for example, in a terminal (a mobile terminal in this invention) that performs photography, a mode for storing the captured image as a single image as is, and a mode for splitting the captured image into left and right halves and storing it as two images may be provided, and if the mode set at the time of photography is a mode for storing the captured image as a single image as is, the captured image will be stored as a single image, and if the mode set at the time of photography is a mode for splitting the image into left and right halves and storing it as two images, the image will be split and stored.

[0017] However, manually switching (changing) these modes is a hassle.

[0018] Furthermore, when switching modes manually, it is possible that you may forget to switch modes. If you forget to switch modes and take a photo, problems may arise such as an image that you actually wanted to split being stored as a single image, or conversely, an image that you actually wanted to store as a single image being split.

[0019] In contrast to this, the present invention provides a mechanism that assumes and takes into account the user's habit of trying to photograph a subject as clearly and / or as large as possible.

[0020] For example, when taking a two-page spread image, i.e., an image of a horizontally long subject, it is assumed that the mobile terminal will be held horizontally to take the image, and when taking a one-page image, such as a cover, i.e., an image of a vertically long subject, it is assumed that the mobile terminal will be held vertically to take the image.

[0021] In the present invention, it is possible to automatically switch between a mode in which a captured image is stored as is and a mode in which a captured image is divided, depending on the orientation of the device.

[0022] In other words, it is possible to provide a mechanism that allows the number of images to be stored to be easily adjusted depending on the shooting.

[0023] In addition, generally, captured images are automatically stored in external memory such as a hard disk, which is a permanent storage area. If a photograph is taken incorrectly, the same subject may be photographed again, but in the case of images that will be used for some kind of work later, such as the image of a questionnaire given as an example in the present invention, duplicate images of the same page may lead to impediments and delays in the progress of subsequent reporting work.

[0024] For example, there is a possibility that an image of the same subject (survey form page) may be selected as the image to be sent twice, leading to the mistake of sending it to the reporting destination.

[0025] Therefore, rather than automatically storing the captured image in external memory, it is desirable to have the user check the captured image after shooting by displaying a preview of the image, and to have the user confirm and select whether to store the image in external memory as an image to be sent to the reporting destination in the reporting work, and then store the appropriate image to be sent in the storage device.

[0026] However, the commonly available preview display function for captured images displays the image captured (only one image) on the display screen immediately after shooting, so it is not possible to confirm whether an image captured in a mode that splits images has actually been split and stored as multiple images.

[0027] Furthermore, if a publicly available preview display function for captured images is used to display one of the divided images (for example, the image on the left page) on the screen, the user will not be able to confirm whether the image on the right page has been captured, and may end up taking another image.

[0028] In other words, it is not possible to confirm whether the number of images taken is appropriate.

[0029] The present invention can provide a mechanism for easily confirming, after an image has been captured, that the image has been captured in a mode in which the image is divided.

[0030] Furthermore, it is possible to provide a mechanism that allows easy confirmation that an image has been divided after the image has been captured.

[0031] This allows the user to easily determine whether or not the image displayed on the screen should be stored as an image to be used later.

[0032] In other words, it is possible to provide a mechanism that allows the number of images to be stored to be easily adjusted depending on the shooting.

[0033] Hereinafter, an example of an embodiment of the present invention will be described with reference to the drawings.

[0034] First Embodiment First, with reference to FIG. 1, an example of the configuration of an information processing system according to a first embodiment of the present invention will be described.

[0035] The information processing system of the present invention is configured by a mobile terminal 100 and a server 200 being communicably connected via a network 101 (for example, a WAN (Wide Area Network)).

[0036] The mobile terminal 100 is an information processing device that photographs a survey form with a camera, stores the photograph, and transmits the photograph to the server 200 via the network 101. The mobile terminal 100 also includes a touch panel display.

[0037] The server 200 receives the multiple images sent from the mobile terminal 100, converts them into a single PDF file, and stores the files. This concludes the explanation of FIG.

[0038] Next, an example of the hardware configuration of various devices in the first embodiment of the present invention will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the hardware configuration of the mobile terminal 100 and the server 200.

[0039] As shown in FIG. 2, in the information processing device, a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an input controller 205, a video controller 206, a memory controller 207, and a communication I / F controller 208 are connected via a system bus 204.

[0040] The CPU 201 comprehensively controls each device and controller connected to the system bus 204 .

[0041] ROM202 or external memory 211 stores the BIOS (Basic Input / Output System) and OS (Operating System), which are control programs executed by CPU201, computer-readable and executable programs for realizing this information processing method, and various necessary data (including data tables).

[0042] The RAM 203 functions as a main memory, a work area, etc. for the CPU 201. The CPU 201 loads programs and the like required for executing processing from the ROM 202 or the external memory 211 into the RAM 203, and executes the loaded programs to realize various operations.

[0043] An input controller 205 controls input from an input device 209 such as a keyboard, a pointing device such as a mouse (not shown), or a camera. If the input device is a touch panel, the user can issue various instructions by pressing (touching with a finger or the like) icons, cursors, or buttons displayed on the touch panel.

[0044] The touch panel may also be a touch panel capable of detecting positions touched by multiple fingers, such as a multi-touch screen.

[0045] A video controller 206 controls display on an external output device such as a display device 210. The display device also includes a display device of a notebook computer that is integrated into the main body.

[0046] The external output device is not limited to a display device, but may be, for example, a projector. Furthermore, the above-described device capable of accepting touch operations also provides an input device. For example, the mobile terminal 100 includes a touch panel display device.

[0047] The video controller 206 can control a video memory (VRAM) for display control, and can use part of the RAM 203 as a video memory area, or can provide a separate dedicated video memory.

[0048] The memory controller 207 controls access to the external memory 211. The external memory may be an external storage device (hard disk) that stores a boot program, various applications, font data, user files, edited files, and various data, a flexible disk (FD), or a CompactFlash (registered trademark) memory connected to a PCMCIA card slot via an adapter.

[0049] The communication I / F controller 208 connects and communicates with external devices via a network, and executes communication control processing on the network. For example, communication using TCP / IP, telephone lines such as ISDN, and 3G lines for mobile phones are possible.

[0050] The CPU 201 enables display on the display by, for example, executing a process of expanding (rasterizing) an outline font into a display information area in the RAM 203. The CPU 201 also enables user instructions using a mouse cursor (not shown) on the display.

[0051] An acceleration sensor 212 detects, for example, the acceleration of the mobile terminal 100. When the acceleration sensor is attached to a device such as the mobile terminal 100 as an external device, the acceleration sensor 212 communicates with the input controller 205 to transmit information about the detected acceleration to the mobile terminal 100.

[0052] Reference numeral 213 denotes a photographing device that photographs an image of a subject. When the photographing device is attached to a device such as the mobile terminal 100 as an external device, for example, the photographing device 213 communicates with the input controller 205 to output the detected photographed image to the mobile terminal 100. This concludes the explanation of FIG. 2.

[0053] Next, an example of the functional configuration of various devices in the first embodiment of the present invention will be described with reference to FIG.

[0054] An image storage application having the functions shown in 311 to 317 is installed in the mobile terminal 100.

[0055] The photographing unit 311 is a functional unit that generates and acquires a photographed image by photographing a subject. The orientation determining unit 312 is a functional unit that determines the orientation (orientation of the screen) of the mobile terminal 100 by a number of determinations.

[0056] The mode setting unit 313 is a functional unit that switches between a mode in which the image of the photographed subject is stored and previewed as a single image and a mode in which the image is stored and previewed as multiple images, depending on the orientation determined and identified by the orientation determination unit 312.

[0057] The screen display unit 314 is a functional unit that displays a shooting screen and a preview display screen. The image processing unit 315 is a functional unit that performs shape correction of the shot image and generates divided images by division processing.

[0058] The storage unit 316 is a functional unit that stores the captured image and the corrected image in a temporary storage area or in a permanent storage area (corresponding to a storage control means). The transmission unit 317 is a functional unit that transmits the image to be transmitted to the server 200, which is the transmission destination.

[0059] The receiving unit 321 is a functional unit that receives images transmitted by the transmitting unit 317. The document file generating unit 322 is a functional unit that performs processing to combine multiple received image files into one document. Specifically, it converts multiple images transmitted as a single survey form report into a multi-page PDF form (one document file).

[0060] The storage unit 323 is a functional unit that stores the received images and the document files described above as data of the investigation results. This concludes the explanation of FIG.

[0061] Next, the flow of mode setting processing according to the orientation of the information processing device in the first embodiment of the present invention will be described with reference to Fig. 4. Each processing in Fig. 4 is executed by CPU 201 of mobile terminal 100 using the functions of various functional units of the image storage application stored in mobile terminal 100.

[0062] In step S401, the mobile terminal 100 starts up a photography application stored in the mobile terminal 100 in response to a user operation, and displays a photography screen.

[0063] Specifically, the image capture screen is displayed in response to an operation to display the image capture screen from a menu screen (not shown) that is displayed after the image storage application is started. Also, the display of the image capture screen is terminated by either closing the image storage application or accepting an operation to close the image capture screen.

[0064] Examples of the photographing screen are shown as 800 in Fig. 8 and 900 in Fig. 9. Details of 800 and 900 will be described later.

[0065] Thereafter, the image storage application executes the processes of steps S403 to S405 every time it acquires the screen orientation (orientation of mobile terminal 100) from the time the shooting screen of the image storage application is displayed until the display of the shooting screen ends.

[0066] Information on the orientation of the mobile terminal 100 is acquired each time the orientation of the mobile terminal 100 changes. In a specific device, the image storage application instructs or requests the OS to notify the image storage application of the orientation after the change (after the change) when the orientation of the mobile terminal 100 changes.

[0067] Upon receiving this instruction, the OS transmits information about the orientation after the change to the image storage application each time it determines that the orientation of the device has changed. This information is received by the mobile terminal 100 and acquired in step S402.

[0068] The OS has a function to identify the direction in which the player's character is facing based on the acceleration value as shown in 1200 in FIG.

[0069] Reference numeral 1210 denotes an example of the relationship between acceleration and the orientation of the mobile terminal 100. The X, Y, and Z values ​​indicate acceleration values ​​measured and acquired by the acceleration sensor. The OS determines, for example, the state of the value closest to the value (X, Y, Z) currently measured and acquired by the acceleration sensor as the current orientation (state) of the terminal.

[0070] An example of the relationship between the actual orientation (state) of the mobile terminal 100 and the acceleration value is shown in FIG.

[0071] The OS, in accordance with instructions from the image storage application, transmits a value indicating the new orientation each time the orientation of the screen of the mobile terminal 100 changes. The orientation value is shown as 710 in FIG. 7. Specifically, if the screen orientation is closest to the portrait state of 1210 in FIG. 12, the OS returns the value "Portrait". If the screen orientation is closest to the upside-down state, the OS returns the value "Upsidedown". If the screen orientation is closest to the left-side landscape state, the OS returns the value "Landscapeleft". If the screen orientation is closest to the right-side landscape state, the OS returns the value "Landscaperight". The image storage application obtains the values ​​transmitted from the OS.

[0072] In step S403, the image storage application determines whether the screen is oriented vertically or horizontally (portrait-long or landscape-long) based on the acquired value.

[0073] Specifically, if the value obtained from the OS is "Portrait" or "Upsidedown", the screen is determined to be in portrait orientation. If the value obtained is "Landscapeleft" or "Landscaperight", the screen is determined to be in landscape orientation.

[0074] If the screen is in portrait orientation, the process proceeds to step S404, where the shooting mode is set to "A4 mode." Specifically, the value of the mode setting 700 (FIG. 7) that is currently active in the image storage application is changed to A4 mode. There are two types of modes, "A4 mode" and "A3 mode," as shown in FIG. 7.

[0075] The A4 mode in the description of this embodiment is a mode in which a captured image is stored in the RAM 203 as is and displayed as a preview.

[0076] If the screen is landscape, the process proceeds to step S405, where the shooting mode is set to "A3 mode." Specifically, the value of the mode setting 700 (FIG. 7) that is currently valid in the image storage application is changed to A3 mode.

[0077] The A3 mode in the description of this embodiment is a mode in which a captured image is stored in the RAM 203, then divided into left and right halves and re-stored as multiple images, and the multiple images are previewed on one screen. This concludes the description of FIG. 4.

[0078] Next, the flow of the display process of the guide image according to the mode in the first embodiment of the present invention will be described with reference to Fig. 5. Each process in Fig. 5 is executed by the CPU 201 of the mobile terminal 100 using the functions of various functional units of the image storage application stored in the mobile terminal 100.

[0079] The image storage application executes the processing from step S501 to step S505 every time the shooting mode is changed (every time the screen orientation is acquired) from the time the shooting screen of the image storage application is displayed until the display of the shooting screen ends.

[0080] In step S501, the image storage application refers to the mode setting 700 that was set or changed in step S404 or S405 of FIG.

[0081] In step S502, it is determined whether the currently set mode is A4 mode or A3 mode. If the A4 mode is set, the process proceeds to step S505, and if the A3 mode is set, the process proceeds to step S503.

[0082] In step S505, the image storage application calculates the size of the largest rectangle with an aspect ratio of A4 paper (length:width = √2:1) that can be placed within the live view display area of ​​the shooting screen, determines the placement position within the live view display area, identifies the positions of the four corners if an A4 vertical rectangle were placed at that position, and displays a guide frame at the identified four corner positions (superimposed on the live view).

[0083] The live view display function is generally installed in compact digital cameras, smartphones, etc. Specifically, it is a function that displays the output from the imaging element of the imaging device (camera / imaging device) installed in the device itself as an image on a display device in real time.

[0084] An example of the shooting screen in A4 mode is shown in 800 in Fig. 8. 805 is the live view display area. 804 is the shutter button.

[0085] Reference numeral 801 denotes a survey form, which is the subject of the photograph. Reference numeral 802 denotes an icon for informing the user that A4 mode is currently set in the mobile terminal 100 in a manner that makes it easy to identify. If the currently set mode becomes A3 mode, icon 802 is switched to a display indicating A3 mode (icon 902 in FIG. 9).

[0086] Reference numeral 803 denotes a guide frame. An image of the guide frame 803 is stored in advance in the external memory 211 of the mobile terminal 100. For example, "guide_frame.jpg" in the guide image 720 of FIG.

[0087] In step S503, the image storage application calculates the size of the largest rectangle that can be placed within the live view display area of ​​the shooting screen, with an aspect ratio of A3 paper in landscape orientation (length:width = 1:√2), determines the placement position within the live view display area, identifies the positions of the four corners of a hypothetical A3 landscape rectangle placed at that position, and displays guide frames at the identified four corner positions (superimposed on the live view). The guide frame is, for example, guide frame 903.

[0088] Furthermore, in step S504, a guide line (separator line) that serves as a reference for dividing the corrected image of the A3 double-page spread after shooting into left and right halves is superimposed and displayed in the center of the live view display area. Specifically, a guide line 906 is displayed as shown in 900 in FIG.

[0089] By aligning the spine of the A4 booklet (A3 double-page spread) with the guide line when photographing the questionnaire, it is possible to capture an image that allows the left and right pages to be properly separated.

[0090] An example of the shooting screen in A3 mode is shown in 900 in Fig. 9. 905 is the live view display area. 904 is the shutter button.

[0091] 901L is the left page of the A3 spread of the subject survey form, and 901R is the right page of the A3 spread of the subject survey form.

[0092] An icon 902 is used to identifiably notify the user that the A3 mode is currently set in the mobile terminal 100. When the currently set mode becomes the A4 mode, the icon 902 is switched to a display indicating the A4 mode (icon 802 in FIG. 8).

[0093] Furthermore, when the A3 mode icon 902 is pressed, the currently set mode is switched to the A4 mode regardless of the orientation of the mobile terminal 100.

[0094] Reference numeral 903 denotes a guide frame. The image of the guide frame 903 is stored in advance in the external memory 211 of the mobile terminal 100. For example, it is "guide_frame.jpg" in the guide image 720 of FIG.

[0095] Reference numeral 906 denotes a guide line. An image of the guide line 906 is stored in advance in the external memory 211 of the mobile terminal 100. For example, "guide_line.jpg" in the guide image 720 of FIG.

[0096] Next, the flow of display and storage processing of captured images according to the mode in the first embodiment of the present invention will be described with reference to Fig. 6. Each process in Fig. 6 is executed by CPU 201 of mobile terminal 100 using the functions of various functional units of the image storage application stored in mobile terminal 100.

[0097] In step S601, the image storage application accepts a photographing operation. For example, it accepts a shutter button press operation. Upon accepting the photographing operation, in step S602, photographing is executed. Specifically, the image storage application instructs the photographing device included in the mobile terminal 100 to execute photographing, and the photographing device executes photographing.

[0098] In step S603, the image storage application acquires a captured image (captured image) from the image capturing device and stores it in a temporary storage area.

[0099] Specifically, the captured image is stored in a temporary storage table created in the RAM 203. For example, an example of the temporary storage table in which the images are stored in step S603 is shown as a captured image storage table 730 in FIG.

[0100] In step S604, the image storage application refers to the currently set mode, specifically, the value of the mode setting 700 in FIG.

[0101] In step S605, the image storage application determines whether the currently set mode is A4 mode or A3 mode. If the A4 mode is set, the process proceeds to step S612, and if the A3 mode is set, the process proceeds to step S606.

[0102] In step S612, the image storage application acquires and corrects the image temporarily stored in step S604. Specifically, the application recognizes the vertices of the subject in the acquired image, and performs correction by deforming the shape of the image so that the recognized vertices match the vertices of a rectangle representing the shape of an A4 portrait paper. The state of the deformation is shown in 1120 of Figure 11.

[0103] For example, the image is deformed as indicated by arrow 1103 so that the vertices of the subject (points to be corrected) shown in 1102 in Fig. 11 coincide with the vertices of a rectangle of A4 portrait size (a rectangle stored in advance in the external memory of mobile terminal 100), and correction is performed to make the image of the subject the size and shape of an A4 sheet of paper in portrait orientation. For the sake of explanation, 1100 in Fig. 11 shows vertices 1101 of a guide frame. An example of correction in progress is shown in 1110.

[0104] In the actual test, identification information indicating the top left, top right, bottom left, and bottom right is assigned to each vertex of an A4 portrait-sized rectangle stored in external memory. Also, identification information indicating the top left, top right, bottom left, and bottom right is assigned to each vertex of the cropped image of the subject, and the image of the subject is transformed so that the top left vertices, top right vertices, bottom left vertices, and bottom right vertices match, thereby correcting the shape of the image of the subject to fit the aspect ratio of A4 paper (length:width = √2:1).

[0105] Thereafter, a correction image storage table for storing the corrected image to be previewed is generated in a temporary storage area such as the RAM 203, and the corrected image (corrected image) is stored as is (as a single image). An example of the correction image storage table storing the corrected image as is is shown in 740A of FIG.

[0106] In step S613, the image storage application displays a preview of the corrected image stored in the corrected image storage table 740A in step S612 as a single image on the display screen. An example of the preview display is shown in 810 in FIG.

[0107] Reference numeral 810 denotes an example of a preview display screen of an image captured in A4 mode, and reference numeral 811 denotes an image after correction.

[0108] The "OK" button 812 is a button for storing the image 811 in a permanent storage area, for example, the external memory 211. The image stored in the permanent storage area is an image that can be selected as a candidate image to be transmitted to the server 200 later.

[0109] The "Cancel" button 813 is a button for discarding the image 811, ending the preview display, and returning to the shooting screen.

[0110] In step S606, the image storage application acquires and corrects the image temporarily stored in step S604. Specifically, the application recognizes the vertices of the subject in the acquired image and performs correction to deform the shape of the image so that the recognized vertices match the vertices of a rectangle representing the shape of A3 landscape paper. The correction is the same as when correcting for A4 portrait.

[0111] For example, the image is deformed as indicated by arrow 1123 so that the vertices of the subject (points to be corrected) shown at 1122 in Fig. 11 coincide with the vertices of a rectangle of A3 landscape size (a rectangle stored in advance in the external memory of mobile terminal 100), and correction is performed to make the image of the subject the size and shape of an A3 sheet of paper in landscape orientation. For the sake of explanation, vertices 1121 of a guide frame are used in 1120 in Fig. 11.

[0112] Thereafter, in step S607, the image storage application generates two pieces of image data by dividing the image corrected in step S606 into two equal parts, left and right, and stores the two pieces of image data in a temporary storage area as multiple images.

[0113] Specifically, a corrected image storage table is generated in the RAM 203, the corrected A3 landscape image is divided into two portrait A4 images, and the two images are stored in the corrected image storage table.

[0114] An example of a corrected image storage table that stores multiple divided images is shown in corrected image storage table 740B in Figure 7. "picture001A_left" is the image that was divided, generated, and stored as the image of the left page of the corrected survey form image. "picture001A_right" is the image that was divided, generated, and stored as the image of the right page of the corrected survey form image.

[0115] In step S608, the image storage application displays a preview of the multiple corrected images that were separated in step S607 and stored in the corrected image storage table 740B, arranged side by side on the display screen. An example of the preview display is shown in 910 in FIG.

[0116] The display positions of the multiple images obtained from the correction image storage table 740B are determined to be positions where the multiple images are displayed separately (for example, positions 914L and 914R in 910 in Figure 9), and the images to be displayed are arranged and displayed at each of the determined positions.

[0117] Specifically, the size and position of the image are determined by aligning the center point of the left side of the left image with position 914L of the center point of reference line 915L (dashed line), and then enlarging or reducing the image while maintaining its aspect ratio until it reaches one of reference lines 916L (dashed lines). Note that the reference lines are not actually displayed on the preview display screen. Furthermore, reference line 915L is set at a position a predetermined distance from the left edge of the live view display area, and reference line 916L is set at a predetermined distance from the top, bottom, and center of the live view display area.

[0118] The center point of the right side of the right image is aligned with position 914R of the center point of reference line 915R (dashed line), and the image is enlarged or reduced while maintaining the aspect ratio until it reaches one of reference lines 916R (dashed lines), thereby determining the size and position of the image and displaying it. Note that the reference lines are not actually displayed on the preview display screen. The reference line 915R is set at a position a predetermined distance from the right edge of the live view display area, and the reference lines 916R are set at positions a predetermined distance from the top, bottom, and center of the live view display area, respectively.

[0119] 910 is an example of a preview display screen in which an image captured in A3 mode is split and displayed. 911L is an image obtained by correcting the image on the left page shown in 901L. 911R is an image obtained by correcting the image on the right page shown in 901R.

[0120] The "OK" button 912 is a button for storing the images 911L and 911R in a permanent storage area, for example, the external memory 211. The images stored in the permanent storage area are images that can be selected as candidates for images to be transmitted to the server 200 later.

[0121] The "Cancel" button 913 is a button for discarding the images 911L and 911R, ending the preview display, and returning to the shooting screen.

[0122] In step S609, the image storage application accepts a user operation, and in step S610, it determines whether the accepted operation is an operation to confirm the storage of the previewed image (the image in the correction image storage table stored in step S607 or S612) in external memory 211, or an operation to discard the image (corresponding to the operation determination means).

[0123] For example, when a press of the "OK" button on the preview display screen is accepted, it is determined that an operation to confirm the storage of the preview-displayed image in the external memory 211 has been accepted.

[0124] Furthermore, when the "Cancel" button on the preview display screen is pressed, it is determined that an operation to discard the image being previewed has been accepted.

[0125] If it is determined that the operation accepted in step S609 is an operation to confirm the storage of the preview-displayed image in the external memory 211, the process proceeds to step S611.

[0126] If it is determined that the operation accepted in step S609 is an operation to discard the image being previewed, the preview display screen is terminated and the shooting screen is displayed.

[0127] In step S611, the image for which the operation to confirm storage has been performed (the image that was being previewed at the time when the pressing of the "OK" button was accepted) is stored in the external memory 211. Specifically, a process is performed to additionally store the image in the image storage table 750 (FIG. 7) stored in the external memory 211.

[0128] After that, the preview display screen is closed and the shooting screen is displayed. This concludes the explanation of FIG.

[0129] The process of selecting and transmitting an image to be transmitted to the server 200 will be described with reference to FIG.

[0130] The image list display screen 1000 is a display screen for displaying the images stored in the image storage table 750 one by one in a list.

[0131] The image storage application displays the image list display screen 1000 on the display screen by accepting an operation to display the image list display screen 1000 on a menu screen (not shown).

[0132] The image storage application displays a list of images as shown at 1000 in a list display section as shown at 1001 so that the images can be selected individually. Reference numeral 1002 denotes the date and time each image was taken.

[0133] When an image selection operation is accepted, the image is put into a selected state. The image in the selected state is made identifiable by displaying a selection frame 1003 (corresponding to the selection accepting means).

[0134] When the image storage application receives a press of the “Move to report form” button 1004 , it determines the selected image as the image to be transmitted to the server 200 , and transitions the display screen to a report form screen 1010 .

[0135] The page number display section 1011 displays the number of target images to be transmitted.

[0136] The image storage application accepts input of the name of the drug being investigated on the questionnaire to be reported (the image of which is sent to server 200), the source of the information (e.g., the name of the hospital where the questionnaire was collected), and an arbitrary management number to identify the report.

[0137] Then, by accepting the press of the "Send" button 1012, the image to be sent and each piece of information entered on the report form screen 1010 are sent to the server 200 as report information.

[0138] The CPU 201 of the server 200 receives the report information, acquires the image data therein, and converts it into a single document file. For example, if 10 images are received, the 10 images are converted into a 10-page PDF file and stored in external memory. This concludes the explanation of FIG. 10.

[0139] As described above, according to the present invention, it is possible to provide a mechanism that allows the number of images to be stored to be easily adjusted depending on the number of images taken.

[0140] For example, it is possible to automatically switch between a mode in which the captured image is stored as is and a mode in which the captured image is divided, depending on the orientation of the device.

[0141] It is also possible to provide a mechanism that allows easy confirmation after an image has been captured that the image has been captured in a mode that divides the image.

[0142] Furthermore, it is possible to provide a mechanism that allows easy confirmation that an image has been divided after the image has been captured.

[0143] This allows the user to easily determine whether or not the image displayed on the screen should be stored as an image to be used later (to be sent to the server as an image to be reported).

[0144] It is assumed that, for example, while out and about, an A4 sheet (survey form) will be placed horizontally and photographed at a location such as a bar counter in a cafe that has sufficient horizontal space but is too shallow to hold an A4 sheet vertically. In this case, it is assumed that the user will want to hold the mobile terminal 100 horizontally and photograph an image of one page of A4 paper. Therefore, in the above-described embodiment, even when the mobile terminal 100 is in a horizontal position, if the A3 mode icon 902 is pressed, the mode can be changed to A4 mode.

[0145] On the other hand, in a location where there is sufficient vertical space and enough width to place an A4 sheet in landscape orientation, it may be desirable to photograph an A3 double-page spread survey sheet placed open in an A3 portrait orientation. In this case, it is assumed that the user will want to hold the mobile terminal 100 in portrait orientation to photograph. In other words, even if the terminal is in portrait orientation, there may be cases where the user wishes to photograph in A3 mode. Therefore, for example, even if the mobile terminal 100 is in portrait orientation, when the A4 mode icon 802 is pressed, the mode may be changed to A3 mode.

[0146] <Second embodiment> Next, with reference to FIG. 14, a processing flow in the second embodiment of the present invention will be described.

[0147] In the first embodiment, the mobile terminal switches between a mode in which the captured image is stored and displayed as is, and a mode in which the captured image is divided into multiple images and displayed in a way that makes it clear that the images have been divided, depending on the orientation of the mobile terminal. However, there are cases in which it is not always desirable to change the mode every time the orientation of the terminal changes.

[0148] For example, when the A3 mode icon 902 is pressed to change the mode to A4 mode, it is conceivable that the user would like to continue taking and storing images in A4 mode even if the terminal is held landscape orientation thereafter.

[0149] The fact that an A4 portrait questionnaire was deliberately placed sideways for the photo suggests that the photo was taken in a location where the questionnaire could only be placed sideways.

[0150] On the other hand, according to the first embodiment, the currently set mode is changed to a mode corresponding to the orientation each time the orientation of the mobile terminal 100 is changed. Therefore, if the mobile terminal 100 is tilted from landscape to portrait when, for example, the mobile terminal 100 is re-held in the hand or the survey form is turned over to photograph the back side of the survey form, and then the mobile terminal 100 is turned landscape again to continue photographing, the mode will switch to A3 mode.

[0151] In the second embodiment, a mechanism for appropriately determining the timing of changing the mode is provided.

[0152] 14 is executed by the CPU 201 of the mobile terminal 100 using the functions of various functional units of the image storage application stored in the mobile terminal 100. Note that descriptions of devices, configurations, processes, screens, data, etc. that are common to the first embodiment will be omitted.

[0153] The process of FIG. 14 starts immediately after step S402 of FIG.

[0154] In step S1401, the image storage application determines whether the mobile terminal 100 is in portrait or landscape orientation. This determination process is the same as the process in step S403 in FIG.

[0155] If it is determined that the mobile terminal 100 is in portrait orientation, the process proceeds to step S1402, and if it is determined that the mobile terminal 100 is in landscape orientation, the process proceeds to step S1403.

[0156] In step S1402, the image storage application determines whether or not photography has already been performed in A3 mode and divided images have been stored in the external memory 211 since the photography screen was displayed from the menu screen (not shown).

[0157] 6, after the corrected image is stored in the external memory 211, if the stored image is an image taken in A4 mode, a flag is set to 1, and if the stored image is an image taken in A3 mode, a flag is set to 2, and when the shooting screen ends and the screen returns to the menu screen, the value of the flag is set to 0. Furthermore, once a flag is set, it is not changed until the screen returns to the menu screen.

[0158] The image storage application determines that the image has been taken in A4 mode (not A3 mode) if the flag is 1, and determines that the image has been taken in A3 mode if the flag is 2. Also, if the flag is 0, it determines that no image has been taken since the transition from the menu screen to the shooting screen with day display.

[0159] If it is determined that photography has been completed in A3 mode, the currently set mode is not changed from A3 mode to A4 mode, and if it is determined that photography has not been completed in A3 mode, the process proceeds to step S404 in Figure 4 and the mode is changed to A4 mode.

[0160] In step S1403, the image storage application determines whether or not an image has already been captured in A4 mode and divided into images stored in the external memory 211 since the image capture screen was displayed from the menu screen (not shown).

[0161] For example, if the flag is 1, it is determined that the image has been taken in A4 mode, and if the flag is 2, it is determined that the image has been taken in A3 mode (not A4 mode). Also, if the flag is 0, it is determined that no image has been taken since the transition from the menu screen to the shooting screen.

[0162] If it is determined that photography has been completed in A4 mode, it is decided not to change the currently set mode from A4 mode to A3 mode, and if it is determined that photography has not been completed in A4 mode without changing the mode, it proceeds to step S405 in Fig. 4, it is decided to change the mode to A3 mode, and the mode is changed to A3 mode. This concludes the description of the second embodiment.

[0163] According to the second embodiment of the invention, it is possible to provide a mechanism for appropriately determining the timing for changing the mode.

[0164] <Third embodiment> Next, with reference to FIG. 15, a processing flow in the third embodiment of the present invention will be described.

[0165] In the third embodiment, even if the image is taken in a mode in which the captured image is divided into multiple images, a mechanism is provided that can appropriately determine whether to divide the image of the subject and store both images or one image, depending on the relationship between the position of the subject and the reference position for division.

[0166] 15 is executed by the CPU 201 of the mobile terminal 100 using the functions of various functional units of the image storage application stored in the mobile terminal 100. Note that descriptions of devices, configurations, processes, screens, data, etc. common to the first and second embodiments will be omitted.

[0167] The process in FIG. 15 starts immediately after it is determined in step S605 in FIG. 6 that the mode is A3.

[0168] In step S1501, the image storage application reads out the image of the subject stored in the captured image storage table 730, performs subject recognition processing, and identifies the positions of the four vertices of the subject on the live view display area. It then determines whether the four vertices fit within the left or right half of the live view display area. In other words, it determines whether the subject fits within an area that is within 50% of the left and right sides of the screen. (Corresponding to subject determination means)

[0169] If it does not fit, the process proceeds to step S607 in Fig. 6. If it does fit, the process proceeds to step S1502.

[0170] In step S1502, the image storage application cuts out and acquires the image on the side where the subject is detected (the side where the four vertices are detected), and stores it in a temporary storage area such as the RAM 203.

[0171] In step S1503, the image storage application sets the size of the destination of image correction to a rectangle of A4 size and shape.

[0172] Then, in step S1504, an image of the recognized subject (survey form) is cut out from the image on the side where the subject was detected (the right or left half of the image actually captured), and trapezoid correction is performed by deforming each vertex of the image of the subject to match the vertices of an A4 vertical rectangle.

[0173] In step S1505, the image storage application stores the corrected image in a temporary storage area (corrected image storage table), and determines the display position of the stored image on the preview screen.

[0174] In this embodiment, if the subject of the captured image is contained within the left half of the live view screen, the display position of the corrected image of the subject is determined to be on the left side of the preview display screen.

[0175] Specifically, the size and position of the image are determined by aligning the center point of the left side of the image with position 914L, which is the center point of reference line 915L (dashed line), and then enlarging or reducing the image while maintaining the aspect ratio until it reaches one of reference lines 916L (dashed lines). Note that the reference lines are not actually displayed on the preview display screen. Furthermore, reference line 915L is set at a position a predetermined distance from the left edge of the live view display area, and reference line 916L is set at a predetermined distance from the top, bottom, and center of the live view display area.

[0176] If the subject of the photographed image is contained in the right half of the live view screen, the display position of the corrected image of the subject is determined to be on the right side of the preview display screen.

[0177] Specifically, the center point of the right side of the image is aligned with position 914R, the center point of reference line 915R (dashed line), and the image is enlarged or reduced while maintaining the aspect ratio until it reaches one of reference lines 916R (dashed lines), thereby determining the size and position of the image and displaying it. Note that the reference lines are not actually displayed on the preview display screen. Furthermore, reference line 915R is set at a position a predetermined distance from the right edge of the live view display area, and reference line 916R is set at a predetermined distance from the top, bottom, and center of the live view display area, respectively.

[0178] In step S1506, the image storage application arranges and displays the corrected subject image stored in the corrected image storage table at the position determined in step S1505.

[0179] If the position determined in step S1505 is between reference line 915L and reference line 916L with respect to position 914L on the left side of the screen, no image is displayed in a position between reference line 915R and reference line 916R on the right side of the screen. Also, if the position determined in step S1505 is between reference line 915LR and reference line 916R with respect to position 914R on the right side of the screen, no image is displayed in a position between reference line 915L and reference line 916L on the left side of the screen. This completes the description of the third embodiment.

[0180] As described above, according to the third embodiment of the present invention, even if an image is captured in a mode in which the captured image is divided into multiple images, it is possible to appropriately determine whether to divide the image of the subject and store both images or one image, depending on the relationship between the position of the subject and the reference position for division.

[0181] For example, when taking a photo of an A4 portrait paper such as the cover of a questionnaire, the hassle of having to turn the device vertically each time to take the photo can be reduced.

[0182] Furthermore, by displaying the image of the subject on only one side of the screen, even if the image is taken in a mode in which the taken image is divided into multiple images, the image of the subject can be divided and highlighted to show the user whether to store both images or one image, and the user can confirm this.

[0183] <Fourth embodiment> Next, with reference to FIG. 16, a processing flow in the fourth embodiment of the present invention will be described.

[0184] In the fourth embodiment, a mechanism is provided that makes it easy to determine whether to store an image as a single image or as multiple images depending on the shooting operation, even if the image was taken in a mode in which the image is divided into multiple images.

[0185] 16 is executed by the CPU 201 of the mobile terminal 100 using the functions of various functional units of the image storage application stored in the mobile terminal 100. Note that a description of devices, configurations, processes, screens, data, etc. common to the first, second, and third embodiments will be omitted.

[0186] In the fourth embodiment, there are two types of shooting operations: pressing the shutter button and pressing (touching) the live view display area.

[0187] When the image storage application receives a shooting operation in step S601, it stores identification information for identifying whether the shooting operation is a pressing operation of the shutter button or a pressing operation of the live view display area in the RAM 203. Furthermore, when the received operation is a pressing operation of the live view display area, it stores the pressed position (position on the live view display area).

[0188] The process in FIG. 16 starts immediately after step S603 in FIG.

[0189] In step S1601, the image storage application determines whether the operation for shooting accepted in step S601 is a press of the shutter button or a press of the live view display area.

[0190] If the shutter button has been pressed, the process proceeds to step S604 in Fig. 6. If the live view display area has been pressed, the process proceeds to step S1602.

[0191] In step S1602, the image storage application determines whether the position where the shooting operation was accepted is on the guide line of the live view display area, in the left half area excluding the guide line, or in the right half area excluding the guide line.

[0192] If the shooting operation is on a guide line, that is, on the center line of the live view display area, the process proceeds to step S604.

[0193] If the position where the photographing operation was accepted is within the left half of the area excluding the guide lines, the process proceeds to step S1607; if it is within the right half of the area excluding the guide lines, the process proceeds to step S1603.

[0194] In step S1603, the image storage application acquires an image stored in the captured image storage table 730, divides it into two equal parts horizontally, and acquires the right half of the image.

[0195] In step S1604, an image of the subject is cut out from the image acquired in step S1603, and the image is deformed and corrected so that each vertex of the image of the subject coincides with the vertex of a rectangle in A4 portrait orientation. The corrected image is then stored in a corrected image storage table.

[0196] On the other hand, in step S1607, the image storage application acquires an image stored in the captured image storage table 730, divides it into two equal parts horizontally, and acquires the left half of the image.

[0197] In step S1608, an image of the subject is cut out from the image acquired in step S1607, and the image is deformed and corrected so that each vertex of the image of the subject coincides with the vertices of a rectangle in A4 portrait orientation. The corrected image is then stored in a corrected image storage table.

[0198] In step S1605, the image storage application determines the display position of the corrected image on the preview screen.

[0199] In this embodiment, if the position of the shooting operation is within the area to the left of the live view display area, the display position of the corrected image is determined to be the left position of the preview display screen.

[0200] If the position of the shooting operation is within the area to the right of the live view display area, the display position of the corrected image is determined to be the right position of the preview display screen.

[0201] In step S1606, the image storage application arranges and displays the corrected subject image stored in the corrected image storage table at the position determined in step S1505.

[0202] Note that if the position determined in step S1605 is on the left side of the screen, no image is displayed on the right side of the screen. Also, if the position determined in step S1605 is on the right side of the screen, no image is displayed on the left side of the screen. This concludes the description of the third embodiment. This concludes the description of the fourth embodiment.

[0203] According to the fourth embodiment of the invention, it is possible to provide a mechanism that can easily determine whether an image captured in a mode in which the captured image is divided into multiple images is to be stored as a single image or multiple images depending on the shooting operation.

[0204] For example, when taking a photo of an A4 portrait paper such as the cover of a questionnaire, the hassle of having to turn the device vertically each time to take the photo can be reduced.

[0205] Furthermore, by displaying the image of the subject on only one side of the screen, even if the image is taken in a mode in which the taken image is divided into multiple images, the image of the subject can be divided and highlighted to show the user whether to store both images or one image, and the user can confirm this.

[0206] As described above, according to the present invention, it is possible to provide a mechanism for appropriately storing images captured on a mobile terminal.

[0207] In the above-described embodiment, the image is converted into a document file on the server 200 side that receives the image, but for example, the image to be sent to the server 200 may be converted into a single document file on the mobile terminal 100, and then the image may be sent to the server 200.

[0208] Furthermore, in the description of the above-mentioned embodiment, a mode is set in which an image taken when the terminal is held in portrait orientation is stored as is, and a mode is set in which an image taken when the terminal is held in landscape orientation is stored as multiple images, and the images are divided and stored according to the mode, but it is also possible to store an image taken when the terminal is held in landscape orientation as is without setting a mode, and to divide an image taken when the terminal is held in landscape orientation into multiple images, store them, and display them as a preview.

[0209] 6, the image and the orientation of mobile terminal 100 at the time of shooting (for example, portrait or landscape) are stored, and in step S604, the information on the orientation of mobile terminal 100 at the time of shooting is referenced, and in step S605, it is determined whether the orientation of mobile terminal 100 at the time of shooting was portrait or landscape. If the orientation was portrait, the process proceeds to step S612, and if the orientation was landscape, the process proceeds to step S606.

[0210] Furthermore, in the above-described embodiment, in order to allow the user to confirm that the image has been divided and stored, the multiple images are initially positioned and displayed separately on the preview display screen 910, but it is also possible to notify and confirm to the user that multiple images have been stored by, for example, initially displaying the multiple images in a state where they are touching each other, and then displaying an animation in which the multiple images are moved apart to their respective positions on the preview display screen 910. It is also possible to notify and confirm to the user that multiple images have been stored by displaying the multiple images in a state where they are touching each other, and distinguishing the edges of each image with lines such as red lines (overlapping images of red lines on the edges of each image).

[0211] The present invention can be embodied as, for example, a system, an apparatus, a method, a program, or a storage medium, and specifically, can be applied to a system consisting of multiple devices, or to an apparatus consisting of a single device. Furthermore, the above-described embodiments can be freely combined.

[0212] The present invention also includes a case where a software program for realizing the functions of the above-described embodiments is supplied to a system or device directly or remotely, and a computer in the system or device reads and executes the supplied program code to achieve the functions.

[0213] Therefore, the program code installed on a computer to implement the functional processing of the present invention also embodies the present invention, and the present invention also includes the computer program itself for implementing the functional processing of the present invention.

[0214] Recording media for supplying the program include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, MOs, CD-ROMs, CD-Rs, CD-RWs, etc. Also available are magnetic tapes, non-volatile memory cards, ROMs, DVDs (DVD-ROMs, DVD-Rs), etc.

[0215] Another method for supplying the program is to connect to an Internet homepage using the browser of the client computer, and then download the computer program of the present invention itself or a compressed file including an automatic installation function from the homepage to a recording medium such as a hard disk.

[0216] The present invention can also be realized by dividing the program code constituting the program of the present invention into multiple files and downloading each file from a different homepage. In other words, the present invention also includes a WWW server that allows multiple users to download program files for realizing the functional processing of the present invention on a computer.

[0217] Alternatively, the program of the present invention may be encrypted, stored on a storage medium such as a CD-ROM, and distributed to users, and users who meet certain conditions may download key information for decrypting the program from a website via the Internet. The downloaded key information may then be used to execute the encrypted program and install it on a computer, thereby achieving the present invention.

[0218] The functions of the above-described embodiments are realized by the computer executing the read program. Alternatively, the functions of the above-described embodiments can also be realized by an operating system or the like running on the computer performing some or all of the actual processing based on the instructions of the program.

[0219] Furthermore, the program read from the recording medium is written to a memory provided in a function expansion board inserted into a computer or a function expansion unit connected to the computer. Thereafter, based on the instructions of the program, a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the functions of the above-mentioned embodiment are also realized by this processing.

[0220] It should be noted that the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. That is, the present invention can be implemented in various forms without departing from the technical idea or main characteristics thereof. [Explanation of symbols]

[0221] 100 mobile devices 101 Network 200 servers

Claims

1. Photography means, an image capture control means for capturing one image of a paper sheet as a subject in one image capture; a first processing mode in which, when the captured image is horizontally long, a guide including a dividing line is displayed and the image of the paper included in the captured image is divided into a plurality of regions by the dividing line; a processing means having a second processing mode that controls the display of a guide that does not include the dividing line when the captured image is vertically long, and does not divide the image of the paper included in the captured image; When the processing mode by the processing means is a first processing mode, images of the sheets of the plurality of areas divided by the dividing lines are displayed as different pages; a display control means for controlling the display of the image on the sheet as a single page without dividing the image when the processing mode is the second processing mode; An information processing device comprising:

2. The processing means controls the display of a guide including a dividing line that divides an image of a paper sheet included in the captured image into left and right on the live view image captured by the photographing control means.

2. The information processing apparatus according to claim 1, wherein:

3. 3. The information processing device according to claim 1, wherein after the processing means divides the captured image into a plurality of areas, the display control means displays the plurality of areas as different pages regardless of the orientation of the captured image.

4. 4. The information processing apparatus according to claim 1, wherein the display control means controls the display of the plurality of areas generated by the processing means so as to be spaced apart from one another.

5. 5. The information processing apparatus according to claim 1, wherein the processing means performs correction to deform the shape of the image in a portion of the photographed image in which the paper is captured so that the portion approaches a rectangle.

6. 6. The information processing apparatus according to claim 1, wherein when the captured image is horizontally long, the image capturing control means captures the image as an A3 paper size image.

7. 7. The information processing apparatus according to claim 1, wherein when the photographed image is horizontally long, the processing means divides the photographed image into two regions on the left and right, each of which has an A4 paper size.

8. 8. The information processing apparatus according to claim 1, wherein when the captured image is portrait-oriented, the image capture control means captures the image as an A4 paper size image.

9. The shooting process and an imaging control step of capturing one image by one imaging of a paper sheet; a first processing mode in which, when the captured image is horizontally long, a guide including a dividing line is displayed and the image of the paper included in the captured image is divided into a plurality of regions by the dividing line; a second processing mode in which, when the captured image is vertically long, a guide that does not include the dividing line is displayed and the image of the paper included in the captured image is not divided; When the processing mode in the processing step is a first processing mode, images of the sheets of the plurality of areas divided by the dividing lines are displayed as different pages; a display control step of controlling the display of the image on the paper sheet as a single page without dividing the image when the processing mode is the second processing mode; An information processing method comprising:

10. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 8.

Images