Program, information processing device and system

Abstract

To efficiently manage information related to capture of noxious animals.SOLUTION: A program causes a computer to execute a first identification procedure, a second identification procedure, and an extraction procedure. The first identification procedure identifies multiple second codes from an image obtained by imaging an application form which is used by a hunter to report capture of a noxious animal and includes a first code and the multiple second codes. The second identification procedure identifies identification information related to the application form on the basis of any of the multiple second codes. The extraction procedure extracts information representing contents of the application form on the basis of the identification information related to the application form identified by the second identification procedure.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] An embodiment of the present invention relates to a program, an information processing device, and a system. [Background technology]

[0002] Conventionally, there is known a technique whereby when a hunter captures a harmful animal, he fills in a paper application form with certain information and submits the application form to the local government together with, for example, the tail of the harmful animal as a part of the captured harmful animal (Patent Document 1 below).Also, there is known a technique where an image reading device reads a print medium having a two-dimensional code arranged on the periphery of the print medium, and then corrects the read result for distortion, etc., and cuts out the image portion corresponding to the print medium from the read image and records and saves it (Patent Document 2 below). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-159589 A [Patent Document 2] Patent No. 6288487 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above Patent Document 1, the management of information regarding the capture of harmful animals can be cumbersome. In addition, in the above Patent Document 2, the operation of a terminal device such as an image reader is required, but some hunters are not good at operating terminal devices. Thus, when applying using a paper application form, it is not always possible to efficiently manage information regarding the capture of harmful animals.

[0005] The problem to be solved by the present invention is to provide a program, an information processing device, and a system that can efficiently manage information relating to the capture of harmful animals. [Means for solving the problem]

[0006] A program according to an embodiment causes a computer to execute a first identification procedure, a second identification procedure, and an extraction procedure. The first identification procedure is for identifying a plurality of second codes from an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes. The second identification procedure is for identifying identification information related to the application form based on one of the plurality of second codes. The extraction procedure is for extracting information indicating the contents of the application form based on the identification information related to the application form identified by the second identification procedure. Effect of the Invention

[0007] According to the present invention, information regarding the capture of harmful animals can be managed efficiently. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of information processing executed by a terminal device according to the embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of an application form according to the embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of a seal according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of content transition of an application according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of content transition of an application according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a data storage unit according to the embodiment. [Figure 9] FIG. 9 is a flowchart illustrating an example of the flow of information processing executed by the terminal device according to the embodiment. [Figure 10]FIG. 10 is a diagram illustrating an example of information processing executed by an information processing device according to a modified example. [Figure 11] FIG. 11 is a diagram illustrating an example of the configuration of an information processing device according to a modified example. [Figure 12] FIG. 12 is a flowchart showing an example of the flow of information processing executed by an information processing device according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] A program according to an embodiment described below causes a computer to execute a first identification procedure, a second identification procedure, and an extraction procedure. The first identification procedure is for identifying a plurality of second codes from an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes. The second identification procedure is for identifying identification information related to the application form based on one of the plurality of second codes. The extraction procedure is for extracting information indicating the contents of the application form based on the identification information related to the application form identified by the second identification procedure.

[0010] Further, a first identification procedure of the program according to the embodiment described below identifies a first code from an image, and a second identification procedure identifies identification information related to the application based on the first code.

[0011] In addition, a first identification procedure of the program in the embodiment described below corrects the image based on the position of each of multiple second codes contained in the image, and a second identification procedure identifies identification information related to the application form based on one of the multiple second codes contained in the image corrected by the first identification procedure.

[0012] Moreover, a second identification step of the program according to the embodiment described below identifies, as identification information related to the application, identification information for identifying the local government to which the application is to be made.

[0013] Moreover, a second identification procedure of the program according to the embodiment described below identifies information related to the type of application form as identification information related to the application form.

[0014] Moreover, a second identification procedure of the program according to the embodiment described below identifies information on the number of pages of the application form as identification information related to the application form.

[0015] In addition, a first identification procedure of the program according to the embodiment described below identifies a third code, which is the same code as the first code, from an image of a sample bag submitted together with an application form, the sample bag having a third code affixed thereto; a second identification procedure identifies identification information related to the application based on the third code; and an extraction procedure matches the information indicated by the first code with the information indicated by the third code.

[0016] Furthermore, the extraction procedure of the program according to the embodiment described below converts information indicating the contents of the application form into text information.

[0017] Moreover, the information processing device 200 according to the embodiment described below includes a receiving unit 231, a first identifying unit 232, a second identifying unit 233, and an extracting unit 234. The receiving unit 231 receives an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes. The first identifying unit 232 identifies the plurality of second codes from the image. The second identifying unit 233 identifies identification information related to the application form based on any one of the plurality of second codes. The extracting unit 234 extracts information indicating the contents of the application form based on the identification information related to the application form identified by the second identifying unit 233.

[0018] Further, the first identification unit 232 of the information processing device 200 according to the embodiment described below identifies a first code from an image, and the second identification unit 233 identifies identification information related to the application based on the first code.

[0019] In addition, the first identification unit 232 of the information processing device 200 in the embodiment described below corrects the image based on the positions of each of the multiple second codes contained in the image, and the second identification unit 233 identifies identification information related to the application form based on any one of the multiple second codes contained in the image corrected by the first identification unit 232.

[0020] Moreover, the second identification unit 233 of the information processing device 200 according to the embodiment described below identifies, as identification information related to the application, identification information for identifying the local government to which the application is to be made.

[0021] Moreover, the second identification unit 233 of the information processing device 200 according to the embodiment described below identifies information related to the type of the application form as identification information related to the application form.

[0022] Moreover, the second identification unit 233 of the information processing device 200 according to the embodiment described below identifies information on the number of pages of the application form as identification information related to the application form.

[0023] In addition, the reception unit 231 of the information processing device 200 according to the embodiment described below receives an image of a sample bag to which a third code, which is the same code as the first code, is affixed and which is submitted together with an application form, the first identification unit 232 identifies the third code from the image, the second identification unit 233 identifies identification information relating to the application based on the third code, and the extraction unit 234 associates the information indicated by the first code with the information indicated by the third code.

[0024] Moreover, the extraction unit 234 of the information processing device 200 according to the embodiment described below converts information indicating the contents of the application form into character information.

[0025] Moreover, the system 1 according to the embodiment described below includes a terminal device 10 and an information processing device 200. The terminal device 10 includes a photographing unit 13 and a transmission unit 18. The photographing unit 13 photographs an application form used for a hunter to apply for the capture of a harmful animal, the application form including a first code and a plurality of second codes, in response to an operation of a user using the terminal device 10. The transmission unit 18 transmits the image photographed by the photographing unit 13 to the information processing device 200. The information processing device 200 includes a reception unit 231, a first identification unit 232, a second identification unit 233, and an extraction unit 234. The reception unit 231 receives an image. The first identification unit 232 identifies a plurality of second codes from the image. The second identification unit 233 identifies identification information related to the application form based on any one of the plurality of second codes. The extraction unit 234 extracts information indicating the contents of the application form based on the identification information relating to the application form identified by the second identification unit 233.

[0026] Hereinafter, the form for carrying out the program, information processing device, and system according to the present application (hereinafter, referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device and system according to the present application are not limited to these embodiments. In addition, each embodiment can be appropriately combined as long as the processing contents are not contradictory. In addition, the same parts in each of the following embodiments are given the same reference numerals, and duplicated explanations will be omitted.

[0027] [Embodiment] [1. Information processing performed by terminal device] The information processing executed by the terminal device 10 will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the information processing executed by the terminal device 10 according to the embodiment. First, the configuration of a system 1 according to the embodiment will be described with reference to Fig. 1. As shown in Fig. 1, the system 1 includes a terminal device 10 and an information processing device 100. The terminal device 10 and the information processing device 100 are connected to each other via a predetermined network so as to be able to communicate with each other via a wired or wireless connection.

[0028] For example, the terminal device 10 and the information processing device 100 are connected to each other so as to be able to communicate with each other via a network N as a predetermined network, either wired or wirelessly. Note that the system 1 shown in FIG. 1 may include a plurality of terminal devices 10 and a plurality of information processing devices 100.

[0029] The terminal device 10 is an information processing device used by a user to access content such as a web page displayed on a browser or content displayed on an application. For example, the terminal device 10 is a tablet terminal, a desktop PC (Personal Computer), a notebook PC, a mobile phone, a PDA (Personal Digital Assistant), or the like. The terminal device 10 also has a photographing unit such as a camera. In the example of FIG. 1, the terminal device 10 is a tablet terminal.

[0030] The information processing device 100 is an information processing device capable of communicating with various devices via a network N, and is realized by, for example, a server device or a cloud system. For example, the information processing device 100 is connected to be able to communicate with various other devices via the network N. The example of FIG. 1 illustrates an example in which the information processing device 100 is a cloud system.

[0031] Next, the information processing executed by the terminal device 10 will be described with reference to Fig. 1. First, the premise will be described. When a hunter H1 captures a harmful animal such as a wild boar, a raccoon dog, or a deer, the hunter H1 may apply for a notification of the capture of the harmful animal to the local government where the hunter H1 is registered. Here, the local government may be, for example, a city, ward, town, or village office, or a prefectural office.

[0032] In the example of FIG. 1, when a hunter H1 captures a vermin, he fills in the necessary information in an application form PA1. Here, the application form PA1 is paper. The hunter H1 also removes a part of the captured vermin (for example, the tail of the vermin) and places the part of the vermin in a specimen bag PA2. Next, the hunter H1 submits the application form PA1 and the specimen bag PA2 to the local government. Then, a local government employee U1 (an example of a user) receives the application form PA1 and the specimen bag PA2.

[0033] In the following, an example will be described in which staff member U1 photographs application form PA1 and sample bag PA2 using terminal device 10, and extracts information about the application, information about application form PA1, and information showing the contents of application form PA1 from the photographed image. For convenience, the steps shown in FIG. 1 include actions performed by natural persons.

[0034] 1 is assumed to have an application AP pre-installed in it. Here, the application AP has a function of extracting, from a captured image, identification information relating to the application, identification information relating to the application form PA1, and information indicating the contents of the application form PA1.

[0035] Specifically, the application AP identifies a plurality of second codes from an image of the application form PA1 including a first code and a plurality of second codes. Next, the application AP identifies identification information related to the application form PA1 based on any one of the plurality of second codes. Then, the application AP extracts information indicating the contents of the application form PA1 based on the identified identification information related to the application form PA1. In the following, the process executed by the application AP will be described as a process executed by the terminal device 10. Also, an example will be described in which the first and second codes are two-dimensional codes.

[0036] In the example of Fig. 1, staff member U1 photographs application form PA1 using the terminal device 10 (step S1). Here, application form PA1 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of application form PA1 according to the embodiment.

[0037] As shown in Figure 2, application form PA1 includes the name of the application form, "A City Harmful Bird and Animal Capture Survey Form," a field RC11 for affixing a sticker SE11 bearing a two-dimensional code CD11, a field RC12 for entering various information, a field RC13 for affixing a photograph of the pest, and two-dimensional codes CD121 to CD124 affixed to the four corners of application form PA1.

[0038] The seal SE1 will be described with reference to FIG. 3. FIG. 3 is a diagram showing an example of the seal SE1 according to the embodiment. It is assumed that the distribution document L1 shown in FIG. 3 is distributed in advance to the hunter. The distribution document L1 includes a note such as "A set of two. Please attach them to the application form and the plastic bag for specimen submission, respectively," and a set of two seals SE21 and SE22. In the example of FIG. 3, the seal SE21 includes a two-dimensional code CD21, a note such as "Attach to application form," a pre-assigned number such as "10001," and a pre-assigned alphabet such as "A." Here, the two-dimensional code CD21 indicates identification information related to the application. For example, the identification information related to the application is a management number that is pre-assigned, etc.

[0039] Furthermore, sticker SE22 includes a two-dimensional code CD22, a notice such as "Attach to plastic bags", a pre-assigned number such as "10001", a pre-assigned alphabet such as "B", etc. Here, the two-dimensional code CD22 indicates identification information related to the application. Such identification information related to the application is, for example, a management number that has been assigned in advance. Furthermore, the identification information related to the application based on the two-dimensional code CD22 indicates the same identification information as the identification information related to the application based on the two-dimensional code CD21.

[0040] Returning to Fig. 2, the explanation will be continued. The sticker SE11 shown in Fig. 2 includes a two-dimensional code CD11, a pre-assigned number such as "10001", a pre-assigned alphabet such as "A", etc. Here, the two-dimensional code CD11 indicates identification information related to the application.

[0041] The entry field RC12 for various items is a field for entering information about the hunter H1, information about the captured vermin, etc. In the example of Fig. 2, the entry field RC12 for various items includes fields for entering the trapper registration number, the trapper name, the capture date, the individual number, the capture area number, the capture location, the vermin's body length, the vermin's weight, etc. The entry field RC12 for various items also includes fields for entering the bird / animal species, whether it is an adult or juvenile, the sex, the capture method, the post-capture processing method, etc.

[0042] The field RC13 for attaching a photo of a harmful animal is a field for attaching a photo taken by the hunter H1. The two-dimensional codes CD121-CD124 attached to the four corners of the application form PA1 indicate identification information related to the application form. For example, the identification information related to the application form is identification information for identifying the local government to which the application is submitted, information related to the type of application form, information related to the number of pages of the application form, etc.

[0043] To give a more specific example, the identification information for identifying the local government to which the application is to be made is a pre-assigned identification number, such as an identification number for identifying the local government. The information regarding the type of application form is information regarding the format of the application form used by each local government, such as information regarding the format indicating the items to be filled in by the hunter. The information regarding the number of application forms is information regarding the number of application forms used by each local government.

[0044] Returning to Fig. 1, the explanation will be continued. The terminal device 10 identifies the first code (step S2). Here, the first code corresponds to the two-dimensional code CD11 attached to the sticker SE11 shown in Fig. 2. The first code also corresponds to the two-dimensional code CD21 attached to the sticker SE21 shown in Fig. 3. For example, the terminal device 10 identifies the first code when the application form PA1 is photographed.

[0045] Then, the terminal device 10 identifies identification information related to the application based on the first code (step S3). For example, when the application form PA1 is photographed, the terminal device 10 reads the first code to identify identification information related to the application indicated by the first code.

[0046] Next, the terminal device 10 identifies a plurality of second codes (step S4). Here, each of the plurality of second codes corresponds to each of the two-dimensional codes CD121 to CD124 attached to the four corners of the application form PA1 shown in Fig. 2. For example, the terminal device 10 identifies a plurality of second codes from the image of the application form PA1. In the example of Fig. 2, the terminal device 10 identifies each of the two-dimensional codes CD121 to CD124 from the image of the application form PA1.

[0047] Then, the terminal device 10 identifies identification information related to the application form based on any one of the multiple second codes (step S5). For example, the terminal device 10 identifies identification information related to the application form indicated by any one of the multiple second codes by reading each of the multiple second codes from the image of the application form PA1.

[0048] Explaining with reference to FIG. 2, for example, the two-dimensional code CD121 indicates identification information for identifying the local government to which the application is to be made as identification information related to the application form. The two-dimensional code CD122 indicates information related to the type of application form as identification information related to the application form. The two-dimensional code CD123 indicates information related to the number of pages of the application form as identification information related to the application form. In this case, the terminal device 10 identifies the identification information for identifying the local government to which the application is to be made, the information related to the type of application form, and the information related to the number of pages of the application form by reading the two-dimensional codes CD121 to CD124.

[0049] To give a more specific example, the terminal device 10 specifies a pre-assigned identification number that identifies the local government to which the application is to be submitted, as the identification information that identifies the local government. The terminal device 10 also specifies information on the application form format used for each local government, as the information on the type of application form, as the information on the format indicating the items to be filled in by the hunter. The terminal device 10 also specifies information on the number of application forms used for each local government, as the information on the number of application forms.

[0050] Next, the terminal device 10 extracts information indicating the contents of the application form based on the identification information related to the application form (step S6). For example, the terminal device 10 extracts information indicating the contents of the application form based on the identification information related to the application form using a conventional technology such as OCR (Optical Character Recognition / Reader). Then, the terminal device 10 converts the information indicating the contents of the application form into character information.

[0051] Then, the staff member U1 photographs the sample bag PA2 using the terminal device 10 (step S7). Here, it is assumed that a pair of stickers, including the sticker affixed to the application form PA1, is affixed to the sample bag PA2. For example, the sticker SE22 shown in FIG. 3 is affixed to the sample bag PA2.

[0052] Next, the terminal device 10 identifies the third code (step S8). Here, the third code corresponds to the two-dimensional code CD22 attached to the sticker SE22 shown in FIG. 3. For example, the terminal device 10 identifies the third code when the specimen bag PA2 is photographed. Then, the terminal device 10 identifies identification information related to the application based on the third code. For example, the terminal device 10 identifies identification information related to the application indicated by the third code by reading the third code when the specimen bag PA2 is photographed.

[0053] Then, the terminal device 10 associates the information indicated by the first code with the information indicated by the third code (step S9). For example, the terminal device 10 associates information related to the application based on the first code as the information indicated by the first code, and information related to the application based on the third code as the information indicated by the third code.

[0054] Next, the terminal device 10 transmits various information to the information processing device 100 (step S10). For example, the terminal device 10 transmits information in which information related to the application, identification information related to the application form, and information indicating the contents of the application form are associated with each other to the information processing device 100. Here, the information related to the application is information in which information indicated by the first code and information indicated by the third code are associated with each other.

[0055] Furthermore, the terminal device 10 transmits an image of the application form PA1 and an image of the sample bag PA2 to the information processing device 100. Then, the information processing device 100 stores the received various pieces of information in a predetermined storage unit that the information processing device 100 has.

[0056] In the above embodiment, the terminal device 10 first identifies the first code, identifies identification information related to the application based on the first code, and then identifies the second code and identifies identification information related to the application based on the second code. However, the present invention is not limited to this. For example, the order of reading the first code and the second code may be reversed. As a more specific example, the terminal device 10 may first identify the second code, identify identification information related to the application based on the second code, and then identify the first code and identify identification information related to the application based on the first code. The terminal device 10 may also perform information processing on the first code and the second code in parallel at the same time.

[0057] In the above-mentioned Patent Document 1, there was a method in which a capture worker such as a hunter uses a terminal device such as a smartphone to upload data to a cloud server and submit a capture application and capture report to a capture manager. For example, in the above-mentioned Patent Document 1, when a vermin is captured, a paper application form is filled out and submitted to the local government along with the tail. On the other hand, depending on the attributes of the capture worker, since they are not familiar with using terminal devices, the capture application and capture report method using the old application form was often adopted. For this reason, there was a problem that applications using terminal devices and applications using the old application form were mixed in the capture manager, which caused a problem of cumbersome work.

[0058] On the other hand, it is considered possible to integrate the application data on a smartphone by photographing the old application form with a scanner or camera and digitizing the application contents written on the application form. However, the above-mentioned Patent Document 2 only corrects the distortion of the photographed image and cannot identify the type of application form, so it may not be suitable for processing handwritten information written on the application form. Thus, in the past, it was not always possible to efficiently manage information on the capture of vermin when applying using paper application forms.

[0059] The application AP identifies a plurality of second codes from an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes. The application AP then identifies identification information related to the application form based on one of the plurality of second codes, and extracts information indicating the contents of the application form based on the identified identification information related to the application form. This allows the application AP to efficiently manage information related to the capture of a harmful animal.

[0060] [2. An example of content transition] An example of content transition of the application AP will be described with reference to Figures 4 and 5. The content described below will be described as being displayed on the terminal device 10.

[0061] First, an example of transition of contents of an application AP in steps S1 to S6 shown in Fig. 1 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of transition of contents of an application AP according to the embodiment.

[0062] For example, the terminal device 10 displays content C11 on the application AP. The content C11 is a home screen of the application AP. In the example of Fig. 4, the content C11 includes text information such as "Code Folder List", each listed file, and a button B111. Here, each listed file stores information regarding the format of an application form.

[0063] Here, it is assumed that the staff member U1 presses the button B111. In this case, the terminal device 10 displays the content C12 (step S11). In the example of FIG. 4, the content C12 includes the button B121 "Read application form" and the button B122 "Take sample photograph."

[0064] Here, it is assumed that staff member U1 presses button B121. In this case, terminal device 10 displays content C13 (step S12). Content C13 displays the portion photographed by the photographing unit of terminal device 10. In the example of FIG. 4, a sticker with a first code attached is displayed as content C13 from among the application form PA1 photographed by the photographing unit. Content C13 also displays information on candidates such as "Unconfirmed HNT990000-10002G0" indicated by the first code. Content C13 also includes button B131 "Confirm Code", button B132 "Take Photo", and button B133 "Save and Next".

[0065] Here, it is assumed that staff member U1 presses button B131. In this case, terminal device 10 identifies the first code attached to the sticker. Then, terminal device 10 displays content C14 (step S13). Content C14 includes information indicated by the identified first code, "HNT990000-10002G0," button B141 "Change Code," button B142 "Take Photo," and button B143 "Save and Next."

[0066] Then, it is assumed that staff member U1 operates the terminal device 10 to photograph the entire application form PA1. In this case, the terminal device 10 displays content C15 (step S14). At this time, staff member U1 photographs the application form PA1 so that each of the four second codes attached to the four corners of the application form PA1 is captured in the image. Content C15 includes information indicated by the identified first code, "HNT990000-10002G0", button B151 "Change Code", button B152 "Take Photo", and button B153 "Save and Next".

[0067] Here, it is assumed that staff member U1 presses button B152. In this case, the photographing unit of terminal device 10 photographs application form PA1.

[0068] Next, the terminal device 10 corrects the captured image. Specifically, the terminal device 10 corrects distortions that occur in the application form PA1 shown in the image based on the positions of the four second codes included in the captured image. For example, the captured object may be tilted due to the angle at which it is captured or the way it is captured. Therefore, the terminal device 10 corrects distortions such as tilts that may occur in the application form PA1 shown in the image. Then, the terminal device 10 identifies identification information related to the application form based on any of the four second codes included in the corrected image. Next, the terminal device 10 extracts information indicating the contents of the application form based on the identification information related to the application form.

[0069] Then, the terminal device 10 displays the content C16 (step S15). The content C16 includes information indicating the contents of the extracted application form, a button B161 "Discard", and a button B162 "Update and save". In the example of Fig. 4, the content C16 displays information such as "trapper registration number 961" as information indicating the contents of the application form together with an image of the application form PA1.

[0070] Here, it is assumed that the staff member U1 scrolls the screen of the terminal device 10. In this case, the terminal device 10 displays the content C17 (step S16). The content C17 includes information indicating the contents of the extracted application form, a button B171 "Discard", and a button B172 "Update and save". In the example of FIG. 4, the content C17 displays information indicating the contents of the application form, such as "Gender: Male", "Capture method: Trap", and "Post-capture processing method: Burial", as well as a photo of the captured vermin.

[0071] Here, it is assumed that staff member U1 presses button B172. In this case, terminal device 10 displays content C18 (step S17). Terminal device 10 saves information in which identification information related to the application and identification information related to the application form are associated with each other. Content C18 displays information in which identification information related to the application and identification information related to the application form are associated with each other. Content C18 also displays "Reading result 1", "Reading result 2", and "Reading result 3" as a list RC181 of reading results. Content C18 includes button B181 "Read application form" and button B182 "Photograph sample".

[0072] Next, an example of transition of contents of the application AP in steps S7 to S9 shown in Fig. 1 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of transition of contents of the application AP according to the embodiment.

[0073] For example, the terminal device 10 displays content C21 on the application AP. Here, content C21 is the same content as content C18 shown in FIG. 4. In content C21, information is displayed in which identification information related to the application and identification information related to the application form are associated with each other. In addition, content C21 displays "Reading result 1," "Reading result 2," and "Reading result 3" as a list RC211 of reading results. Content C21 includes a button B211 "Read application form" and a button B212 "Take sample photograph."

[0074] Here, it is assumed that staff member U1 presses button B212. In this case, terminal device 10 displays content C22 (step S21). In the example of FIG. 5, content C22 displays the area photographed by the photographing unit. In the example of FIG. 5, a sticker with a third code attached is displayed as content C22 from among the sample bag PA2 photographed by the photographing unit. Content C22 also displays information on candidates such as "Unconfirmed HNT990000-10002G0" indicated by the third code. Content C22 also includes button B221 "Confirm Code", button B222 "Take Photo", and button B223 "Save and Next".

[0075] Here, it is assumed that staff member U1 presses button B221. In this case, the terminal device 10 identifies the third code attached to the sticker. Then, the terminal device 10 displays content C23 (step S23). The content C23 includes information indicated by the identified third code, "HNT990000-10002G0," a button B231 "Change Code," a button B232 "Take Photo," and a button B233 "Save and Next."

[0076] Then, it is assumed that the staff member U1 operates the terminal device 10 to take an image of the entire sample bag PA2. In this case, the terminal device 10 displays the content C24 (step S23). The content C24 includes the information indicated by the identified third code, "HNT990000-10002G0", a button B241 "Change Code", a button B242 "Take Photo", and a button B243 "Save and Next".

[0077] Here, it is assumed that staff member U1 presses button B242. In this case, terminal device 10 displays content C25 (step S24). Terminal device 10 saves information in which identification information related to the application is associated with identification information related to the application form. Content C25 displays information in which identification information related to the application is associated with identification information related to the application form. Content C25 also displays "Reading result 1", "Reading result 2", and "Reading result 3" as a list RC251 of reading results. Content C25 includes button B251 "Read application form" and button B252 "Photograph sample".

[0078] 3. Terminal Device Configuration Next, an example of a functional configuration of the terminal device 10 will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the terminal device 10 according to an embodiment. As shown in Fig. 6, the terminal device 10 has a communication unit 11, a storage unit 12, an image capture unit 13, an input unit 14, an output unit 15, and a control unit 16.

[0079] (Regarding communication section 11) The communication unit 11 is realized by, for example, a network interface card (NIC), etc. The communication unit 11 is connected to a network N by wire or wirelessly, and transmits and receives information to and from various other devices.

[0080] (Regarding the storage unit 12) The storage unit 12 stores programs and the like for implementing control by the control unit 16. The storage unit 12 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0081] (About the shooting section 13) The photographing unit 13 is realized by, for example, a camera etc. For example, the photographing unit 13 photographs a subject in response to an operation by a user.

[0082] (Regarding input unit 14) The input unit 14 accepts various operations from the user. For example, the input unit 14 accepts various operations from the user via a display screen of the output unit 15 of the terminal device 10 by using a touch panel function. The input unit 14 may also accept various operations from buttons provided on the terminal device 10 or a keyboard or mouse connected to the terminal device 10.

[0083] (Regarding output unit 15) The output unit 15 is a display screen realized by, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, etc., and is a display device for displaying various information. For example, the output unit 15 displays the content displayed on the application AP.

[0084] (Regarding the control unit 16) The control unit 16 executes various processes of the terminal device 10. The control unit 16 can be realized by a control circuit including a processor and a memory. Each functional unit of the control unit 16 is realized, for example, by executing instructions written in a program read from an internal memory by the processor, using the internal memory as a working area. The programs read from the internal memory by the processor include an OS (Operating System) and application programs. In addition, each functional unit of the control unit 16 may be realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

[0085] As shown in Fig. 6, the control unit 16 has an application control unit 17 and a transmission unit 18, and realizes or executes the functions and actions of information processing described below. The internal configuration of the control unit 16 is not limited to the configuration shown in Fig. 6, and may be other configurations as long as they perform the information processing described below. Furthermore, the connection relationship between the processing units in the control unit 16 is not limited to the connection relationship shown in Fig. 6, and may be other connection relationships.

[0086] (Regarding application control unit 17) The application control unit 17 controls the application AP. For example, the application AP causes the computer to execute a first identification procedure, a second identification procedure, and an extraction procedure.

[0087] The first identification step is to identify the second codes from an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes. Here, each of the second codes corresponds to each of the two-dimensional codes CD121 to CD124 attached to the four corners of the application form PA1 shown in FIG. 2.

[0088] For example, the first identification procedure identifies a plurality of second codes from an image of an application form. In the example of Fig. 2, the first identification procedure identifies each of the two-dimensional codes CD121 to CD124 from the image of application form PA1.

[0089] The first identification procedure also identifies a first code. Here, the first code corresponds to a two-dimensional code CD11 attached to a sticker SE11 shown in Fig. 2. The first code also corresponds to a two-dimensional code CD21 attached to a sticker SE21 shown in Fig. 3. For example, the first identification procedure identifies the first code when an application form is photographed.

[0090] The first identification procedure also identifies a third code. Here, the third code corresponds to the two-dimensional code CD22 attached to the sticker SE22 shown in Fig. 3. For example, the first identification procedure identifies the third code when the sample bag PA2 is photographed.

[0091] The first identification procedure may correct the image. The image correction will be described with reference to FIG. 4. For example, the first identification procedure corrects distortions that occur in the application form PA1 shown in the image based on the positions of the four second codes included in the captured image. For example, the captured object may be tilted due to the angle at which the image was captured or the way the image was captured. Therefore, the first identification procedure corrects distortions such as tilts that may occur in the application form PA1 shown in the image. In this case, the second identification procedure may identify identification information related to the application form based on any of the four second codes included in the corrected image.

[0092] The second identification step identifies identification information related to the application form based on any of the multiple second codes. For example, the second identification step identifies identification information related to the application form indicated by any of the multiple second codes by reading each of the multiple second codes from an image of the application form.

[0093] Explaining with reference to FIG. 2, for example, the two-dimensional code CD121 indicates identification information for identifying the local government to which the application is to be made as identification information related to the application. The two-dimensional code CD122 indicates information related to the type of application as identification information related to the application. The two-dimensional code CD123 indicates information related to the number of pages of the application as identification information related to the application. In this case, the second identification procedure reads the two-dimensional codes CD121 to CD124 to identify the identification information for identifying the local government to which the application is to be made, the information related to the type of application, and the information related to the number of pages of the application.

[0094] To give a more specific example, the second identification step identifies an identification number that is assigned in advance as identification information that identifies the local government to which the application is to be made, and identifies the local government. The second identification step also identifies, as information related to the type of application form, information related to the application form format used by each local government, and information related to the format indicating the items to be filled in by the hunter. The second identification step also identifies, as information related to the number of application forms, information related to the number of application forms used by each local government.

[0095] Furthermore, the second identification step identifies identification information related to the application based on the first code. For example, the second identification step identifies identification information related to the application indicated by the first code by reading the first code when the application form is photographed.

[0096] Furthermore, the second identification step identifies identification information related to the application based on the third code. For example, the second identification step identifies identification information related to the application indicated by the third code by reading the third code when the sample bag is photographed.

[0097] The extraction step extracts information indicating the contents of the application form based on the identification information related to the application form identified by the second identification step. For example, the extraction step extracts information indicating the contents of the application form using a conventional technology such as OCR based on the identification information related to the application form. Then, the extraction step converts the information indicating the contents of the application form into character information.

[0098] Furthermore, the extraction procedure associates information indicated by the first code with information indicated by the third code. For example, the extraction procedure associates information related to an application based on the first code as information indicated by the first code, and information related to an application based on the third code as information indicated by the third code.

[0099] (Regarding the transmitting unit 18) The transmitting unit 18 transmits various information. Specifically, the transmitting unit 18 transmits various information to the information processing device 100. For example, the transmitting unit 18 transmits information in which information related to the application, identification information related to the application form, and information indicating the contents of the application form are associated with each other to the information processing device 100. Here, the information related to the application is information in which information indicated by the first code and information indicated by the third code are associated with each other. In addition, the transmitting unit 18 transmits an image of the application form PA1 and an image of the sample bag PA2 to the information processing device 100.

[0100] 4. Configuration of Information Processing Device Next, an example of a functional configuration of the information processing device 100 will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the configuration of the information processing device according to the embodiment. As shown in Fig. 7, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130.

[0101] (Regarding communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from various other devices.

[0102] (Regarding the storage unit 120) The storage unit 120 stores programs and the like for implementing control by the control unit 130. The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 also includes a data storage unit 121.

[0103] (Regarding data storage unit 121) The data storage unit 121 stores various information applied for by a hunter. Fig. 8 is a diagram showing an example of the data storage unit according to the embodiment. In the example shown in Fig. 8, the data storage unit 121 has items such as "Data ID (Identifier)", "Identification information related to application", "Identification information related to application form", and "Contents of application form".

[0104] The "data ID" is an identifier for identifying a data set. The "identification information related to an application" is identification information related to an application associated with the "data ID." For example, the identification information related to an application is a management number that is assigned in advance.

[0105] The "identification information related to the application form" is identification information related to the application form associated with the "data ID." For example, the identification information related to the application form is identification information for identifying the local government to which the application is submitted, information related to the type of application form, information related to the number of pages of the application form, etc.

[0106] "Application content" is information indicating the content of the application form associated with the "data ID." For example, the information indicating the application content stores information entered in the application form as character information. In addition, the "application content" may store an image of the application form that has been photographed, an image of the sample bag, or the like, in association with the application content.

[0107] For example, in FIG. 8, "D1" identified by the data ID has application-related identification information "A1", application form identification information "AG1", and application form content "AI1".

[0108] In the example shown in Figure 8, the identification information etc. related to the application is expressed as an abstract code such as "A1", but the identification information etc. related to the application may also be a number, a character string, or the file format of a file containing various information indicating the identification information etc. related to the application.

[0109] (Regarding the control unit 130) The control unit 130 executes various processes of the information processing device 100. The control unit 130 can be realized by a control circuit including a processor and a memory. Each functional unit of the control unit 130 is realized, for example, by executing instructions written in a program read from an internal memory by the processor, using the internal memory as a working area. The programs read by the processor from the internal memory include an OS and application programs. In addition, each functional unit of the control unit 130 may be realized, for example, by an integrated circuit such as an ASIC or an FPGA.

[0110] As shown in Fig. 7, the control unit 130 has a reception unit 131, and realizes or executes the functions and actions of information processing described below. The internal configuration of the control unit 130 is not limited to the configuration shown in Fig. 7, and may be other configurations as long as they perform information processing described below. Furthermore, the connection relationship between the processing units included in the control unit 130 is not limited to the connection relationship shown in Fig. 7, and may be other connection relationships.

[0111] (Regarding the reception unit 131) The reception unit 131 receives various types of information. For example, the reception unit 131 receives various types of information from the terminal device 10. The reception unit 131 stores the received various types of information in the data storage unit 121.

[0112] 5. Processing Procedure Next, the procedure of information processing executed by the terminal device 10 according to the embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the flow of information processing executed by the terminal device 10 according to the embodiment.

[0113] 9, the photographing unit 13 photographs the application form in response to a user's operation (step S101). Specifically, if the photographing unit 13 has not photographed the application form in response to a user's operation (step S101; No), the photographing unit 13 waits until it accepts a user's operation.

[0114] On the other hand, when the photographing unit 13 photographs the application form in response to the user's operation (step S101; Yes), the application control unit 17 identifies the first code from the image photographed by the photographing unit 13 (step S102). Next, the application control unit 17 identifies identification information related to the application based on the first code (step S103).

[0115] Then, the application control unit 17 identifies a plurality of second codes from the image captured by the photographing unit 13 (step S104). Next, the application control unit 17 identifies identification information related to the application form based on any of the plurality of second codes (step S105). Then, the application control unit 17 extracts information indicating the contents of the application form based on the identification information related to the application form (step S106).

[0116] Then, the photographing unit 13 photographs the sample bag in response to the user's operation (step S107). Specifically, if the photographing unit 13 has not photographed the sample bag in response to the user's operation (step S107; No), the process ends.

[0117] On the other hand, when the photographing unit 13 photographs the sample bag in response to the user's operation (step S107; Yes), the application control unit 17 identifies the third code from the image photographed by the photographing unit 13 (step S108). Next, the application control unit 17 associates the information indicated by the first code with the information indicated by the third code (step S109).

[0118] Then, the transmission unit 18 transmits various information (step S110). In the above example, the photographing unit 13 ends the process when the photographing unit 13 does not photograph the sample bag in response to the user's operation, but the present invention is not limited to this. For example, when the photographing unit 13 does not photograph the sample bag in response to the user's operation, the process may return to before step S107.

[0119] 6. Modifications The above-mentioned application AP may be implemented in various different forms other than the above-mentioned embodiment, so other embodiments will be described below.

[0120] 6-1. When an information processing device executes information processing In the above embodiment, the terminal device 10 identifies a plurality of second codes from an image of an application form including a first code and a plurality of second codes, and extracts information indicating the contents of the application form based on identification information related to the application form identified based on one of the plurality of second codes. However, the present invention is not limited to this. For example, the information processing device 100 may execute the above information processing.

[0121] 6-1-1. Information processing performed by the information processing device The information processing executed by the information processing device 200 will be described with reference to Fig. 10. Fig. 10 is a diagram showing an example of information processing executed by the information processing device 200 according to a modified example. First, the configuration of the system 2 according to the embodiment will be described with reference to Fig. 10. As shown in Fig. 10, the system 2 includes a terminal device 10 and an information processing device 200. The terminal device 10 and the information processing device 200 are connected to each other via a network N so as to be able to communicate with each other by wire or wirelessly. Note that the system 2 shown in Fig. 10 may include a plurality of terminal devices 10 and a plurality of information processing devices 200.

[0122] The information processing device 200 is an information processing device capable of communicating with various devices via a network N, and is realized by, for example, a server device or a cloud system. For example, the information processing device 200 is connected to be able to communicate with various other devices via the network N. In the example of FIG. 10, an example is shown in which the information processing device 200 is a cloud system.

[0123] In the following, an example will be described in which information related to the application, information related to the application form, and information indicating the contents of the application form are extracted from an image taken by employee U1. For the sake of convenience, the steps shown in FIG. 10 are assumed to include actions taken by natural persons.

[0124] In the following, an example will be described in which the terminal device 10 transmits to the information processing device 200 images of the application form PA1 and the sample bag PA2 captured by the staff member U1.

[0125] In the example of Fig. 1, staff member U1 photographs application form PA1 using the terminal device 10 (step S31). Staff member U1 also photographs sample bag PA2 using the terminal device 10 (step S32).

[0126] Next, the information processing device 200 receives an image of the application form PA1 and an image of the sample bag PA2 (step S33). Then, the information processing device 200 identifies the first code (step S34). For example, the information processing device 200 identifies the first code when the application form PA1 is photographed.

[0127] Next, the information processing device 200 identifies identification information related to the application based on the first code (step S35). For example, when the application form PA1 is photographed, the information processing device 200 reads the first code to identify the identification information related to the application indicated by the first code.

[0128] Then, the information processing device 200 identifies a plurality of second codes (step S36). In the example of Fig. 2, the information processing device 200 identifies each of the two-dimensional codes CD121 to CD124 from the image of the application form PA1.

[0129] Next, the information processing device 200 identifies identification information related to the application form based on any one of the multiple second codes (step S37). For example, the information processing device 200 identifies identification information related to the application form indicated by any one of the multiple second codes by reading each of the multiple second codes from the image of the application form PA1.

[0130] Explaining with reference to FIG. 2, for example, the two-dimensional code CD121 indicates identification information for identifying the local government to which the application is to be made as identification information related to the application form. The two-dimensional code CD122 indicates information related to the type of application form as identification information related to the application form. The two-dimensional code CD123 indicates information related to the number of pages of the application form as identification information related to the application form. In this case, the information processing device 200 identifies the identification information for identifying the local government to which the application is to be made, the information related to the type of application form, and the information related to the number of pages of the application form by reading the two-dimensional codes CD121 to CD124.

[0131] To give a more specific example, the information processing device 200 identifies a pre-assigned identification number that identifies a local government as identification information for identifying the local government to which the application is to be submitted. Furthermore, the information processing device 200 identifies information on the format of the application form used for each local government as information on the type of application form, which is information on the format indicating the items to be filled in by the hunter. Furthermore, the information processing device 200 identifies information on the number of application forms used for each local government as information on the number of application forms.

[0132] Then, the information processing device 200 extracts information indicating the contents of the application form based on the identification information related to the application form (step S38). For example, the information processing device 200 extracts information indicating the contents of the application form based on the identification information related to the application form using conventional technology such as OCR. Then, the information processing device 200 converts the information indicating the contents of the application form into character information.

[0133] Next, the information processing device 200 identifies the third code (step S39). For example, the information processing device 200 identifies the third code when the specimen bag PA2 is photographed. Then, the information processing device 200 identifies identification information related to the application based on the third code. For example, the information processing device 200 identifies identification information related to the application indicated by the third code by reading the third code when the specimen bag PA2 is photographed.

[0134] Then, the information processing device 200 associates the information indicated by the first code with the information indicated by the third code (step S40). For example, the information processing device 200 associates information related to the application based on the first code as the information indicated by the first code, and information related to the application based on the third code as the information indicated by the third code. Then, the information processing device 200 stores information in which the information indicated by the first code and the information indicated by the third code are associated with each other in the data storage unit 121. Furthermore, the information processing device 200 stores an image of the application form PA1 and an image of the sample bag PA2 in the data storage unit 121. In this way, the information processing device 200 can efficiently manage information related to the capture of vermin.

[0135] 6-1-2. Configuration of information processing device Next, an example of a functional configuration of the information processing device 200 will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of a configuration of the information processing device 200 according to a modified example. As shown in Fig. 11, the information processing device 200 has a communication unit 110, a storage unit 120, and a control unit 230.

[0136] (Regarding the control unit 230) The control unit 230 executes various processes of the information processing device 200. The control unit 230 can be realized by a control circuit including a processor and a memory. Each functional unit of the control unit 230 is realized, for example, by executing instructions written in a program read from an internal memory by the processor, using the internal memory as a working area. The programs read by the processor from the internal memory include an OS and application programs. In addition, each functional unit of the control unit 230 may be realized, for example, by an integrated circuit such as an ASIC or an FPGA.

[0137] As shown in Fig. 11, control unit 230 has reception unit 231, first identification unit 232, second identification unit 233, and extraction unit 234, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of control unit 230 is not limited to the configuration shown in Fig. 11, and may be other configurations as long as they perform information processing described below. Also, the connection relationship between each processing unit of control unit 230 is not limited to the connection relationship shown in Fig. 11, and may be other connection relationships.

[0138] (Regarding the reception unit 231) The reception unit 231 receives various information. Specifically, the reception unit 231 receives an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes.

[0139] For example, the reception unit 231 receives an image of the application form PA1 and an image of the sample bag PA2 from the terminal device 10. Then, the reception unit 231 stores the received images in the data storage unit 121.

[0140] (Regarding the first identification unit 232) The first identification unit 232 identifies a plurality of second codes from the image accepted by the acceptance unit 231. Here, each of the plurality of second codes corresponds to each of the two-dimensional codes CD121 to CD124 attached to the four corners of the application form PA1 shown in FIG.

[0141] For example, the first identification unit 232 identifies a plurality of second codes when an application form is photographed. In the example of Fig. 2, the first identification unit 232 identifies each of the two-dimensional codes CD121 to CD124 when the application form PA1 is photographed.

[0142] In addition, the first identification unit 232 identifies the first code. For example, the first identification unit 232 identifies the first code when an image of an application form is captured.

[0143] Furthermore, the first identification unit 232 identifies the third code. For example, the first identification unit 232 identifies the third code when the sample bag PA2 is photographed.

[0144] The first identification unit 232 may correct the image. The image correction will be described with reference to FIG. 4. For example, the first identification unit 232 corrects distortions that occur in the application form PA1 shown in the image based on the positions of the four second codes included in the captured image. For example, the captured object may be tilted due to the angle at which the image was captured or the way the image was captured. Therefore, the first identification unit 232 corrects distortions such as tilts that may occur in the application form PA1 shown in the image. In this case, the second identification unit 233 may identify identification information related to the application form based on any of the four second codes included in the corrected image.

[0145] (Regarding the second identification unit 233) The second identification unit 233 identifies identification information related to the application form based on any one of the multiple second codes. For example, the second identification unit 233 identifies identification information related to the application form indicated by any one of the multiple second codes by reading each of the multiple second codes from an image of the application form.

[0146] Explaining with reference to FIG. 2, for example, the two-dimensional code CD121 indicates identification information for identifying the local government to which the application is to be made as identification information related to the application. The two-dimensional code CD122 indicates information related to the type of application as identification information related to the application. The two-dimensional code CD123 indicates information related to the number of pages of the application as identification information related to the application. In this case, the second identification unit 233 identifies the identification information for identifying the local government to which the application is to be made, the information related to the type of application, and the information related to the number of pages of the application by reading the two-dimensional codes CD121 to CD124.

[0147] To give a more specific example, the second identification unit 233 identifies an identification number that is assigned in advance as identification information for identifying the local government to which the application is to be made, and identifies the local government. Furthermore, the second identification unit 233 identifies, as information on the type of application form, information on the application form format used for each local government, and information on the format indicating the items to be filled in by the hunter. Furthermore, the second identification unit 233 identifies, as information on the number of application forms, information on the number of application forms used for each local government.

[0148] Furthermore, the second identification unit 233 identifies identification information related to the application based on the first code. For example, when an application form is photographed, the second identification unit 233 reads the first code to identify identification information related to the application indicated by the first code.

[0149] Furthermore, the second identification unit 233 identifies identification information related to the application based on the third code. For example, when the sample bag is photographed, the second identification unit 233 reads the third code to identify the identification information related to the application indicated by the third code.

[0150] (Regarding the extraction unit 234) The extraction unit 234 extracts information indicating the contents of the application form based on the identification information related to the application form identified by the second identification unit 233. For example, the extraction unit 234 extracts information indicating the contents of the application form using a conventional technology such as OCR based on the identification information related to the application form. Then, the extraction unit 234 converts the information indicating the contents of the application form into character information.

[0151] Furthermore, the extraction unit 234 associates the information indicated by the first code with the information indicated by the third code. For example, the extraction unit 234 associates information related to the application based on the first code as the information indicated by the first code, and information related to the application based on the third code as the information indicated by the third code. Then, the extraction unit 234 stores in the data storage unit 121 the information in which the information indicated by the first code and the information indicated by the third code are associated with each other.

[0152] [6-1-3. Processing Procedure] Next, the procedure of information processing executed by the information processing device 200 according to the embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing an example of the flow of information processing executed by the information processing device according to the modified example.

[0153] 12, the reception unit 231 receives an image of an application form and an image of a sample bag (step S201). Specifically, if the reception unit 231 has not received an image of the application form and an image of the sample bag (step S201; No), the reception unit 231 waits until the reception of the image of the application form and the image of the sample bag.

[0154] On the other hand, when the receiving unit 231 receives an image of the application form and an image of the sample bag (step S201; Yes), the first identifying unit 232 identifies a first code from the image of the application form (step S202). Next, the first identifying unit 232 identifies identification information related to the application based on the first code (step S203).

[0155] Then, the second identification unit 233 identifies a plurality of second codes from the image of the application form (step S204). Next, the second identification unit 233 identifies identification information related to the application form based on any of the plurality of second codes (step S205). Then, the extraction unit 234 extracts information indicating the contents of the application form based on the identification information related to the application form (step S206).

[0156] Then, the first identification unit 232 identifies the third code from the image of the sample bag (step S207). Next, the extraction unit 234 associates the information indicated by the first code with the information indicated by the third code (step S208).

[0157] In the above modified example, the terminal device 10 transmits images of the application form PA1 and the sample bag PA2 taken by the staff member U1 to the information processing device 200, but the present invention is not limited to this. For example, the image of the application form PA1 and the image of the sample bag PA2 may be transmitted separately. Specifically, the terminal device 10 may transmit an image of the application form PA1 to the information processing device 200, and then transmit an image of the sample bag PA2 to the information processing device 200 after a predetermined period of time.

[0158] [6-2. Code] In the above embodiment, the first and second codes are described as two-dimensional codes, but the present invention is not limited thereto. For example, the first and second codes may be any codes. For example, the first and second codes may be one-dimensional codes, etc.

[0159] [6-3. Submission of application form] Furthermore, the information processing device 100 may provide information on application forms to each local government. Generally, application forms have different formats for each local government. Therefore, for example, an operator who manages the information processing device 100 can provide application forms in various formats to the local government, thereby enabling application forms in different formats to be managed in a centralized manner.

[0160] For example, the information processing device 100 may provide information on application forms in a unified format to a local government. Also, the information processing device 100 may provide information on application forms in a format selected by a local government from among the files listed as shown in FIG.

[0161] In such a case, the information processing device 100 may receive a predetermined remuneration from the local government that provided the application form. Also, the information processing device 100 may receive a request from the local government that provided the application form to create a new application form in a predetermined format. In this case, the information processing device 100 may receive a predetermined remuneration from the local government that made the request.

[0162] [6-4. Detection of application form deficiencies] Furthermore, the application AP may detect information about a certain defect in the application form, such as a sticker not being attached to the application form, a missing entry in a field of the application form such as the hunter's name not being written, or other document defects.

[0163] The information on the predetermined defect is, for example, a defect in the photo of the vermin. For example, it is assumed that there is a rule that the photo to be attached to the application form must have the head of the vermin facing right. In this case, the application AP may detect information on the predetermined defect in the application form when the head of the vermin included in the image is not facing right.

[0164] For example, the application AP may detect information regarding certain deficiencies in an application form and display the detection results of the deficiencies.

[0165] [6-5. Score] Furthermore, the application AP may display a score indicating the degree to which the information indicating the contents of the application form was read. Also, if the score is less than a predetermined threshold, the application AP may display an error message such as "The application form could not be read properly." In this case, the application AP may display the parts of the information indicating the contents of the application form that could not be read in a highlighted manner.

[0166] [6-6. Additional Information] Further, the second code may store additional information. For example, the second code may further store identification information for identifying the hunter. The second code may further store information regarding the validity period of the application form.

[0167] [6-7. If the application form is multiple pages] Furthermore, if the application form has multiple pages, the application AP may execute the process of extracting information indicating the contents of the application form multiple times. For example, assume that the identification information regarding the application form includes information regarding the number of pages of the application form is two. In this case, the application AP may execute the process of extracting information indicating the contents of the application form twice.

[0168] An example where the application form has two pages will be described using Fig. 4. First, the application AP executes the information processing indicated by steps S11 to S16 on the first page of the application form. Then, the application AP executes the information processing indicated by steps S15 to S16 on the second page of the application form. In this way, the application AP can extract information indicating the contents of each application form even if the application form has multiple pages.

[0169] Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and gist of the invention. [Explanation of symbols]

[0170] N Network 1 System 2. System 10 Terminal Equipment 11 Communications Department 12 Storage section 13. Photography Department 14 Input section 15 Output section 16 Control section 17 Application control section 18 Transmitter 100 Information processing device 110 Communications Department 120 Storage section 121 Data storage unit 130 Control section 131 Reception 200 Information processing device 230 Control Unit 231 Reception 232 First Specific Part 233 Second Specific Part 234 Extraction part

Claims

1. a first identification step of identifying a plurality of second codes from an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes; a second identification step of identifying identification information relating to the application based on any one of the plurality of second codes; an extraction step of extracting information indicating the contents of the application form based on identification information relating to the application form identified by the second identification step; A program that causes a computer to execute the following.

2. The first identification step includes: Identifying the first code from the image; The second identification step includes: Identifying identification information for the application based on the first code. The program according to claim 1.

3. The first identification step includes: correcting the image based on the positions of each of the plurality of second codes included in the image; The second identification step includes: Identifying identification information related to the application form based on any one of the second codes included in the image corrected by the first identification procedure. The program according to claim 1.

4. The second identification step includes: Identification information for identifying the local government to which the application is to be submitted is specified as identification information related to the application form. The program according to claim 1.

5. The second identification step includes: Identifying information regarding the type of the application as identification information regarding the application The program according to claim 1.

6. The second identification step includes: Identifying information regarding the number of pages of the application form as identification information regarding the application form The program according to claim 1.

7. The first identification step includes: A sample bag to which a third code, which is the same code as the first code, is attached, is identified from an image of the sample bag submitted together with the application form; The second identification step includes: determining identifying information relating to the application based on the third code; The extraction procedure comprises: Corresponding information indicated by the first code with information indicated by the third code. The program according to claim 2.

8. The extraction procedure comprises: Converting information indicating the contents of the application form into text information The program according to claim 1.

9. a reception unit that receives an image of an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes; a first identification unit that identifies the plurality of second codes from the image; a second identification unit that identifies identification information related to the application form based on any one of the plurality of second codes; an extraction unit that extracts information indicating the contents of the application form based on identification information related to the application form identified by the second identification unit; An information processing device comprising:

10. The first identification unit is Identifying the first code from the image; The second identification unit is Identifying identification information for the application based on the first code. The information processing device according to claim 9.

11. The first identification unit is correcting the image based on the positions of each of the plurality of second codes included in the image; The second identification unit is Identifying identification information related to the application form based on any one of the second codes included in the image corrected by the first identification unit. The information processing device according to claim 9.

12. The second identification unit is Identification information for identifying the local government to which the application is to be submitted is specified as identification information related to the application form. The information processing device according to claim 9.

13. The second identification unit is Identifying information regarding the type of the application as identification information regarding the application The information processing device according to claim 9.

14. The second identification unit is Identifying information regarding the number of pages of the application form as identification information regarding the application form The information processing device according to claim 9.

15. The reception unit is receiving an image of a sample bag having a third code, which is the same code as the first code, attached thereto, the sample bag being submitted together with the application; The first identification unit is Identifying the third code from the image; The second identification unit is determining identifying information relating to the application based on the third code; The extraction unit is Corresponding information indicated by the first code with information indicated by the third code. The information processing device according to claim 10.

16. The extraction unit is Converting information indicating the contents of the application form into text information The information processing device according to claim 9.

17. A system including a terminal device and an information processing device, The terminal device a photographing unit that photographs an application form used by a hunter to report the capture of a harmful animal, the application form including a first code and a plurality of second codes, in response to an operation of a user who uses the terminal device; a transmission unit that transmits an image captured by the imaging unit to the information processing device; Equipped with The information processing device includes: A reception unit that receives the image; a first identification unit that identifies the plurality of second codes from the image; a second identification unit that identifies identification information related to the application form based on any one of the plurality of second codes; an extraction unit that extracts information indicating the contents of the application form based on identification information related to the application form identified by the second identification unit; A system comprising:

Images