Information Processing System, Information Processing Method, and Program

Abstract

To provide an information processing system, an information processing method, and a program storage medium that can assist applicants in filling out entry columns on procedural documents.SOLUTION: In an information processing system, an information processing device includes: a personal information acquisition unit configured to acquire personal information about a user to assist an applicant in filling out an application form required to apply for a procedure; a guidance determination unit configured to determine a content or type of guidance to encourage the user to fill out the application form recognized by a user terminal based on the acquired personal information; and a guidance control unit configured to control the guidance to be superimposed and displayed on an image showing the application form or on the application form.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program storage medium.

Background Art

[0002] When a resident applies for a procedure, it is necessary to enter information in the entry fields of the document. Patent Document 1 discloses a technique for presenting reference information corresponding to an entry field from an image of the entry field in order to reduce entry mistakes when a user enters information in a document. Patent Document 2 discloses a technique for displaying a page for guiding submission destination information according to the submitted document.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] When applying for a procedure, even when filling out the same application form, the items and information to be filled in may differ according to individual applicants. Therefore, for applicants who are not familiar with the procedure, it has been difficult to determine specifically what should be filled in the application form for their own case. In this regard, the techniques described in Patent Document 1 and Patent Document 2 do not consider flexible entry assistance according to the applicant.

[0005] In view of the above problems, an object of the present invention is to provide an information processing system, an information processing method, and a program storage medium capable of assisting an applicant in filling out an application form.

Means for Solving the Problems

[0006] According to one aspect of the present invention, acquisition means for acquiring personal information of a user; determination means for determining the content of a guide for prompting the user to fill in an application form based on the personal information; guide control means for controlling to superimpose and display the guide on an image showing the application form or on the application form; an information processing system comprising the above is provided.

[0007] According to one aspect of the present invention, acquire personal information of a user, determine the content of a guide for prompting the user to fill in an application form based on the personal information, control to superimpose and display the guide on an image showing the application form or on the application form, an information processing method is provided.

[0008] According to one aspect of the present invention, a program storage medium storing a program for causing a computer to execute a process of acquiring personal information of a user, execute a process of determining the content of a guide for prompting the user to fill in an application form based on the personal information, execute a process of controlling to superimpose and display the guide on an image showing the application form or on the application form, is provided.

Advantages of the Invention

[0009] According to the present invention, it is possible to provide an information processing system, an information processing method, and a program storage medium capable of assisting an applicant in filling in an application form.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Embodiments for Carrying Out the Invention

[0011] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding elements are denoted by the same reference numerals, and the description thereof may be omitted or simplified.

[0012] [Outline of Functions] First, the outline of the functions realized by the present invention will be described with reference to FIG. 1. FIG. 1 is a diagram for explaining an example of a situation where a user who fills out an application form uses the user terminal 20. When the user presents the identity document to the user terminal 20, the user terminal 20 reads personal information from the identity document. Further, the user terminal 20 captures an image of the application form D1 to be filled out by the user through a user operation, and acquires the type of the application form D1. The user terminal 20 transmits the read personal information and the type of the application form to the information processing device 10.

[0013] Based on the personal information and the type of the application form received from the user terminal 20, the information processing device 10 selects guide information to be displayed on the user terminal 20. The guide information is information for prompting the user to fill out the application form, and changes according to the type of the application form and the personal information of the user. The information processing device 10 transmits a control signal for displaying the selected guide information on the user terminal 20.

[0014] Returning to the description of the user terminal 20, the user terminal 20 receives the control signal transmitted from the information processing device 10. The user terminal 20 captures an image of the application form D1 to be filled out through a user operation. The user terminal 20 displays the captured image of the application form D1. The user terminal 20 superimposes and displays the guide information on the captured image of the application form D1 based on the received control signal.

[0015] The user looks at the guide information displayed on the user terminal 20 and fills out the application form D1. The displayed guide information varies according to the type of the application form and the personal information of the user who fills it out. Thereby, even when the filling content required for each user changes, the user can smoothly fill out the application form without being confused about the filling content.

[0016] [First Embodiment] Next, the configuration of the information processing system 1 in this embodiment will be described with reference to FIG. 2. FIG. 2 is a diagram showing an overall configuration example of the information processing system 1 in this embodiment. The information processing system 1 includes an information processing apparatus 10 and a user terminal 20. The information processing apparatus 10 and the user terminal 20 are connected to a LAN (Local Area Network), the Internet, etc., and can communicate with each other. The number of user terminals 20 connected to the information processing apparatus 10 is at least one or more. The information processing system 1 is communicably connected to an external Resident Basic Register Network System NW (hereinafter, also referred to as the "Resident Register Network NW") via a telecommunication line.

[0017] The information processing apparatus 10 is an information processing apparatus that generates, for example, a guide for smoothly prompting a resident (hereinafter, also referred to as a user or an applicant) who makes a procedure application in an office or a government agency to fill in an application form. The application form is an application form, a notification form, etc. used in administrative procedures (resident record business, seal registration business, tax business, national health insurance business, national pension business, long-term care insurance business, health and welfare business,). Examples include a resident change notification, a marriage notification, a divorce notification, etc. The application form may be used in administrative procedures other than the above (related to the use of various public facilities, civil engineering and road maintenance occupancy business, water and sewerage business, livelihood protection business, late-stage elderly medical system business, tax collection business, etc.). Other examples of the application form include documents required for procedures for obtaining compensation or subsidy, procedures for obtaining a household register transcript or identity verification, issuance, re-issuance, renewal procedures, etc. of a My Number card, a passport, a driver's license, a national health insurance card, etc. The guide is, for example, the content to be filled in for each item of the application form, guidance on whether filling is required, and something that suggests specific filling content according to each individual resident, but is not limited thereto.

[0018] The user terminal 20 is a terminal that can be operated by a user who applies for a procedure, and is an information processing terminal that displays a guide to encourage the user to fill out an application form. The user terminal 20 is, for example, a smartphone, a tablet, an AR (Augmented Reality) goggle-type, contact lens-type, hat-type, sunglasses-type, eyeglasses-type or other wearable device, a projector, etc. The user terminal 20 may be any type that can be operated by a user, and the mode is not limited.

[0019] Next, the configurations of the information processing device 10 and the user terminal 20 will be described with reference to Fig. 2 and Fig. 1. The information processing device 10 is composed of a personal information acquisition unit 110, a guide determination unit 120, a storage unit 130, a guide control unit 140, and a communication unit 150. The user terminal 20 is composed of a reading unit 210, an imaging unit 220, a recognition unit 230, and a display unit 240.

[0020] The reading unit 210 reads personal information such as an identification number from a user's identification document. The identification document may be, for example, a My Number card, a driver's license, a health insurance card, or a passport. The personal information read by the reading unit 210 is not limited to the identification number, and may include name, gender, age, and the like. Means by which the reading unit 210 obtains personal information from an identification document include reading an integrated circuit (IC) chip built into the identification document, and reading letters and numbers printed on the face of the identification document using an optical character reader (OCR) or the like. Means for obtaining personal information from an identification document are not limited to those mentioned above.

[0021] The personal information acquisition unit 110 acquires the personal information read by the reading unit 210. The personal information acquisition unit 110 may acquire information from the Resident Register Network NW via the communication unit 150 based on the acquired personal information, and may supplement the personal information.

[0022] The imaging unit 220 captures an image of the application form that the user fills in. For example, it is assumed that the imaging unit 220 continuously captures an image of the imaging range in accordance with a predetermined frame rate.

[0023] The recognition unit 230 recognizes the type of the application form imaged by the imaging unit 220 and the spatial coordinates of the space where the application form is located. The spatial coordinates indicate the three-dimensional coordinates where the application form is actually placed and may include elements such as the orientation, size, and distance of the application form with respect to the imaging unit 220. Examples of the means by which the recognition unit 230 recognizes the type of the application form and the spatial coordinates include, but are not limited to, methods using the appearance of the application form itself and markers MK described later.

[0024] Using FIG. 3, an example of the format of the application form filled in by the user will be described. FIG. 3 illustrates a resident relocation form as an example of the application form. The application form D1 includes examples P1 to P5 of the filling items filled in by the user. The positions, numbers, and types of the filling items vary depending on the type of the application form D1. Further, markers MK that can be used by the recognition unit 230 to recognize the type and spatial coordinates of the application form may be described.

[0025] Next, the structure of the database stored in the storage unit 130 will be described with reference to FIG. 4. FIG. 4 is an example of the data structure of the database stored in the storage unit 130. The storage unit 130 stores a database that associates search conditions with each content constituting the guide. FIG. 4 is an example in which a plurality of databases exist for each type of application form. The database is composed of combinations of each content constituting the guide information, the items of the application form associated with the content, and the search conditions. The content is information including a guidance text, a layout, a display state, etc. for the associated items. The search conditions are determined based on personal information. The filling items P1 to PN indicate each filling item included in the application form D1.

[0026] The guide determination unit 120 searches for suitable content for each entry item of the application form from the database stored in the storage unit 130 using the application form type recognized by the recognition unit 230 and the personal information acquired by the personal information acquisition unit 110. Further, the guide determination unit 120 determines the guide information to be displayed on the display unit 240 for the group of the searched content.

[0027] The guide control unit 140 transmits a control signal for causing the display unit 240 to display the guide information selected by the guide determination unit 120.

[0028] The display unit 240 sequentially displays the images continuously shot by the imaging unit 220 within the imaging range. The image displayed by the display unit 240 may include the application form which is the entry target of the user. The display unit 240 receives the control signal transmitted by the guide control unit 140, and superimposes and displays the content selected by the guide determination unit 120 on the application form. In one example, the display unit 240 displays an image or video shot by the imaging unit 220 by a user operation. Further, the display unit 240 acquires the spatial coordinates where the application form D1 acquired by the recognition unit 230 is located, and can adjust the position where the guide information is displayed based on the spatial coordinates. Thereby, even when the user places the application form at a free position in the real space and starts filling it out, it is possible to display the guide information at an appropriate position within the display screen (display unit 240), and the convenience can be improved.

[0029] The state of the guide information displayed by the display unit 240 will be described with reference to FIGS. 5 and 6. FIGS. 5 and 6 are an example showing the state of the guide information displayed on the image showing the application form D1. The contents E1 to E5 in FIGS. 5 and 6 indicate each content constituting the guide information. Each content is displayed in a state retrieved based on the personal information of the user.

[0030] An example of the state of the content will be described. For example, content E1 shows content prompting the entry of a name, such as "Please fill in your name and then affix your signature. In your case, enter the name 'XXXX'". A user who views content E1 can confirm that their name should be written in the old Chinese characters in the household register, etc., and can prevent miswriting by using regular Chinese characters. Also, when referring to content E2, content prompting the entry of the new address after relocation, such as "Please enter your new address", is displayed. A user who views content E2 can confirm that they should write the new address after the move instead of the old address before the move, and can prevent incorrect entry regarding the address. Another example of the state of other content will be described. For example, when the acquired personal information includes information indicating an individual's income (personal income information), a guide prompting the user to enter their specific income information (amount information) is displayed in the item for entering income information on the application form. Or, for an item where the matters to be entered change according to the user's income requirements, a guide prompting the user to vary the necessity of entry and the items to be entered according to the personal income information may be displayed. In other words, the display content of the guide changes according to the user's personal income information. Another example of the state of other content will be described. Assume an example where the acquired personal information includes information indicating whether there is a person who subscribes to the national health insurance among the user and the user's family members. When the user conducts a transfer procedure, if there is a person who subscribes to the national health insurance among the people transferring with the user, a guide indicating that an application regarding the national health insurance (for example, address change registration related to the national health insurance) is necessary may be displayed. In other words, the display content of the guide and the presence or absence of the display change according to whether the user and the person associated with the user subscribe to a predetermined insurance. Note that the guide is not limited to the state of being superimposed and displayed on the application form, and is not limited as long as it can be notified to the user, such as being displayed on the display unit 240.

[0031] Next, an example in which the guide information displayed according to personal information changes will be described with reference to FIGS. 5 and 6. FIGS. 5 and 6 show the guide information displayed for different users. In FIGS. 5 and 6, different contents E4 or E5 are displayed for the entry item P5. Based on the family composition of the acquired personal information, when there is a family living with the user, the content E4 in FIG. 5 displays a guidance such as "Please enter all the people who have moved from the old address to the new address. 'Mr. ○○△△' and 'Mr. ○○××' are candidates", and information prompting the user to enter is described. On the other hand, based on the family composition of the personal information, when there is no family living together, the content E5 in FIG. 6 displays a guidance such as "No entry is required", informing the user that no entry is required. That is, the examples in FIGS. 5 and 6 show that the guide information is changed based on the family composition, which is an example of personal information. In addition, by referring to the family composition specified from the personal information, the number of frames prompting entry in the guide may be changed according to the number of family members living together. Specifically, when the number of family members living together is 5 and 3, the number of frames prompting entry in the guide may be made different in the entry frames listing the people moving with the user. Also, in other examples, according to personal information such as gender, age, and date of birth, the gender, age, and date of birth to be entered may be explicitly shown in the guide.

[0032] Thereby, it is possible to notify the necessity of entry for each item according to the user, and thus it is possible to prevent the user from making an entry error. As described above, by changing the guide information displayed to the user according to the personal information, it becomes possible to guide the entry more in accordance with the actual situation of the user.

[0033] Next, the processing flow of the information processing system 1 in the present embodiment will be described with reference to FIGS. 7 and 8. FIG. 7 is a sequence diagram explaining the processing flow performed between the information processing device 10 and the user terminal 20.

[0034] First, the reading unit 210 of the user terminal 20 reads personal information such as an identification number from the user's identification document (S201). Next, the reading unit 210 transmits the read personal information to the information processing device 10 (S202).

[0035] Next, the personal information acquisition unit 110 of the information processing device 10 acquires the personal information read by the reading unit 210 (S101). Note that in S101, the personal information acquisition unit 110 may acquire information from the Resident Register Network NW via the communication unit 150 based on the acquired personal information, and complement the personal information.

[0036] In parallel with step S101, the imaging unit 220 of the user terminal 20 captures an image of the application form to be filled out by the user (S203). For example, the imaging unit 220 continuously captures images of objects captured within the imaging range according to a predetermined frame rate.

[0037] The recognition unit 230 of the user terminal 20 recognizes the type of the application form captured by the imaging unit 220 and the spatial coordinates where the application form is located (S204). The recognition unit 230 transmits the recognized application form type to the information processing device 10 (S205).

[0038] The guide determination unit 120 of the information processing device 10 searches for suitable content for each entry item of the application form from the database stored in the storage unit 130 using the application form type recognized by the recognition unit 230 and the personal information acquired by the personal information acquisition unit 110 (S102). The guide determination unit 120 also determines the group of searched contents as guide information to be displayed on the display unit 240 (S103).

[0039] The guide control unit 140 transmits a control signal for causing the display unit 240 to display the content selected by the guide determination unit 120 (S104).

[0040] The display unit 240 receives the control signal transmitted by the guide control unit 140, and displays the content selected by the guide determination unit 120 superimposed on the application form shown on the display unit (S205).

[0041] FIG. 8 is a flowchart showing the processing flow of the information processing system 1. After step S205, the imaging unit 220 of the user terminal 20 captures the application form again (S206). Next, the recognition unit 230 of the user terminal 20 recognizes, among the items in the application form captured by the imaging unit 220, the items that are blank among the items for which the user is required to fill in (S207), and determines whether there are blanks. If it is determined in step 207 that there are blanks (S208, YES), the guide determination unit 120 refers to the database stored in the storage unit 130, and selects the corresponding content for each item according to the blank items recognized by the recognition unit 230 (S209). For example, if the recognition unit 230 recognizes that only the entry item P3 and the entry item P4 among the items for which the user is required to fill in in FIG. 3 are blank, only the content related to the entry item P3 and the entry item P4 may be selected. After step S208, the process returns to step S206 again. If it is determined in step 207 that there are no blanks (S208, NO), the display unit 240 ends the display of the guide (S210).

[0042] Thereby, the user looks at the guide information displayed on the display unit 240 of the user terminal 20 and fills in the application form D1. Since the displayed guide varies according to the type of the application form and the personal information of the user who fills it in, even when the content to be filled in varies for each user, the user can fill in the application form smoothly.

[0043] In addition, by displaying an entry guide to the user, even for documents that the applicant is legally required to fill in directly, it is possible to facilitate the applicant's judgment in filling in and improve the efficiency of the application procedure.

[0044] Also, according to one aspect of the present invention, by changing the guide according to the type of the application form filled in by the user and the blank status, even for users who are not familiar with the procedure application, it is possible to flexibly guide the entry according to the situation of each user. Thereby, the user can shorten the time required for filling in the application form by himself / herself, and the burden on the window staff to assist in filling in the application form can be reduced. Thereby, the efficiency of the entire process related to the procedure application can be improved.

[0045] Also, according to one aspect of the present invention, by referring to personal information associated with identification information and the like, it becomes possible to grasp in detail the attributes and situations of each user, so that it becomes possible to guide flexible entry according to the user.

[0046] [Second Embodiment] Next, the configuration of the user terminal 20 in the second embodiment will be described with reference to FIG. 9. The user terminal 20 in this embodiment is different from the first embodiment in that it is a wearable body that can be worn by the user. The description of the points common to the first embodiment will be omitted. FIG. 9 shows an example of the overall configuration of the user terminal 20 in this embodiment.

[0047] The user terminal 20 of this embodiment is a terminal that can be operated by a user who makes a procedure application, and is an information processing terminal that displays a guide for prompting the user to fill in an application form. FIG. 9 illustrates an AR (Augmented Reality) goggle-type device as an example of the user terminal 20, but other wearable devices such as contact lens type, hat type, sunglass type, and glasses type may also be used.

[0048] The user terminal 20 has a reading unit 210, an imaging unit 220, a recognition unit 230, and a display unit 240, similar to the first embodiment, and is communicable with the information processing device 10. The imaging direction of the imaging unit 220 is adjusted to an orientation approximate to the line-of-sight direction when the user wears the user terminal 20. In other words, the imaging unit 220 captures a subject that appears in the user's line-of-sight direction.

[0049] The display unit 240 is provided to cover the eyes of the user wearing the user terminal 20. The display unit 240 continuously displays the images captured by the imaging unit 220. In this case, the display unit 240 displays the surrounding background and the application form captured by the imaging unit 220 as images, and superimposes a guide on the image showing the application form. As a result, to the user wearing the user terminal 20, it appears that the guide is superimposed on the application form. In other examples, the display unit 240 may be able to transmit light so as not to completely block the user's line of sight. Thereby, the user can proceed with filling out the application form without discomfort with respect to the application form seen through the display unit 240. According to the present embodiment, the user can easily view the guide and the usability is improved.

[0050] [Modification Example] Next, a modification example applicable to the above embodiment will be described. The configuration of the user terminal 20 in the modification example will be described with reference to FIG. 10. The user terminal 20 in the present embodiment is different from the first and second embodiments above in that it projects and displays a guide on the application form. The points common to the first and second embodiments will be omitted from the description. FIG. 10 shows an example of the functions of the user terminal 20 in the present embodiment.

[0051] In an example of FIG. 10, the user terminal 20 is a projector. By irradiating a light beam onto the application form, the user terminal 20 superimposes and displays the content E6 on the application form by projection mapping technology. Thereby, the user can fill out the application form while referring to the content E6. Note that the application form may be displayed by a device (not shown) and may be able to receive the user's filling out. According to this modification example, since it is not necessary for the user to perform operations such as photographing the application form using the user terminal, the convenience of the user can be improved.

[0052] Another modification applicable to the above-described embodiment will be described. The method for acquiring the identification information acquired by the reading unit 210 is not limited. For example, it may be acquired by holding the My Number card over a device capable of communicating with the AR goggles. Alternatively, the My Number may be acquired by reading the identification number described on the face of the My Number card with the camera provided in the AR goggles.

[0053] In addition, the application form described in this specification may be not only in paper medium but also displayed on the screen of a display device.

[0054] Further, the communication unit 150 may transmit the image captured by the imaging unit 220 to a terminal (not shown) operated by a staff member. As a result, since the user can share his / her entry status with the staff member, the staff member can point out any deficiencies in the description of the application form even when not present on the spot, and the user can be assisted more flexibly.

[0055] A modification example of changing the guide according to the personal information acquired by the information processing system 1 will be described. Even when the guide determination unit 120 cannot narrow down the content to be displayed based on the acquired personal information, it may determine whether the user may meet a predetermined condition based on the acquired personal information and select the content corresponding to the predetermined condition. The predetermined conditions are, for example, "existence of public assistance", "existence of care certification", "existence of pension payment", "whether it is an income situation for which subsidy should be received", etc. In this modification example, an example in which the guide determination unit 120 selects the content to be displayed based on personal information will be described. For example, assume that the conditions necessary to clearly determine "whether it is a target for subsidy payment" are "income information" and "employment form information (for example, self-employed, regular employment, non-regular employment)". Here, when the information processing system 1 acquires "income information" without acquiring "employment form" and the "income information" indicates an income less than a predetermined amount, the guide determination unit 120 determines that it is highly likely that it is "a target for subsidy payment" regardless of the "employment form information". Then, the guide determination unit 120 selects the content indicating to the user that "there is a possibility of being a target for subsidy payment". That is, even when there is a lack of the acquired personal information and it cannot be determined that the personal information satisfies all the conditions corresponding to the content, if the personal information satisfies some of the conditions corresponding to the content, the guide determination unit 120 may select the content. In this way, when the user may meet a predetermined condition, the guide determination unit 120 selects the content corresponding to the predetermined condition. According to this, even when the personal information used for content search is not sufficiently determined, flexible guidance can be performed.

[0056] Another modification example will be described. Part or all of the functions provided by the information processing device 10 may be designed to be provided by the user terminal 20. Part or all of the functions provided by the user terminal 20 may be designed to be provided by the information processing device 10. The storage unit 130 may be designed to be provided by an external device (not shown).

[0057] Another modification example will be described. Instead of the captured image, the user terminal 20 may display a template image indicating the format of the application form D1. Thereby, the effect of reducing the processing load can be obtained.

[0058] [Minimum Configuration] The minimum configuration of the information processing system according to the present invention will be described with reference to FIG. 11. FIG. 11 is a diagram showing an overall configuration example of the information processing system 3 in the present embodiment. The information processing system 3 includes a personal information acquisition unit 301, a guidance determination unit 302, and a guidance control unit 303.

[0059] The personal information acquisition unit 301 acquires the personal information of the user. The guidance determination unit 302 determines the content or type of guidance for prompting the user to fill in the application form recognized by the terminal based on the personal information acquired by the personal information acquisition unit 301. The guidance control unit 303 controls to superimpose and display the guidance on the image showing the application form.

[0060] Next, the processing flow related to the minimum configuration of the information processing system will be described with reference to FIG. 12. The personal information acquisition unit 301 acquires the personal information of the user (S301). The guidance determination unit 302 determines the content or type of guidance for prompting the user to fill in the application form recognized by the terminal based on the personal information acquired by the personal information acquisition unit 301 (S302). The guidance control unit 303 controls to superimpose and display the guidance on the image showing the application form (S303).

[0061] Thereby, it is possible to assist the user in filling in the application form. In addition, even for documents that the applicant needs to fill in directly due to legal constraints, it is possible to facilitate the applicant's judgment in filling in and streamline the application procedure. Also, by changing the guidance according to the type of application form filled in by the user and the blank status, even for users who are not familiar with the procedure application, it is possible to flexibly guide the filling in according to the situation of each user. Thereby, the user himself / herself can shorten the time required to fill in the application form, and the burden on the window staff to assist in filling in the application form can be reduced. Thereby, the efficiency of the entire process related to the procedure application can be improved.

[0062] [Hardware Configuration Example] Next, an example of a hardware configuration for implementing the information processing apparatus (10), user terminal (20), and information processing system (1, 3) in each of the above-described embodiments using one or more computers will be described. Each functional unit included in the information processing apparatus (10), user terminal (20), and information processing system (1, 3) is realized by an arbitrary combination of hardware and software centered around at least one CPU (Central Processing Unit) of an arbitrary computer, at least one memory, a program loaded into the memory, a storage unit such as at least one hard disk for storing the program, a network connection interface, and the like. It is understood by those skilled in the art that there are various modifications to this realization method and apparatus. Note that the storage unit can store programs stored before the shipment of the apparatus, as well as programs downloaded from storage media such as optical disks, magneto-optical disks, semiconductor flash memories, and servers on the Internet.

[0063] FIG. 13 is a block diagram illustrating the hardware configuration of the information processing apparatus (10), user terminal (20), and information processing system (1, 3). As shown in FIG. 13, the information processing apparatus (10), user terminal (20), and information processing system (1, 3) include a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, a communication interface 5A, and a bus 6A. The peripheral circuit 4A includes various modules. The information processing apparatus (10), user terminal (20), and information processing system (1, 3) may not have the peripheral circuit 4A. Note that the information processing apparatus (10), user terminal (20), and information processing system (1, 3) may be configured by a plurality of physically and / or logically separated apparatuses. In this case, each of the plurality of apparatuses can have the above-described hardware configuration.

[0064] Bus 6A is a data transmission path for the processor 1A, memory 2A, input / output interface 3A, peripheral circuit 4A, and communication interface 5A to transmit and receive data with each other. The processor 1A is an arithmetic processing device such as a CPU, GPU (Graphics Processing Unit), or microprocessor. The processor 1A can execute processing according to various programs stored in the memory 2A, for example.

[0065] The memory 2A is a memory such as RAM (Random Access Memory) or ROM (Read Only Memory), and stores programs and various data.

[0066] The input / output interface 3A includes an interface for acquiring information from an input device, external device, external storage unit, external sensor, camera, etc., and an interface for outputting information to an output device, external device, external storage unit, etc. The input device is, for example, a touch panel, keyboard, mouse, microphone, camera, etc. The output device is, for example, a display, speaker, printer, lamp, etc.

[0067] The processor 1A can issue commands to each module and perform operations based on their operation results.

[0068] The communication interface 5A enables the information processing device (10), user terminal (20), and information processing system (1, 3) to communicate with an external device, and also enables the information processing device (10), user terminal (20), and information processing system (1, 3) to communicate with each other. Note that some functions of the information processing device (10), user terminal (20), and information processing system (1, 3) may be configured by a computer.

[0069] [Supplementary Notes] Note that the configurations of the above-described embodiments may be combined or some of the constituent parts may be replaced. Further, the configuration of the present invention is not limited to the above-described embodiments only, and various modifications may be made without departing from the gist of the present invention. For example, the configurations and processes disclosed in each embodiment and modification example may be combined with each other. Some or all of the above embodiments may be described as follows in the appended claims, but are not limited thereto.

[0070] [Appended Note 1] An acquisition means for acquiring personal information of a user; A determination means for determining the content of a guide for prompting the user to fill in an application form based on the personal information; A guide control means for controlling to superimpose and display the guide on an image showing the application form or on the application form; An information processing system comprising the above.

[0071] [Appended Note 2] The guide control means controls to superimpose and display the guide on an image showing the application form. The information processing system according to Appended Note 1.

[0072] [Appended Note 3] The guide control means changes the guide according to the type of the application form or the blank items. The information processing system according to Appended Note 1 or 2.

[0073] [Appended Note 4] Comprising an input means for receiving an input of the user's My Number information, The acquisition means acquires personal information associated with the My Number information. The information processing system according to any one of Appended Notes 1 to 3.

[0074] [Appended Note 5] Comprising a recognition means for recognizing the application form based on a marker drawn on the application form reflected in a captured image captured by a terminal or the appearance of the application form. The information processing system according to any one of Supplementary Notes 1 to 4.

[0075] [Supplementary Note 6] The captured image is captured by a camera provided in the terminal operated by the user. The guidance control means controls to display guidance on a display unit provided in the terminal. The information processing system according to any one of Supplementary Notes 1 to 5.

[0076] [Supplementary Note 7] The information processing system according to Supplementary Note 6, wherein the terminal is a wearable body worn by the user.

[0077] [Supplementary Note 8] Obtain the personal information of the user. Based on the personal information, determine the content of the guidance prompting the user to fill in the application form. A step of controlling to superimpose and display the guidance on an image showing the application form or on the application form. An information processing method comprising the above.

[0078] [Supplementary Note 9] Cause a computer to Execute a process of obtaining the personal information of the user. Execute a process of determining the content of the guidance prompting the user to fill in the application form based on the personal information. Execute a process of controlling to superimpose and display the guidance on an image showing the application form or on the application form. A program storage medium storing a program for causing the above to be executed.

Explanation of Reference Signs

[0079] 1 Information processing system 10 Information processing device 110 Personal information acquisition unit 120 Guidance determination unit 130 Storage unit 140 Guidance control unit 150 Communication unit 20 User terminal 210 Reading Unit 220 Imaging Unit 230 Recognition Unit 240 Display Unit 3 Information Processing System 301 Personal Information Acquisition Unit 302 Guide Determination Unit 303 Guide Control Unit NW Resident Registry Network MK Marker P1, P2, P3, P4, P5 Entries D1 Application Form E1, E2, E3, E4, E5, E6 Contents 1A Processor 2A Memory 3A Input / Output Interface 4A Peripheral Circuit 5A Communication Interface 6A Bus

Claims

1. An acquisition means for acquiring personal information of a user; a control means for determining auxiliary information for assisting in filling out the application form based on the personal information, and for controlling the display of the auxiliary information and at least one of an image showing the application form or information relating to the application form; Equipped with An information processing system, wherein the control means determines the auxiliary information to be displayed based on a family structure included in the personal information.

2. the control means changes the number of fields to be filled in as the auxiliary information on the application form based on the family structure. The information processing system according to claim 1 .

3. The control means controls to display auxiliary information that guides a necessary application based on the personal information.

3. The information processing system according to claim 1 or 2.

4. the control means controls to display auxiliary information regarding the necessity of filling out each item in the application form based on the personal information; The information processing system according to claim 1 .

5. the control means determines the auxiliary information based on the type of application form and the personal information from a database prepared for each type of application form by associating search conditions determined based on the personal information with the auxiliary information; The information processing system according to claim 1 .

6. The control means determines whether or not a predetermined condition is met based on the personal information, and controls the auxiliary information to be displayed in accordance with the predetermined condition. The information processing system according to claim 3 .

7. An acquisition means for acquiring personal information of a user; a control means for determining auxiliary information for assisting in filling out the application form based on the personal information, and for controlling the display of the auxiliary information and at least one of an image showing the application form or information relating to the application form; Equipped with The control means controls the information processing system so as to display auxiliary information that guides users to make necessary applications based on the personal information.

8. the control means controls to display auxiliary information regarding the necessity of filling out each item in the application form based on the personal information; The information processing system according to claim 7.

9. the control means determines the auxiliary information based on the type of application form and the personal information from a database prepared for each type of application form by associating search conditions determined based on the personal information with the auxiliary information; 9. The information processing system according to claim 7 or 8.

10. An acquisition means for acquiring personal information of a user; a control means for determining auxiliary information for assisting in filling out the application form based on the personal information, and for controlling the display of the auxiliary information and at least one of an image showing the application form or information relating to the application form; Equipped with The control means controls the information processing system to display auxiliary information regarding the need to fill in each item in the application form based on the personal information.

11. the control means determines the auxiliary information based on the type of application form and the personal information from a database prepared for each type of application form by associating search conditions determined based on the personal information with the auxiliary information; The information processing system according to claim 10.

12. An acquisition means for acquiring personal information of a user; a control means for determining auxiliary information for assisting in filling out the application form based on the personal information, and for controlling the display of the auxiliary information and at least one of an image showing the application form or information relating to the application form; Equipped with The control means of the information processing system determines the auxiliary information based on the type of application form and the personal information from a database prepared for each type of application form by associating search conditions determined based on the personal information with the auxiliary information.

13. The computer Obtaining personal information of users, determining auxiliary information to assist in filling out the application form based on the personal information, and controlling so as to display the auxiliary information and at least one of an image showing the application form or information relating to the application form; In the control, the auxiliary information to be displayed is determined based on a family structure included in the personal information.

14. The computer Obtaining personal information of users, determining auxiliary information to assist in filling out the application form based on the personal information, and controlling so as to display the auxiliary information and at least one of an image showing the application form or information relating to the application form; The information processing method further comprises controlling the display of auxiliary information that guides the user to make a necessary application based on the personal information.

15. On the computer, The process of obtaining personal information of users; determining auxiliary information to assist in filling out the application form based on the personal information, and controlling the display of the auxiliary information together with at least one of an image showing the application form or information relating to the application form; Run the command, The program, in the control process, determines the auxiliary information to be displayed based on a family structure included in the personal information.

16. On the computer, The process of obtaining personal information of users; determining auxiliary information to assist in filling out the application form based on the personal information, and controlling the display of the auxiliary information together with at least one of an image showing the application form or information relating to the application form; Run the command, The program controls the control process so that auxiliary information guiding users to make necessary applications is displayed based on the personal information.

Images