Information processing system, information processing method, and program

Abstract

To provide an information processing system, an information processing method, and a program storage medium capable of assisting an applicant for filling out an application form.SOLUTION: In an information processing system, an information processing apparatus comprises: a personal information acquisition unit for acquiring personal information of a user read by a read unit of a user terminal to enable assistance in filling out an application, for an applicant who fills out an application form necessary for applying for a procedure, and acquiring information from a resident basic registry network through a communication unit based on the acquired personal information, to complement the personal information; and a guidance determination unit for determining, on the basis of the personal information, the content or type of guidance to prompt the user to fill out an application form recognized by a terminal; and a guidance control unit for controlling the guidance to be superimposed on an image of the application form or on the application form.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program storage medium. [Background technology]

[0002] When residents apply for a procedure, they need to fill in information in fields on a document. Patent Document 1 discloses a technology that displays reference information corresponding to a field from an image of the field, in order to reduce mistakes when users fill out documents. Patent Document 2 discloses a technology that displays a page that provides information on where to submit documents according to the documents to be submitted. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-011586 [Patent Document 2] Japanese Patent Application Publication No. 2018-147321 Summary of the Invention [Problem to be solved by the invention]

[0004] When applying for a procedure, even when filling out the same application form, the items and information to be filled out may differ depending on the individual applicant. As a result, it is difficult for applicants who are unfamiliar with the procedure to determine what specific information they should fill out on the application form. In this regard, the technologies described in Patent Documents 1 and 2 do not take into consideration providing flexible assistance for filling out the form according to the applicant.

[0005] In view of the above-mentioned problems, an object of the present invention is to provide an information processing system, an information processing method, and a program storage medium that can assist an applicant in filling out an application form. [Means for solving the problem]

[0006] According to one aspect of the present invention, An acquisition means for acquiring personal information of a user; a determining means for determining the content of a guide to prompt the user to fill out an application form based on the personal information; a guide control means for controlling the guide to be superimposed on the image showing the application form or on the application form; An information processing system is provided.

[0007] According to one aspect of the present invention, Obtaining personal information of users, determining the content of a guide to prompt the user to fill out an application form based on the personal information; controlling the guide to be superimposed on the image showing the application form or on the application form; A method for processing information is provided.

[0008] According to one aspect of the present invention, On the computer, The process of obtaining personal information of users; A process of determining the content of a guide to encourage the user to fill out an application form based on the personal information; a process of controlling the guide to be superimposed on an image showing the application form or on the application form; A program storage medium is provided that stores a program for executing the above. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an information processing system, an information processing method, and a program storage medium that can assist an applicant in filling out an application form. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of use of an information processing system according to an embodiment of the present invention. [Figure 2] 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present invention. [Figure 3] 10 is an example of an application form used in the present embodiment. [Figure 4] 3 is an example showing a database structure in the present embodiment. [Figure 5] 10A and 10B are diagrams illustrating an example of a guide output in the present embodiment. [Figure 6] 10A and 10B are diagrams illustrating an example of a guide output in the present embodiment. [Figure 7] FIG. 2 is a sequence diagram showing a processing flow of the present embodiment. [Figure 8] 1 is a flowchart showing a processing flow of the present embodiment. [Figure 9] 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present invention. [Figure 10] 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present invention. [Figure 11] 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present invention. [Figure 12] 1 is a flowchart showing a processing flow of the present embodiment. [Figure 13] 2 is an example of a hardware configuration of an information processing system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, similar or corresponding elements are designated by the same reference numerals, and descriptions thereof may be omitted or simplified.

[0012] [Feature Overview] First, an overview of the functions realized by the present invention will be described using Fig. 1. Fig. 1 is a diagram illustrating an example of a situation in which a user using a user terminal 20 to fill out an application form. When the user presents an identification document to the user terminal 20, the user terminal 20 reads personal information from the identification document. The user terminal 20 also captures an image of the application form D1 to be filled out by the user through user operation, and obtains the application form type of the application form D1. The user terminal 20 transmits the read personal information and application form type to the information processing device 10.

[0013] The information processing device 10 selects guide information to be displayed on the user terminal 20 based on the personal information and application form type received from the user terminal 20. The guide information is information that prompts the user to fill out the application form, and changes depending on the application form type and the user's personal information. The information processing device 10 transmits a control signal to display the selected guide information on the user terminal 20.

[0014] Returning to the explanation of the user terminal 20, the user terminal 20 receives a control signal transmitted from the information processing device 10. The user terminal 20 captures an image of the application form D1 to be filled out by user operation. The user terminal 20 displays the captured image of the application form D1. Based on the received control signal, the user terminal 20 superimposes guide information on the captured image of the application form D1.

[0015] The user fills out the application form D1 while looking at the guide information displayed on the user terminal 20. The guide information displayed differs depending on the type of application form and the personal information of the user filling it out. This allows the user to smoothly fill out the application form without having to worry about what to fill in, even if the content required to be filled out varies from user to user.

[0016] [First embodiment] Next, the configuration of the information processing system 1 in this embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the overall configuration of the information processing system 1 in this embodiment. The information processing system 1 includes an information processing device 10 and a user terminal 20. The information processing device 10 and the user terminal 20 are connected to a LAN (Local Area Network), the Internet, etc., and are capable of communicating with each other. The number of user terminals 20 connected to the information processing device 10 is at least one. The information processing system 1 is connected to an external resident registration network system NW (hereinafter also referred to as "Jumin Ki Net NW") so as to be able to communicate with each other via a telecommunications line.

[0017] The information processing device 10 is an information processing device that generates a guide to smoothly encourage residents (hereinafter also referred to as users or applicants) who are filing application procedures at a government office or other government agency to fill out application forms. Application forms are applications and notifications used in administrative procedures (resident registration procedures, seal registration procedures, tax procedures, national health insurance procedures, national pension procedures, long-term care insurance procedures, health and welfare procedures, etc.), such as resident change notifications, marriage notifications, and divorce notifications. Application forms may also be used in other administrative procedures (related to the use of various public facilities, civil engineering and road maintenance and occupation procedures, water supply and sewerage operations, public assistance procedures, medical care for the elderly, tax collection procedures, etc.). Other examples of application forms include documents required for obtaining compensation or subsidies, obtaining certified copies of family registers or identification documents, and issuing, reissuing, or renewing My Number cards, passports, driver's licenses, national health insurance cards, etc. The guide may be, for example, information on what to fill in for each item on the application form, guidance on whether or not it is necessary to fill in the form, or suggestions on specific information to fill in depending on each individual resident, but is not limited to this.

[0018] The user terminal 20 is a terminal that can be operated by a user who applies for a procedure, and is an information processing terminal that displays a guide to encourage the user to fill out an application form. The user terminal 20 is, for example, a smartphone, a tablet, a wearable device such as AR (Augmented Reality) goggles, contact lenses, hats, sunglasses, or glasses, a projector, etc. The form of the user terminal 20 is not limited as long as it can be operated by the user.

[0019] Next, the configurations of the information processing device 10 and the user terminal 20 will be described with reference to Fig. 2 and Fig. 1. The information processing device 10 is composed of a personal information acquisition unit 110, a guide determination unit 120, a storage unit 130, a guide control unit 140, and a communication unit 150. The user terminal 20 is composed of a reading unit 210, an imaging unit 220, a recognition unit 230, and a display unit 240.

[0020] The reading unit 210 reads personal information such as an identification number from a user's identification document. Examples of identification documents include a My Number card, a driver's license, a health insurance card, and a passport. The personal information read by the reading unit 210 is not limited to the identification number, and may include name, gender, age, and the like. Means by which the reading unit 210 obtains personal information from an identification document include reading an IC (Integrated Circuit) chip built into the identification document, and reading letters and numbers printed on the face of the identification document using an OCR (Optical Character Reader) or the like. The means for obtaining personal information from an identification document are not limited to those described above.

[0021] The personal information acquisition unit 110 acquires the personal information read by the reading unit 210. The personal information acquisition unit 110 may acquire information from the Resident Registration Network NW via the communication unit 150 based on the acquired personal information, and supplement the personal information.

[0022] The imaging unit 220 captures an image of the application form that the user fills in. For example, it is assumed that the imaging unit 220 continuously captures an image of the imaging range in accordance with a predetermined frame rate.

[0023] The recognition unit 230 recognizes the type of application form captured by the imaging unit 220 and the spatial coordinates where the application form is located. Spatial coordinates indicate the three-dimensional coordinates where the application form is actually placed, and may include elements such as the orientation, size, and distance of the application form relative to the imaging unit 220. Methods by which the recognition unit 230 recognizes the type and spatial coordinates of the application form include, but are not limited to, the appearance of the application form itself and a method using a marker MK, which will be described later.

[0024] An example of the format of an application form to be filled out by a user will be described using FIG. 3. FIG. 3 illustrates a resident change notification as an example of an application form. Application form D1 includes P1 to P5, which are examples of entry items to be filled out by a user. The position, number, and type of entry items vary depending on the type of application form D1. In addition, a marker MK that can be used by the recognition unit 230 to recognize the type of application form and spatial coordinates may be written on the application form.

[0025] Next, the structure of the database stored in the storage unit 130 will be explained using Figure 4. Figure 4 is an example of the data structure of the database stored in the storage unit 130. The storage unit 130 stores a database that associates search conditions with each piece of content that makes up the guide. Figure 4 is an example in which there are multiple databases for each type of application form. The database is made up of combinations of each piece of content that makes up the guide information, application form items associated with the content, and search conditions. The content is information that includes guidance text, layout, display format, etc. for the associated items. The search conditions are determined based on personal information. Entry items P1 to PN indicate the entry items included in the application form D1.

[0026] The guide determination unit 120 searches for suitable content for each entry item on the application form from the database stored in the storage unit 130, using the application form type recognized by the recognition unit 230 and the personal information acquired by the personal information acquisition unit 110. The guide determination unit 120 also determines the group of searched contents as guide information to be displayed on the display unit 240.

[0027] The guide control unit 140 transmits a control signal for causing the display unit 240 to display the guide information selected by the guide determination unit 120 .

[0028] The display unit 240 sequentially displays images continuously captured within the imaging range by the imaging unit 220. The images displayed by the display unit 240 may include an application form to be filled out by the user. The display unit 240 receives a control signal transmitted by the guide control unit 140 and superimposes content selected by the guide determination unit 120 onto the application form. In one example, the display unit 240 displays an image or video captured by the imaging unit 220 in response to a user operation. The display unit 240 can also acquire spatial coordinates of the position of the application form D1 acquired by the recognition unit 230 and adjust the position at which the guide information is displayed based on the spatial coordinates. This makes it possible to display the guide information at an appropriate position within the display screen (display unit 240), even if the user places the application form at a desired position in real space and starts filling it out.

[0029] The manner of guide information displayed by the display unit 240 will be described using Figures 5 and 6. Figures 5 and 6 show an example of the manner of guide information displayed on an image showing application form D1. Contents E1 to E5 in Figures 5 and 6 indicate the respective contents that make up the guide information. Each content is displayed in a manner that is searched based on the user's personal information.

[0030] An example of a content format will be described. For example, content E1 prompts the user to enter their name, stating, "Please enter your name and stamp it. In your case, enter the name 'XXXXX'." A user viewing content E1 can confirm that their name should be written using the old kanji characters, such as those used in their family register, thereby preventing typos of commonly used kanji characters. Furthermore, content E2 prompts the user to enter their new address after moving, stating, "Please enter your new address." A user viewing content E2 can confirm that they should enter their new address after moving, not their old address, thereby preventing incorrect address entry. Another example of a content format will be described. For example, if the acquired personal information includes information indicating an individual's income (personal income information), a guide prompting the user to enter their specific income information (amount information) in the income information entry field on the application form may be displayed. Alternatively, for fields where the information to be entered changes depending on the user's income requirements, a guide prompting the user to change whether or not to enter information or the fields to be entered depending on the personal income information may be displayed. In other words, the above example can be rephrased as the guide display content that changes depending on the user's personal income information. An example of another content mode will be described. Assume an example in which the acquired personal information includes information indicating whether or not the user and the user's family members are enrolled in national health insurance. When a user is completing procedures to move into a new home, if any of the people moving in with the user are enrolled in national health insurance, a guide may be displayed indicating that an application for national health insurance (e.g., a change of address registration for national health insurance) is required. In other words, the content of the guide and whether or not it is displayed varies depending on whether or not the user and people associated with the user are enrolled in a specific insurance plan. Note that the guide is not limited to being superimposed on the application form, but may be displayed on the display unit 240 or any other mode that can notify the user.

[0031] Next, an example of how the guide information displayed changes depending on personal information is described using FIGS. 5 and 6. FIGS. 5 and 6 each show guide information displayed for a different user. In FIGS. 5 and 6, different content items E4 and E5 are displayed for entry item P5. If the user has family members living with them based on the family structure of the acquired personal information, content E4 in FIG. 5 displays a message urging the user to enter information, such as, "Please enter the names of all people moving from the old address to the new address. 'XXX' and 'XXX' are candidates." On the other hand, if the user does not have family members living with them based on the family structure of the personal information, content E5 in FIG. 6 displays a message stating, "No entry required," informing the user that no entry is required. In other words, the examples in FIGS. 5 and 6 show how the guide information changes based on family structure, which is an example of personal information. Alternatively, the number of boxes prompting the user to enter information may be changed based on the number of family members living with them, referring to the family structure identified from the personal information. Specifically, the number of boxes that the guide prompts the user to fill in in the entry boxes that list people who will be moving with the user may be different depending on whether the number of family members living together is 5 or 3. In another example, the gender, age, and date of birth that should be filled in may be clearly indicated on the guide depending on personal information such as gender, age, and date of birth.

[0032] This allows the user to be notified of whether or not each item needs to be filled out, which helps prevent users from making mistakes when filling out their information. As described above, by changing the guide information displayed to the user depending on their personal information, it is possible to guide the user to fill out their information in a way that is more in line with their actual situation.

[0033] Next, the flow of processing in the information processing system 1 in this embodiment will be described with reference to Fig. 7 and Fig. 8. Fig. 7 is a sequence diagram illustrating the flow of processing performed between the information processing device 10 and the user terminal 20.

[0034] First, the reading unit 210 of the user terminal 20 reads personal information such as an identification number from the user's personal identification document (S201). Next, the reading unit 210 transmits the read personal information to the information processing device 10 (S202).

[0035] Next, the personal information acquisition unit 110 of the information processing device 10 acquires the personal information read by the reading unit 210 (S101). Note that in S101, the personal information acquisition unit 110 may acquire information from the Resident Registration Network NW via the communication unit 150 based on the acquired personal information, and complement the personal information.

[0036] In parallel with step S101, the imaging unit 220 of the user terminal 20 captures an image of the application form to be filled out by the user (S203). For example, the imaging unit 220 continuously captures images of objects captured within the imaging range at a predetermined frame rate.

[0037] The recognition unit 230 of the user terminal 20 recognizes the type of the application form captured by the imaging unit 220 and the spatial coordinates where the application form is located (S204). The recognition unit 230 transmits the recognized application form type to the information processing device 10 (S205).

[0038] The guide determination unit 120 of the information processing device 10 searches for suitable content for each entry item of the application form from the database stored in the storage unit 130 using the application form type recognized by the recognition unit 230 and the personal information acquired by the personal information acquisition unit 110 (S102). The guide determination unit 120 also determines the group of searched contents as guide information to be displayed on the display unit 240 (S103).

[0039] The guide control unit 140 transmits a control signal for causing the display unit 240 to display the content selected by the guide determination unit 120 (S104).

[0040] The display unit 240 receives the control signal sent by the guide control unit 140, and displays the content selected by the guide determination unit 120 superimposed on the application form displayed on the display unit (S205).

[0041] FIG. 8 is a flowchart showing the processing flow of the information processing system 1. After step S205, the imaging unit 220 of the user terminal 20 captures an image of the application form again (S206). Next, the recognition unit 230 of the user terminal 20 recognizes blank fields among the fields that the user is requested to fill in on the application form captured by the imaging unit 220 (S207) and determines whether or not any fields are blank. If it is determined in step 207 that there are blank fields (S208, YES), the guide determination unit 120 refers to the database stored in the storage unit 130 and selects corresponding content for each blank field recognized by the recognition unit 230 (S209). For example, if the recognition unit 230 recognizes that only entry fields P3 and P4 are blank among the fields that the user is requested to fill in in FIG. 3, it may select only content related to entry fields P3 and P4. After step S208, the process returns to step S206. If it is determined in step 207 that there is no blank space (S208, NO), the display unit 240 ends the display of the guide (S210).

[0042] As a result, the user fills out the application form D1 while looking at the guide information displayed on the display unit 240 of the user terminal 20. The guide displayed differs depending on the type of application form and the personal information of the user filling it out, so even if the content required to be filled out varies for each user, the user can fill out the application form smoothly.

[0043] In addition, by displaying a guide for filling out the form to the user, it becomes easier for the applicant to make decisions when filling out the form, even for documents that, due to legal restrictions, must be filled out directly by the applicant, thereby making the application process more efficient.

[0044] Furthermore, according to one aspect of the present invention, by changing the guide depending on the type of application form the user is filling out and the number of blank spaces, even users who are unfamiliar with application procedures can be flexibly guided to fill out the form according to their individual circumstances. This not only reduces the time required for the user to fill out the application form, but also reduces the burden on counter staff to assist with filling out the application form. This improves the efficiency of the entire process related to application procedures.

[0045] In addition, according to one aspect of the present invention, by referring to personal information associated with identification information, etc., it becomes possible to grasp each user's attributes and situation in detail, thereby enabling flexible guidance in filling out information according to the user.

[0046] [Second embodiment] Next, the configuration of the user terminal 20 in the second embodiment will be described with reference to Fig. 9. The user terminal 20 in this embodiment differs from the first embodiment in that it is a wearable device that can be worn by a user. Explanation of points in common with the first embodiment will be omitted. Fig. 9 shows an example of the overall configuration of the user terminal 20 in this embodiment.

[0047] The user terminal 20 of this embodiment is a terminal that can be operated by a user who applies for a procedure, and is an information processing terminal that displays a guide to encourage the user to fill out an application form. Fig. 9 illustrates an AR (Augmented Reality) goggle-type device as an example of the user terminal 20, but it may also be a wearable device such as a contact lens-type, hat-type, sunglasses-type, or eyeglass-type device.

[0048] The user terminal 20 has a reading unit 210, an imaging unit 220, a recognition unit 230, and a display unit 240, similar to the first embodiment, and is capable of communicating with the information processing device 10. The imaging direction of the imaging unit 220 is adjusted to a direction that approximates the line of sight when the user wears the user terminal 20. In other words, the imaging unit 220 captures an image of a subject that appears in the line of sight of the user.

[0049] The display unit 240 is provided so as to cover the eyes of the user wearing the user terminal 20. The display unit 240 continuously displays images captured by the imaging unit 220. In this case, the display unit 240 displays the surrounding background and the application form captured by the imaging unit 220 as images, and displays a guide superimposed on the image showing the application form. As a result, the guide appears to the user wearing the user terminal 20 as superimposed on the application form. In another example, the display unit 240 may be light-transmitting so as not to completely block the user's line of sight. This allows the user to fill out the application form viewed through the display unit 240 without feeling any discomfort. According to this embodiment, the user can easily view the guide, thereby improving usability.

[0050] [Variations] Next, a modified example that can be applied to the above-described embodiment will be described. The configuration of the user terminal 20 in the modified example will be described using FIG. 10. The user terminal 20 in this embodiment differs from the first and second embodiments in that a guide is projected and displayed on the application form. Explanation of points common to the first and second embodiments will be omitted. FIG. 10 shows an example of the functions of the user terminal 20 in this embodiment.

[0051] In the example of FIG. 10, the user terminal 20 is a projector. The user terminal 20 irradiates the application form with light rays, thereby superimposing content E6 on the application form using projection mapping technology. This allows the user to fill out the application form while referring to content E6. Note that the application form may be displayed on a device (not shown), and the user's entries may be accepted. This modification eliminates the need for the user to take a photo of the application form using the user terminal, thereby improving user convenience.

[0052] Other variations applicable to the above embodiment will be described. The method of acquiring the identification information acquired by the reading unit 210 is not limited, and for example, the identification information may be acquired by holding the My Number card over a device capable of communicating with the AR goggles. Alternatively, the My Number may be acquired by reading the identification number printed on the My Number card using a camera provided in the AR goggles.

[0053] Furthermore, the application form described in this specification may be a paper medium or may be displayed on the screen of a display device.

[0054] Furthermore, the communication unit 150 may transmit the image captured by the imaging unit 220 to a terminal (not shown) operated by a staff member. This allows the user to share the status of their own entry with the staff member, so that even if the staff member is not present, it is possible to point out any incompleteness in the application form, allowing for more flexible assistance to the user.

[0055] A modified example in which the information processing system 1 changes a guide based on acquired personal information will be described. Even if the guide determination unit 120 cannot narrow down the content to be displayed based on the acquired personal information, it may determine whether the user is likely to meet certain conditions based on the acquired personal information and select content that meets the certain conditions. Examples of certain conditions include whether the user is receiving welfare benefits, whether the user is certified for nursing care, whether the user receives pension benefits, and whether the user has an income level that warrants subsidies. In this modified example, an example in which the guide determination unit 120 selects content to be displayed based on personal information will be described. For example, assume that the conditions necessary to clearly determine whether the user is eligible for a subsidy are income information and employment status information (e.g., self-employed, full-time employment, non-full-time employment). Here, if the information processing system 1 acquires income information without acquiring employment status and the income information indicates an income below a certain level, the guide determination unit 120 determines that the user is likely to be eligible for a subsidy regardless of the employment status information. The guide determination unit 120 then selects content that indicates to the user that the user is likely to be eligible for a subsidy. In other words, even if the acquired personal information is insufficient and the guide determination unit 120 cannot determine that the personal information satisfies all of the conditions corresponding to the content, the guide determination unit 120 may select the content if the personal information satisfies some of the conditions corresponding to the content. In this way, if there is a possibility that the user meets the predetermined conditions, the guide determination unit 120 selects content that meets the predetermined conditions. This makes it possible to provide flexible guidance even if the personal information used for content search is not sufficiently determined.

[0056] Other modifications will be described. The user terminal 20 may be designed to have some or all of the functions of the information processing device 10. The information processing device 10 may be designed to have some or all of the functions of the user terminal 20. The storage unit 130 may be designed to be included in an external device (not shown).

[0057] Another modification will be described below: Instead of a captured image, the user terminal 20 may display a template image showing the format of the application form D1, which has the effect of reducing the processing load.

[0058] [Minimum configuration] The minimum configuration of an information processing system according to the present invention will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of the overall configuration of an information processing system 3 according to this embodiment. The information processing system 3 includes a personal information acquisition unit 301, a guide determination unit 302, and a guide control unit 303.

[0059] The personal information acquisition unit 301 acquires the user's personal information. The guide determination unit 302 determines the content or type of guide to encourage the user to fill out the application form recognized by the terminal, based on the personal information acquired by the personal information acquisition unit 301. The guide control unit 303 controls the guide to be superimposed on the image showing the application form.

[0060] Next, the processing flow relating to the minimum configuration of the information processing system will be described using Fig. 12. The personal information acquisition unit 301 acquires the user's personal information (S301). The guide determination unit 302 determines the content or type of guide to encourage the user to fill out the application form recognized by the terminal, based on the personal information acquired by the personal information acquisition unit 301 (S302). The guide control unit 303 controls the guide to be superimposed on the image showing the application form (S303).

[0061] This makes it possible to assist users in filling out application forms. In addition, even for documents that legally require applicants to fill out themselves, it makes it easier for applicants to make decisions when filling out forms, thereby streamlining application procedures. Furthermore, by changing the guide depending on the type of application form the user is filling out and the number of blank spaces, even users who are unfamiliar with application procedures can be flexibly guided to fill out forms according to their individual circumstances. This not only reduces the time required for users to fill out application forms themselves, but also reduces the burden on counter staff to assist with filling out application forms. This improves the efficiency of the entire process related to application procedures.

[0062] [Hardware configuration example] Next, an example of a hardware configuration for implementing the information processing device 10, user terminal 20, and information processing system 1, 3 in each of the above-described embodiments using one or more computers will be described. Each functional unit of the information processing device 10, user terminal 20, and information processing system 1, 3 is implemented by any combination of hardware and software, centered around at least one central processing unit (CPU) of any computer, at least one memory, a program loaded into the memory, at least one storage unit such as a hard disk for storing the program, and a network connection interface. Those skilled in the art will understand that there are various variations in this implementation method and device. The storage unit can store programs stored before the device is shipped, as well as programs downloaded from storage media such as optical disks, magneto-optical disks, and semiconductor flash memory, or from servers on the Internet.

[0063] FIG. 13 is a block diagram illustrating an example of the hardware configuration of the information processing device (10), the user terminal (20), and the information processing system (1, 3). As shown in FIG. 13, the information processing device (10), the user terminal (20), and the information processing system (1, 3) each have a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, a communication interface 5A, and a bus 6A. The peripheral circuit 4A includes various modules. The information processing device (10), the user terminal (20), and the information processing system (1, 3) may not have the peripheral circuit 4A. Note that the information processing device (10), the user terminal (20), and the information processing system (1, 3) may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices may have the above hardware configuration.

[0064] The bus 6A is a data transmission path for the processor 1A, memory 2A, input / output interface 3A, peripheral circuit 4A, and communication interface 5A to transmit and receive data to and from each other. The processor 1A is, for example, an arithmetic processing device such as a CPU, a GPU (Graphics Processing Unit), or a microprocessor. The processor 1A can execute processes according to various programs stored in the memory 2A, for example.

[0065] The memory 2A is, for example, a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory), and stores programs and various data.

[0066] The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external storage units, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external storage units, etc. Examples of input devices include a touch panel, keyboard, mouse, microphone, camera, etc. Examples of output devices include a display, speaker, printer, lamp, etc.

[0067] The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0068] The communication interface 5A enables the information processing device 10, the user terminal 20, and the information processing system 1, 3 to communicate with external devices, and also enables the information processing device 10, the user terminal 20, and the information processing system 1, 3 to communicate with each other. Note that some of the functions of the information processing device 10, the user terminal 20, and the information processing system 1, 3 may be configured by a computer.

[0069] [Additional Notes] The configurations of the above-described embodiments may be combined or some of the components may be interchanged. Furthermore, the configuration of the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the spirit of the present invention. For example, the configurations and processes disclosed in each embodiment and modification may be combined with each other. Some or all of the above-described embodiments may be described as follows, but are not limited to the following supplementary notes.

[0070] [Appendix 1] An acquisition means for acquiring personal information of a user; a determining means for determining the content of a guide to prompt the user to fill out an application form based on the personal information; a guide control means for controlling the guide to be superimposed on the image showing the application form or on the application form; An information processing system comprising:

[0071] [Appendix 2] the guide control means controls the display of the guide so as to be superimposed on an image showing the application form; 10. The information processing system of claim 1.

[0072] [Appendix 3] the guide control means changes the guide depending on the type of the application form or blank items. 3. The information processing system according to claim 1 or 2.

[0073] [Appendix 4] an input means for receiving input of the user's My Number information; The acquisition means acquires personal information associated with the My Number information. 4. An information processing system according to any one of claims 1 to 3.

[0074] [Appendix 5] a recognition means for recognizing the application form based on a marker drawn on the application form or the appearance of the application form that appears in an image captured by a terminal; 5. An information processing system according to any one of claims 1 to 4.

[0075] [Appendix 6] the captured image is captured by a camera provided in a terminal operated by the user, the guide control means controls a display unit included in the terminal to display a guide; 6. An information processing system according to any one of appendices 1 to 5.

[0076] [Appendix 7] The information processing system according to claim 6, wherein the terminal is a wearable device worn by the user.

[0077] [Appendix 8] Obtaining personal information of users, determining the content of a guide to prompt the user to fill out an application form based on the personal information; a step of controlling the guide to be superimposed on an image showing the application form or on the application form; An information processing method comprising:

[0078] [Appendix 9] On the computer, The process of obtaining personal information of users; A process of determining the content of a guide to encourage the user to fill out an application form based on the personal information; a process of controlling the guide to be superimposed on an image showing the application form or on the application form; A program storage medium that stores a program for executing the above. [Explanation of symbols]

[0079] 1. Information Processing Systems 10. Information processing equipment 110 Personal Information Acquisition Department 120 Guide Determination Unit 130 Storage section 140 Guide control section 150 Communications Department 20 User terminal 210 Reading unit 220 Imaging unit 230 Recognition part 240 Display section 3. Information Processing Systems 301 Personal Information Acquisition Department 302 Guide Determination Department 303 Guide control unit NW Resident Registration Network MK marker P1, P2, P3, P4, P5 entry items D1 application form E1, E2, E3, E4, E5, E6 content 1A processor 2A Memory 3A input / output interface 4A peripheral circuit 5A communication interface 6A Bus

Claims

[Claim 1] An acquisition means for acquiring personal information of a user; a control means for determining auxiliary information to assist the user in filling out the application form based on the personal information, and for controlling the display of the auxiliary information together with at least one of an image showing the application form or information relating to the application form; Equipped with The control means determines the auxiliary information to be displayed based on the family structure included in the personal information.

Images