Information processing systems, information processing methods, and programs

The information processing system addresses the challenge of varying application form requirements by using personal information to guide users, ensuring accurate and efficient form completion.

JP7896735B2Active Publication Date: 2026-07-29NEC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
NEC CORP
Filing Date
2025-05-15
Publication Date
2026-07-29

AI Technical Summary

Technical Problem

Existing systems fail to provide flexible entry assistance for applicants filling out application forms, as the required information varies based on individual circumstances, leading to confusion for those unfamiliar with the procedure.

Method used

An information processing system that obtains personal information, determines guide content based on this data, and overlays it onto the application form to assist users in filling it out accurately.

Benefits of technology

The system ensures users can fill out forms correctly by providing tailored guidance, reducing errors and time, and alleviating staff burden, thus enhancing application process efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007896735000001
    Figure 0007896735000001
  • Figure 0007896735000002
    Figure 0007896735000002
  • Figure 0007896735000003
    Figure 0007896735000003
Patent Text Reader

Abstract

To provide an information processing system, an information processing method, and a program storage medium capable of assisting an applicant for filling out an application form.SOLUTION: In an information processing system, an information processing apparatus comprises: a personal information acquisition unit for acquiring personal information of a user read by a read unit of a user terminal to enable assistance in filling out an application, for an applicant who fills out an application form necessary for applying for a procedure, and acquiring information from a resident basic registry network through a communication unit based on the acquired personal information, to complement the personal information; and a guidance determination unit for determining, on the basis of the personal information, the content or type of guidance to prompt the user to fill out an application form recognized by a terminal; and a guidance control unit for controlling the guidance to be superimposed on an image of the application form or on the application form.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0004] ,

[0006] , , , , , ,

[0005] , , , , , , ,

[0001] The present invention relates to an information processing system, an information processing method, and a program storage medium.

Background Art

[0002] When a resident applies for a procedure, it is necessary to enter information in the entry fields of the document. Patent Document 1 discloses a technique for presenting reference information corresponding to an entry field from an image of the entry field in order to reduce entry errors when a user enters information into a document. Patent Document 2 discloses a technique for displaying a page for guiding submission destination information according to the submitted document.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] When applying for a procedure, even when filling out the same application form, the items and information to be filled in may differ depending on the individual applicant. Therefore, for applicants who are not familiar with the procedure, it has been difficult to determine specifically what should be filled in the application form for their own case. In this regard, the techniques described in Patent Document 1 and Patent Document 2 do not consider flexible entry assistance according to the applicant.

[0005] In view of the above problems, an object of the present invention is to provide an information processing system, an information processing method, and a program storage medium capable of assisting an applicant in filling out an application form.

Means for Solving the Problems

[0006] According to one aspect of the present invention, Means of obtaining users' personal information, A determination means for determining the content of a guide that prompts the user to fill out an application form, based on the aforementioned personal information, A guide control means for controlling the display of the guide superimposed on an image of the application form or on the application form, An information processing system equipped with the following features is provided.

[0007] According to one aspect of the present invention, We obtain the user's personal information, Based on the aforementioned personal information, the content of the guide prompting the user to fill out the application form will be determined. Control the system to overlay the guide onto an image of the application form or onto the application form itself. Information processing methods are provided.

[0008] According to one aspect of the present invention, On the computer, The process of acquiring users' personal information. A process to determine the content of the guide that prompts the user to fill out the application form, based on the aforementioned personal information. A process to control the display of the guide superimposed on an image showing the application form or on the application form itself. A program storage medium is provided for storing a program to execute. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an information processing system, an information processing method, and a program storage medium that can assist applicants in filling out application forms. [Brief explanation of the drawing]

[0010] [Figure 1] This is a diagram illustrating an example of how to use the information processing system in this embodiment. [Figure 2] This is an example of a diagram showing the configuration of the information processing system in this embodiment. [Figure 3] An example of the application form used in this embodiment. [Figure 4] An example showing the structure of the database in this embodiment. [Figure 5] A figure showing an example of the guide output in this embodiment. [Figure 6] A figure showing an example of the guide output in this embodiment. [Figure 7] A sequence diagram showing the process flow of this embodiment. [Figure 8] A flowchart showing the process flow of this embodiment. [Figure 9] An example of the configuration diagram of the information processing system in this embodiment. [Figure 10] An example showing the configuration diagram of the information processing system in this embodiment. [Figure 11] An example showing the configuration diagram of the information processing system in this embodiment. [Figure 12] A flowchart showing the process flow of this embodiment. [Figure 13] An example of the hardware configuration of the information processing system in this embodiment.

Mode for Carrying Out the Invention

[0011] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. In the drawings, the same elements or corresponding elements are denoted by the same reference numerals, and the description thereof may be omitted or simplified.

[0012] [Overview of Functions] First, an overview of the functions realized by the present invention will be explained using Figure 1. Figure 1 is a diagram illustrating an example of a situation in which a user fills out an application form using the user terminal 20. When the user presents identification documents to the user terminal 20, the user terminal 20 reads personal information from the identification documents. The user terminal 20 also takes an image of the application form D1 that the user is filling out through user operation and obtains the application form type of the application form D1. The user terminal 20 transmits the read personal information and the application form type to the information processing device 10.

[0013] The information processing device 10 selects guide information to display on the user terminal 20 based on the personal information and application form type received from the user terminal 20. The guide information prompts the user to fill out the application form and changes depending on the application form type and the user's personal information. The information processing device 10 transmits a control signal to display the selected guide information on the user terminal 20.

[0014] Returning to the explanation of the user terminal 20, the user terminal 20 receives control signals transmitted from the information processing device 10. The user terminal 20 takes an image of the application form D1 to be filled out by user operation. The user terminal 20 displays the image of the application form D1. Based on the received control signals, the user terminal 20 overlays guide information onto the image of the application form D1.

[0015] The user fills out application form D1 by referring to the guide information displayed on the user terminal 20. The displayed guide information varies depending on the type of application form and the user's personal information. This allows users to fill out the application form smoothly without confusion, even if the required information changes for each user.

[0016] [First Embodiment] Next, the configuration of the information processing system 1 in this embodiment will be described using Figure 2. Figure 2 is a diagram showing an example of the overall configuration of the information processing system 1 in this embodiment. The information processing system 1 comprises an information processing device 10 and a user terminal 20. The information processing device 10 and the user terminal 20 are connected to a LAN (Local Area Network) or the Internet, etc., and can communicate with each other. The number of user terminals 20 connected to the information processing device 10 is at least one. The information processing system 1 is connected to an external Basic Resident Register Network System NW (hereinafter also referred to as "Basic Resident Register Network NW") via a telecommunications line so as to be able to communicate.

[0017] The information processing device 10 is an information processing device that generates a guide to facilitate the smooth completion of application forms for residents (hereinafter also referred to as users or applicants) who apply for procedures within government offices or other government agencies. Application forms refer to application forms and notification forms used in administrative procedures (resident registration services, seal registration services, tax services, national health insurance services, national pension services, long-term care insurance services, health and welfare services), with examples including resident change notifications, marriage notifications, and divorce notifications. Application forms may also be used in administrative procedures other than those mentioned above (related to the use of various public facilities, civil engineering and road maintenance services, water and sewage services, welfare services, medical care system services for the elderly, tax collection services, etc.). Other examples of application forms include procedures for obtaining compensation or subsidies, procedures for obtaining family register transcripts or identification documents, and documents required for issuance, reissuance, and renewal procedures for My Number cards, passports, driver's licenses, national health insurance cards, etc. A guide may include, but is not limited to, instructions on what to fill in each item on an application form, guidance on whether or not to fill in certain items, or suggestions for specific information to be filled in according to the individual resident.

[0018] The user terminal 20 is a terminal that can be operated by the user submitting the application, and is an information processing terminal that displays a guide to prompt the user to fill out the application form. The user terminal 20 can be, for example, a smartphone, a tablet, a wearable device such as an AR (Augmented Reality) goggle, contact lens, hat, sunglasses, or glasses, or a projector. The user terminal 20 only needs to be operable by the user, and its form is not limited.

[0019] Next, the configuration of the information processing device 10 and the user terminal 20 will be explained using Figures 2 and 1. The information processing device 10 consists of a personal information acquisition unit 110, a guide determination unit 120, a storage unit 130, a guide control unit 140, and a communication unit 150. The user terminal 20 consists of a reading unit 210, an imaging unit 220, a recognition unit 230, and a display unit 240.

[0020] The reading unit 210 reads personal information such as identification numbers from the user's identity verification documents. Examples of identity verification documents include My Number cards, driver's licenses, health insurance cards, and passports. The personal information read by the reading unit 210 is not limited to identification numbers and may also include names, genders, ages, etc. Means by which the reading unit 210 obtains personal information from identity verification documents include reading the IC (Integrated Circuit) chip embedded in the identity verification document, as well as reading the characters and numbers written on the surface of the identity verification document using an OCR (Optical Character Reader), etc. The means of obtaining personal information from identity verification documents are not limited to those mentioned above.

[0021] The personal information acquisition unit 110 acquires the personal information read by the reading unit 210. The personal information acquisition unit 110 may also acquire information from the Basic Resident Register Network (Juki Net) via the communication unit 150 based on the acquired personal information, and supplement that information.

[0022] The imaging unit 220 captures images of the application form that the user fills out. For example, the imaging unit 220 is expected to continuously capture images within the imaging range according to a predetermined frame rate.

[0023] The recognition unit 230 recognizes the type of application form captured by the imaging unit 220 and the spatial coordinates where the application form is located. Spatial coordinates refer to the three-dimensional coordinates where the application form is actually placed and may include elements such as the orientation, size, and distance of the application form relative to the imaging unit 220. Means by which the recognition unit 230 recognizes the type of application form and spatial coordinates include, but are not limited to, the appearance of the application form itself or the use of a marker MK described later.

[0024] Figure 3 illustrates an example of an application form to be filled out by a user. Figure 3 shows a resident change notification as an example of an application form. Application form D1 includes P1 to P5, which are examples of items to be filled out by the user. The position, number, and type of items to be filled out will differ depending on the type of application form D1. In addition, a marker MK that can be used by the recognition unit 230 to recognize the type of application form and spatial coordinates may be included.

[0025] Next, the structure of the database stored in the storage unit 130 will be explained using Figure 4. Figure 4 is an example of the data structure of the database stored in the storage unit 130. The storage unit 130 stores a database that associates search conditions with each content item that constitutes the guide. Figure 4 is an example in which multiple databases exist for each type of application form. The database consists of combinations of each content item that constitutes the guide information, the application form items associated with the content, and the search conditions. The content is information that encompasses the guidance text, layout, and display manner for the associated items. The search conditions are determined based on personal information. Entry items P1 to PN indicate each entry item included in application form D1.

[0026] The guide determination unit 120 uses the application type recognized by the recognition unit 230 and the personal information acquired by the personal information acquisition unit 110 to search for suitable content for each entry field of the application form from the database stored in the storage unit 130. The guide determination unit 120 also determines the group of retrieved content to be displayed as guide information on the display unit 240.

[0027] The guide control unit 140 transmits a control signal to the display unit 240 to display the guide information selected by the guide determination unit 120.

[0028] The display unit 240 sequentially displays images captured by the imaging unit 220 within the imaging range. The images displayed by the display unit 240 may include the application form to be filled out by the user. The display unit 240 receives control signals transmitted by the guide control unit 140 and overlays the content selected by the guide determination unit 120 onto the application form. In one example, the display unit 240 displays an image or video captured by the imaging unit 220 based on user operation. The display unit 240 can also acquire the spatial coordinates of the application form D1 acquired by the recognition unit 230 and adjust the position where the guide information is displayed based on the spatial coordinates. This makes it possible to display the guide information in an appropriate position on the display screen (display unit 240) even if the user places the application form in a free position in real space and begins filling it out, thereby improving convenience.

[0029] Figures 5 and 6 illustrate the format of the guide information displayed by the display unit 240. Figures 5 and 6 are examples showing the format of the guide information displayed on an image of application form D1. Contents E1 to E5 in Figures 5 and 6 represent the individual contents that make up the guide information. Each content is displayed in a format that has been searched based on the user's personal information.

[0030] Let's explain an example of content format. For example, Content E1 prompts the user to enter their name, stating, "Please fill in your name and affix your seal. In your case, please enter the name '○○○○'." Users who view Content E1 can confirm that they should write their name using the old kanji characters as they appear in their family register, preventing them from making the mistake of writing it using commonly used kanji characters. Furthermore, viewing Content E2 displays a prompt to enter the user's new address, stating, "Please fill in your new address." Users who view Content E2 can confirm that they should enter their new address, not their old address, preventing them from making incorrect address entries. Let's explain another example of content format. For example, if the acquired personal information includes information indicating an individual's income (personal income information), a guide may be displayed in the income information section of the application form to prompt the user to enter their specific income information (amount information). Alternatively, for items where the required information changes depending on the user's income requirements, a guide may be displayed prompting the user to adjust whether or not to fill in the information, or which items to fill in, according to their personal income information. To rephrase the above example, the content of the guide changes according to the user's personal income information. Let's explain an example of other content formats. Suppose the acquired personal information includes information indicating whether or not there are individuals in the user's family who are enrolled in National Health Insurance. When a user completes the transfer of residence procedure, if there are individuals enrolled in National Health Insurance among those transferring with the user, a guide may be displayed indicating that an application related to National Health Insurance (e.g., address change registration related to National Health Insurance) is required. In other words, the content and presence or absence of the guide will vary depending on whether or not the user and individuals associated with the user are enrolled in the prescribed insurance. Note that this guide is not limited to being superimposed on the application form; it is not limited to being displayed on the display unit 240 or any other format that can inform the user.

[0031] Next, we will explain an example of how the guide information displayed changes depending on the personal information, using Figures 5 and 6. Figures 5 and 6 show the guide information displayed for different users. In Figures 5 and 6, different content E4 or E5 is displayed for the input field P5. Based on the family structure of the acquired personal information, if the user has family members living with them, content E4 in Figure 5 displays the message, "Please fill in the names of all people moving from the old address to the new address. '○○△△' and '○○××' are candidates," prompting the user to fill in the information. On the other hand, if the user does not have family members living with them based on the family structure of the personal information, content E5 in Figure 6 displays the message, "No need to fill in," informing the user that they do not need to fill in the information. In other words, the examples in Figures 5 and 6 show how the guide information can be changed based on the family structure, which is an example of personal information. Alternatively, the number of boxes prompting the user to fill in the guide could be changed according to the number of family members living with the user, based on the family structure identified from the personal information. Specifically, the number of fields in the guide that prompts users to fill in when listing the people moving with them may differ depending on whether there are five or three family members living together. In another example, the guide may explicitly indicate which personal information such as gender, age, and date of birth should be filled in.

[0032] This allows us to inform users whether or not they need to fill in each item, thus preventing user errors. As described above, by changing the guide information displayed to users according to their personal information, it becomes possible to guide them to fill out the form in a way that is more in line with their actual situation.

[0033] Next, the processing flow of the information processing system 1 in this embodiment will be explained using Figures 7 and 8. Figure 7 is a sequence diagram illustrating the processing flow between the information processing device 10 and the user terminal 20.

[0034] First, the reading unit 210 of the user terminal 20 reads personal information such as an identification number from the user's identity verification document (S201). Next, the reading unit 210 transmits the read personal information to the information processing device 10 (S202).

[0035] Next, the personal information acquisition unit 110 of the information processing device 10 acquires the personal information read by the reading unit 210 (S101). In S101, the personal information acquisition unit 110 may acquire information from the Basic Resident Register Network NW via the communication unit 150 based on the acquired personal information and supplement the personal information.

[0036] In parallel with step S101, the imaging unit 220 of the user terminal 20 captures images of the application form that the user is filling out (S203). For example, the imaging unit 220 continuously captures objects within the imaging range according to a predetermined frame rate.

[0037] The recognition unit 230 of the user terminal 20 recognizes the type of application form captured by the imaging unit 220 and the spatial coordinates where the application form is located (S204). The recognition unit 230 transmits the recognized application form type to the information processing device 10 (S205).

[0038] The guide determination unit 120 of the information processing device 10 searches for suitable content for each entry item of the application form from the database stored in the storage unit 130 using the application form type recognized by the recognition unit 230 and the personal information acquired by the personal information acquisition unit 110 (S102). The guide determination unit 120 also determines the group of retrieved content to be displayed as guide information on the display unit 240 (S103).

[0039] The guide control unit 140 transmits a control signal to the display unit 240 to display the content selected by the guide determination unit 120 (S104).

[0040] The display unit 240 receives the control signal transmitted by the guide control unit 140 and overlays the content selected by the guide determination unit 120 onto the application form displayed on the display unit (S205).

[0041] Figure 8 is a flowchart showing the processing flow of the information processing system 1. After step S205, the imaging unit 220 of the user terminal 20 re-images the application form (S206). Next, the recognition unit 230 of the user terminal 20 recognizes the blank items among the items that the user is required to fill in on the application form captured by the imaging unit 220 (S207), and determines whether there are any blanks. If it is determined in step 207 that there are blanks (S208, YES), the guide determination unit 120 refers to the database stored in the storage unit 130 and selects the corresponding content for each item according to the blank items recognized by the recognition unit 230 (S209). For example, if the recognition unit 230 recognizes that only items P3 and P4 are blank among the items that the user is required to fill in in Figure 3, it may select only the content related to items P3 and P4. After step S208, the process returns to step S206. If it is determined in step 207 that there are no blank spaces (S208, NO), the display unit 240 terminates the display of the guide (S210).

[0042] As a result, the user fills out application form D1 by looking at the guide information displayed on the display unit 240 of the user terminal 20. Since the displayed guide differs depending on the type of application form and the personal information of the user filling it out, the user can fill out the application form smoothly even if the required information changes for each user.

[0043] In addition, by displaying a guide for users to fill out the form, even for documents that legally require the applicant to fill out themselves, it becomes easier for the applicant to make decisions when filling them out, and the application process can be made more efficient.

[0044] Furthermore, according to one aspect of the present invention, by changing the guide according to the type of application form the user is filling out and the amount of blank space remaining, even users unfamiliar with the application process can be flexibly guided to fill out the form according to their individual circumstances. This reduces the time required for the user to fill out the application form, and also reduces the burden on counter staff who have to assist with filling out the application form. This improves the overall efficiency of the application process.

[0045] Furthermore, according to one aspect of the present invention, by referring to personal information associated with identification information, it becomes possible to understand the attributes and circumstances of each user in detail, thereby enabling flexible guidance on how to fill out information according to the user.

[0046] [Second Embodiment] Next, the configuration of the user terminal 20 in the second embodiment will be described with reference to Figure 9. The user terminal 20 in this embodiment differs from that of the first embodiment in that it is a wearable device that can be worn by the user. The points that are common with the first embodiment will not be explained. Figure 9 shows an example of the overall configuration of the user terminal 20 in this embodiment.

[0047] The user terminal 20 in this embodiment is a terminal that can be operated by a user submitting an application, and is an information processing terminal that displays a guide to prompt the user to fill out the application form. Figure 9 shows an example of an AR (Augmented Reality) goggle-type device as an example of the user terminal 20, but other wearable devices such as contact lenses, hats, sunglasses, or glasses may also be used.

[0048] The user terminal 20, like the first embodiment, has a reading unit 210, an imaging unit 220, a recognition unit 230, and a display unit 240, and is capable of communicating with the information processing device 10. The imaging direction of the imaging unit 220 is adjusted to approximate the direction of the user's line of sight when the user is wearing the user terminal 20. In other words, the imaging unit 220 photographs subjects that are visible in the direction of the user's line of sight.

[0049] The display unit 240 is positioned to cover the eyes of the user wearing the user terminal 20. The display unit 240 continuously displays images captured by the imaging unit 220. In this case, the display unit 240 displays the surrounding background and the application form as images captured by the imaging unit 220, and superimposes the guide onto the image showing the application form. As a result, to the user wearing the user terminal 20, it appears as if the guide is superimposed on the application form. In other examples, the display unit 240 may be light-transmitting so as not to completely block the user's line of sight. As a result, the user can fill out the application form without any discomfort while viewing it through the display unit 240. According to this embodiment, the user can easily see the guide, resulting in improved usability.

[0050] [Differentiation] Next, a modified example applicable to the above embodiment will be described. The configuration of the user terminal 20 in the modified example will be explained with reference to Figure 10. The user terminal 20 in this embodiment differs from the first and second embodiments in that it projects the guide onto the application form. The points common to the first and second embodiments will not be explained. Figure 10 shows an example of the functions of the user terminal 20 in this embodiment.

[0051] In the example shown in Figure 10, the user terminal 20 is a projector. The user terminal 20 projects light onto the application form, overlaying content E6 onto the application form using projection mapping technology. This allows the user to fill out the application form while referring to content E6. The application form may also be displayed by a device not shown, and user completion may be accepted. This modified example improves user convenience because it eliminates the need for the user to take a picture of the application form using the user terminal.

[0052] Other modifications applicable to the above embodiment will be described. The method for obtaining the identification information acquired by the reading unit 210 is not limited; for example, it may be obtained by holding the My Number Card over a device that can communicate with the AR goggles. Alternatively, the My Number may be obtained by reading the identification number written on the surface of the My Number Card with the camera provided in the AR goggles.

[0053] Furthermore, the application forms described herein may be in paper format or displayed on the screen of a display device.

[0054] Furthermore, the communication unit 150 may transmit the images captured by the imaging unit 220 to a terminal (not shown) operated by an employee. This allows the user to share their completion status with the employee, enabling the employee to point out any deficiencies in the application form even when the employee is not present, thus allowing for more flexible assistance to the user.

[0055] This section describes a modified version in which the guide changes according to the personal information acquired by the information processing system 1. Even if the guide determination unit 120 cannot narrow down the content to be displayed based on the acquired personal information, it may determine whether the user is likely to meet certain conditions based on the acquired personal information and select content according to those conditions. The predetermined conditions are, for example, "whether or not the user receives welfare benefits," "whether or not the user is certified for long-term care," "whether or not the user receives pension benefits," and "whether or not the user's income situation qualifies for subsidies." This modified version describes an example in which the guide determination unit 120 selects content to be displayed based on personal information. For example, let's assume that the conditions necessary to clearly determine "whether or not the user is eligible for subsidies" are "income information" and "employment status information (e.g., self-employed, regular employment, non-regular employment)." Here, if the information processing system 1 acquires "income information" without acquiring "employment status" and the "income information" indicates an income below a certain level, the guide determination unit 120 will determine that there is a high possibility that the user is "eligible for subsidies," regardless of the "employment status information." The guide determination unit 120 will then select content to indicate to the user that "there is a possibility that the user is eligible for subsidies." In other words, even if the acquired personal information is insufficient and the guide determination unit 120 cannot determine that the personal information meets all the conditions corresponding to the content, it may still select the content if the personal information meets some of the conditions corresponding to the content. In this way, the guide determination unit 120 selects content according to the predetermined conditions if there is a possibility that the user meets the predetermined conditions. This allows for flexible guidance even when the personal information used for content search is not sufficiently determined.

[0056] Other variations are described below. The user terminal 20 may be designed to have some or all of the functions of the information processing device 10. The information processing device 10 may be designed to have some or all of the functions of the user terminal 20. The storage unit 130 may be designed to be provided by an external device (not shown).

[0057] Let's describe another variation. The user terminal 20 may display a template image showing the format of application form D1 instead of the captured image. This has the effect of reducing the processing load.

[0058] [Minimum configuration] The minimum configuration of the information processing system in the present invention will be explained with reference to Figure 11. Figure 11 is a diagram showing an example of the overall configuration of the information processing system 3 in this embodiment. The information processing system 3 comprises a personal information acquisition unit 301, a guide determination unit 302, and a guide control unit 303.

[0059] The personal information acquisition unit 301 acquires the user's personal information. Based on the personal information acquired by the personal information acquisition unit 301, the guide determination unit 302 determines the content or type of guide to prompt the user to fill out the application form recognized by the terminal. The guide control unit 303 controls the system to overlay the guide onto the image showing the application form.

[0060] Next, Figure 12 will be used to explain the processing flow related to the minimum configuration of the information processing system. The personal information acquisition unit 301 acquires the user's personal information (S301). Based on the personal information acquired by the personal information acquisition unit 301, the guide determination unit 302 determines the content or type of guide to prompt the user to fill in the application form recognized by the terminal (S302). The guide control unit 303 controls the system to overlay the guide onto the image showing the application form (S303).

[0061] This allows for assistance in filling out application forms. In addition, even for documents that legally require applicants to fill out themselves, it makes it easier for applicants to make decisions when filling them out, thus streamlining the application process. Furthermore, by changing the guide depending on the type of application form and the amount of blank space remaining, even users unfamiliar with the application process can be flexibly guided according to their individual circumstances. This reduces the time users spend filling out application forms and also reduces the burden on counter staff assisting with application completion. As a result, the overall efficiency of the application process can be improved.

[0062] [Example Hardware Configuration] Next, an example of a hardware configuration in which the information processing device (10), user terminal (20), and information processing system (1, 3) in each of the embodiments described above are implemented using one or more computers will be explained. Each functional unit of the information processing device (10), user terminal (20), and information processing system (1, 3) is implemented by any combination of hardware and software, centering on at least one CPU (Central Processing Unit) of any computer, at least one memory, a program loaded into the memory, at least one storage unit such as a hard disk that stores the program, and a network connection interface. It will be understood by those skilled in the art that there are various modifications to this implementation method and device. The storage unit can store not only programs stored before the device is shipped, but also programs downloaded from storage media such as optical discs, magneto-optical discs, semiconductor flash memory, or servers on the Internet.

[0063] Figure 13 is a block diagram illustrating the hardware configuration of an information processing device (10), a user terminal (20), and an information processing system (1, 3). As shown in Figure 13, the information processing device (10), user terminal (20), and information processing system (1, 3) each have a processor 1A, memory 2A, input / output interface 3A, peripheral circuitry 4A, communication interface 5A, and bus 6A. Peripheral circuitry 4A includes various modules. The information processing device (10), user terminal (20), and information processing system (1, 3) do not necessarily have peripheral circuitry 4A. Note that the information processing device (10), user terminal (20), and information processing system (1, 3) may be composed of multiple physically and / or logically separated devices. In this case, each of the multiple devices may have the above hardware configuration.

[0064] Bus 6A is a data transmission path for the processor 1A, memory 2A, input / output interface 3A, peripheral circuitry 4A, and communication interface 5A to send and receive data to and from each other. Processor 1A is a processing unit such as a CPU, GPU (Graphics Processing Unit), or microprocessor. Processor 1A can execute processing according to various programs stored in memory 2A, for example.

[0065] Memory 2A refers to memory such as RAM (Random Access Memory) or ROM (Read Only Memory), which stores programs and various data.

[0066] The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external storage units, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external storage units, etc. Input devices include, for example, touch panels, keyboards, mice, microphones, cameras, etc. Output devices include, for example, displays, speakers, printers, lamps, etc.

[0067] Processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0068] Communication interface 5A enables the information processing device (10), user terminal (20), and information processing systems (1, 3) to communicate with external devices, as well as enable the information processing device (10), user terminal (20), and information processing systems (1, 3) to communicate with each other. Some functions of the information processing device (10), user terminal (20), and information processing systems (1, 3) may be configured using a computer.

[0069] [Additional Notes] Furthermore, the configurations of the embodiments described above may be combined or some of the components may be replaced. Also, the configuration of the present invention is not limited to the embodiments described above, and various modifications may be made without departing from the spirit of the invention. For example, the configurations and processes disclosed in each embodiment and modification may be combined with each other. Some or all of the above embodiments may also be described as follows, but are not limited to these.

[0070] [Note 1] Means of obtaining users' personal information, A determination means for determining the content of a guide that prompts the user to fill out an application form, based on the aforementioned personal information, A guide control means for controlling the display of the guide superimposed on an image of the application form or on the application form, An information processing system equipped with the following features.

[0071] [Note 2] The guide control means controls the display of the guide superimposed on the image showing the application form. The information processing system described in Appendix 1.

[0072] [Note 3] The guide control means changes the guide according to the type of application form or the blank items. The information processing system described in Appendix 1 or 2.

[0073] [Note 4] The system includes an input means for receiving the user's My Number information, The acquisition means acquires personal information associated with the My Number information. An information processing system as described in any one of the items 1 to 3 of the appendix.

[0074] [Note 5] The system includes recognition means for recognizing the application form based on markers drawn on the application form or the appearance of the application form as seen in the captured image taken by the terminal. An information processing system as described in any one of the items 1 to 4 of the appendix.

[0075] [Note 6] The captured image is taken by a camera installed in the terminal operated by the user. The guide control means controls the display unit of the terminal to display the guide. An information processing system as described in any one of the items 1 to 5 of the appendix.

[0076] [Note 7] The terminal is a wearable device worn by the user, as described in Appendix 6 of the information processing system.

[0077] [Note 8] We obtain the user's personal information, Based on the aforementioned personal information, the content of the guide prompting the user to fill out the application form will be determined. The steps include controlling the display of the guide superimposed on an image showing the application form or on the application form itself, An information processing method comprising the following:

[0078] [Note 9] On the computer, The process of acquiring users' personal information. A process to determine the content of the guide that prompts the user to fill out the application form, based on the aforementioned personal information. A process to control the display of the guide superimposed on an image showing the application form or on the application form itself. A program storage medium that stores programs to execute. [Explanation of Symbols]

[0079] 1. Information Processing System 10 Information Processing Devices 110 Personal Information Acquisition Department 120 Guide Determination Section 130 Storage section 140 Guide Control Unit 150 Communications Department 20 User Terminals 210 Reading Unit 220 Imaging Unit 230 Recognition part 240 Display section 3. Information Processing Systems 301 Personal Information Acquisition Department 302 Guide Determination Section 303 Guide Control Unit NW (Basic Resident Register Network) MK Marker P1, P2, P3, P4, P5 entry items D1 application form E1, E2, E3, E4, E5, E6 content 1A Processor 2A Memory 3A Input / Output Interface 4A Peripheral Circuits 5A Communication Interface 6A bus

Claims

1. Means for obtaining user information, A control means that determines auxiliary information to assist the application based on the user information, and controls the display of the application information and the auxiliary information, Equipped with, The control means modifies the auxiliary information according to the type of application, The control means determines the auxiliary information to be displayed based on the family structure included in the user information. Information processing system.

2. An acquisition means for acquiring user information, A control means that determines auxiliary information to assist the application based on the user information, and controls the display of the application information and the auxiliary information, Equipped with, The control means modifies the auxiliary information according to the type of application, The control means controls the display of the auxiliary information that guides the user to the necessary application, based on the user information. Information processing system.

3. The aforementioned application includes multiple types of applications, The aforementioned application is an administrative procedure. The information processing system according to claim 1 or 2.

4. The aforementioned auxiliary information is displayed on the user's available device. The information processing system according to claim 1 or 2.

5. A reading means for reading a medium associated with the user information, Furthermore, The aforementioned user information includes the user's personal information, The information processing system according to claim 1 or 2.

6. A reading means for reading a medium associated with the user information, Furthermore, The aforementioned user information includes the user's personal information, The information processing system according to claim 3.

7. A reading means for reading a medium associated with the user information, Furthermore, The aforementioned user information includes the user's personal information, The information processing system according to claim 4.

8. The control means controls the display of the auxiliary information regarding whether or not each item in the application needs to be filled in, based on the user information. The information processing system according to claim 1 or 2.

9. Obtain user information, Based on the user information, auxiliary information to assist the application is determined, and the system is controlled to display the information related to the application and the auxiliary information. In the control step described above, the auxiliary information is changed according to the type of application, In the control step described above, the auxiliary information to be displayed is determined based on the family structure included in the user information. Information processing methods.

10. Obtain user information, Based on the user information, auxiliary information to assist the application is determined, and the system is controlled to display the information related to the application and the auxiliary information. In the control step described above, the auxiliary information is changed according to the type of application, In the control step described above, the system controls the system to display the auxiliary information that guides the user to the necessary application based on the user information. Information processing methods.

11. The process of obtaining user information, A process that determines auxiliary information to assist the application based on the user information, and controls the display of the application information and the auxiliary information, Have the computer run it, In the control process described above, the auxiliary information is changed according to the type of application, In the control process described above, the auxiliary information to be displayed is determined based on the family structure included in the user information. program.

12. A process for obtaining user information, A process that determines auxiliary information to assist the application based on the user information, and controls the display of the application information and the auxiliary information, Have the computer run it, In the control process described above, the auxiliary information is changed according to the type of application, In the control process described above, the system controls the system to display the auxiliary information that guides users through the necessary applications based on the user information. program.