Online procedure system, user terminal and program

Abstract

To provide an online procedure system capable of reducing a load applied to an online procedure.SOLUTION: In an online procedure system 1, a user terminal 5 comprises shooting means 501 for shooting a face image of a user, application information transmitting means 502 for transmitting the face image of the user and user information to a receiving device 3 as application information, and key information receiving means 503 for receiving a reservation code for executing an online procedure by a certificate camera 2 from the receiving device 3. The certificate camera 2 comprises acquiring means 201 for acquiring a reservation code, shooting means 202 for shooting the face image of the user, and personal identification information transmitting means 204 for transmitting the face information of the user to the receiving device 3 as personal identification information. The receiving device 3 comprises personal identifying means 304 for performing personal identification processing based on the face image received from the user terminal 5 and the face image received from the certificate camera 2.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an online procedure system for performing online procedures. [Background technology]

[0002] Procedures such as opening a bank account, inheriting bank deposits, and changing the name of an account are generally carried out by the individual in person at a branch. Patent Document 1 describes a system in which application information is entered and documents required for application are photographed on a terminal of a receptionist at a financial institution or the like, and the application information and document images are sent to a server device for registration, thereby enabling procedures to be carried out smoothly. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-113316 A Summary of the Invention [Problem to be solved by the invention]

[0004] In-store procedures often take time, and users and receivers have limited time available to complete the procedures, and it is difficult to plan ahead. For this reason, it is possible to replace part of the in-store procedures with online procedures to shorten the time required for in-store procedures. However, even if part of the in-store procedures is replaced with online procedures, completing the online procedures in one go is still a burden for users, especially if identity verification is performed to ensure the security of the procedures.

[0005] The present invention has been made in consideration of the above problems, and has an object to provide an online procedure system etc. that can reduce the burden associated with online procedures. [Means for solving the problem]

[0006] A first invention for solving the above-mentioned problems is an online procedure system having a user terminal, an online procedure device, and a reception device, the user terminal receiving a face image of a user, and the documents required for the store procedure. an application information transmission means for transmitting the face image and user information to the reception device as application information; After transmitting the application information to the reception device, a key information receiving means for receiving key information for performing an online procedure at the online procedure device from the reception device; an identification information receiving means for receiving user identification information for performing a procedure at a store from the reception device when performing an online procedure at the online procedure device; the online procedure device comprises: an acquisition means for acquiring the key information; an image capturing means for capturing an image of a user's face; and an identity verification information transmission means for transmitting the image of the user's face to the reception device as identity verification information; The application information transmission means further transmits image information of the photographed image of the document to the reception device as the application information, instead of the photographed image of the document, and the user terminal performs image analysis of the photographed image of the document to determine whether the photographed document is a document necessary for the procedure at the store, and is only able to transmit the image information to the reception device when all photographed images of the documents necessary for the procedure at the store have been photographed. The reception device is an online procedure system characterized in that it has an identity verification means for performing identity verification processing based on a face image received from the user terminal and a face image received from the online procedure device. It is also preferable that the user terminal extracts the creation date and time of the document from the captured image of the document, and determines whether the document is within its expiration date or not by comparing the creation date and time with the current date and time. It is also desirable for the online processing device to be connected online to a store terminal to enable a video call between the user and a receptionist at the store where the processing will be performed, and at that time it is also desirable to accept the selection of the store where the processing will be performed.

[0007] According to the present invention, the user can transmit application information from a user terminal as an online procedure, and can verify the identity of the user from an online procedure device separate from the user terminal. Each procedure can be simplified compared to performing these procedures all at once, and the user can perform each procedure in a short time on a convenient schedule, whenever he or she feels like it. This reduces the time and psychological burden on the user required for the online procedures.

[0008] Also In the present invention, some of the procedures required at the store, such as inputting application information and identity verification, are performed online in advance, so the time required for the procedures at the store can be shortened.

[0009] In addition, in the present inventionSince it is confirmed that the necessary documents are prepared by the user as a prerequisite for the procedure, there is no need to go to the store and find out that the necessary documents are not prepared when the user visits the store to carry out the procedure, and then to go back to the store with the necessary documents. In addition, the necessary documents are checked automatically, so the burden of checking them is reduced.

[0010] It is preferable that the user terminal has a document image transmission means for transmitting a photographed image of the document to the reception device during online processing at the online processing device. The reception device, for example, compares image information of the captured image received from the user terminal during online procedure with the image information received from the user terminal before performing the online procedure. This allows photographed images of necessary documents to be sent in advance as information required for the procedure, shortening the time required for the procedure at the store.

[0011] The online procedure device has a reading means for acquiring an image of the face of the user's identification card. It is a photo machine that It is desirable that the identity verification information transmitting means transmits the image of the card face to the reception device as identity verification information, and the identity verification means compares the information written on the card face obtained from the image of the card face with the user information received from the user terminal. This allows for more rigorous identity verification.

[0012] A second invention is a user terminal used by a user who performs online procedures using an online procedure device communicably connected to a reception device, the user's face image used for identity verification during online procedures using the online procedure device. And the documents required for the store procedure. an application information transmission means for transmitting the face image and user information to the reception device as application information; After transmitting the application information to the reception device, a key information receiving means for receiving key information for performing an online procedure at the online procedure device from the reception device; an identification information receiving means for receiving user identification information for performing a procedure at a store from the reception device when performing an online procedure at the online procedure device; Have The application information transmission means further transmits image information of the photographed image of the document to the reception device as the application information, instead of the photographed image of the document, and the user terminal performs image analysis of the photographed image of the document, determines whether the photographed document is a document necessary for the procedure at the store, and is able to transmit the image information to the reception device only when all photographed images of the documents necessary for the procedure at the store have been photographed. The user terminal is characterized in that A second invention is a user terminal of the online procedure system of the first invention.

[0013] OA reception device communicably connected to a user terminal used by a user who performs online procedures using the online procedure device. teeth the application information receiving means for receiving a user's face image and user information as application information from the user terminal; key information transmitting means for transmitting key information for performing an online procedure at the online procedure device to the user terminal; personal identification information receiving means for receiving a user's face image photographed by the online procedure device as personal identification information; and personal identification means for performing personal identification processing based on the face image received by the application information receiving means and the face image received by the personal identification information receiving means. 。

[0014] No. 3 The present invention relates to a user terminal used by a user who performs online procedures using an online procedure device that is communicably connected to a reception device, the user's face image used for identity verification during online procedures using the online procedure device. And the documents required for the store procedure. a user terminal having an image capturing means for capturing an image of the face of the user and an application information transmitting means for transmitting the face image and user information to the reception device as application information; After transmitting the application information to the reception device, a key information receiving means for receiving key information for performing an online procedure at the online procedure device from the reception device; an identification information receiving means for receiving user identification information for performing a procedure at a store from the reception device when performing an online procedure at the online procedure device; Have The application information transmission means further transmits, as the application information, image information of the photographed image, rather than the photographed image of the document, to the reception device, and the user terminal performs image analysis of the photographed image of the document to determine whether the photographed document is a document necessary for a procedure at the store, and is capable of transmitting the image information to the reception device only when all photographed images of documents necessary for the procedure at the store have been photographed. This is a program that functions as a user terminal. No. 3 The present invention is a program for a user terminal of the second invention.

[0015] O A reception device communicably connected to a user terminal used by a user who performs online procedures using the online procedure device. The program isand functioning as a reception device having an application information receiving means for receiving a user's face image and user information from the user terminal as application information, a key information transmitting means for transmitting key information for performing an online procedure at the online procedure device to the user terminal, an identity verification information receiving means for receiving a user's face image photographed by the online procedure device as identity verification information, and an identity verification means for performing identity verification processing based on the face image received by the application information receiving means and the face image received by the identity verification information receiving means. 。 Effect of the Invention

[0016] The present invention makes it possible to provide an online procedure system etc. that can reduce the burden associated with online procedures. [Brief description of the drawings]

[0017] [Figure 1] A diagram showing an online procedure system 1. [Diagram 2] A diagram showing a passport photo machine 2. [Diagram 3] FIG. 2 shows a hardware configuration of the reception device 3. [Figure 4] FIG. 2 shows a hardware configuration of a user terminal 5. [Diagram 5] A diagram showing the functional configuration of online procedure system 1. [Figure 6] 6 is a flowchart showing a process when application information is transmitted from a user terminal 5. [Figure 7] FIG. 4 shows a display screen of a user terminal 5. [Figure 8] FIG. 1 shows application information 100. [Figure 9] 4 is a flowchart showing the process of identity verification etc. performed by the passport photo machine 2. [Figure 10] FIG. 4 shows a display screen of the passport photo machine 2. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

[0019] (1. Online Procedure System 1) 1 is a diagram showing an online procedure system 1 according to an embodiment of the present invention. As shown in Fig. 1, the online procedure system 1 includes a passport photo machine 2, a reception device 3, a store terminal 4, a user terminal 5, and the like.

[0020] The ID photo machine 2 takes a picture of a user and prints the taken image, and is installed on the street, etc. In this embodiment, the ID photo machine 2 is particularly used as an online procedure device for performing online procedures.

[0021] FIG. 2( a ) is a diagram showing the external appearance of the passport photo machine 2 , and FIG. 2( b ) is a diagram showing the system configuration of the passport photo machine 2 .

[0022] The passport photo machine 2 has a box-like appearance where a user enters to take a picture, and includes a control device 20, a display unit 21, a billing unit 22, a photographing unit 23, a light 24, a printer 25, a reading unit 26, an audio input / output unit 27, etc.

[0023] The control device 20 is provided inside the ID photo machine 2 and controls the overall processing of the ID photo machine 2. The control device 20 can be realized, for example, by a computer having a control unit, a storage unit, and a communication unit. However, the control device 20 is not limited to this and can have various appropriate configurations.

[0024] The display unit 21 is realized by a touch panel display or the like that also serves as an input unit of the ID photo machine 2. The display unit 21 displays various screens related to user operations and selections, and accepts user input of instructions and the like on the screen.

[0025] The billing unit 22 includes an input slot for coins and bills, a change return slot, a receipt outlet, a receipt printer, etc. (not shown), and manages billing from users and the issuance of receipts.

[0026] The photographing unit 23 is provided with a camera or the like inside a photographing window. The camera may be, for example, a high-resolution digital camera, but is not limited to this.

[0027] The lighting 24 is used when photographing the user. The lighting 24 is, for example, a surface light source that emits white light, and is provided above the photographing unit 23, but is not limited to this.

[0028] The printer 25 prints images, and is provided inside the photo ID machine 2. Printed images are discharged to a print outlet. There is no particular restriction on the type of printer 25 and the number of printers to be installed.

[0029] The reading unit 26 reads identification cards such as a driver's license and a My Number card, and includes a scanner, a camera, and the like for acquiring an image of the face of the identification card.

[0030] The audio input / output unit 27 includes a microphone and a speaker used for audio input / output.

[0031] The reception device 3 executes various processes related to online procedures. Fig. 3 is a diagram showing the hardware configuration of the reception device 3. The reception device 3 can be realized by a computer configured by connecting a control unit 31, a storage unit 32, a communication unit 33, etc. via a bus. However, the configuration of the reception device 3 is not limited to this and can be changed as appropriate. Furthermore, the reception device 3 may be realized by multiple computers.

[0032] The control unit 31 includes a CPU, a ROM, a RAM, etc. The CPU loads programs stored in a storage medium such as the storage unit 32 or the ROM into a work area on the RAM and executes them. The ROM is a non-volatile memory, and permanently stores programs such as the boot program and the BIOS, data, etc. The RAM is a volatile memory, and temporarily stores programs and data loaded from the storage unit 32 or the ROM, etc., and includes a work area used by the control unit 31 to perform various processes.

[0033] The storage unit 32 is a hard disk drive, a solid state drive, or the like, and stores programs executed by the reception device 3 during processing described below, data necessary for executing the programs, an OS, etc. These programs and data are read out and executed by the control unit 31 as necessary.

[0034] The communication unit 33 includes a communication control device, a communication port, etc., and mediates communication via the network.

[0035] The store terminal 4 is a terminal used by a person who accepts procedures at a store. The contents of the procedures are not particularly limited. The store terminal 4 may be a computer having a control unit, a storage unit, a communication unit, a display unit, etc.

[0036] The user terminal 5 is a terminal carried by a user who performs online procedures, and may be, for example, a mobile terminal such as a smartphone or a tablet terminal.

[0037] 4 is a diagram showing the hardware configuration of the user terminal 5. As the user terminal 5, for example, a computer terminal configured by connecting a control unit 51, a storage unit 52, a communication unit 53, an input unit 54, a display unit 55, a camera 56, an audio input / output unit 57, etc. via a bus is used. However, the configuration of the user terminal 5 is not limited to this and can be changed as appropriate.

[0038] The functions of the control unit 51, memory unit 52, and communication unit 53 of the user terminal 5 are approximately the same as those of the control unit 31, memory unit 32, and communication unit 33 described above, and the memory unit 52 stores a dedicated application program for the user terminal 5 to execute the processing described below.

[0039] The display unit 55 is, for example, a liquid crystal display, and is provided with a touch panel as the input unit 54. The camera 56 is, for example, a digital camera equipped with an imaging element such as a CCD or CMOS. The audio input / output unit 57 includes a microphone for inputting audio, a speaker for outputting audio, and the like.

[0040] (2. Functions of Online Procedure System 1) Fig. 5 is a diagram showing the functional configuration of the online procedure system 1. As shown in Fig. 5, in the online procedure system 1, the user terminal 5 has an imaging means 501, an application information transmission means 502, a key information receiving means 503, a document image transmission means 504, an identification information receiving means 505, and the like.

[0041] The photographing means 501 is a means for the control unit 51 of the user terminal 5 to photograph an image of the user's face and documents required for a procedure (hereinafter, sometimes referred to as necessary documents) using the camera 56.

[0042] The application information transmission means 502 is a means by which the control unit 51 of the user terminal 5 transmits a face image of the user, user information, etc. as application information to the reception device 3 via the communication unit 53 to apply for the procedure. The application information will be described later.

[0043] The key information receiving means 503 receives, from the reception device 3, key information for the control unit 51 of the user terminal 5 to carry out an online procedure at the ID photo machine 2 via the communication unit 53. The key information will be described later.

[0044] The document image transmitting means 504 is a means for transmitting a photographed image of a necessary document to the reception device 3 via the control unit 51 of the user terminal 5 through the communication unit 53 during online procedures at the ID photo machine 2 .

[0045] The identification information receiving means 505 is for the control unit 51 of the user terminal 5 to receive user identification information for carrying out the procedure at the store from the reception device 3 via the communication unit 53 during the online procedure at the ID photo machine 2. The user identification information will be described later.

[0046] The ID photo machine 2 (online procedure device) includes an acquisition unit 201, a photographing unit 202, a reading unit 203, an identity verification information transmitting unit 204, and the like.

[0047] The acquiring means 201 is for the control device 20 of the ID photo machine 2 to acquire the above-mentioned key information.

[0048] The photographing means 202 is a device in which the control device 20 of the passport photo machine 2 photographs an image of the user's face using the photographing section 23 .

[0049] The reading means 203 is a means for the control device 20 of the ID photo machine 2 to obtain an image of the face of the user's identification card by using the reading section 26.

[0050] The personal identification information transmitting means 204 is a means by which the control device 20 of the passport photo machine 2 transmits to the reception device 3 a face image of the user, an image of the face of the personal identification card, etc. as personal identification information used for personal identification.

[0051] The reception device 3 includes an application information receiving means 301, a key information transmitting means 302, an identity verification information receiving means 303, an identity verification means 304, a document image receiving means 305, an identification information transmitting means 306, and the like.

[0052] The application information receiving means 301 is a means by which the control unit 31 of the reception device 3 receives the application information from the user terminal 5 via the communication unit 33 .

[0053] The key information transmitting means 302 is a means by which the control unit 31 of the reception device 3 transmits the key information to the user terminal 5 via the communication unit 33 .

[0054] The personal identification information receiving means 303 is a means by which the control unit 31 of the reception device 3 receives the personal identification information from the photo ID machine 2 via the communication unit 33 .

[0055] The identity verification means 304 is a means for performing identity verification processing by the control unit 31 of the reception device 3 based on the facial image received from the user terminal 5 as application information and the facial image received from the ID photo machine 2 as identity verification information, or for performing identity verification by comparing the user information received from the user terminal 5 as application information with the image of the face of the identity card received from the ID photo machine 2 as identity verification information.

[0056] The document image receiving means 305 is a means for the control unit 31 of the reception device 3 to receive the photographed image of the necessary document from the user terminal 5 via the communication unit 33 .

[0057] The identification information transmitting means 306 is a means by which the control unit 31 of the reception device 3 transmits the user identification information to the user terminal 5 via the communication unit 33 .

[0058] (3. Processing in Online Procedure System 1) Next, the process in the online procedure system 1 will be described with reference to Fig. 6 etc. In this embodiment, a user who performs a procedure at a store performs a preliminary online procedure, such as sending application information from the user terminal 5, and then performs identity verification from the photo ID machine 2. Each procedure will be described below.

[0059] (3-1. Submission of application information, etc.) 6 is a flowchart showing the processing when transmitting application information from the user terminal 5. S101-S107 and S110 in the figure are executed by the control unit 51 of the user terminal 5 controlling each unit of the user terminal 5, and S108-S109 are executed by the control unit 31 of the reception device 3 controlling each unit of the reception device 3.

[0060] In this embodiment, the user terminal 5 starts a dedicated application in response to an operation by the user, and displays a selection screen (not shown) for selecting a procedure to be performed by the user on the display unit 55. When a desired procedure is selected on the selection screen, an input screen for inputting images of documents required for that procedure is displayed on the display unit 55 of the user terminal 5, as shown in Fig. 7(a).

[0061] The input screen displays the name 551 of the selected procedure, a photographing button 552, the names 553 of the required documents, and an image display area 554. In this embodiment, a plurality of documents are required for the procedure, and an image display area 554 is provided for each required document. The user selects the photographing button 552, activates the camera 56 of the user terminal 5, and photographs the documents prepared by the user (S101; photographing means 501).

[0062] When the user terminal 5 photographs a document, it performs image analysis of the photographed image and determines whether the photographed document is a document required for the procedure (S102). A template for the characteristics of the required document (e.g., a specific layout of lines, specific writing formed in a specific position, etc.) is stored in advance for each required document in the storage unit 52 of the user terminal 5, and the user terminal 5 can determine whether the photographed document is a required document based on whether the template can be extracted from the photographed image.

[0063] If the user terminal 5 determines that the photographed document is one of multiple required documents (S102; YES), it displays the photographed image 555 of the document in the image display area 554 of the corresponding required document (S103), as shown in FIG. 7(b).

[0064] When the user terminal 5 determines that the photographed document does not correspond to any of the plurality of required documents (S102; NO), it displays a warning to that effect on the display unit 55 and prompts the user to photograph the document again (S101).

[0065] Depending on the type of document required for the procedure, some documents may have a set expiration date (e.g., three months from the time of document creation). In this case, in S102, the creation date and time written in a predetermined position on the required document may be extracted from the photographed image 555, and the creation date and time may be compared with the current date and time to determine whether the document is usable (whether it is within the expiration date or not). In the example of FIG. 7(b), the determination result 556a ("Usable") and the expiration date 556b determined from the creation date and time are displayed together with the photographed image 555. If the document is unusable, a warning to that effect may be displayed on the display unit 55 in the same manner as above, and the user may be prompted to prepare a necessary document within the expiration date and take another photograph (S101).

[0066] The user terminal 5 repeats the processes of S101 to S103 until all necessary documents required for the procedure have been photographed (S104; NO), and when all necessary documents have been photographed (S104; YES), as shown in FIG. 7(c), a message 558 is displayed on the display unit 55 to indicate that all necessary documents have been collected, and an application button 557 for applying for the procedure is displayed in place of the photograph button 552.

[0067] When the user selects the application button 557, the user terminal 5 displays a photographing screen (not shown) for photographing a facial image of the user on the display unit 55. The user terminal 5 activates the camera 56 in response to a user's operation on the photographing screen, and photographs an image of the user's face (S105; photographing means 501).

[0068] The user terminal 5 also displays an input screen (not shown) on the display unit 55 and accepts input of user information required for application and a password (referred to as user information, etc.) (S106). The above user information is, for example, the user's address, name, email address, etc.

[0069] Then, the user terminal 5 transmits the user's face image, image information of the photographed image 555 of the necessary document, the above user information and password as application information required for the application to the reception device 3 (S107; application information transmission means 502), and applies for the procedure. The above image information is, for example, the file name, file size, photographed date and time, photographed position, etc. of the photographed image, and can be obtained from the EXIF ​​data included in the photographed image 555.

[0070] The reception device 3 receives the application information (S108; application information receiving means 301) and accepts the application. Then, the reception device 3 issues a reservation code for performing online procedures at the ID photo machine 2 and transmits it to the user terminal 5 (S109; key information transmitting means 302). The user terminal 5 receives the reservation code (S110; key information receiving means 503).

[0071] The reservation code is key information used for the online procedure at the ID photo machine 2, such as the application reception number. The reception device 3 transmits the reception number or the reception number encoded as a barcode or two-dimensional code to the user terminal 5 in S109. In addition, the reception device 3 can also transmit to the user terminal 5 the expiration date for which the online procedure can be performed at the ID photo machine 2, etc.

[0072] As shown in FIG. 8, the reservation code 101 issued by the reception device 3 is linked to feature amount 102 calculated from the user's facial image received in S108, image information 103 of the photographed image 555 of the necessary document received in S108, user information 104, password 105, etc., and registered as application information 100 in the database of the memory unit 32 of the reception device 3.

[0073] The above-described determination result of whether the document can be used and the expiration date obtained from the creation date and time of the document may be transmitted from the user terminal 5 and registered as the application information 100. The application information 100 registered in the database also includes a provisional registration number 106, an identification card image 107, and a photographed image 555 of the required document, which will be described later, but these pieces of information are not registered at this point.

[0074] The user can then go to the ID photo machine 2 at a convenient time and date to have their identity verified.

[0075] (3-2. Identity Verification, etc.) Fig. 9 is a flow chart showing the processing when identity verification etc. is performed from the ID photo machine 2. S201-S202, S206-S207, and S212-S213 in Fig. 9 are executed by the control device 20 of the ID photo machine 2 controlling the respective parts of the ID photo machine 2, and S203-S205, S208, S2111, and S214-S216 are executed by the control unit 31 of the reception device 3 controlling the respective parts of the reception device 3. The remaining processing is executed by the control unit 51 of the user terminal 5 controlling the respective parts of the user terminal 5.

[0076] When a user enters the ID photo machine 2, the user selects "Online Procedure" from the menu displayed on the menu screen (not shown) of the display unit 21, and then selects the type of procedure. Then, the display screen shown in Fig. 10(a) is displayed on the display unit 21 of the ID photo machine 2. Note that the ID photo machine 2 continues to capture a video of the face of the user operating the display unit 21 using the imaging unit 23.

[0077] On the display screen of FIG. 10(a), a user can select by pressing a button 211 corresponding to each option whether he / she has a reservation code 101 or whether he / she wishes to make various inquiries with the store.

[0078] When the user selects button 211 indicating that he / she has the reservation code 101, an input area 212 for the reservation code 101 and a selection button 213 for the store to be used are displayed on the display unit 21 of the ID photo machine 2, as shown in Fig. 10(b). The user inputs the reservation code 101 in the input area 212, and selects the store to be used with the selection button 213. If the reservation code 101 has been transmitted to the user terminal 5 as a barcode or two-dimensional code, it is also possible to read the reservation code 101 using a code reader (reading unit 26) provided in the ID photo machine 2.

[0079] The ID photo machine 2 accepts input of the reservation code 101, etc. (reservation code 101 and the store where the reservation is used) and acquires the reservation code 101, etc. (S201; acquisition means 201). Then, the ID photo machine 2 cuts out a face image of the user from one frame (still image) of the video captured by the image capture unit 23, and transmits the face image of the user together with the reservation code 101, etc. as personal identification information to the reception device 3 (S202; image capture means 202, personal identification information transmission means 204).

[0080] The reception device 3 receives the user's face image and reservation code 101, etc. (S203; identity verification information receiving means 303), and performs identity verification processing based on the face image received from the user terminal 5 and the face image received from the ID photo machine 2 (S204; identity verification means 304). More specifically, features are calculated from the face image received from the ID photo machine 2, and compared with the features 102 registered as the application information 100 (feature features 102 of the face image received from the user terminal 5). Then, it is determined whether or not they match. Note that the user may input a password 105 together with the reservation code 101 into the ID photo machine 2, and the reception device 3 may determine whether or not the combination of the input reservation code 101 and password 105 is registered as the application information 100 as part of identity verification.

[0081] When the above feature amounts match and identity verification is complete, the reception device 3 transmits a message to the effect that verification is complete to the ID photo machine 2 (S205). If identity verification is unsuccessful (the feature amounts do not match), a message to that effect is transmitted to the ID photo machine 2, and a message to the effect that identity verification has failed is displayed on the display unit 21 of the ID photo machine 2.

[0082] When the ID photo machine 2 receives a notification of completion of the confirmation from the reception device 3 (S206), it connects online to the store terminal 4 of the selected store (S207), enabling a video call with the receptionist at the store as shown in Fig. 10(c). The user can talk to the receptionist, receive an explanation of the procedure, set the date and time of visit, etc.

[0083] During this process, as shown in FIG. 10(d), an instruction 214 is displayed on the display unit 21 to start up a dedicated application on the user terminal 5 and to transmit a photographed image 555 of the necessary document.

[0084] The user starts the dedicated application by operating the user terminal 5. At this time, communication is performed between the user terminal 5 and the reception device 3, and the reception device 3 transmits a notification of permission to transmit the document to the user terminal 5 (S208).

[0085] When the user terminal 5 receives the permission notification (S209), it displays a document image transmission screen shown in Fig. 7(d) on the display unit 55. On the document image transmission screen, a send button 559 is displayed instead of the application button 557 in Fig. 7(c), and the user selects the send button 559 according to the above-mentioned instruction 214. Then, the user terminal 5 transmits the photographed images 555 (document images) of each required document to the reception device 3 (S210; document image transmission means 504).

[0086] When the reception device 3 receives the photographed image 555 of each required document (S211; document image receiving means 305), the reception device 3 additionally registers the received photographed image 555 as the application information 100 described above.

[0087] Here, the reception device 3 may compare image information included in the EXIF ​​data of the received captured image 555 with the image information 103 of the application information 100, and confirm whether the captured image 555 of the necessary document taken by the user in the above-mentioned S101 (see FIG. 6) matches the captured image 555 received in S211. Alternatively, the reception device 3 may perform a determination similar to that in the above-mentioned S102 (see FIG. 6) on the captured image 555 received in S211, and confirm again that it is the captured image 555 of the necessary document. If these confirmations fail, a message to that effect may be transmitted to the user terminal 5 or the ID photo machine 2, and an instruction to transmit the captured image 555 again may be displayed.

[0088] The ID photo machine 2 further displays instructions 215 to scan the identification card on the display unit 21, as shown in Figure 10(e). The user follows the instructions 215 to have the ID photo machine 2 scan the driver's license or other identification card.

[0089] The ID photo machine 2 scans the face of the identification card using the reading unit 26, acquires an image of the face of the identification card (S212; reading means 203), and transmits the image of the face of the identification card to the reception device 3 as identification information (S213; identification information transmission means 204).

[0090] The reception device 3 receives the image of the face of the identification card (S214; identification information receiving means 303), and performs identity verification again using the image of the face of the identification card (S215; identification means 304). The information written on the face of the identification card includes user information such as the user's name and address, and in S215, the information written on the face obtained by OCR processing of the image of the face of the card is compared with the user information 104 in the application information 100 (user information 104 received from the user terminal 5). If the identification card includes a face image, it is also possible to calculate a feature amount from the face image extracted from the image of the face of the card, and compare it with the feature amount 102 in the application information 100.

[0091] If these comparison targets match, identity verification is completed, and the reception device 3 issues a temporary registration number as user identification information for identifying the user before the procedure at the store, and transmits it to the user terminal 5 (S216; identification information transmitting means 306). The user terminal 5 receives the temporary registration number (S217; identification information receiving means 505), and ends the process.

[0092] If the identity verification in S215 fails (if the comparison targets do not match), a message to that effect is sent to the ID photo machine 2, and a message to that effect can be displayed on the display unit 21 of the ID photo machine 2. In addition, the provisional registration number issued by the reception device 3 and the image of the face of the identity verification card received in S214 are additionally registered as the provisional registration number 106 and the identity verification card image 107 in the application information 100.

[0093] Furthermore, a message that temporary registration number 106 has been sent to user terminal 5 can be sent from reception device 3 to photo ID machine 2, and a message 216 that indicates that temporary registration number 106 has been sent to user terminal 5 can be displayed on display 21 of photo ID machine 2 as shown in Fig. 10(f). A similar message is also sent to store terminal 4, and the receptionist at the store informs the user of the necessary matters when the user visits the store (such as "Please bring the necessary documents and identification card with you when you visit the store"), and the process ends.

[0094] Thereafter, the user goes to the store, presents the temporary registration number 106, and completes the remaining required procedures with the store receptionist. The store terminal 4 can also perform additional identity verification by calculating a feature amount from a face image of the user captured by a photographing device (not shown) in the store and comparing the feature amount with the feature amount 102 of the application information 100 corresponding to the temporary registration number 106. The above-mentioned password 105 may be input by the user and used for identity verification.

[0095] The receptionist can also determine the authenticity of the necessary paper documents brought by the user and visually check whether they match the photographed image 555 of the application information 100. Similarly, the receptionist can also determine the authenticity of the identification card brought by the user and visually check whether they match the identification card image 107 of the application information 100.

[0096] As described above, according to this embodiment, the user can transmit application information from the user terminal 5 and perform identity verification from the ID photo machine 2 as an online procedure. Each procedure can be simplified compared to performing these procedures all at once, and the user can perform each procedure in a short time when he or she feels like it on a convenient date. This reduces the time and psychological burden on the user required for online procedures. Furthermore, since some of the procedures at the store, such as inputting application information and identity verification, are performed online in advance, the time required for the procedures at the store can be shortened.

[0097] In addition, the user terminal 5 can transmit the image information 103, etc. to the reception device 3 only when all the photographed images 555 of the necessary documents have been photographed, so it is confirmed that the necessary documents are prepared on the user's side as a prerequisite for the procedure, and there is no need to go to the store and find out that the necessary documents are not prepared when the user visits the store to carry out the procedure, and it is no longer necessary to go to the store again with the necessary documents. In addition, since the necessary documents are checked automatically, the burden of checking on the user is also reduced.

[0098] In addition, in this embodiment, when performing online procedures using the ID photo machine 2, a photographed image 555 of the necessary document can be sent in advance from the user terminal 5 to the reception device 3 as information necessary for the procedure, thereby shortening the time required for the procedure at the store.

[0099] Furthermore, in this embodiment, when carrying out online procedures using the passport photo machine 2, identity verification is performed using not only the user's face image but also their identity card, thereby enabling more rigorous identity verification during the procedures.

[0100] However, the present invention is not limited to the above embodiment. For example, in this embodiment, the ID photo machine 2 is used as the online procedure device, but the online procedure device is not limited to this, and may be any device that can communicate with the reception device 3 and the store terminal 4 and has functions necessary for online procedures such as a facial image capture function. In addition, the user's signature may be input on the display unit 21 of the ID photo machine 2 during online procedures, and this may be registered as application information 100 so that it can be used for identity verification at the store.

[0101] Furthermore, when applying for the online procedure using the user terminal 5, it may be possible to specify which ID photo machine 2 (online procedure device) to use for the online procedure. In this case, even if the reservation code 101 is entered in any ID photo machine 2 other than the specified one, the process related to the online procedure will not proceed.

[0102] In addition, in this embodiment, it is assumed that there are procedures to be carried out at a store, and some of these procedures are replaced by online procedures. However, it is also possible to complete all procedures solely through online procedures without having to go to a store.

[0103] Although the preferred embodiment of the present invention has been described above with reference to the accompanying drawings, the present invention is not limited to the above examples. It is clear that a person skilled in the art can come up with various modified or altered examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally belong to the technical scope of the present invention. [Explanation of symbols]

[0104] 1: Online application system 2: ID photo machine 3: Reception device 4: Store terminal 5: User terminal 100: Application information 101: Reservation code 102: Features 103: Image information 104: User information 105:Password 106:Temporary registration number 107: ID image 201: Acquisition method 202: Shooting method 203: Reading means 204: Personal identification information transmission means 301: Application information receiving means 302: Key information transmission means 303: Personal identification information receiving means 304: Identity Verification Method 305: Document image receiving means 306: Identification information transmission means 501: Shooting method 502: Application information transmission means 503: Key information receiving means 504: Document image transmission means 505: Identification information receiving means

Claims

1. An online procedure system having a user terminal, an online procedure device, and a reception device, The user terminal, An image capturing means for capturing an image of a user's face and a document required for a procedure at a store; application information transmitting means for transmitting the face image and user information to the reception device as application information; a key information receiving means for receiving, from the reception device, key information for performing an online procedure at the online procedure device after transmitting the application information to the reception device; an identification information receiving means for receiving user identification information for performing a procedure at a store from the reception device when performing an online procedure at the online procedure device; having The online procedure device includes: An acquisition means for acquiring the key information; An image capturing means for capturing a face image of a user; a personal identification information transmitting means for transmitting a face image of the user to the reception device as personal identification information; having The application information transmitting means further transmits image information of the photographed image, rather than the photographed image of the document, to the reception device as the application information; the user terminal performs image analysis of the photographed image of the document, determines whether the photographed document is a document necessary for the procedure at the store, and is capable of transmitting the image information to the reception device only when all photographed images of the documents necessary for the procedure at the store have been photographed; The online procedure system is characterized in that the reception device has an identity verification means for performing identity verification processing based on the facial image received from the user terminal and the facial image received from the online procedure device.

2. 2. The online procedure system according to claim 1, wherein the user terminal has a document image transmission means for transmitting a photographed image of the document to the reception device during online procedure at the online procedure device.

3. The online procedure system described in Claim 2, characterized in that the reception device compares the image information of the captured image received from the user terminal during online procedure with the image information received from the user terminal before performing online procedure.

4. An online procedure system as described in any one of claims 1 to 3, characterized in that the user terminal extracts the creation date and time of the document from a photographed image of the document, and determines whether the document is within its expiration date by comparing the creation date and time with the current date and time.

5. The online procedure device is a photo ID machine having a reading means for acquiring an image of the face of a user's identification card, the identity verification information transmitting means transmits the image of the face of the card to the reception device as identity verification information; An online procedure system as described in any one of claims 1 to 4, characterized in that the identity verification means compares the information written on the face of the identity verification card obtained from the face image with the user information received from the user terminal.

6. An online procedure system as described in any one of claims 1 to 5, characterized in that the online procedure device is connected online to a store terminal and enables a video call between the user and the receptionist at the store where the procedure is performed.

7. The online procedure system described in Claim 6, characterized in that the online procedure device accepts the selection of the store at which the procedure will be performed.

8. A user terminal used by a user who performs online procedures using an online procedure device communicably connected to the reception device, an image capturing means for capturing an image of a user's face used for identity verification during online processing at the online processing device and a document required for the processing at the store; application information transmitting means for transmitting the face image and user information to the reception device as application information; a key information receiving means for receiving, from the reception device, key information for performing an online procedure at the online procedure device after transmitting the application information to the reception device; an identification information receiving means for receiving user identification information for performing a procedure at a store from the reception device when performing an online procedure at the online procedure device; having The application information transmitting means further transmits image information of the photographed image, rather than the photographed image of the document, to the reception device as the application information; The user terminal performs image analysis of the captured image of the document, determines whether the captured image of the document is necessary for the procedure at the store, and is only able to transmit the image information to the reception device once all images of the documents necessary for the procedure at the store have been captured.

9. A user terminal used by a user who performs an online procedure using an online procedure device connected to a reception device so as to be capable of communicating with the reception device, the user terminal having an image capturing means for capturing an image of the face of the user used for identity verification during the online procedure using the online procedure device and a document required for the procedure at a store, application information transmitting means for transmitting the face image and user information to the reception device as application information; a key information receiving means for receiving, from the reception device, key information for performing an online procedure at the online procedure device after transmitting the application information to the reception device; an identification information receiving means for receiving user identification information for performing a procedure at a store from the reception device when performing an online procedure at the online procedure device; having The application information transmitting means further transmits image information of the photographed image, rather than the photographed image of the document, to the reception device as the application information; The user terminal is a program for functioning as a user terminal, which performs image analysis of the captured image of the document, determines whether the captured image is a document necessary for the procedure at the store, and is only able to transmit the image information to the reception device once all images of the documents necessary for the procedure at the store have been captured.

Images