Method and system for authenticating user and computer-readable recording medium

Abstract

The present invention relates to a method and system for authenticating a user and a computer-readable recording medium. The user authentication method comprises: a sending step, sending multiple instructions for the user to perform multiple actions to a user terminal; a receiving step, receiving videos shot corresponding to the multiple instructions from the user terminal; a determining step, determining whether the user exists in the video; and an authenticating step, authenticating the user based on the face of the user extracted from the video when it is determined that the user exists.

Description

Technical Field

[0001] The present invention relates to a user authentication method and system, and in particular to the following method and system, which can receive a video shot by a user terminal, analyze the received video to determine whether a user exists in the video, and process the user's authentication. Background Art

[0002] With the spread of mobile devices such as smartphones and the development of the Internet, financial services and settlement services using mobile devices are widely used. In order to use such financial and settlement services, real-name authentication of users may be required. However, due to the sharp increase in the number of users of such services and the limited resources of institutions providing authentication services, the provision of real-name authentication services through face-to-face real-name authentication may be limited. As a result, services for authenticating users through non-face-to-face real-name authentication have recently been actively developed in the field of image processing and recognition. For example, facial information of a user extracted from an image taken with a camera can be used for user authentication.

[0003] However, compared with face-to-face real-name authentication, this non-face-to-face real-name authentication is difficult to confirm whether it is the actual person, so there is a side effect that someone else may impersonate the person. For example, there may be a problem of using a photo or paper printed with the same person as the ID card of another person to determine that the person is the same person. In addition, when non-face-to-face real-name authentication is performed in a client device, when the real-name authentication result processed by the client device is transmitted to the system requiring real-name authentication, there may be a disadvantage that different real-name results are transmitted through cracking. Furthermore, even if image recognition and processing for non-face-to-face real-name authentication are performed in a server device, the image sent from the client for non-face-to-face real-name authentication may change due to eavesdropping and hacking of information transmission and reception. Summary of the invention

[0004] The present invention provides a user authentication method, a recording medium storing a computer program, and a system for solving the above-mentioned problems.

[0005] The present invention provides the following user authentication method and system, namely, in response to multiple instructions guiding a user to perform multiple actions, receiving a video shot corresponding to the multiple instructions from a user terminal, determining whether the user exists in the video, and if it is determined that the user exists, authenticating the user based on the user's face extracted from the video.

[0006] The present invention provides the following user authentication method and system, that is, during the user authentication process, the video shot by the camera is received from the user terminal in real time and continuously.

[0007] The present invention can be implemented in numerous ways, including methods, systems, or computer-readable storage media storing a plurality of instructions.

[0008] A user authentication method according to an embodiment of the present invention includes: a sending step of sending a plurality of instructions for causing a user to perform a plurality of actions to a user terminal; a receiving step of receiving a video shot corresponding to the plurality of instructions from the user terminal; a determining step of determining whether a user exists in the video; and an authentication step of authenticating the user based on the user's face extracted from the video when it is determined that the user exists.

[0009] According to an embodiment, the step of receiving videos shot corresponding to the plurality of instructions from the user terminal includes: receiving the videos from the user terminal in real time through a channel used for communicating with the user terminal.

[0010] According to an embodiment, the video is continuously received via a channel used for communicating with the user terminal.

[0011] According to one embodiment, the step of determining whether there is a user in the video includes the following steps: determining whether the user performs multiple actions corresponding to multiple instructions in the video by analyzing the video; and in the case where it is determined that the user performs multiple actions corresponding to the multiple instructions, determining that the user exists in the captured video.

[0012] According to one embodiment, the step of receiving videos shot in response to multiple instructions from a user terminal includes the following steps: receiving a face-related video shot in response to an instruction guiding the shooting of the user's face from the user terminal; receiving an ID card-related video shot in response to an instruction guiding the shooting of the user's ID card from the user terminal, and the step of authenticating the user includes: a first information extraction step of extracting first information related to the user's face from the face-related video; a second information extraction step of extracting second information related to the user's face from the ID card-related video; a comparison step of comparing the extracted first information and the extracted second information; and a step of authenticating the user when the extracted first information and the extracted second information are similar.

[0013] According to an embodiment, the plurality of instructions include an instruction to capture a frontal view of the user's face.

[0014] According to one embodiment, multiple instructions include instructions for guiding the movement of a user's ID card, and the step of receiving a video related to the ID card includes: receiving a video of the user's ID card taken according to the instructions from a user terminal, and the step of authenticating the user includes: determining whether the user's ID card exists in the video based on the movement of the user's ID card obtained by analyzing the above video.

[0015] According to one embodiment, the ID card-related video includes a video that captures at least a portion of a user and the user's ID card together, and the step of receiving the ID card-related video includes the following steps: receiving an area including at least a portion of the user from a user terminal through a first channel; and receiving an area including the user's ID card from the user terminal through a second channel.

[0016] According to one embodiment, the step of sending multiple instructions for the user to perform multiple actions to the user terminal includes: a selection step of randomly selecting multiple instructions from a plurality of predetermined instruction candidates; and a sending step of sending the randomly selected multiple instructions to the user terminal.

[0017] According to one embodiment, the step of sending multiple instructions to a user terminal for causing a user to perform multiple actions includes: sending a first instruction to the user terminal for causing the user to perform a first action, the step of receiving from the user terminal a video shot corresponding to the multiple instructions includes: receiving from the user terminal a video shot corresponding to the first instruction, and the step of determining whether there is a user in the video includes: analyzing the video shot corresponding to the first instruction to determine whether the user performs the first action in response to the first instruction.

[0018] According to one embodiment, the step of sending multiple instructions to a user terminal to enable a user to perform multiple actions also includes: when it is determined that the user performs a first action, sending a second instruction to the user terminal to enable the user to perform a second action, the step of receiving videos shot corresponding to the multiple instructions from the user terminal also includes: receiving a video shot corresponding to the second instruction from the user terminal, and the step of determining whether the user exists in the video also includes: analyzing the video shot corresponding to the second instruction to determine whether the user performs the second action in response to the second instruction.

[0019] According to one embodiment, the step of sending multiple instructions to a user terminal to enable the user to perform multiple actions also includes: when it is determined that the user does not perform the first action, sending a third instruction to the user terminal to enable the user to perform a third action, the third instruction being selected based on the differences between the user's action obtained from an analysis of a video shot corresponding to the first instruction and the first action.

[0020] According to an embodiment, the present invention further includes: in a case where it is determined that the user does not perform the first action, communicating with the user terminal using a channel different from a channel used for communicating with the user terminal.

[0021] According to an embodiment, the step of sending a plurality of instructions for the user to perform a plurality of actions to the user terminal includes sending information related to a plurality of resolutions corresponding to the plurality of instructions together with the plurality of instructions to the user terminal.

[0022] According to an embodiment, the plurality of resolutions corresponding to the plurality of instructions include a resolution of each of a plurality of areas in a screen for displaying videos shot corresponding to the plurality of instructions.

[0023] According to one embodiment, the plurality of instructions include an instruction for guiding the photographing of at least a portion of the user and the user's ID card, and the resolution of the area for guiding the photographing of the user's ID card is set to be higher than the resolution of the area for guiding the photographing of at least a portion of the user.

[0024] According to an embodiment, the step of sending a plurality of instructions for the user to perform a plurality of actions to the user terminal includes sending information related to a transmission speed corresponding to each of the plurality of instructions together with the plurality of instructions to the user terminal.

[0025] The present invention provides a computer-readable recording medium recording a computer program for executing the user authentication method according to an embodiment of the present invention in a computer.

[0026] A user authentication system according to an embodiment of the present invention includes: a communication module, which sends multiple instructions to a user terminal for causing a user to perform multiple actions, and receives videos shot corresponding to the multiple instructions from the user terminal; a memory; and at least one processor, wherein the at least one processor is connected to the memory and is configured to execute multiple computer-readable instructions contained in the memory, and the at least one processor is further configured to determine whether a user exists in the video, and if it is determined that the user exists, authenticate the user based on the user's face extracted from the video.

[0027] According to an embodiment, the communication module is further configured to receive video in real time from the user terminal through the channel used for communicating with the user terminal.

[0028] According to some embodiments of the present invention, the video received from the user terminal can be analyzed to determine whether the user exists, and user authentication is performed when it is determined that the user exists, thereby preventing the phenomenon of using the user's printed photos or papers for user authentication.

[0029] According to some embodiments of the present invention, a video received in real time may be analyzed to provide a user authentication service, thereby solving the problem of images or videos being processed in the process of authenticating a user.

[0030] According to some embodiments of the present invention, the user authentication system can analyze the video received in real time from the user terminal to perform user authentication, and thus, the user authentication service can be provided through an application and a web browser that provide the user authentication service.

[0031] The effects of the present invention are not limited to the effects mentioned above, and those skilled in the art (hereinafter referred to as "technical personnel in the field") to which the present invention belongs can clearly understand other effects not mentioned from the description of the scope of protection claimed in the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Embodiments of the present invention will be described with reference to the accompanying drawings described below, wherein like reference numerals denote like structural elements, but are not limited thereto.

[0033] Figure 1 An exemplary diagram of a video showing the user's actions in accordance with instructions displayed on a user terminal during a user authentication process according to an embodiment of the present invention.

[0034] Figure 2 An exemplary diagram of a video showing the user's actions according to instructions displayed on a user terminal during a user authentication process according to another embodiment of the present invention.

[0035] Figure 3 The present invention is a simplified diagram showing a structure in which a user authentication system is connected to a plurality of user terminals in a manner that enables communication in order to provide a user authentication service according to an embodiment of the present invention.

[0036] Figure 4 A block diagram showing the internal structure of a user terminal and a user authentication system according to an embodiment of the present invention.

[0037] Figure 5 FIG. 4 is a block diagram showing the structure of a user authentication system according to an embodiment of the present invention.

[0038] Figure 6 The figure is a flow chart showing a user authentication method according to an embodiment of the present invention.

[0039] Figure 7 The figure is a diagram showing an image analysis model for inferring or outputting action execution results based on an input image according to an embodiment of the present invention.

[0040] Figure 8 The diagram is an example of authenticating a user based on a video of the user's actions according to a plurality of instructions according to an embodiment of the present invention.

[0041] Fig. 9 FIG. 1 is a diagram showing an exemplary instruction information database according to an embodiment of the present invention.

[0042] Fig.10 A diagram showing an example of selecting different instructions according to whether a user performs an action through a user authentication system according to an embodiment of the present invention.

[0043] Fig.11The figure is an example diagram showing a screen for capturing a user's action in response to an instruction according to an embodiment of the present invention.

[0044] Fig.12 This is an illustrative diagram showing a screen for capturing a user's action in response to an instruction according to another embodiment of the present invention.

[0045] Fig.13 This is a diagram showing an example of a screen for capturing a user's action in response to an instruction according to still another embodiment of the present invention.

[0046] Fig.14 The figure is an example diagram showing that a user and his / her ID card are photographed together in response to an instruction according to an embodiment of the present invention.

[0047] Fig.15 The diagram is an example of a movement of photographing an ID card in response to an instruction in order to confirm whether the ID card of the user exists in accordance with an embodiment of the present invention.

[0048] Description of Reference Numerals

[0049] 100, 100_1, 100_2, 100_3: User terminals

[0050] 110: Camera

[0051] 120: User

[0052] 300: User authentication system

[0053] 310: Network

[0054] 412, 438: Communication module

[0055] 414, 434: Processor

[0056] 416, 436: Memory

[0057] 418, 432: Input and output interfaces

[0058] 420: Input and output devices

[0059] 510: Instruction processing module

[0060] 520: Image extraction module

[0061] 530: Image analysis module

[0062] 540: Authentication module DETAILED DESCRIPTION

[0063] Hereinafter, the specific contents of the embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, in the following description, if it is judged that the gist of the present invention is unclear, the specific description related to the well-known function or structure will be omitted.

[0064] In the accompanying drawings, the same or corresponding structural elements are given the same reference numerals. In addition, in the process of describing the following embodiments, repeated descriptions of the same or corresponding structural elements will be omitted. However, even if the technology related to the structural element is omitted, such structural element will be included in the embodiments.

[0065] The advantages, features and methods of achieving the disclosed embodiments will be described in detail with reference to the accompanying drawings. Figure 1 However, the present invention is not limited to the embodiments disclosed below, but can be implemented in many different forms. However, the embodiments are provided to complete the present invention and to inform the technicians in the technical field of the present invention of the full scope of the present invention.

[0066] The terms used in this specification are briefly described, and the disclosed embodiments are specifically described. The terms used in this specification take into account the functions in the present invention and select the currently widely used general terms as much as possible, but this may change according to the intention, conventions and the advent of new technologies in the technical field to which the present invention belongs. In addition, in certain cases, there are terms that the applicant selects at will. In this case, their meanings are described in detail in the corresponding description part of the present invention. Therefore, the terms used in the present invention are not simple term names, but are defined based on the meanings of the above terms and the overall content of the present invention.

[0067] In this specification, unless the context clearly specifies that it is singular, the expression in the singular includes the expression in the plural. Also, unless the context clearly specifies that it is plural, the expression in the plural includes the expression in the singular. Throughout the specification, when a part is said to "include" other structural elements, unless there is a special description to the contrary, it means that other structural elements may also be included, and does not mean that other structural elements are excluded.

[0068] Furthermore, the terms "module" or "unit" used in the specification mean software or hardware structural elements, and the "module" or "unit" performs a function. However, the "module" or "unit" is not limited to software or hardware. The "module" or "unit" can be configured to be stored in an addressable storage medium, or can be configured to enable one or more processors to work. Therefore, as an example, the "module" or "unit" may include at least one of the structural elements, processors, functions, attributes, processes, subroutines, program code segments, drivers, firmware, microcodes, circuits, data, databases, data structures, tables, arrays, and variables such as software structural elements, object-oriented software structural elements, class structural elements, and task structural elements. The functions provided in the structural elements and "modules" or "units" can be combined into a smaller number of structural elements and "modules" or "units" or can be separated into additional structural elements and "modules" or "units".

[0069] According to one embodiment of the present invention, a "module" or "unit" can be implemented as a processor and a memory. "Processor" should be interpreted as a broad meaning including a general-purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, etc. In multiple environments, a "processor" may also refer to an application-specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc. For example, a "processor" may also refer to a combination of a digital signal processor and a microprocessor, a combination of multiple microprocessors, a combination of more than one microprocessor combined with a digital signal processor core, or a combination of processing devices such as a combination of any other structures. In addition, "memory" should be interpreted as a broad meaning including any electronic component that can store electronic information. "Memory" may also refer to a random access memory (RAM), a read-only memory (ROM), a non-volatile random access memory (NVRAM), a programmable read-only memory (PROM), an electrically programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory, a magnetic or optical data storage device, and various types of processor-readable media such as registers. If the processor reads information from the memory or records information in the memory, the memory is in a state of electronic communication with the processor. Memory integrated with the processor is in electronic communication with the processor.

[0070] In the present invention, the "system" may include at least one of a server device and a cloud device, but is not limited thereto. For example, the system may be composed of one or more server devices. As another example, the system may be composed of one or more cloud devices. As another example, the system may be composed of a server device and a cloud device to operate.

[0071] In the present invention, an “image” may include one or more images, or may be a video including a plurality of images.

[0072] In the present invention, a "video" may be an image including multiple images captured by a camera and one or more objects in the images move. For example, a video may include all images captured in a user terminal. As another example, a video may include an image and / or a portion of an image corresponding to a frame extracted from an image captured by a user terminal. The number of frames or images extracted from an image captured by a user terminal may be adjusted.

[0073] In the present invention, "video recording the user's actions" includes video recording the user's actions performed using his / her own body and / or an object. For example, the user's own body may include face, hands, arms, legs, etc. Also, an object may be an object that the user holds with his / her hands and performs any actions on, for example, may include an ID card, etc., but is not limited thereto.

[0074] In the present invention, "determining whether a user exists" may include determining whether a user actually exists. For example, whether a user exists in a video shot corresponding to a plurality of instructions may be whether a user shot in the video actually exists. In particular, in the case where a user image or a shot image, paper, video, etc. is shot by a user terminal, but not the actual user, it may be determined that the user does not exist.

[0075] In the present invention, "real-time reception" may be receiving data at the same time as the data occurs. According to one embodiment, real-time reception of the captured video may be receiving the captured video immediately after the video is captured by the image sensor. For example, the user authentication system receiving the captured video from the user terminal in real time may be sending the video to the user authentication system immediately after the video is captured by the user terminal, and the user authentication system receiving the captured video from the user terminal. Wherein, when the user terminal sends to the user authentication system, the video capturing / processing time of the user terminal and / or the communication delay provided from the user terminal to the user authentication system may occur, and the video received after such video capturing / processing time and / or any communication delay time is also regarded as real-time reception.

[0076] In the present invention, "identity card" may be a document or card that proves the identity or personal information of an individual or user. For example, the identity card may be a resident registration card, a social security card, a driver's license, a passport, a student ID card, a disability card, etc., but is not limited thereto.

[0077] In the present invention, "similar" may include all meanings of the same or similar. For example, two pieces of information being similar may mean that the two pieces of information are the same or similar.

[0078] In the present invention, a "channel" may be a path for any information and / or data to be communicated between two devices. For example, a channel used for communication between a user authentication system and a user terminal may be a path for any information and / or data to be communicated between the user authentication system and the user terminal.

[0079] In the present invention, "user" and "user terminal" are used differently, but a user may be a user terminal, and conversely, a user terminal may also be a user.

[0080] Figure 1 This is an example diagram of a video of imaging the user's actions according to the received instructions in the process of authenticating the user 120 according to an embodiment of the present invention. The user 120 may receive a request for personal authentication or real-name authentication of the user 120 through the user terminal 100 for the service used by the user. The service may include any service that the user terminal 100 can execute through a web browser and / or an application, such as payment service, credit card service, bank service, virtual currency service, etc., but is not limited thereto.

[0081] According to one embodiment, when user 120 joins the system that provides the service that he / she uses or when he / she loses his / her account number and / or password, he / she may receive such a user authentication request from the user authentication system. For example, such a user authentication system may be provided together with the system that provides the service. As another example, the user authentication system may be provided separately from the system that provides the service.

[0082] The user authentication system may be configured to receive a video of at least a portion of the user captured from the user terminal 100. The video may be imaged or captured by a camera attached to the user terminal 100 or connected by wire or wirelessly. According to one embodiment, as shown in the figure, the camera 110 may be attached to the front face of the user terminal 100. In this case, the camera 110 may capture the actions performed by the user viewing the front face of the user terminal 100, and the captured video may be transmitted to the user authentication system. For example, the user authentication system may receive a video of the user's actions captured in real time from the user terminal 100.

[0083] The user authentication system may be configured to receive a video of at least a portion of the user captured from the user terminal 100, and may determine whether the user exists in the received video. According to one embodiment, the user authentication system may transmit one or more instructions to the user terminal 100, and the transmitted one or more instructions may be output to the user terminal 100. For example, as shown in the figure, the user terminal 100 may receive an instruction of "Please make a V sign" from the user authentication system 300, and may display such an instruction on the display of the user terminal 100. Among them, the received instruction may be displayed in an area different from the area where the captured video is displayed.

[0084] In response to the instruction received by the user terminal 100, the user can perform the action guided by the instruction, and the action of the user can be captured by the camera 110 and transmitted to the user authentication system. For example, as shown in the figure, the user 120 can make a V shape with his right hand according to the instruction of "please make a V shape", and this action can be captured by the camera 110. The video captured in the user terminal 100 can be transmitted to the user authentication system in real time. The user authentication system can determine whether the user exists in the video received in real time from the user terminal 100.

[0085] Figure 2 1 is an example diagram of a video of imaging the user's actions according to an instruction displayed on the user terminal 100 in the process of authenticating the user 120 according to another embodiment of the present invention. When it is determined that the user 120 exists, the user authentication system may send an instruction to the user terminal 100 to require the user 120 to show his / her ID card so that the camera 110 can take the photo. According to another embodiment, in the process of determining whether the user exists, the user terminal 100 may receive such an instruction to require the user's ID card to be shown from the user authentication system 300. Such an instruction may be output to the user terminal 100, for example, as shown in the figure, an instruction "Please show your ID card (surface)" may be displayed on the display of the user terminal 100. Among them, the received instruction may be displayed in an area different from the area where the video taken is displayed.

[0086] In response to such an instruction, the user 120 raises his / her ID card in his / her hand to show it so that his / her ID card is photographed by the camera 110. The video of the ID card of the user 120 can be transmitted to the user authentication system 300. For example, as shown in the figure, in the process of photographing at least a part of the user 120, the ID card of the user can be photographed together. The above-mentioned image can be transmitted to the user authentication system 300 immediately after being photographed by the camera, that is, in real time. In the present embodiment, it is shown in a manner that the face and ID card of the user 120 are photographed together, but it is not limited to this. Only the ID card of the user 120 can be photographed by the camera 110 and provided to the user authentication system 300. The user authentication system can use the video of the ID card photographed in this way to authenticate the user 120.

[0087] Figure 3A simplified diagram of a structure in which a user authentication system 300 is connected in a manner capable of communicating with multiple user terminals 100_1, 100_2, and 100_3 in order to provide a user authentication service according to an embodiment of the present invention. The user authentication system 300 may include a system capable of authenticating users of multiple user terminals 100_1, 100_2, and 100_3 through a network 310. According to an embodiment, the user authentication system 300 may include a computer executable program (e.g., a downloadable application) related to the user authentication service and one or more server devices and / or databases that can store, provide, and execute data, or one or more distributed computing devices and / or distributed databases based on cloud computing services. The user authentication service provided by the user authentication system 300 can be provided to users through an application or web server required by the user authentication service installed on multiple user terminals 100_1, 100_2, and 100_3. Among them, the server that manages the above application can request user authentication from the user authentication system 300 when receiving a user authentication request from multiple user terminals 100_1, 100_2, and 100_3. In this case, the user authentication system 300 is connected to the plurality of user terminals 100_1, 100_2, and 100_3 so as to be able to communicate with each other.

[0088] Multiple user terminals 100_1, 100_2, 100_3 can communicate with the user authentication system 300 through the network 130 in order to authenticate the user. According to one embodiment, multiple user terminals 100_1, 100_2, 100_3 can transmit videos captured by image sensors related to the user terminals 100_1, 100_2, 100_3 to the user authentication system 300. The captured video may include any information and / or data required for the authentication of the user. For example, the captured video may include information related to at least a part of the user (e.g., the user's face). As another example, the captured video may include information related to the user's ID card.

[0089] In order to authenticate the user, the multiple user terminals 100_1, 100_2, and 100_3 may send the video captured by the image sensor to the user authentication system 300 in real time through a channel capable of two-way communication. According to one embodiment, the user authentication system 300 may receive the video captured by the multiple user terminals 100_1, 100_2, and 100_3 through a Voice over Internet Protocol (VoIP) channel with the user terminal 100. According to another embodiment, the video captured in this way may be received from the user terminal 100 in real time through a broadcast channel. The broadcast channel may be generated by any method capable of two-way communication, for example, it may be generated by using Web Real-Time Communication (WebRTC), etc., but is not limited thereto.

[0090] The network 310 can be configured to enable communication between multiple user terminals 100_1, 100_2, 100_3 and the user authentication system 300. The network 310 can be configured according to the setting environment, for example, by a wired network such as Ethernet, power line communication, telephone line communication device and RS-serial communication, a wireless network such as a mobile communication network, a wireless LAN (Wireless LAN, WLAN), wireless fidelity (Wi-Fi), Bluetooth (Bluetooth) and cellular (ZigBee) or a combination thereof. In other words, the communication method is not limited to this, and can include a communication method using a communication network that the network 310 can include (as an example, a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) and short-range wireless communication between user terminals. For example, the network 310 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. Furthermore, the network 310 may include any one or more of a bus network, a star network, a ring network, a mesh network, a star bus network, a tree network, or a hierarchical network, but is not limited thereto.

[0091] Figure 3In the figure, as examples of user terminals, a portable terminal 100_1, a tablet terminal 100_2 and a personal computer terminal 100_3 are shown, but the present invention is not limited thereto. The user terminal may be any computing device capable of wired and / or wireless communication and having a user interface capable of receiving information related to user authentication from a user. For example, the user terminal may include a smart phone, a mobile phone, a navigator, a computer, a notebook computer, a digital broadcast terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet computer, a game console, a wearable device, an Internet of Things (IoT) device, a virtual reality (VR) device, an augmented reality (AR) device, etc. Furthermore, Figure 3 It is shown that three user terminals 100_1 , 100_2 , and 100_3 communicate with the user authentication system 300 through the network 310 , but the present invention is not limited thereto, and a different number of user terminals may communicate with the user authentication system 300 through the network 310 .

[0092] The user authentication system 300 may receive user authentication requests from a plurality of user terminals 100_1, 100_2, and 100_3 via the network 310. The received user authentication request may be stored in a storage medium related to the user authentication system 300 as user authentication information. The user authentication request may include user information that generates the user authentication request, a video of at least a portion of the user, a video of the user's ID card, etc., and may be requested when the user needs to authenticate himself for a specific service or product.

[0093] The user authentication system 300 can transmit multiple instructions to the user terminals 100_1, 100_2, and 100_3 through the network 310 to enable the users of the multiple user terminals 100_1, 100_2, and 100_3 to perform multiple actions. According to one embodiment, such multiple instructions can be transmitted to the multiple user terminals 100_1, 100_2, and 100_3 in real time. In response to such multiple instructions, the users of the multiple user terminals 100_1, 100_2, and 100_3 perform the actions represented by the corresponding instructions, and the video of the performed actions can be transmitted to the user authentication system 300 in real time. The video received in this way can be used to authenticate the users of the multiple user terminals 100_1, 100_2, and 100_3.

[0094] Figure 44 is a block diagram showing the internal structure of the user terminal 100 and the user authentication system 300 according to an embodiment of the present invention. The user terminal 100 may include a communication module 412, a processor 414, a memory 416, and an input / output interface 418. Similarly, the user authentication system 300 may include an input / output interface 432, a processor 434, a memory 436, and a communication module 438. Figure 4 As shown, the user terminal 100 and the user authentication system 300 may be configured to communicate information and / or data via the network 310 using respective communication modules 412 and 438. Furthermore, the input / output device 420 may be configured to input information and / or data to the user terminal 100 via the input / output interface 418, or to output information and / or data generated from the user terminal 100. Figure 4 In the figure, the communication module 412, the processor 414, the memory 416 and the input / output interface 418 are shown as the internal structure of the user terminal 100, but other user terminals (e.g., Figure 3 The user terminals 100_1, 100_2, 100_3) may also include an internal structure that is the same as or similar to the internal structure of the user terminal 100.

[0095] The communication modules 412 and 438 may provide a structure or function that enables the user terminal 100 and the user authentication system 300 to communicate with each other through the network 310, and may also provide a structure or function that enables the user terminal 100 and / or the user authentication system 300 to communicate with other user terminals or other systems (for example, a separate cloud system, a separate video receiving system). As an example, a request (for example, a user authentication request) generated by the processor 414 of the user terminal 100 according to the program code stored in a recording device such as the memory 416 may be transmitted to the user authentication system 300 through the network 310 according to the control of the communication module 412. Conversely, a control signal or instruction (for example, an instruction to guide the user's action) provided according to the control of the processor 434 of the user authentication system 300 may be sent to the user terminal 100 through the communication module 412 of the user terminal 100 via the communication module 438 and the network 310. For example, the user terminal 100 may receive at least one of an instruction to guide the user's action or information related to an image illustratively showing such an instruction from the user authentication system 300 through the communication module 412.

[0096] The memory 416, 436 may include any non-temporary computer-readable recording medium. According to one embodiment, the memory 416, 436 may include a random access memory (RAM), a permanent mass storage device such as a read-only memory (ROM), a disk drive, a solid state drive (SSD), a flash memory, etc. As another example, a permanent mass storage device such as a read-only memory, a solid state drive, a flash memory, a disk drive, etc., as a separate permanent storage device distinguished from the memory 416, 436, may be included in the user terminal 100 or the user authentication system 300. In addition, the memory 416, 436 may store an operating system and at least one program code (for example, a browser installed and driven on the user terminal 100 or a user authentication dedicated application installed on the user terminal 100 to provide a user authentication service or an application for providing a user authentication service, etc.). Different from this, the memory 416, 436 may store a program code required for performing user authentication provided by a web browser.

[0097] Such software structural elements may be loaded from a computer-readable recording medium different from the memory 416, 436. Such additional computer-readable recording medium may include a recording medium that can be directly connected to such user terminal 100 and user authentication system 300, for example, a computer-readable recording medium that may include a floppy disk drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. As another example, the software structural elements may be loaded into the memory 416, 436 via the communication module 412, 438, rather than via a computer-readable recording medium. For example, at least one program may be loaded into the memory 416, 436 based on a computer program installed via a file (as an example, the above-mentioned user authentication dedicated application or an application providing user authentication services), and the above-mentioned file is provided by a developer or a file distribution system that distributes the installation file of the application via the network 310. In contrast, at least one program may be loaded into the memory 416, 436 via a web browser.

[0098] The processors 414, 434 may be configured to perform basic arithmetic, logic, and input-output calculations to process instructions of a computer program. The instructions may be provided to the processors 414, 434 via the memory 416, 436 or the communication modules 412, 438. For example, the processors 414, 434 may execute the received instructions according to program code stored in a recording device such as the memory 416, 436.

[0099] The input-output interface 418 may be a unit for coupling with the input-output device 420. As an example, the input device may include a camera with an image sensor, a keyboard, a microphone, a mouse, etc., and the output device may include a display, a speaker, a haptic feedback device, etc. As another example, the input-output interface 418 may be a unit for coupling with a device such as a touch screen that combines the structure or function of performing input and output into one. For example, in the process of processing the instructions of the computer program loaded into the memory 416 by the processor 414 of the user terminal 100, the service screen or content composed of the information and / or data provided by the user authentication system 300 or other user terminals can be displayed on the display through the input-output interface 418. Figure 4 The input / output device 420 is shown as not included in the user terminal 100, but the present invention is not limited thereto, and the input / output device 420 may constitute one device together with the user terminal 100. In addition, the input / output interface 432 of the user authentication system 300 may be a unit for connecting with a device (not shown) for input or output that is connected to the user authentication system 300 or that the user authentication system 300 may include. Figure 4 The input / output interfaces 418 and 432 are shown as elements configured separately from the processors 414 and 434 , but the present invention is not limited thereto, and the input / output interfaces 418 and 432 may be included in the processors 414 and 434 .

[0100] The user terminal 100 and the user authentication system 300 may include Figure 4 More structural elements. However, it is not necessary to explicitly show the structural elements of most of the prior art. According to one embodiment, the user terminal 100 may be implemented to include at least a part of the above-mentioned input and output devices. In addition, the user terminal 100 may also include other structural elements such as a transceiver, a global positioning system (GPS) module, one or more cameras including an image sensor, various sensors, a database, etc. For example, in the case where the user terminal 100 is a smart phone, generally, it may include structural elements possessed by a smart phone, such as an acceleration sensor or a gyroscope sensor, a camera module, various physical buttons, buttons using a touch pad, input and output ports, a vibrator for vibration, and the like. Various structural elements may also be included in the user terminal 100.

[0101] According to one embodiment, the processor 414 of the user terminal 100 may be configured to enable an application or web browser providing a user authentication service to operate. In this case, the program code related to the corresponding application or web browser may be loaded into the memory 416 of the user terminal 100. During the operation of the application or web browser, the processor 414 of the user terminal 100 may receive information and / or data provided from the input and output device 420 through the input and output interface 418 or may receive information and / or data from the user authentication system 300 through the communication module 412, and process the received information and / or data to store them in the memory 416. Furthermore, the above information and / or data may be provided to the user authentication system 300 through the communication module 412.

[0102] According to one embodiment, during the operation of the application or web browser providing the user authentication service, the processor 414 may receive information such as text, images, etc. through an input device such as a camera, a touch screen, a keyboard, etc. connected to the input and output interface. In addition, the processor 414 may store the received image, video, and / or text in the memory 416 or provide it to the user authentication system 300 through the communication module 412 and the network 310. For example, the processor 414 may receive information for generating a user authentication request through an input device such as a touch screen, a keyboard, etc. In addition, the processor 414 may receive information related to a video of the user's actions through an input device such as a camera. The received information may be provided to the user authentication system 300 through the communication module 412 and the network 310.

[0103] The processor 414 may be configured to output the processed information and / or data through an output device such as a display output device (e.g., a touch screen, a display, etc.), a voice output device (e.g., a speaker), etc. of the user terminal 100. According to one embodiment, the information and / or data (e.g., instructions for guiding the user's actions, illustrative images representing such actions, etc.) provided by an application or web browser providing a user authentication service may be displayed through a display output device. According to another embodiment, the information and / or data provided by an application or web browser providing a user authentication service may be output through a voice output device, etc. For example, instructions for guiding the user's actions may be output through the user terminal through a speaker and provided to the user.

[0104] The processor 434 of the user authentication system 300 may be configured to generate any information and / or data required to authenticate the user. According to one embodiment, the processor 434 may generate information and / or data required to communicate with the user terminal requesting user authentication (e.g., information related to the channel of the user terminal). According to another embodiment, the processor 434 may be configured to generate information and / or data related to multiple instructions for causing the user to perform specific actions. The information and / or data generated in this way may be stored in the memory 436, and then, may be provided to the user terminal 100 through the communication module 438 and the network 310.

[0105] The processor 434 may be configured to manage, process and / or store information and / or data received from multiple user terminals including the user terminal 100 and / or multiple external systems. The processor 434 may be configured to receive videos captured by an image sensor from multiple user terminals in real time. The video received in real time may be received uninterruptedly, i.e., continuously. Among them, the video may be a video of at least the actions of the user being captured. For example, if the communication with the user terminal is disconnected and the real-time reception of the captured video is interrupted, the processor 434 may end the user authentication, or start a new user authentication after the communication is restarted.

[0106] The processor 434 may be configured to analyze the video received in real time to determine whether there is a user in the received video. In the case of the user, the processor 434 may analyze the face of the user extracted in the video, and authenticate the user based on the analyzed result. For example, the processor 434 may extract information related to the user's face from the face-related video corresponding to the instruction for guiding the shooting of the user's face, and extract information related to the user's face from the ID card-related video corresponding to the instruction for guiding the shooting of the user's ID card. By comparing the information related to the two extracted user faces, user authentication can be performed in similar situations. The authentication result for the user can be provided to the user terminal 100 through the communication module 438 and the network 310. The specific method of providing the service of authenticating the user based on the video received by the processor 434 of the user authentication system 300 is described in detail below.

[0107] Figure 5 4 is a block diagram showing the structure of a user authentication system 300 according to an embodiment of the present invention. The processor 434 of the user authentication system 300 may include an instruction processing module 510, an image extraction module 520, an image analysis module 530, and an authentication module 540. In addition, the processor 434 may send and receive information and / or data with an external system through a communication module 438. In addition, the processor 434 may store information and / or data in a memory 436, or obtain information and / or data from the memory 436.

[0108] The instruction processing module 510 may be configured to generate a plurality of instructions for authenticating a user. Each of the plurality of instructions may include instructions for guiding the user's actions. Furthermore, each of the plurality of instructions may include an illustrative image representing such an action. For example, the plurality of instructions may include any instructions for determining whether the user exists. As another example, the plurality of instructions may include instructions for guiding the user to present his or her ID card. The instructions generated in this way may be stored in a storage medium (e.g., memory 436) that can be accessed by the processor 434.

[0109] The instruction processing module 510 may select one or more instructions from a plurality of pre-stored instructions. According to one embodiment, the instruction processing module 510 may randomly select a plurality of instructions from a plurality of pre-stored instruction candidates. For example, the selected plurality of instructions may include an instruction to guide the user to take a photo of the front of the face. As another example, the selected plurality of instructions may include an instruction to guide the user to take a photo of his / her ID card.

[0110] The instruction processing module 510 may transmit the selected multiple instructions to the user terminal 100 through the communication module 438. According to one embodiment, the instruction processing module 510 may transmit the selected multiple instructions to the user terminal 100 in a determined order. For example, in the case where the multiple instructions include the first instruction, the second instruction and the third instruction, the first instruction may be preferentially transmitted to the user terminal 100. Thereafter, in the case where the analysis of the first instruction is completed by the image analysis module 530, the second instruction may be transmitted to the user terminal 100. In the case where the analysis of the video received corresponding to the second instruction is completed, the instruction processing module 510 may transmit the third instruction to the user terminal 100. According to another embodiment, in the case of a specific instruction, the instruction processing module 510 may transmit information related to multiple channels to the user terminal 100, and the multiple channels are used to transmit the video shot in each of the multiple areas in the screen of the user terminal. For example, in the case where the area where the user is shot and the area where the ID card is shot are separated, the videos shot in the two areas may be transmitted through different channels.

[0111] The instruction processing module 510 may transmit a plurality of instructions to the user terminal 100 until the user authentication is completed. According to one embodiment, the plurality of instructions may include instructions for determining whether a user exists in the captured video. For example, such instructions may include instructions for enabling a user to perform a specific action using his or her body (e.g., face, etc.) and / or an item (e.g., an ID card, etc.). According to another embodiment, the plurality of instructions may include instructions for authenticating a user in the captured video. For example, such instructions may include instructions for guiding appropriate recognition of the user's face (e.g., instructions for guiding the capture of the front of the user's face) and instructions for guiding the capture of the user's ID card.

[0112] The image extraction module 520 can receive a video in real time from the user terminal 100 through the communication module 438. If the user terminal 100 receives an instruction to guide a specific action from the instruction processing module 510, the user of the user terminal 100 can perform such an action. During the execution of such an action, the camera associated with the user terminal 100 can shoot the user's action, and the user terminal 100 can send the video shot corresponding to the received instruction to the image extraction module 520 through the communication module 438. The user terminal 100 can transmit the shot video to the image extraction module 520 in real time immediately after shooting the video, and the image extraction module 520 can receive the shot video in real time. According to one embodiment, the image extraction module 520 can directly receive the video through the communication module 438 via the network 310. According to another embodiment, the video transmitted in real time from the user terminal 100 can be received by an additional server (e.g., an Internet voice protocol management server, a broadcast channel management server, etc.) that manages the channel between the user authentication system 300 and the user terminal 100, and can be provided to the image extraction module 520 through the additional server. According to yet another embodiment, the image extraction module 520 may receive videos captured at multiple areas in the screen of the user terminal through multiple channels.

[0113] The image extraction module 520 may extract one or more images for authenticating a user from a video received in real time. According to one embodiment, the image extraction module 520 may be configured to extract one or more images contained in the received video according to a predetermined rule. For example, the image extraction module 520 may be configured to extract multiple images contained in the received video at a determined time interval (e.g., extracting every 1 second). According to another embodiment, the image extraction module 520 may receive information related to the instructions transmitted to the user from the instruction processing module 510, and adjust the speed of extracting images from the received video according to the received instructions. For example, in the case of an instruction to guide an action corresponding to the static state of the user (e.g., an action of watching the front of the face, an action of showing an ID card, etc.), the image extraction module 520 may extract an image from the received video at a low image extraction speed. As another example, in the case of an instruction to guide an action corresponding to the dynamic state of the user (e.g., an action of moving the face, an action of moving the ID card), the image extraction module 520 may extract an image from the received video at a high image extraction speed. The image extracted in this way may be stored in the image analysis module 530.

[0114] The image extraction module 520 can determine multiple resolutions corresponding to multiple instructions. Among them, the resolution can be the resolution applicable when the user terminal 100 uses the camera to shoot in accordance with the instructions. According to one embodiment, the resolution can be determined differently according to the area in the captured video. For example, it can be set to shoot the area where the user's ID card is located in the captured video with a high resolution. The resolution determined in this way can be stored in the memory 436 in relation to the corresponding instruction.

[0115] The image extraction module 520 may determine a transmission speed corresponding to each of the plurality of instructions. The transmission speed may be a transmission speed applicable when transmitting a video captured by the user terminal 100 using a camera to the user authentication system 300. For example, the transmission speed may be represented by the number of frames transmitted per second (fps). The transmission speed thus determined may be stored in the memory 436 in relation to the corresponding instruction. According to one embodiment, the transmission speed may represent a playback speed of a video captured by the camera of the user terminal 100. The user terminal 100 may transmit the captured video to the image extraction module 520 according to a playback speed corresponding to the transmission speed.

[0116] When transmitting an instruction to the user terminal 100, the instruction processing module 510 may transmit the resolution related to the instruction and / or the information related to the transmission speed together. Thus, in response to the received instruction, the user terminal 100 may shoot with the camera at the received resolution, and the shot video may be provided to the user authentication system 300 at the received transmission speed. For example, different resolutions may be received for multiple areas displayed in the screen of the shot video, and when shooting the video, the user terminal 100 may apply the resolution set for multiple areas to the camera.

[0117] The image analysis module 530 may receive one or more extracted images from the image extraction module 520, and may analyze the extracted images. According to one embodiment, a library file for analyzing whether a user performs an action directed by each of a plurality of instructions may be stored in the memory 436. In this environment, the image analysis module 530 may access the memory 436 and use the pre-stored library file to analyze the received image. According to another embodiment, an analysis model may be generated for determining whether a user performs an action directed by a plurality of instructions, and the generated analysis model may be stored in a storage medium (e.g., the memory 436). The image analysis module 530 may use this analysis model to analyze the extracted image. Reference Figure 7 Describe this analytical model in detail.

[0118] The image analysis module 530 may analyze the received one or more images to determine whether the user within the image performs actions corresponding to the plurality of instructions.

[0119] According to one embodiment, in the case where the instruction transmitted to the user terminal 100 is an instruction to guide the movement of a part of the user's body and / or an item, the image analysis module 530 may determine whether the user has moved according to the transmitted instruction. According to another embodiment, in the case where the instruction transmitted to the user terminal 100 is an instruction to guide the movement of the user's ID card, the image analysis module 530 may analyze an image extracted from a video received corresponding to such an instruction to determine whether the ID card has moved. Information on whether the user performs actions corresponding to a plurality of instructions may be provided to the authentication module 540.

[0120] According to one embodiment, the image analysis module 530 may extract information related to the user's face from the received image. For example, the received image may include an image related to the user's face (e.g., the front of the user's face), and the image analysis module 530 may extract first information related to the user's face from such an image. As another example, the received image may include an image of the user's ID card, and the image analysis module 530 may extract second information related to the user's face from the image of the user's ID card. The first information and second information related to the user extracted in this way may be provided to the authentication module 540.

[0121] According to an embodiment, after more than one instruction is sent to the user terminal 100 in a predetermined order, the image analysis module 530 may analyze an image extracted from a video received corresponding to each of the more than one instruction transmitted from the user terminal 100. For example, the image analysis module 530 may analyze the extracted image to determine whether the user performs the action guided by the instruction in response to the corresponding instruction. Under this configuration, whenever an analysis result corresponding to an instruction is generated, the generated analysis result may be provided to the authentication module 540.

[0122] The authentication module 540 can determine whether a user exists in the video received in real time based on the analysis result of the image extracted from the image analysis module 530. For example, such analysis results can be received in the order of instructions transmitted to the user terminal. According to one embodiment, in the case where it is determined that the user performs all actions corresponding to one or more instructions (for example, 3 instructions) transmitted to the user terminal 100, the authentication module 540 can determine that the user exists in the received video. Different from this, in the case where it is determined that the user does not perform the actions corresponding to one or more instructions transmitted to the user terminal, the authentication module 540 can determine that the user does not exist in the received video.

[0123] According to another embodiment, in the case where it is determined that the user has not performed an action corresponding to a first instruction among the multiple instructions transmitted to the user terminal 100, the authentication module 540 may cause the instruction processing module 510 to transmit a different second instruction to the user terminal 100. The second instruction can be selected by the instruction processing module 510 based on the difference between the user's action obtained from the video analysis received corresponding to the first instruction and the action corresponding to the first instruction. The result of analyzing the image extracted from the video shot corresponding to the second instruction, in the case where it is presented that the user performs the action corresponding to the second instruction, the authentication module 540 may determine that the user exists in the received video. In another embodiment, in the case of receiving an analysis result that the user performs actions corresponding to a predetermined number of instructions among the multiple instructions, the authentication module 540 may determine that the user exists in the received video.

[0124] In another embodiment, when it is determined that the video received from the user terminal 100 is not continuous, the authentication module 540 may determine that the user does not exist in the received video. For example, when it is determined that the time difference between one or more continuous frames included in the video does not correspond to the transmission speed instructed by the instruction processing module 510, it may be determined that the user does not exist in the received video.

[0125] In yet another embodiment, in the case where it is determined that the user has not performed an action corresponding to the first instruction among the multiple instructions transmitted to the user terminal 100, the authentication module 540 may cause the communication module 438 to change the channel used for communicating with the user terminal. According to one embodiment, the authentication module 540 may change the currently used channel to a different communication channel in order to communicate with the user terminal 100. Thus, the problem that the user authentication cannot be performed normally due to the problem of the communication channel can be prevented. According to another embodiment, the authentication module 540 may issue an instruction to the communication module 438 to change the channel currently used in the communication process with the user terminal 100 to a communication channel that can be connected to the consultant. Thus, in the case where the user's action does not correspond to the action represented by the instruction, the consultant can directly perform user authentication to provide accurate authentication for the user.

[0126] The authentication module 540 can authenticate the user based on the analysis result of the extracted image. According to one embodiment, the authentication module 540 can be configured to authenticate the user when it is determined from the received image that the user exists. In another embodiment, when the video analysis result is received from the image analysis module 530 and it is determined that the ID card is moved, the authentication module 540 can determine that the ID card exists. Thus, when it is determined that the ID card exists, the user can be authenticated.

[0127] The authentication module 540 may receive first information related to the user's face extracted from a face-related video corresponding to an instruction for guiding the user to take a photo of the user's face, and may receive second information related to the user's face extracted from an ID card-related video corresponding to an instruction for guiding the user to take a photo of the user's ID card. Moreover, the extracted first information related to the user's face and the extracted second information related to the user's face may be compared with each other. Wherein, in the case where the extracted first information is similar to the extracted second information, the authentication module 540 may authenticate the user. For example, in the case where the similarity between the extracted first information and the extracted second information is greater than a predetermined similarity, it may be determined that the extracted first information is similar to the extracted second information. As another example, the authentication module 540 may determine the similarity between the extracted first information and the extracted second information and the reliability related thereto, and may determine whether the extracted first information and the extracted second information are similar based on the determined similarity and reliability. Such similarity and / or reliability can be determined using any technology known in the field of image processing, for example, rule-based technology, machine learning technology, artificial neural network model, etc. that infer / output similarity and / or reliability based on information extracted from multiple images can be used, but it is not limited thereto. The user authentication result determined by the authentication module 540 can be provided to the user terminal 100, or can be provided to a system related to the user authentication request.

[0128] Figure 5 The figure shows that the processor 434 includes the instruction generation module 510, the image extraction module 520, the image analysis module 530 and the authentication module 540 as separate modules, but it is not limited thereto, and more than two modules can be implemented as one module.

[0129] Figure 6 1 is a flow chart showing a user authentication method 600 according to an embodiment of the present invention. The user authentication method 600 may be executed by the user authentication system 300. As shown in the figure, the user authentication method 600 may start with step S610 of sending a plurality of instructions to the user terminal for the user to perform a plurality of actions. For example, the plurality of actions may include an action required for determining whether the user exists, an action required for extracting the user's face, and an action required for photographing the user's ID card, etc.

[0130] Afterwards, in step S620, videos shot corresponding to the multiple instructions may be received from the user terminal. According to one embodiment, the user authentication system 300 may receive videos shot corresponding to the multiple instructions from the user terminal in real time through a channel for communicating with the user terminal. To this end, the user terminal may respond to the multiple instructions, shoot the actions represented by the instructions using a camera including an image sensor, and may transmit the shot videos to the user authentication system 300 in real time.

[0131] Next, in step S630, the user authentication system 300 may determine whether the user exists in the video. The user's actions corresponding to each of the plurality of instructions may be captured in the video. For example, such actions may be actions that move a part of the user's body (e.g., face, hand, arm, etc.) and / or an object (e.g., an object that the user can lift with his hand, etc.).

[0132] Finally, in step S640, when it is determined that the user exists, the user authentication system 300 can authenticate the user based on the user's face extracted from the video. According to one embodiment, the user authentication system 300 can be configured to extract multiple user faces from the video. For example, first information related to the face of the user being photographed can be extracted from the video. In addition, second information related to the face of the user included in the user's ID card can be extracted from the video. Afterwards, the user authentication system 300 can compare the similarity between the extracted first information related to the user's face and the second information, and can authenticate the user if the first information and the second information are similar.

[0133] Figure 7 1 is a diagram showing an image analysis model 720 configured to infer or output an action execution result 730 based on an image 710 according to an embodiment of the present invention. The image analysis model 720 may be generated by the processor 434 of the user authentication system 300, and the generated image analysis model 720 may be stored in a storage medium (e.g., memory 436) accessible to the processor 434. The image 710 may include one or more images extracted from a video received by the user authentication system 300. For example, the image extraction module 520 may receive a captured video from a user terminal in real time, and extract the image 710 from the received video according to a predetermined rule. The extracted image 710 may be provided to the image analysis module 530, and the image analysis module 530 may be configured to input the extracted image 710 to the image analysis model 720 to infer or output the user's action execution result 730. For example, the action execution result may include information related to whether the user performs an action corresponding to each of a plurality of instructions. Among them, the image analysis model 720 may include a plurality of models for analyzing a plurality of actions represented by a plurality of instructions.

[0134] According to one embodiment, the image analysis module 530 may be configured to provide multiple learning images of the actions of multiple users as input images of the image analysis model 720 to infer or output the result of whether the user performs a specific action in the image. For example, the image analysis model 720 may be configured to infer the result of whether the user performs a specific action through rule-based learning and prediction. As another example, the image analysis model 720 may be configured to learn through known machine learning techniques and output the action execution result 730 through the input image. For example, machine learning techniques may include a Find-S algorithm, a Version Space algorithm, and a Candidate Elimination algorithm. As another example, the image analysis model 720 may include an artificial neural network model generated using any neural network, etc.

[0135] Figure 8 An example diagram showing authentication of a user based on a video of the user's actions according to multiple instructions captured according to one embodiment of the present invention. The user terminal 100 may request user authentication through the user authentication system 300. In response to this, the user authentication system 300 may generate a channel for communicating with the user terminal. For example, in the case where the user authentication system 300 communicates with the user terminal using web instant messaging, the user authentication system 300 may transmit information containing a link (e.g., a "user request to start" button) to the user terminal. In response to this, the user terminal may generate a channel for communicating with the user by clicking such a button. The user terminal 100 may transmit a video captured by a camera connected to the user terminal to the user authentication system 300 in real time through the generated channel.

[0136] The user terminal 100 can start to transmit the video shot by the camera in real time, and can transmit the video shot to the end of the transmission to the user authentication system 300 in real time (step S810). The shot video can be transmitted in real time through the channel between the user authentication system 300 and the user terminal 100. As a result, the user authentication system 300 can start to receive the video shot by the user terminal 100 in real time, and can receive the video shot to the end of the reception in real time through the generated channel (step S812). That is, the user authentication system 300 can receive the video shot by the user terminal 100 in real time and continuously during the execution of user authentication.

[0137] After starting to receive the video captured by the user terminal 100, the user authentication system 300 may transmit a plurality of instructions to the user terminal 100 in a predetermined order. For example, such a plurality of instructions may be randomly selected. In response to this, the user may perform actions corresponding to the plurality of instructions, and the user terminal 100 may transmit a video of the actions performed in real time to the user authentication system 300. The user authentication system 300 may analyze the video transmitted in real time and store the analyzed results. In addition, the user authentication system 300 may authenticate the user based on the video stored in real time, and may notify the user terminal 100 of the authentication result.

[0138] First, the user authentication system 300 may transmit an instruction to "watch the front of the face" (step S814). In response to this, the user 120 may perform an action to present the front of his face in the picture taken by the camera (step S816). This action is captured by the camera, and the user terminal 100 may transmit the captured video to the user authentication system 300 in real time. The user authentication system 300 may analyze the video received in real time and determine whether the user performs the action represented by the transmitted instruction, that is, the action of facing the front, and may store the analysis result (step S818).

[0139] Next, the user authentication system 300 may transmit a "shake head left and right" instruction to the user terminal 100 (step S820). In response to this, the user 120 may perform an action to present the action of shaking head left and right in the picture captured by the camera (step S822). The user terminal 100 may capture such an action through a camera, and may transmit the captured video to the user authentication system 300 in real time. The user authentication system 300 may analyze the video received in real time to determine whether the user performs the action represented by the transmitted instruction, that is, the action of shaking head left and right, and may store the analysis result (step S824). In the present invention, the user 120 performs actions guided by multiple instructions corresponding to multiple instructions, and therefore, the user authentication system 300 may determine that the user is present in front of the camera during user authentication.

[0140] In the case where it is determined that the user exists, the user authentication system 300 may request or transmit to the user terminal 100 an instruction to place the ID card in a specific area and be photographed (step S826). For example, the specific area may correspond to a portion of the area within each image or frame constituting the captured video, and may be displayed by the display of the user terminal. In response to this, the user may present the user's ID card in the specific area (step S828). This ID card may be photographed by a camera associated with the user terminal 100, and the captured video may be transmitted to the user authentication system 300 in real time. The user authentication system 300 may extract the user's facial image by analyzing the ID card-related video corresponding to the instruction to present the ID card in the specific area, and extract the user's facial image from the face-related video corresponding to the instruction to face the front (step S830). The user authentication system 300 compares the extracted facial images of the two users, and in the case of being similar to each other, may notify the completion of the user's authentication (step S832). In response to this notification, the user terminal 100 may terminate the real-time transmission of the captured video. Thus, in the user authentication system 300, the reception of the captured video will also be terminated.

[0141] Fig. 9 FIG. 9 is a diagram showing an exemplary instruction information database 900 according to an embodiment of the present invention. The instruction information database 900 can be constructed as an arbitrary data structure for storing multiple instructions, resolutions, transmission speeds, etc., wherein the resolutions of various regions can be set to be different according to the instructions.

[0142] The resolution and transmission speed corresponding to the plurality of instructions may be determined by the processor 434, and the determined resolution and transmission speed may be stored in a storage medium (e.g., a memory 436) as an instruction information database 900. According to one embodiment, a high resolution may be determined and stored for an instruction for guiding the shooting of an image related to the face for authenticating a user. For example, as shown in the figure, a video of the front of the face corresponding to instruction 1 may be received, so the resolution related to instruction 1 (e.g., 720p) may be set to be higher than the resolution related to other instructions. As another example, a video of the face and the ID card (surface) may be received corresponding to instruction 5, and the facial image in the ID card of the user may be used to authenticate the user. Thus, the resolution of area 2 of the ID card for guiding the shooting of the user (e.g., 1024p) may be set to be higher than the resolution related to other instructions. In this case, information related to area 1 and / or area 2 may be stored in a storage medium (e.g., a memory 436) as an instruction information database 900 or an area information database.

[0143] According to another embodiment, among the multiple instructions for determining whether the user is present, a relatively high resolution may be set for the instruction for guiding the capture of an image for analyzing the user's movement. For example, a video of an action of moving the face to the left corresponding to instruction 2 may be received, and therefore, the resolution associated with instruction 2 (e.g., 480p) may be set to be higher than the resolution associated with the instruction representing the static movement of the user. And, in the case of instruction 4, it may be similarly set. Different from this, for example, the instruction representing the static movement of the user may include, for example, instruction 3 ("Please make a V sign"), and the resolution associated with instruction 3 may be set to a relatively low 240p.

[0144] Processor 434 may determine the transmission speed differently according to a plurality of instructions. According to one embodiment, a high transmission speed may be set for instructions that direct the capture of images for analyzing the user's movement. For example, instructions 2 and 4 may receive a video of the user's movement, and therefore, a high transmission speed (e.g., 5fps) may be set compared to other instructions. According to another embodiment, a relatively low transmission speed may be set for instructions related to the user's static movement. For example, instructions 1, 3, and 5 may be related to the user's static movement, and as shown, the transmission speed may be set to 1fps.

[0145] When the processor 434 transmits each instruction to the user terminal with reference to the instruction information database 900 stored in the storage medium, information related to the resolution and / or transmission speed related to each instruction can be transmitted together. In response to this, when the user terminal shoots a video through a camera corresponding to the received instruction, the received resolution can be suitable for the camera, and the frame or image of the captured video can be transmitted to the user authentication system 300 at the received transmission speed. The user terminal can transmit the captured video to the user authentication system 300 at different transmission speeds according to the instruction, so the data usage in the user terminal used to authenticate the user can be minimized.

[0146] Fig.10 This is a diagram showing an example of selecting different instructions according to whether a user performs an action by a user authentication system 300 according to an embodiment of the present invention. As shown in the figure, the user authentication system 300 can select instruction 1 ("turn face to the right") (step S1010). For example, such instruction 1 can be selected by a predetermined rule. In the process of authenticating the user, the selected instruction 1 can be transmitted to the user terminal.

[0147] In response to the received instruction 1, the user terminal may use a camera to capture the user's actions, and may transmit the captured user's actions to the user authentication system 300. The user authentication system 300 may analyze the received video to determine whether the user executes instruction 1 (step S1020). If it is determined that the user executes instruction 1, instruction 2 ("blink") may be selected (step S1030). The action represented by instruction 2 may be unrelated to the action represented by instruction 1.

[0148] If it is determined that the user has not executed instruction 1, instruction 3 ("turn face to the left") may be generated or selected (step S1040). Instruction 3 may be selected based on the difference between the user's action obtained from the analysis of the received video and the action corresponding to instruction 1. For example, the action related to instruction 3 may be an action similar to the action related to instruction 1. Thus, in the case where the user's action in the video shot corresponding to instruction 1 is not verified, the result of the analysis corresponding to instruction 1 may be improved or verified again by analyzing the user's action in the video shot corresponding to instruction 3 representing a similar action.

[0149] Although in Fig.10 Although not shown in the figure, if it is determined that the user has not executed instruction 1, the verification process may be terminated, or the execution of instruction 1 may be requested again. In this case, the user authentication system 300 may transmit information related to the determination that instruction 1 has not been executed to the user terminal.

[0150] On the other hand, the user terminal can use the application or web browser that provides the user authentication service to perform the user authentication request. In response to this, a channel between the user terminal and the user authentication system that provides the user authentication service can be generated. The user terminal can use the generated channel to communicate with the user authentication system. Figures 11 to 15 This figure shows an exemplary screen in which a user is photographed and acts in accordance with an instruction while utilizing a user authentication service.

[0151] Fig.11 1 is an example diagram of a screen that captures a user's actions in response to an instruction according to an embodiment of the present invention. According to an embodiment, a user terminal may receive an instruction "face forward" from a user authentication system 300. In response to such an instruction, a user may perform an action to position his or her face in an area 1110 displayed on a screen that displays a video captured by a camera. When the above-mentioned action is performed, a video capturing the front of the user's face may be transmitted to the user authentication system 300 in real time. In response to this, the user authentication system 300 may analyze the video captured in a portion of the area 1110 in the video during the process of authenticating the user.

[0152] As shown in the figure, corresponding to the received instruction, information related to the received instruction can be displayed together on the screen of the user terminal displaying the video shot by the camera. According to one embodiment, the text 1130 representing the received instruction, i.e., "Please face forward", can be displayed together on the screen of the user terminal displaying the shot video. In addition, the character image 1120 representing the received instruction can also be displayed together on the screen of the user terminal. With reference to the above text 1130 and / or character image 1120, the user can perform the action corresponding to the received instruction. The user authentication system 300 that receives the video of the above action in real time can determine whether the user exists in the video. In addition, the user authentication system 300 can extract information related to the user's face in the received video.

[0153] Fig.12 This is an example diagram of a screen that captures a user's actions in response to an instruction according to another embodiment of the present invention. According to this embodiment, the user terminal can receive an instruction of "turn face to the right" from the user authentication system 300. In response to such an instruction, the user can make his or her face be located in a specific area 1210 displayed on the screen captured by the camera to perform the action of turning the face to the right. When performing the above-mentioned action of turning the face, a video of the user's face turning to the right can be transmitted to the user authentication system 300 in real time. In response to this, the user authentication system 300 can analyze the video captured in a part of the area 1210 in the video during the process of authenticating the user.

[0154] As shown in the figure, corresponding to the received instruction, information related to the received instruction can be displayed together on the screen of the user terminal displaying the video shot by the camera. According to one embodiment, the text 1230 representing the received instruction, i.e., "turn face to the right", can be displayed together on the screen of the user terminal displaying the shot video. In addition, the character image 1220 representing the received instruction can also be displayed together on the screen of the user terminal. With reference to such text 1230 and / or character image 1220, the user can perform an action corresponding to the received instruction, and the user authentication system 300 that receives the video of shooting such an action in real time can determine whether the user exists in the video.

[0155] Fig.13This is an example diagram of a screen that captures a user's actions in response to an instruction according to another embodiment of the present invention. According to this embodiment, the user terminal can receive an instruction of "please close your eyes" from the user authentication system 300. In response to such an instruction, the user can position his or her face in the area 1310 displayed on the screen captured by the camera and perform the action of closing the eyes. When performing the above-mentioned action, the video of the user's action of closing his or her eyes can be transmitted to the user authentication system in real time. In response to this, the user authentication system 300 can analyze the video captured in a part of the area 1310 in the video during the process of authenticating the user.

[0156] exist Fig.13 In the example, corresponding to the received instruction, information related to the received instruction can be displayed together on the screen of the user terminal displaying the video shot by the camera. For example, the text 1330 representing the received instruction, i.e., "Please close your eyes", can also be displayed together on the screen of the user terminal displaying the shot video. In addition, the character image 1320 representing the received instruction can also be displayed together on the screen of the user terminal. With reference to the above-mentioned text 1330 and / or character image 1320, the user can perform an action corresponding to the received instruction, and the user authentication system 300 that receives the video of shooting such an action in real time can determine whether the user exists in the video.

[0157] Fig.14 An example diagram of photographing a user and the user's ID card together in accordance with an instruction according to an embodiment of the present invention is shown. According to this embodiment, the user terminal may receive an instruction of "showing the ID card (surface) together with the face" from the user authentication system 300. In response to such an instruction, as shown in the figure, the user may perform an action so that his face is located in the area 1410 displayed on the screen captured by the camera. At the same time, the user may perform an action so that the ID card is located in the area 1440 displayed on the screen. When performing the above-mentioned actions, a video of the user's face and ID card can be transmitted to the user authentication system 300 in real time. In response to this, the user authentication system 300 may analyze the video captured in the area 1410 and / or the area 1440 in the video during the user authentication process.

[0158] As shown in the figure, corresponding to the received instruction, information related to the received instruction can be displayed together on the screen of the user terminal that displays the video shot by the camera. According to one embodiment, the text 1420 representing the received instruction, namely "Show the ID card (surface) together with the face", can be displayed together on the screen of the user terminal that displays the shot video. In addition, the ID card image 1430 representing the received instruction is also displayed together on the screen of the user terminal. With reference to the information displayed on the screen in this way, the user can perform an action corresponding to the received instruction, and the user authentication system 300 that receives the video shot of such an action can extract the user's face from the ID card image. The images from the ID card can be compared with each other. Fig.11 The facial image extracted from the video of the front face and the facial image extracted from the video of the ID card are used to authenticate the user.

[0159] According to one embodiment, different settings may be applied to the area 1410 for photographing at least a portion of the user (including at least a portion of the user's face) and the area 1440 for photographing the ID card. For example, different channels are applied to the two areas, and the videos photographed in the two areas may be transmitted to the user authentication system 300 through the channels set respectively. As another example, different resolutions are applied to the two areas, and the videos photographed in the two areas may be videos photographed at different resolutions. Among them, the resolution of the video photographed in the area 1440 for guiding the photographing of the ID card may be greater than the resolution of the video photographed in the area 1410 for guiding the photographing of at least a portion of the user.

[0160] Fig.15 An example diagram showing the movement of an ID card captured in response to an instruction in order to confirm whether the ID card of the user exists according to an embodiment of the present invention. According to an embodiment, the user terminal may receive an instruction of "showing the face and the ID card (surface) and moving the ID card" from the user authentication system 300. In response to such an instruction, the user may perform an action to make his face located in the area 1510 displayed on the screen captured by the camera. At the same time, the user may make the ID card located in other areas 1540 of the screen captured by the camera and perform the action of moving the ID card. When performing the above-mentioned actions, the video of capturing the user's face and the action of moving the ID card may be transmitted to the user authentication system 300 in real time. In response to this, the user authentication system 300 may analyze the video captured in the area 1510 and / or the area 1540 in the video during the process of authenticating the user.

[0161] Fig.15In the example, corresponding to the received instruction, information related to the received instruction can be displayed together on the screen of the user terminal displaying the video shot by the camera. For example, the text 1520 representing the received instruction, i.e., "show face and ID card (surface) and move ID card", can be displayed together on the screen of the user terminal displaying the shot video. In addition, the ID card image 1530 and the ID card area 1540 representing the received instruction can also be displayed together on the screen of the user terminal. The user can use this information displayed on the screen to perform an action corresponding to the received instruction, and the user authentication system 300 that receives the video of shooting such an action in real time can determine whether the ID card exists. For example, the user authentication system 300 can determine whether the user's ID card exists in the video based on the movement of the user's ID card obtained by analyzing the video. In the case where the ID card exists, the user authentication system 300 can authenticate the user.

[0162] The user authentication method described above can be implemented as a computer-readable code in a computer-readable recording medium. Computer-readable recording media include all kinds of recording devices storing data that can be read by a computer system. Examples of computer-readable recording media include read-only memory, random access memory, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. In addition, the computer-readable recording medium can be distributed in a computer system connected via a network, and the computer-readable code can be stored and executed in a distributed manner. In addition, the functional program, code, and code segment used to implement the above-mentioned embodiment can be easily deduced by a programmer in the technical field to which the present invention belongs.

[0163] The method, action or technique of the present invention can be implemented by multiple units. For example, such technique can be implemented by hardware, firmware, software or a combination thereof. A person skilled in the art of the present invention can understand that a plurality of exemplary logic blocks, modules, circuits and algorithm steps described in connection with the content of the present invention can be implemented by electronic hardware, computer software or a combination thereof. In order to clearly illustrate this mutual substitution of hardware and software, a plurality of exemplary structural elements, blocks, modules, circuits and steps have been described above from their functional point of view. Whether these functions are implemented by hardware or by software is determined according to the design requirements added to the specific application and the overall system. A person skilled in the art of the present invention can implement the functions described in a variety of ways for each specific application, but these implementations cannot be interpreted as exceeding the scope of the present invention.

[0164] In a hardware implementation, the processing unit utilized in executing the technology may be implemented in one or more application specific integrated circuits, digital signal processors, digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in the present invention, computers, or a combination thereof.

[0165] Therefore, the multiple exemplary logic blocks, modules and circuits described in connection with the present invention may be implemented or executed by a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination designed in a manner to perform the functions described in the present invention. The general purpose processor may be a microprocessor, alternatively, the processor may also be any kind of processor, controller, microcontroller or state machine. The processor may also be implemented by a combination of computing devices, for example, a digital signal processor and a microprocessor, a plurality of microprocessors, more than one microprocessor connected to a digital signal processor core, or any other combination of structures.

[0166] In the implementation of firmware and / or software, the technology can be implemented by instructions stored on a computer-readable recording medium such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage device, etc. The instructions can be executed by more than one processor, so that multiple processors can perform the functional specific implementation described in the present invention.

[0167] In the case of software implementation, the above technology can be used as more than one instruction or code, which can be stored on a computer-readable medium or transmitted by a computer-readable medium. Computer-readable media include any medium that allows a computer program to be easily transmitted from one place to another, including both computer storage media and communication media. The storage medium can be any available medium accessible by a computer. As a non-limiting example, this computer-readable medium may include a random access memory, a read-only memory, an electrically erasable programmable read-only memory, a CD-ROM or other optical disk storage, a disk storage or other magnetic storage device, or any other medium accessible by a computer for transferring or storing the desired program code in the form of an instruction or data structure. In addition, any connection can be appropriately referred to as a computer-readable medium.

[0168] For example, if the software is transmitted from a web page, server or other remote source using a coaxial cable, fiber optic cable, soft wire, digital subscriber line (DSL), or wireless technologies such as infrared, wireless and microwave, the coaxial cable, fiber optic cable, soft wire, digital subscriber line, or wireless technologies such as infrared, wireless and microwave are included in the definition of medium. Disks and discs used in the present invention include CDs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks and Blu-ray discs, where multiple disks usually generate data magnetically, while multiple discs use lasers to generate data optically. The above combinations are also included in the scope of computer-readable media.

[0169] The software module may reside in a random access memory, a flash memory, a read-only memory, an erasable programmable read-only memory, an electrically erasable programmable read-only memory, a register, a hard disk, a removable disk, a CD-ROM, or any other known form of storage medium. An exemplary storage medium may be connected to a processor so that the processor reads information from the storage medium or records information in the storage medium. Alternatively, the storage medium may be combined with the processor. The processor and the storage medium may exist in an application specific integrated circuit. The application specific integrated circuit may exist in a user terminal. Alternatively, the processor and the storage medium may exist as individual structural elements in a user terminal.

[0170] The embodiments described above describe implementations of the presently disclosed subject matter in one or more stand-alone computer systems, but the present invention is not limited thereto and may be implemented in connection with any computing environment, such as a network or a distributed computing environment. Further, in the present invention, implementations of the subject matter may be implemented in multiple processing cores or devices, and storage may be similarly affected by multiple devices. Such devices may also include personal computers, network servers, and portable devices.

[0171] In this specification, the present invention is described in relation to a part of the embodiments, and various modifications and variations can be made within the scope of the present invention that can be understood by those skilled in the art. Moreover, these modifications and variations also fall within the scope of the invention protection scope attached to this specification.

Claims

1. A user authentication method, characterized in that: include: A sending step of sending a plurality of instructions for the user to perform a plurality of actions to the user terminal; A receiving step, receiving videos shot corresponding to the plurality of instructions from the user terminal; A determination step of determining whether the user exists in the video; as well as an authentication step, in which, when it is determined that the user exists, the user is authenticated based on the face of the user extracted from the video, The step of sending a plurality of instructions for the user to perform a plurality of actions to the user terminal comprises: sending information related to a transmission speed corresponding to each of the plurality of instructions together with the plurality of instructions to the user terminal, The step of determining whether the user exists in the video includes determining that the user does not exist when it is determined that a time difference between one or more consecutive frames included in the video does not correspond to the information related to the transmission speed.

2. The user authentication method according to claim 1, characterized in that: The step of receiving the video shot corresponding to the plurality of instructions from the user terminal includes: receiving the video in real time from the user terminal via a channel used for communicating with the user terminal.

3. The user authentication method according to claim 2, characterized in that: The video is continuously received via a channel used to communicate with the user terminal.

4. The user authentication method according to claim 1, characterized in that: The step of determining whether the user exists in the video also includes the following steps: Determining whether the user performs a plurality of actions corresponding to the plurality of instructions in the video by analyzing the video; and When it is determined that the user performs a plurality of actions corresponding to the plurality of instructions, it is determined that the user exists in the captured video.

5. The user authentication method according to claim 1, characterized in that: The step of receiving, from the user terminal, videos shot in response to the multiple instructions comprises the following steps: receiving, from the user terminal, a face-related video captured in response to an instruction to capture the user's face; as well as receiving, from the user terminal, a video related to the ID card shot in response to the instruction to shoot the user's ID card, The steps to authenticate the above user include: A first information extraction step of extracting first information related to the face of the user from the face-related video; A second information extraction step of extracting second information related to the face of the user from the ID card related video; a comparison step of comparing the extracted first information and the extracted second information; and When the extracted first information and the extracted second information are similar, a step of authenticating the user.

6. The user authentication method according to claim 5, characterized in that: The plurality of instructions include an instruction to photograph the front face of the user.

7. The user authentication method according to claim 5, characterized in that: The above-mentioned multiple instructions include instructions for guiding the movement of the user's ID card, The step of receiving the video related to the ID card includes: receiving, from the user terminal, a video of the ID card of the user shot according to the instruction, The step of authenticating the user includes: determining whether the user's ID card exists in the video based on the movement of the user's ID card obtained by analyzing the video.

8. The user authentication method according to claim 5, characterized in that: The ID card related video includes a video that captures at least a portion of the user and the ID card of the user together. The steps of receiving the above-mentioned ID card related video include the following steps: receiving, from the user terminal via a first channel, a region including at least a portion of the user; and An area including the ID card of the user is received from the user terminal via a second channel.

9. The user authentication method according to claim 1, characterized in that: The step of sending a plurality of instructions to the user terminal for causing the user to perform a plurality of actions further includes: A selection step of randomly selecting the plurality of instructions from a plurality of predetermined instruction candidates; and The step of sending is to send the above-mentioned multiple instructions randomly selected to the above-mentioned user terminal.

10. The user authentication method according to claim 1, characterized in that: The step of sending a plurality of instructions to the user terminal for causing the user to perform a plurality of actions further comprises: sending a first instruction to the user terminal for causing the user to perform a first action, The step of receiving the videos shot corresponding to the plurality of instructions from the user terminal comprises: receiving the video shot corresponding to the first instruction from the user terminal, The step of determining whether the user exists in the video further includes: analyzing the video shot corresponding to the first instruction to determine whether the user performs the first action in response to the first instruction.

11. The user authentication method according to claim 10, characterized in that: The step of sending multiple instructions to the user terminal to enable the user to perform multiple actions further includes: when it is determined that the user performs the first action, sending a second instruction to the user terminal to enable the user to perform a second action, The step of receiving the videos shot corresponding to the plurality of instructions from the user terminal further includes: receiving the video shot corresponding to the second instruction from the user terminal, The step of determining whether the user exists in the video further includes: analyzing the video shot corresponding to the second instruction to determine whether the user performs the second action in response to the second instruction.

12. The user authentication method according to claim 10, characterized in that: The step of sending a plurality of instructions to the user terminal to enable the user to perform a plurality of actions further includes: when it is determined that the user does not perform the first action, sending a third instruction to the user terminal to enable the user to perform a third action, The third instruction is selected based on a difference between an action of the user obtained from an analysis of a video shot in response to the first instruction and the first action.

13. The user authentication method according to claim 10, characterized in that: Also includes: When it is determined that the user does not perform the first action, communication is performed with the user terminal using a channel different from a channel used for communication with the user terminal.

14. The user authentication method according to claim 1, characterized in that: The step of sending a plurality of instructions for the user to perform a plurality of actions to the user terminal further includes: sending information related to a plurality of resolutions corresponding to the plurality of instructions together with the plurality of instructions to the user terminal.

15. The user authentication method according to claim 14, characterized in that: The plurality of resolutions corresponding to the plurality of commands include a resolution of each of a plurality of regions in a screen that displays the video captured corresponding to the plurality of commands.

16. The user authentication method according to claim 14, characterized in that: The plurality of instructions include an instruction to take a photo of at least a portion of the user and the user's ID card. The resolution of the area for guiding the user's ID card to be photographed is set higher than the resolution of the area for guiding the user's ID card to be photographed.

17. A computer-readable recording medium, characterized in that A computer program for executing the user authentication method according to any one of claims 1 to 16 in a computer is recorded.

18. A user authentication system, characterized in that: include: a communication module, sending a plurality of instructions for the user to perform a plurality of actions to the user terminal, and receiving videos shot corresponding to the plurality of instructions from the user terminal; Memory; as well as at least one processor, the at least one processor being connected to the memory and configured to execute a plurality of computer-readable instructions contained in the memory, The at least one processor is further configured to determine whether the user exists in the video, and if it is determined that the user exists, authenticate the user based on a face of the user extracted from the video, The sending of the plurality of instructions to the user terminal for causing the user to perform the plurality of actions comprises: sending information related to a transmission speed corresponding to each of the plurality of instructions together with the plurality of instructions to the user terminal, The determining whether the user exists in the video includes determining that the user does not exist when it is determined that a time difference between one or more consecutive frames included in the video does not correspond to the information related to the transmission speed.

19. The user authentication system according to claim 18, characterized in that: The communication module is further configured to receive the video in real time from the user terminal via a channel used to communicate with the user terminal.

Images