Information verification method and system

Abstract

To provide a method for verifying information received via an instant messaging application operating on a user terminal and providing a video call service.SOLUTION: An information verification method includes the steps of: receiving a gender related to a first user account; receiving an image containing a face captured through an image sensor when an application is operating; inputting the received image into an artificial neural network model and outputting a gender related to the face contained in the received image; and verifying a received gender on the basis of the output gender.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to a method and system for verifying information received via an instant messaging application that provides video calling services, and in particular, to a method and system for verifying a user's gender information received via an instant messaging application. [Background technology]

[0002] The use of user terminals such as camera-equipped smartphones, tablet PCs, laptop computers, desktop computers, etc. is becoming more widespread. In addition, with the recent development of communication technology, users can easily send images and videos taken using their own terminals to others. Furthermore, since users can send or broadcast videos taken using their own terminals to others in real time, video call services and personal broadcasting services are widely used. In the case of using anonymous chat services in this environment, there is an increasing demand from users to use not only text chat but also video call services.

[0003] Meanwhile, some users of anonymous chat services may use anonymous chat services through video calls after entering a gender different from their own gender. If a partner in an anonymous chat service is matched based on such a false gender, not only may the matched partner feel uncomfortable, but the reliability of the anonymous chat service may also be adversely affected. In order to check for such false gender, a method is used in which monitoring personnel directly use the application to expose users who act under a false gender, or directly inspect and expose the image declared by the user. However, since such inspection work is performed manually, the number of users who can be inspected may be limited depending on the number of monitoring personnel. In addition, since the monitoring personnel verify whether the gender of the user is false based on their own judgment, there is a risk that the inspection results by the monitoring personnel may be erroneous. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Korean Patent No. 10-1277322 Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure provides an information verification method, a computer program, a recording medium, a system, and the like for solving the above-mentioned problems.

[0006] A method and system are provided for receiving a gender associated with a user account and verifying the gender associated with the received user account based on an image including the user's face captured via an image sensor while an application is being operated.

[0007] Methods and systems are provided for collecting information and / or data related to a user account received or processed via an instant messaging application and verifying a gender associated with the user account based on the collected information and / or data related to the user account.

[0008] Methods and systems are provided that utilize facial imagery of a user as well as information and / or data associated with a user account received or processed via an instant messaging application to verify the gender associated with a user account.

[0009] In this application, unless otherwise clearly indicated in the context, "face" and "face" are synonymous. [Means for solving the problem]

[0010] The present disclosure can be embodied in a variety of ways, including as a method, a system, an apparatus, or a computer-readable storage medium storing commands.

[0011] A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service according to one embodiment of the present disclosure includes the steps of receiving a gender associated with a first user account, receiving an image including a face captured through an image sensor while the application is operating, inputting the received image into an artificial neural network model and outputting a gender associated with the face included in the received image, and verifying the received gender based on the output gender.

[0012] According to one embodiment, the artificial neural network model is generated by performing machine learning based on data indicative of a plurality of training images and data indicative of gender for people within the plurality of training images.

[0013] According to one embodiment, the received image includes clothing, and the step of outputting a gender associated with a face included in the received image includes the steps of extracting image features from the received image and inputting the extracted image features into an artificial neural network model to output the gender.

[0014] According to one embodiment, the step of verifying the received gender based on the output gender includes a step of providing the received image to a separate monitoring system if the output gender differs from the received gender.

[0015] According to one embodiment, the step of verifying the received gender based on the output gender includes a step of providing the received image to a separate monitoring system if the output gender is the same as the received gender and the reliability of the output gender is less than or equal to a predetermined reliability.

[0016] According to one embodiment, if the separate monitoring system determines that the received gender differs from the gender associated with the first user account, a penalty is assessed against the first user account.

[0017] According to one embodiment, the information verification method further includes a step of receiving evaluation information for the first user account from the second user account, and the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on the received evaluation information and the output gender.

[0018] According to one embodiment, the information verification method further includes a step of receiving interest information associated with the first user account, and the step of verifying the received gender based on the outputted gender includes a step of verifying the received gender based on the interest information and the outputted gender.

[0019] According to one embodiment, the information verification method further includes a step of receiving evaluation information for one or more second user accounts provided by the first user account, and the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on the evaluation information for the one or more second user accounts provided by the received first user account and the output gender.

[0020] According to one embodiment, the information verification method further includes a step of receiving one or more second user accounts that have been previously matched with the first user account, and the step of verifying the received gender based on the outputted gender includes a step of verifying the received gender based on the received information for the one or more second user accounts and the outputted gender.

[0021] According to one embodiment, the information verification method further includes a step of receiving declared information for the first user account, and the step of verifying the received gender based on the outputted gender includes a step of verifying the received gender based on the received declared information and the outputted gender.

[0022] According to one embodiment, the information verification method further includes receiving information for a plurality of user accounts associated with the first user account within the application, and verifying the received gender based on the outputted gender includes verifying the received gender based on the information for the plurality of user accounts associated with the first user account and the outputted gender.

[0023] According to one embodiment, the information verification method further includes a step of collecting user activity information for the first user account, and the step of verifying the received gender based on the outputted gender includes a step of verifying the received gender based on the collected user activity information and the outputted gender.

[0024] According to one embodiment, the user activity information for a first user account includes information regarding at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the first user account while making a video call with a second user account.

[0025] According to one embodiment, receiving a gender associated with the first user account includes receiving at least one of a gender entered while the first user account was subscribed to the application or a gender extracted from account information associated with the first user account.

[0026] According to one embodiment, the step of receiving an image including a face includes a step of receiving an image including the detected face when a face is detected in image data captured through an image sensor operated after the first user account is registered to the application.

[0027] According to one embodiment, the information verification method further includes a step of receiving text entered during a text chat between the first user account and one or more second user accounts, and the step of verifying the received gender based on the outputted gender includes a step of verifying the received gender based on the received text and the outputted gender.

[0028] In one embodiment of the present disclosure, a computer program for executing a method for verifying information received via an instant messaging application operating in the above-described user terminal and providing a video call service is provided.

[0029] A system for verifying information received via an instant messaging application providing a video calling service of the present disclosure includes a communication module configured to receive a gender associated with a first user account from a user terminal and receive an image including a face captured through an image sensor while the application is operated, and a processor configured to input the received image into an artificial neural network model to output a gender associated with the face included in the received image, and verify the received gender based on the output gender.

[0030] According to one embodiment, the communication module is further configured to receive reputation information for the first user account from the second user account, and the processor is further configured to verify the received gender based on the received reputation information and the output gender. Effect of the Invention

[0031] According to some embodiments of the present disclosure, by verifying a user's gender information received via an instant messaging application, distrust that a user using an anonymous video chat service may have regarding the gender of the other party, and further distrust of the anonymous video chat service, may be minimized or eliminated.

[0032] In some embodiments of the present disclosure, an information processing system may analyze the gender associated with a user account based on information about the user account collected via an instant messaging application, thereby minimizing the cost of manpower required to test a user's gender.

[0033] According to some embodiments of the present disclosure, the verification of a user's gender is performed through an information processing system and a separate monitoring system, i.e., a two-step system, so that the error rate of the verification result for the user's gender can be reduced or minimized. [Brief description of the drawings]

[0034] Non-limiting embodiments of the present disclosure will be described with reference to the accompanying drawings, in which like reference numerals indicate like elements, as described below. [Figure 1] 1 is a schematic diagram illustrating a configuration in which an information processing system is communicatively connected to a plurality of user terminals to provide an instant messaging service according to an embodiment of the present disclosure. [Diagram 2] 2 is a block diagram showing an internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure. FIG. [Diagram 3] FIG. 1 is a block diagram illustrating a configuration of an information processing system configured to provide a video calling service and verify a user's gender according to one embodiment of the present disclosure. [Figure 4] FIG. 2 is a schematic diagram illustrating an artificial neural network model configured to output, from an input image, a gender associated with a person or face in the input image according to one embodiment of the present disclosure. [Diagram 5] 1 is a flowchart illustrating a method for verifying information received via an instant messaging application operating in a user terminal and providing a video call service according to an embodiment of the present disclosure. [Figure 6] 10 is a flowchart illustrating detailed steps of verifying the received gender based on the output gender according to one embodiment of the present disclosure. [Figure 7] 1 is a diagram illustrating an example of receiving a gender associated with a user account while the user account is being subscribed to an instant messaging application according to an embodiment of the present disclosure. [Figure 8] 1 is a diagram illustrating an example of detecting a face image from an image captured through an image sensor and inputting requirements for a partner of a video call service while an instant messaging application according to an embodiment of the present disclosure is operated. [Figure 9]1 is a diagram illustrating an example of applying a blurring process to an image including at least a portion of a user in an instant messaging application according to an embodiment of the present disclosure. [Figure 10] 1 is a diagram illustrating an example of applying facial effect processing and sticker items to an image including a user's face in an instant messaging application according to an embodiment of the present disclosure. [Figure 11] 1 is a diagram illustrating an example of starting a video call session according to an embodiment of the present disclosure, adding a video call partner during the video call session, and performing text chat. [Figure 12] 1 is a diagram illustrating an example of sending evaluation information evaluating a counterpart during a video call session with the counterpart and receiving evaluation information from the counterpart according to an embodiment of the present disclosure. [Figure 13] 1 is a diagram illustrating an example of using a lock-in item to prevent a party from leaving a video call session according to an embodiment of the present disclosure. [Figure 14] 1 is a diagram showing an example of using a shake item of a user terminal during a video call with a partner according to an embodiment of the present disclosure. [Figure 15] 1 is a diagram showing an example of sending a declaration item during a video call session with a partner according to an embodiment of the present disclosure. [Figure 16] 1 is a diagram illustrating an example of querying messages and friend lists associated with a user account according to an embodiment of the present disclosure. [Figure 17] 1 is a diagram illustrating an example of outputting profile information related to a user account according to an embodiment of the present disclosure. [Figure 18] 1 is a diagram illustrating an example of outputting one or more user accounts that have made a video call with a user account according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0035] Hereinafter, specific details for implementing the present disclosure will be described in detail with reference to the accompanying drawings, however, in the following description, detailed descriptions of well-known functions and configurations will be omitted if they may unnecessarily obscure the gist of the present disclosure.

[0036] In the accompanying drawings, the same or corresponding components are given the same reference numerals. In addition, in the following description of the embodiments, duplicated description of the same or corresponding components may be omitted. However, even if a description of a component is omitted, it is not intended that such a component is not included in a certain embodiment.

[0037] The advantages and features of the disclosed embodiments, and the methods for achieving the same, will become apparent from the following detailed description of the embodiments in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, and may be embodied in various different forms, and the embodiments are provided solely for the purpose of making the disclosure complete and fully conveying the scope of the invention to those skilled in the art to which the disclosure pertains.

[0038] The terms used in this specification will be briefly explained, and the disclosed embodiments will be specifically explained.

[0039] The terms used in this specification are currently selected as widely used general terms as possible while taking into consideration the functions in this disclosure, but these may change depending on the intentions or precedents of engineers in the relevant fields, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meanings are described in detail in the description of the relevant invention. Therefore, the terms used in this disclosure should be defined based on the meanings that the terms have and the overall content of this disclosure, rather than simply the names of the terms.

[0040] In this specification, the singular expression includes the plural expression unless the context clearly indicates otherwise. In addition, the plural expression includes the singular expression unless the context clearly indicates otherwise.

[0041] Throughout the specification, when a part is described as "comprising" a certain element, this means that it can further include other elements, not excluding other elements, unless specifically stated to the contrary.

[0042] Also, the term "module" or "unit" used in the specification means a software or hardware component, and the "module" or "unit" performs a certain function. However, the meaning of "module" or "unit" is not limited to software or hardware. The "module" or "unit" may be configured to be in an addressable storage medium or to execute one or more processors. Thus, as an example, a "module" or "unit" may include components such as software components, object-oriented software components, class components, and task components, and at least one of a process, a function, an attribute, a procedure, a subroutine, a segment of program code, a driver, firmware, microcode, a circuit, data, a database, a data structure, a table, an array, or a variable. The components and "modules" or "units" may be combined into fewer components and "modules" or "units" or further separated into additional components and "modules" or "units".

[0043] According to an embodiment of the present disclosure, a "module" or a "unit" may be embodied with a processor and a memory. A "processor" should be broadly construed to include a general purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, and the like. In some environments, a "processor" may also refer to an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), and the like. A "processor" may also refer to a combination of processing devices, such as, for example, a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors in conjunction with a DSP core, or any other such configuration. Additionally, a "memory" should be broadly construed to include any electronic component capable of storing electronic information. "Memory" may refer to various types of processor-readable media, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, magnetic or optical data storage devices, registers, etc. Memory is said to be in electronic communication with a processor if the processor can read information from the memory and / or store information in the memory. Memory that is integrated into a processor is in electronic communication with the processor.

[0044] In this disclosure, a "user account" may refer to an account or data associated therewith that a user creates and uses in an instant messaging application. Also, a user account of an instant messaging application may refer to a user who uses the instant messaging application. Similarly, a user who uses a video calling service provided by an instant messaging application may refer to a user account of the instant messaging application.

[0045] In this disclosure, an "image" may include multiple images or videos. Also, an image may include an image captured through an image sensor attached to a user terminal, an image captured by an image sensor configured to be able to communicate with a user terminal, or a partial image extracted from a captured video image.

[0046] In this disclosure, "during the time a user account is subscribed to an application" or "at the time a user account is subscribed to an application" may refer to the period during which information and / or data required to subscribe a user account to an application is obtained or received.

[0047] In the present disclosure, "user activity information" may include information or data indicating the activity of a user or a user terminal using a user account of an instant messaging application. According to one embodiment, the user activity information of a user account may refer to information or data used by the user account while the instant messaging application is running. For example, the user activity information may include, but is not limited to, a blur item, a facial effect item, a sticker item, etc. applied to an image including the user's face. According to another embodiment, the user activity information of a user account may refer to information or data used during a video call provided by the user account in an instant messaging application. For example, the user activity information may include, but is not limited to, a lock-in item, a shake item, etc. used during a video call with the other party.

[0048] FIG. 1 is a schematic diagram showing a configuration in which an information processing system (130) is communicatively connected to a plurality of user terminals (112, 114, 116) to provide an instant messaging service according to an embodiment of the present disclosure. The information processing system (130) may include a system that can store, process, and verify information received through an instant messaging service to the plurality of user terminals (112, 114, 116) via a network (120), as well as provide information through the instant messaging service. According to an embodiment, the information processing system (130) may include one or more server devices and / or databases, or one or more distributed computing devices and / or distributed databases based on a cloud computing service, that can store, provide, and execute computer executable programs (e.g., downloadable applications) and data related to the instant messaging service. The instant messaging service provided by the information processing system (130) may be provided to users through instant messaging applications installed on the plurality of user terminals (112, 114, 116). For example, the instant messaging service may include a video call service and / or a text messaging service between the user terminals (112, 114, 116). In FIG. 1, it has been described that the information processing system (130) may be configured to verify information received via an instant messaging application, but this is not limited thereto, and the information processing system (130) may be configured to verify information received via an instant messaging application through a system separate from the information processing system (130).

[0049] In FIG. 1, a mobile phone terminal (112), a tablet terminal (114), and a PC terminal (116) are illustrated as examples of user terminals, but are not limited thereto, and the user terminal can be any computing device capable of wired and / or wireless communication, having an image sensor (e.g., a camera) attached thereto or capable of communicating with an image sensor, and having an instant messaging application installed and running on it. For example, the user terminal can include a smart phone, a mobile phone, a navigation system, a computer, a laptop, a digital broadcasting terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), a tablet PC, a game console, a wearable device, an IoT (internet of things) device, a VR (virtual reality) device, an AR (augmented reality) device, and the like. Additionally, while FIG. 1 illustrates three user terminals (112, 114, 116) communicating with the information processing system (130) via the network (120), this is not limiting and a different number of user terminals may be configured to communicate with the information processing system (130) via the network (120).

[0050] The communication method is not limited, and may include not only a communication method utilizing a communication network (e.g., a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) that the network 120 may include, but also short-range wireless communication between user terminals. For example, the network 120 may include at least one of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. In addition, the network 120 may include at least one of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree, or a hierarchical network, etc., but is not limited thereto.

[0051] The information processing system (130) may provide a video call service between user terminals (112, 114, 116) on which an instant messaging application is operated. According to an embodiment, the information processing system (130) may match a first user of a first user terminal and a second user of a second user terminal based on a specified condition, and may interconnect the first user terminal and the second user terminal so that a video call can be made between both users. Such specified conditions may include conditions for a party with which the user himself / herself desires to make a video call, and may include conditions input by at least one of the first user or the second user. For example, the specified conditions may include, but are not limited to, the gender, region, age, occupation, annual income, physical condition, etc. of the other party. According to another embodiment, the information processing system (130) may randomly match a first user of a first user terminal and a second user of a second user terminal, and interconnect the first user terminal and the second user terminal so that a video call can be made between both users.

[0052] The information processing system (130) may be configured to collect information through an instant messaging application. According to an embodiment, the information processing system (130) may be configured to receive an image including a user's face captured through an image sensor attached to a user terminal during operation of the instant messaging application. For example, such an image including the user's face may be detected or selected from an image (e.g., a video image) captured after the user subscribes to the instant messaging application, and the detected image may be provided to the information processing system (130). Also, the detected image may include not only the user's face but also the user's clothes. According to another embodiment, the information processing system (130) may collect any information and / or data related to a user for an instant messaging application. For example, the information processing system (130) may collect, but is not limited to, information input by the user to the instant messaging application, a history of the user's use of the instant messaging application, the user's friend list, input information of other users for the user, text input during a text chat, and the like.

[0053] The information processing system (130) may be configured to verify information received via an instant messaging application. According to an embodiment, when a user subscribes to an instant messaging application, the information processing system (130) may be configured to verify information received from a user terminal. Here, the information received from the user terminal may include information about the user, information indicating the user, etc., such as, but not limited to, the user's gender, age, or year of birth.

[0054] The information processing system 130 may be configured to verify information regarding the user's gender received based on information collected via an instant messaging application. According to an embodiment, the information processing system 130 may verify information regarding the user's gender received by analyzing an image including the user's face. For example, an image including the user's face or image feature information extracted therefrom may be input to a trained artificial neural network model to output the user's gender. According to another embodiment, the information processing system 130 may analyze the user's gender received based on information related to the user collected via an instant messaging application as well as an analysis result of the image including the user's face. For example, in addition to the user's gender result analyzed from the image including the user's face, the user's gender may be verified based on at least one of information input by the user via an instant messaging application, history information of the user's use of the instant messaging application, information on the user's friend list, input information of other users regarding the user, or text information input during a text chat. As yet another example, the information processing system (130) may verify the gender of the received user by using only information related to the user collected through the instant messaging application, without considering the analysis results of the image including the user's face. If the gender of the received user is different from the actual gender of the user, the information processing system may provide it to a separate verification system (e.g., a monitoring personnel check, a different algorithm for gender verification, etc.). In addition, a user account in which a false gender is entered may be subject to a penalty (e.g., suspension of use, withdrawal from membership, etc.) when using an instant messaging application.In FIG. 1, the information processing system (130) is disclosed as verifying information received via an instant messaging application, but this is not limited thereto, and a user terminal on which an instant messaging application is operated may be configured to verify the received information.

[0055] FIG. 2 is a block diagram showing the internal configuration of a user terminal (112) and an information processing system (130) in one embodiment of the present invention. The user terminal (112) may include a memory (216), a processor (218), a communication module (220), and an input / output interface (214). Similarly, the information processing system (130) may include a memory (234), a processor (236), a communication module (238), and an input / output interface (232). As shown in FIG. 2, the user terminal (112) and the information processing system (130) may be configured to communicate information and / or data over the network (120) using their respective communication modules (220, 238). In addition, the input / output device (212) may be configured to input information and / or data to the user terminal (112) and / or output information and / or data generated by the user terminal (112) via the input / output interface (214). In FIG. 2, memory (234), processor (236), communication module (238), and input / output interface (232) are illustrated as internal components of user terminal (112), although other user terminals (e.g., user terminals (114, 116) of FIG. 1) may include internal components that are the same as or similar to the internal components of user terminal (112).

[0056] The memory (216, 234) may include any non-transitory computer-readable recording medium. According to an embodiment, the memory (216, 234) may include a non-volatile permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), a disk drive, a solid state drive (SSD), a flash memory, or the like. As another example, a non-volatile mass storage device such as a ROM, an SSD, a flash memory, a disk drive, or the like may be included in the user terminal (112) or the information processing system (130) as a separate permanent storage device separate from the memory (216, 234). In addition, the memory (216, 234) may store an operating system and at least one program code (e.g., code for a browser installed and operated in the user terminal (112) or an instant messaging application installed in the user terminal (112) for providing an instant messaging service, etc.). Such software components may be loaded from a computer-readable recording medium separate from the memory (216, 234). Such separate computer-readable recording media may include recording media directly connectable to these user terminals and information verification systems, and may include computer-readable recording media such as floppy drives, disks, tapes, DVD / CD-ROM drives, memory cards, etc. As another example, the software components may be loaded into the memory (216, 234) through the communication modules (220, 238) rather than computer-readable recording media. For example, at least one program may be loaded into the memory (216, 234) based on a computer program (e.g., the instant messaging application described above) that is installed by a file provided over the network (120) by a developer or a file distribution system that distributes installation files for the application.

[0057] The processors (218, 236) may be configured to process computer program commands by performing basic arithmetic, logic, and input / output operations. The commands may be provided to the processors (218, 236) by the memory (216, 234) or the communication modules (220, 238). For example, the processors (218, 236) may be configured to execute commands received by program code stored in a storage device, such as the memory (216, 234).

[0058] The communication modules (220, 238) may provide a configuration or function for the user terminal (112) and the information verification system (130) to communicate with each other via the network (120), and may provide a configuration or function for the user terminal (112) and / or the information processing system (130) to communicate with other user terminals or other systems (e.g., a separate monitoring system). For example, a request generated by the processor (218) of the user terminal (112) from a program code stored in a recording device such as the memory (216) may be transmitted to the information processing system (130) via the network (120) under the control of the communication module (220). Conversely, a control signal, command, content, file, etc. provided under the control of the processor (236) of the information processing system (130) may be received by the user terminal (112) through the communication module (220) of the user terminal (112) via the communication module (238) and the network (120). For example, control signals, commands, content, files, etc. of the information processing system (130) received through the communication module (220) can be transmitted to the processor (218) or memory (216), and the content, files, etc. can be stored in a storage medium (the permanent storage device described above) that the user terminal (112) may further include.

[0059] The input / output interface (214) may be a means for interfacing with the input / output device (212). For example, the input device may include a device such as a camera, a keyboard, a microphone, or a mouse, and the output device may include a device such as a display, a speaker, or a haptic feedback device. As another example, the input / output interface (214) may be a means for interfacing with a device in which the configuration or function for performing input and output is integrated into one, such as a touch screen. For example, when the processor (218) of the user terminal (112) processes a command of a computer program loaded in the memory (216), a service screen or content configured using information and / or data provided by the information processing system (130) or another user terminal may be displayed on the display via the input / output interface (214). The input / output device (212) may be configured as a single device together with the user terminal (112). In addition, the input / output interface 232 of the information processing system 130 may be a means for interfacing with a device (not shown) for input or output that may be connected to the information processing system 130 or may be included in the information processing system 130. In FIG. 2, the input / output interfaces 214, 232 are illustrated as elements configured separately from the processors 218, 236, but are not limited thereto, and the input / output interfaces 214, 232 may be configured to be included in the processors 218, 236.

[0060] The user terminal (112) and the information processing system (130) may include more components than those in FIG. 2. However, it is not necessary to clearly illustrate most of the conventional technical components. According to an embodiment, the user terminal (112) may be embodied to include at least some of the above-mentioned input / output devices. The user terminal (112) may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, a database, and the like. For example, if the user terminal (112) is a smartphone, it may include components that are generally included in a smartphone, and may be embodied to further include various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, buttons using a touch panel, an input / output port, and a vibrator for vibration.

[0061] According to an embodiment, the processor (218) of the user terminal (112) may be configured to operate an instant messaging application providing a video call service. In this case, program code related to the instant messaging application may be loaded into the memory (216) of the user terminal (112). During operation of the instant messaging application, the processor (218) of the user terminal (112) may receive information and / or data provided from the input / output device (212) via the input / output interface (214) or may receive information and / or data from the information processing system (130) via the communication module (220), process the received information and / or data, and store it in the memory (216). Also, such information and / or data may be provided to the information processing system (130) via the communication module (220).

[0062] The user terminal (112) may be configured to operate a camera, which is an input device connected to an input / output interface, while the instant messaging application is being operated. For example, the camera may be arranged to capture an image including the face of the user of the user terminal (112), and may be installed on the front and / or rear of the user terminal (112). Video or images captured through the camera may be transmitted to the processor (218). According to an embodiment, the processor (218) may be configured to detect whether an image including a face is present from a video or image captured while the application is being operated (e.g., while the application is being operated after the user subscribes to the application). The processor (218) may be configured to detect an image including a face from the received image by applying any face recognition or detection algorithm, technique, and / or artificial intelligence technique known in the field of object recognition or detection. For example, the processor (218) may be configured to extract one or more feature points from the received image and determine whether a face is present in the received image based on the extracted feature points. If a face is detected from the video or image received from the camera, the processor 218 can provide the image including the face to the information processing system 130 via the communication module 220 and the network 120. According to another embodiment, during a video call service with another person provided by an instant messaging application, one or more images captured through the camera can be provided to the information processing system 130 via the communication module 220 and the network 120. In addition, the processor 236 of the information processing system 130 can provide to the user terminal 112 one or more images received from the user terminal of the other person in the call with the user terminal 112.During such a video call service, the image captured through the camera and the user's voice received through a microphone connected to the input / output interface can be provided together through the information processing system (130) and provided to the other user's terminal.

[0063] According to an embodiment, while the instant messaging application is operated, the processor (218) may receive text, images, etc. input or selected through an input device such as a touch screen, keyboard, etc. connected to the input / output interface, and may store the received text and / or image in the memory (216) or provide it to the information processing system (130) through the communication module (220) and the network (120). For example, the processor (218) may receive user information such as a user's gender and age, text information such as a text message, interest information, and declaration information input during the instant messaging service through an input device such as a touch screen, keyboard, etc. In addition, the processor (218) may be configured to receive evaluation information on the other party and item information such as a blur item, a facial effect item, a lock-in item, a shake item, and a sticker item through the input device. Thus, the received text and / or image may be provided to the information processing system (130) through the communication module (220) and the network (120).

[0064] During operation of the instant messaging application, the processor 218 may be configured to output processed information and / or data through an output device, such as a display-capable device (e.g., a touch screen, a display, etc.) or an audio-capable device (e.g., a speaker) of the user terminal 112. According to an embodiment, information and / or data provided by the instant messaging application may be displayed through a display-capable device, etc. For example, during a video call service provided by the instant messaging application, the processor 218 may be configured to display not only an image of the user but also an image of the other party through a display-capable output device. As another example, the processor 218 may be configured to display various functions or configurations provided by the instant messaging application (e.g., a profile, a user information input interface, rating information, video processing items, a chat box, a friend list, etc.) on a display-capable output device. According to another embodiment, information and / or data provided by the instant messaging application may be output through an audio-capable device, etc. For example, during a video call service, the processor 218 may be configured to output the voice of the other party received from the information processing system 130.

[0065] According to an embodiment, the processor 236 of the information processing system 130 may be configured to manage, process, and / or store information and / or data received from a plurality of user terminals including the user terminal 112. For example, the processor 236 may provide a video call service and / or a text chat service provided by an instant messaging application to the plurality of user terminals based on the information and / or data received from the plurality of user terminals. For example, the processor 236 may be configured to provide video, audio, and / or text data received from each user terminal to the other user terminal while both user terminals are performing a video call.

[0066] The processor (236) of the information processing system (130) may be configured to verify information and / or data received from the user terminal (112) while the instant messaging application is operating. According to an embodiment, the processor (236) of the information processing system (130) may be configured to receive information regarding the user's gender from the user terminal (112) and verify the received gender. Specifically, the processor (236) of the information processing system (130) may be configured to verify the user's gender based on the received information and / or data related to the user terminal (112). A specific manner in which the processor (236) of the information processing system (130) verifies the information regarding the user's gender will be described in detail below.

[0067] 3 is a block diagram showing a configuration of an information processing system (130) configured to provide a video calling service and verify a user's gender according to an embodiment of the present disclosure. The processor (236) of the information processing system (130) may be configured to include a data collection module (310), a data learning module (320), a data recognition module (330), and a gender verification module (340). The processor (236) may also transmit and receive information and / or data to and from an external device through a communication module (238). In addition, the processor (236) may store information and / or data in and / or retrieve information and / or data from the memory (234).

[0068] The data collection module (310) may be configured to receive an image including a user's face from each of a plurality of user terminals through the communication module (238) while the instant messaging application is being operated. According to an embodiment, the data collection module (310) may receive an image including a user's face from an active user terminal of a user account after subscribing to the instant messaging application of the user account. For example, the received image may include not only the user's face but also at least one of other body parts of the user (e.g., neck, shoulders, arms, etc.) or clothing. The image received from the user terminal may be stored in the memory (234) or provided to the data recognition module (330).

[0069] The data collection module (310) may be configured to receive information associated with the user account from the user terminal through the communication module (238) while the instant messaging application is operating. According to one embodiment, the data collection module (310) may be configured to receive a gender associated with the user account from the user terminal. According to another embodiment, the data collection module (310) may be configured to receive interest information associated with the user account from the user terminal. According to yet another embodiment, the data collection module (310) may receive information for multiple user accounts associated with the user account. For example, such multiple user accounts may be stored as a friend list for the user account.

[0070] The data collection module (310) may receive information on one or more user accounts with which the user account is matched in an instant messaging application through the communication module (238). According to an embodiment, a list of such one or more matched user accounts may be stored in the usage history of the user account. Such one or more matched user accounts may be stored in the usage history of the user account regardless of whether a video call or text chat service has been performed with the user account.

[0071] The data collection module (310) may be configured to receive information and / or data generated during a video call between a user account (e.g., a first user account) and another user account (e.g., a second user account) through the communication module (238). According to one embodiment, during a video call session between the first user account and the second user account, the data collection module (310) may receive evaluation information of the second user account for the first user account. Such evaluation information of the second user account for the first user account may be stored in association with the first user account. According to another embodiment, during a video call session between the first user account and the second user account, the data collection module (310) may receive evaluation information of the first user account for the second user account, such evaluation information may be stored in association with the first user account. Here, the evaluation information may include evaluation items including icons indicating characteristics of each user account or user, and a number for each evaluation item. According to yet another embodiment, during a video call session between the first user account and the second user account, the data collection module (310) may receive reporting information for the first user account from the second user account. For example, the reporting information may include reporting items related to information different from the information of the first user account during the video call (e.g., when the gender of a person in a real image is different from the gender of a person known), inappropriate behaviors performed by the user of the first user account, etc., and may also include the number of times for each reporting item. According to yet another embodiment, while the first user account is conducting a video call service with the second user account, the data collection module (310) may receive text messages between the first user account and the second user account.

[0072] The data collection module 310 may be configured to receive user activity information used during a video call between a user account (e.g., a first user account) and another user account (e.g., a second user account). According to an embodiment, such user activity information may include information received from the first user account during a video call session between the first user account and the second user account, as well as information received from the first user account before such a video call is performed. For example, the user activity information may include information on at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the first user account during a video call session with the second user account. Here, the facial effect item may include at least one of a facial filter applicable to the face of the first user account, an item for reducing the face of the first user account, or a beauty item applicable to the face of the first user account. The information and / or data received by the data collection module (310) may be stored in memory (234) in association with a user account and / or provided to the data recognition module (330) and / or the gender verification module (340).

[0073] The data learning module (320) may receive data indicative of a plurality of training images through the memory (234) or the communication module (238). For example, the plurality of training images may include any set of images that may be trained to clearly show the distinction between males and females. The data indicative of the plurality of training images may include data indicative of an image including a plurality of people or faces, data indicative of image features extracted from such an image, and the like. The data indicative of image features may include any information and data capable of indicating or characterizing an image, and may include, for example, information and data indicative of or characterizing an object (e.g., face, clothing, etc.) in an image. As an example, the information and data indicative of or characterizing an object (e.g., face, clothing, etc.) in an image may include information and data indicative of at least one of feature points for the object, a segmentation mask for the object, or a depth for the object. In addition, the data learning module (320) may also receive data indicative of the gender of the person or face in the plurality of training images. For example, the data indicative of the gender may include data indicative of male or female.

[0074] The data learning module 320 may generate an artificial neural network model by performing machine learning to input a plurality of training images and output gender. According to an embodiment, the data learning module 320 may be configured to input a plurality of training images and / or image features extracted therefrom to an artificial neural network model and output gender through unsupervised learning. In addition, the data learning module 320 may be configured to perform labeling, i.e., supervised learning, on the training images to generate or update an artificial neural network model when it is determined that the gender output for the training image is incorrect based on data indicating gender associated with a person or face in the training image. Thus, the data learning module 320 may generate or update an artificial neural network model through semi-supervised learning using a plurality of training images and data indicating gender associated with a person or face in the training image. According to another embodiment, the data learning module (320) may generate an artificial neural network model by performing machine learning to input learning information related to the user account and output gender. Here, the learning information related to the user account may include information related to the user account that may be received or processed via an instant messaging application. For example, the learning information related to the user account may include, but is not limited to, at least one of rating information, interest information, history information, declaration information, friend list, user activity information, or text messages related to the user account.In this case, the data learning module (320) can generate or update an artificial neural network model by performing machine learning to input not only the learning information related to the user account but also the learning image into the artificial neural network model to output gender.

[0075] The data recognition module (330) may be configured to receive an image including a face received from a user account, input the received image to an artificial neural network model, and output a gender associated with a face or person in the received image. Here, the artificial neural network model may include an artificial neural network model trained by the data learning module (320). According to an embodiment, the data recognition module (330) may be configured to input image features extracted from an image including a face to the trained artificial neural network model, and output a gender associated with a person or face in the image. Also, if it is determined that the output gender is different from the actual gender, the data recognition module (330) may be configured to provide the received image and the actual gender to the data learning module (320) so that the artificial neural network model is retrained. According to another embodiment, the data recognition module (330) may receive information corresponding to learning information associated with a user account used in training the artificial neural network model in the data learning module (320), and input the received information to the artificial neural network model to output a gender. This information, along with the received image, can then be input into a trained artificial neural network model to output a gender. The gender output from the artificial neural network model can be provided to a gender verification module (340) to verify the gender of the user account.

[0076] The gender verification module (340) can verify the gender of the user account received when the user account subscribes to the instant messaging application based on the gender information provided by the data recognition module (330). According to an embodiment, the gender verification module (340) can impose a penalty such as suspension of use or withdrawal of subscription on the user account if the output gender is different from the gender of the received user account. According to another embodiment, the gender verification module (340) can transmit an image including a face related to the user account to a separate monitoring system if the output gender is different from the gender of the received user account. Here, the separate monitoring system can include a system that verifies the gender of the user account using a method or algorithm different from the verification method or algorithm performed by the gender verification module (340), and can be configured, for example, for monitoring personnel to directly inspect the received image. Alternatively, the gender verification module (340) can be configured to complete the verification of the gender of the user account if the output gender is the same as the gender of the received user account.

[0077] The gender verification module (340) may be configured to receive information related to the user account as well as the gender information output from the data recognition module (330) and verify the gender of the user account based on the output gender information and the received information. According to an embodiment, the information related to the user account may include information received from the user account via an instant messaging application or information generated or processed when the user account is active on the instant messaging application. For example, the information related to the user account may include, but is not limited to, at least one of rating information, interest information, history information, declaration information, friend list, user activity information, or text messages related to the user account. Here, the user activity information may include information on at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the user account during a video call with another user account.

[0078] According to an embodiment, the gender verification module (340) may be configured to verify the gender of the received user account through rule-based learning and prediction based on the information related to the received user account and the gender output from the data recognition module (330). For example, the gender verification module (340) may generate a table that matches the gender of the user account based on at least one of the output gender information or the information related to the user account. Thus, the gender verification module (340) may extract a gender corresponding to the information related to the received user account and the output gender received from the data recognition module (330) based on the generated table, and compare the extracted gender with the gender of the received user account. In another embodiment, the gender verification module (340) may verify the gender information of the received user account through a known machine learning technique using the information related to the received user account and the gender output from the data recognition module (330). For example, the machine learning technique may include, but is not limited to, a Find-S algorithm, a Version Space algorithm, and a Candidate Elimination algorithm. According to still another embodiment, the gender verification module (340) may change a weighting value used in outputting the gender of the user account or change a confidence score associated with the output of the user's gender using the received information related to the user account. The gender verification module (340) may be configured to provide an image including the face of the user account to a separate monitoring system if the received user account is different from the actual gender based on the received information related to the user account and the gender output from the data recognition module (330).

[0079] In Fig. 3, the processor (236) of the information processing system (130) is configured to include a data collection module (310), a data learning module (320), a data recognition module (330), and a gender verification module (340) in order to verify the gender of the user, but is not limited thereto, and the processor (218) of the user terminal may be configured to verify the gender of the user by including the same or similar configuration as the data collection module (310), the data learning module (320), the data recognition module (330), and the gender verification module (340). Also, in Fig. 3, the data collection module (310), the data learning module (320), the data recognition module (330), and the gender verification module (340) are illustrated as separate modules, but are not limited thereto, and each of these modules (310 to 340) may be combined and embodied as one or more modules.

[0080] FIG. 4 is a schematic diagram illustrating an artificial neural network model (400) configured to output gender associated with a person or face in an input image from an input image according to an embodiment of the present disclosure. The artificial neural network model (400) is a statistical learning algorithm implemented based on the structure of a biological neural network in machine learning technology and cognitive science, or a structure for executing the algorithm. According to an embodiment, the artificial neural network model (400) can represent a machine learning model having a problem-solving ability by learning such that a node, which is an artificial neuron forming a network by synaptic connections like a biological neural network, repeatedly adjusts the weight value of the synapse and reduces the error between a correct output corresponding to a specific input and an inferred output. For example, the artificial neural network model (400) can include any probability model, neural network model, etc. used in artificial intelligence learning methods such as machine learning and deep learning.

[0081] According to one embodiment, the artificial neural network model (400) may include an artificial neural network model configured to input training images including faces or people and / or image features extracted from such training images and output gender. In another embodiment, the artificial neural network model (400) may include an artificial neural network model configured to input training information received or processed via an instant messaging application and output gender. In yet another embodiment, the artificial neural network model (400) may include an artificial neural network model configured to input training information received or processed via an instant messaging application and training images including faces or people (or image features extracted from the training images) and output gender.

[0082] The artificial neural network model (400) is realized as a multilayer perceptron (MLP) composed of multiple nodes and connections between them. The artificial neural network model (400) according to the present embodiment can be realized using one of various artificial neural network model structures including MLP. As shown in FIG. 4, the artificial neural network model (400) is composed of an input layer (420) that receives an input signal or data (410) from the outside, an output layer (440) that outputs an output signal or data (450) corresponding to the input data, and n (here, n is a positive integer) hidden layers (430_1 to 430_n) that are located between the input layer (420) and the output layer (440) and receive signals from the input layer (420), extract characteristics, and transmit them to the output layer (440). Here, the output layer (440) receives signals from the hidden layers (430_1 to 430_n) and outputs them to the outside.

[0083] The learning method of the artificial neural network model (400) includes a supervised learning method in which the model learns to be optimized for solving a problem by inputting a teacher signal (correct answer), and an unsupervised learning method that does not require a teacher signal. The data learning module (320) can train the artificial neural network model (400) to perform analysis on an input image using supervised learning to provide gender information associated with a face or person in a learning image, and to extract a gender corresponding to the image. The artificial neural network model (400) trained in this way can be provided to or accessed by the data recognition module (330), and can output a gender associated with a user account in response to an input of an image including a face received from the user account.

[0084] According to an embodiment, as illustrated in FIG. 4, an input variable of the artificial neural network model (400) capable of extracting gender information may be a training image including a face or a person. For example, an input variable input to an input layer (420) of the artificial neural network model (400) may be an image vector (410) in which the training image is composed of one vector data element. In response to the input of the training image including a face or a person, an output variable output from an output layer (440) of the artificial neural network model (400) may be a vector (450) indicating gender. In addition, the output layer (440) of the artificial neural network model (400) may be configured to output a vector indicating the confidence or accuracy of the output gender. For example, the vector indicating the confidence or accuracy of such an output may be interpreted or displayed as a score. In the present disclosure, the output variables of the artificial neural network model (400) are not limited to the types described above, and may be indicated in various forms related to gender information and the confidence of the gender information.

[0085] In this way, the input layer (420) and output layer (440) of the artificial neural network model (400) are matched with a plurality of input variables and a plurality of corresponding output variables, and the synapse values ​​between the nodes included in the input layer (420), hidden layers (430_1 to 430_n), and output layer (440) are adjusted, so that the artificial neural network model can learn to extract a correct output corresponding to a specific input. Through this learning process, the characteristics hidden in the input variables of the artificial neural network model (400) can be grasped, and the synapse values ​​(or weights) between the nodes of the artificial neural network model (400) can be adjusted so that the error between the output variables calculated based on the input variables and the target output is reduced. Using the artificial neural network model (400) trained in this way, gender information for a person or face in an input image can be output in response to an input image.

[0086] According to another embodiment, the input variables of the artificial neural network model (400) capable of extracting gender information may include learning information received or processed via an instant messaging application. For example, the learning information received or processed via an instant messaging application may include, but is not limited to, at least one of rating information, interest information, history information, declaration information, friend list, user activity information, or text messages. In response to such learning information, the output layer (440) of the artificial neural network model (400) may be a vector indicating gender and a vector indicating confidence or accuracy for gender. According to yet another embodiment, the input variables of the artificial neural network model (400) capable of extracting gender information may include such learning information and a learning image including a face, and the output layer (440) of the artificial neural network model (400) may be a vector indicating gender and a vector indicating confidence or accuracy for gender. Here, the weighted values ​​between the nodes included in the input layer (420), hidden layers (430_1 to 430_n), and output layer (440) may be adjusted so that a correct output corresponding to a specific input may be extracted. The artificial neural network model (400) capable of extracting such gender information may be provided to or accessed by the data recognition module (330), and an image including a face or person in relation to a user account and / or information related to the user account may be input to the artificial neural network model (400), and the gender of the user account and a score indicating the confidence or accuracy of the gender may be output.

[0087] 5 is a flowchart illustrating a method (500) for verifying information received via an instant messaging application operating on a user terminal and providing a video call service according to an embodiment of the present disclosure. The method may be performed by an information processing system (130) or a user terminal (112, 114, 116) and may begin with a step (S510) of receiving a gender (e.g., a user's gender) associated with a first user account. According to one embodiment, the gender associated with the user account may be directly input when subscribing to an application for the user account. In another embodiment, the gender associated with the user account may be extracted from account-related information associated with the first user account.

[0088] Then, while the application is operated in step S520, an image including a face captured through the image sensor may be received. For example, the image sensor may be attached to a front and / or rear part of the user terminal so as to generate an image including the user's face. According to an embodiment, the image sensor may be configured to be automatically operated and generate an image after a user account is registered. If an image including the face of the user account is detected in the generated images, the image including the detected face may be provided to a data recognition module to verify the gender of the user account.

[0089] Next, the data recognition module may input the received image into an artificial neural network model and output a gender associated with the face included in the received image (S530). Here, the artificial neural network model may be generated by machine learning performed by the data learning module based on data representing a plurality of training images and data representing the gender of a person in the plurality of training images. Also, the received image may include not only the user's face but also the user's clothing. Image features may be extracted from such an image, and the extracted image features may be input into the artificial neural network model to output the gender.

[0090] Also, in step (S540), the gender verification module may be configured to verify the received gender based on the output gender. According to one embodiment, reputation information for the first user account may be received from the second user account, and the gender verification module may verify the received gender based on the received reputation information and the output gender. In another embodiment, interest information related to the first user account may be received, and the gender verification module may verify the received gender based on the received interest information and the output gender. According to yet another embodiment, reputation information for one or more second user accounts provided by the first user account may be received, and the gender verification module may be configured to verify the received gender based on the received reputation information for the one or more second user accounts provided by the first user account and the output gender information. In yet another embodiment, one or more second user accounts that have previously been matched with the first user account are received, and the gender verification module may verify the received gender based on the received information for the one or more second user accounts and the output gender. According to yet another embodiment, declared information for a first user account may be received, and the gender verification module may be configured to verify the received gender based on the received declared information and the output gender. According to yet another embodiment, information for a plurality of user accounts (e.g., a friends list) associated with the first user account within the application may be received, and the gender verification module may verify the received gender based on the information for the plurality of user accounts (e.g., gender and number of friends) associated with the first user account and the output gender. In yet another embodiment, user activity information for the first user account may be collected, and the gender verification module may verify the received gender based on the collected user activity information and the output gender.For example, the user activity information for the first user account may include information on at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the first user account during a video call with the second user account. In yet another embodiment, text entered during a text chat between the user account and one or more second user accounts may be received, and the gender verification module may be configured to verify the received gender based on the received text and the output gender.

[0091] FIG. 6 is a flowchart showing detailed steps of verifying the received gender based on the output gender according to an embodiment of the present disclosure (S540). First, the gender verification module may start with a step of determining whether the output gender is the same as the received gender (S610). If the output gender is different from the received gender, the received image may be provided to a separate monitoring system (S630). Alternatively, if the output gender is the same as the received gender, the gender verification module may determine whether the reliability (e.g., score) of the output gender received from the data recognition module is equal to or greater than a predetermined reliability. For example, if the score of the output gender in the artificial neural network model is 89 points or less, it may be analyzed that there is a recognition failure rate of about 30% of the output gender, and in this case, the predetermined reliability (score) may be set to 90 points. If the reliability of the output gender is equal to or greater than the predetermined reliability, the verification of the received gender may be completed (S640). Alternatively, if the confidence level for the output gender is less than a predetermined confidence level, the received image may be provided to a separate verification system (S630).

[0092] A separate verification system may analyze the received image to determine whether the received gender is the same as the gender associated with the user account (S650). If it is determined that the received gender is different from the gender associated with the user account, a penalty may be applied to the user account (S660). Alternatively, if it is determined that the received gender is the same as the gender associated with the user account, verification of the received gender may be completed (S640).

[0093] 7 is a diagram illustrating an example of receiving a gender associated with a user account while the user account is being subscribed to an instant messaging application according to an embodiment of the present disclosure. Subscription to the instant messaging application may be performed through a first operation (710) and a second operation (720) in a user terminal. In one embodiment, the instant messaging application may be one of multiple applications installed and executed on the user terminal.

[0094] When the instant messaging application is operated, the user may be provided with an interface for subscribing to the instant messaging application. As illustrated in a first operation (710), a list of other sites or applications (712) may be displayed on a screen. The user may select one of the displayed list of other websites or applications (712) and log in with a user account of the selected website or application to link and subscribe to the instant messaging application. Here, the other websites may include websites to which a given user is likely to have already subscribed, and the user may select a website to which the user has already subscribed, and account information of the selected website may be used when linking and subscribing to the instant messaging application. Gender information of the user may be extracted from the account information of the selected website, and the information processing system may be configured to verify the extracted gender information. As illustrated in a second operation (720), the user may be provided with an interface for inputting the user's gender (722) and birth year (724) at or during the time of subscribing to the instant messaging application. The received user gender (722) and year of birth (724) can be provided to an information processing system, and the received user gender (722) can be verified by the information processing system.

[0095] 8 is a diagram illustrating an example of detecting an image including a face from a plurality of images captured through an image sensor and inputting requirements for a partner of a video call service while an instant messaging application according to an embodiment of the present disclosure is being operated. After a user subscribes to the instant messaging application, as shown in a first operation (810), input image data can be generated and displayed on a screen through an image sensor disposed on the front side of a user terminal operated by the instant messaging application.

[0096] The user terminal may determine whether there is an image including the user's face from the input video data. As illustrated in the first operation (810), for example, a smiley face emoji and a text "Finding a face" (812) may be displayed while detecting the user's face from the video data. If the user's face is detected from the video data, the image including the user's face may be used to verify the gender associated with the user. According to one embodiment, one image including the user's face may be used to verify the gender of the user. According to another embodiment, multiple images including the user's face may be used to verify the gender of the user. In this case, the multiple images including the face may be used to determine the depth of an object including the user's face, and information regarding the depth of the object may be used to verify the gender of the user. Alternatively, the information processing system may input each of the multiple images including the user's face to the data recognition module (330) to output multiple genders and confidence values, and analyze the output multiple genders and confidence values ​​to verify the gender of the user.

[0097] As illustrated in the first operation (810), after a user subscribes to the instant messaging application, a number of icons (814, 816, 818, 820) may be displayed on the screen. For example, when the icon (814) is selected, information related to the user's profile may be displayed. For another example, when the icon (816) is selected, information related to a shop provided by the instant messaging application may be displayed. For yet another example, when the icon (818) is selected, information on a number of user accounts related to the user account (e.g., a friend list) and information on messages previously exchanged with the number of user accounts may be displayed. For yet another example, when the icon (820) is selected, information on the usage history of the user account (e.g., a list of users previously matched with the user account, etc.) may be displayed. Also, as illustrated in the first operation (810), text "I am searching for anyone in everywhere" (822) may be displayed, allowing the user account to specify information on a person with whom the user account desires video calling services. When the text (822) is selected (e.g., touched), an interface is provided in which the user can input desired characteristics of a partner for the video calling service, such as gender and region, as shown in a second operation (830).

[0098] 9 is a diagram illustrating an example of applying blur processing to an image including at least a part of a user in an instant messaging application according to an embodiment of the present disclosure. A first operation (910) illustrates an operation in which image data including a user's face and clothes is displayed through an image sensor before the user matches a partner for a video call service. As illustrated, a swipe area (914) for starting to search for a partner for a video call may be displayed. When a swipe is performed after a specific point of the swipe area (914) is touched, a partner for a video call may be searched for based on a previously set condition.

[0099] A user may click an icon (912) for blurring an image to apply the blur item to one or more images including a part of the user. According to an embodiment, when a user selects the second region (912), an interface, i.e., a second action (920), may be displayed in which the degree of the blur effect to be applied to the displayed image may be selected. Then, the user may determine the degree of the blur effect by touching a point on a bar (922) located at the bottom of the screen and then adjusting the point on the line. Information on such blur items may be stored as user activity information of the user account and may be used to determine the gender of the user account. For example, blur items may be provided only to females, and if a particular user account uses the blur item more than a predetermined number of times, it may be interpreted as an action to deceive its gender, and the gender of the particular user account may be more likely to be determined to be false.

[0100] 10 is a diagram illustrating an example of applying a facial effect process and a sticker item to an image including a user's face in an instant messaging application according to an embodiment of the present disclosure. A user can select an item to be applied to a displayed image through a first operation (1010), a second operation (1020), and a third operation (1030) in a user terminal. For example, the items can include facial effect items and sticker items, including a face filter effect item and a face reduction item. The selected item can be used when the user makes a video call with another user.

[0101] In one embodiment, as shown in a first operation (1010), a user may select a first icon (1012) for applying a face filter item, and when a first region (1012) is selected, a list (1014) of applicable face filters may be displayed horizontally. The user may perform a swipe motion within these lists (1014) to display additional face filters that are not currently displayed. The user may select one of the applicable face filters to apply to a portion (e.g., the face) or the entirety of the displayed image. Such face filters may include filters that can apply beauty effects to the face.

[0102] According to one embodiment, as shown in the second operation (1020), the user may select a second icon (1022) for applying a face reduction item, and when the second icon (1022) is selected, a bar (1024) may be displayed that allows the user to select the degree of face reduction. The user may determine the degree of reduction of the face included in the image by adjusting the points of the bar (1024) on the line. The degree of such face reduction may be displayed as a numerical value (e.g., 8 in FIG. 10).

[0103] In one embodiment, as shown in a third action (1030), a user may select a third icon (1032) for selecting stickers that can be applied to the face, and when the third icon (1032) is selected, a list of applicable stickers (1034) may be displayed horizontally. The user may perform a swipe motion within these lists (1034) to display more stickers that are not currently displayed. One of the displayed stickers may be selected, and the selected sticker may be used in a video call session with another user.

[0104] Information on facial effect items and sticker items that a user plans to use or has used during a video call session with another user may be stored as user activity information. Such user activity information may include information on the type and number of times of items used. The user activity information may be used to verify the gender of a user. Information on facial effect items and sticker items that are frequently used according to males and females may be collected, and the collected information may be used to verify the gender of a user. According to an embodiment, the information processing system may be configured to verify the gender of a first user account based on user activity information including gender information, facial effect items, sticker items, etc. output from the data recognition module (330) for a first user account.

[0105] 11 is a diagram illustrating an example of starting a video call session according to an embodiment of the present disclosure, and adding a video call partner during the video call session to perform text chat. According to an embodiment, the information processing system may collect information on a second user account that is a video call partner to verify the gender of the first user account. In another embodiment, text entered during a text chat with the second user account may be collected to verify the gender of the first user account. Here, the text may include text entered from at least one of the first user account or the second user account.

[0106] A user of a first user account can determine a partner with whom to perform a video call of the first user account through a first operation (1110). As illustrated in the first operation (1110), when the information processing system matches a second user account that is a partner of a video call of the first user account, profile information (1114) for the second user account can be displayed on the screen. For example, the profile information can include a facial image, a residential area, interest information, and rating information for the second user account of the second user account. When the profile information for the second user account is displayed, if a skip icon (1112) is touched, a video call with the second user account can not be performed. In contrast, if the skip icon (1112) is not touched, a video call with the second user account can be performed.

[0107] During a video call session between a first user account and a second user account, the second user account can be added as a friend of the first user account. According to an embodiment, the user of the first user account can add the second user account as a friend of the first user account by selecting an icon (1122) for adding a friend displayed on the screen through a second operation (1120). In this case, the added second user account can be stored in association with the first user account.

[0108] During a video call session between the first user account and the second user account, the user of the first user account may conduct a text chat with the user of the second user account. The user of the first user account may input text through a text input area (1132) displayed on the screen through a third operation (1130), and the text input from the first user account and / or the second user account may be displayed in a text display window (1134). Such text may be stored in association with the first user account. The information processing system may be configured to collect text associated with the first user account and analyze the content of the text, and to verify the gender of the first user based on the content of the analyzed text. As an example, the information processing system may extract keywords from the collected text, assign weighted values ​​to the extracted keywords, and verify the gender of the first user based on the keywords and weighted values. As another example, the information processing system may be configured to perform natural language processing on the collected text to verify the gender of the first user.

[0109] FIG. 12 is a diagram illustrating an example of transmitting evaluation information for evaluating a counterpart during a video call session with the counterpart and receiving evaluation information from the counterpart according to an embodiment of the present disclosure. A user of a first user account can transmit evaluation information for a second user account and can receive evaluation information for the user from the second user account. Here, the evaluation information can include evaluation items selected for the user account. A first operation (1210) may represent an operation required when the user of the first user account transmits evaluation information for the second user account, and a second operation (1220) may represent an operation in which the user of the first user account receives evaluation information for the first user account from the second user account.

[0110] According to one embodiment, an icon (1212) for displaying the rating information indicated by the first operation (1210) may be selected. When the icon (1212) is selected, a list of rating items (1214) may be displayed. As illustrated, the rating items may be displayed as swaggs, and for example, swaggs may include, but is not limited to, a Handsome icon, a Pretty icon, a Cute icon, a Stylish icon, a Lovely icon, a Humorous icon, and the like. For example, if a user of a first user account selects a Handsome icon for a second user account, the Handsome icon may be displayed on a screen of a user terminal on which the second user account is operated, and the selected icon may be stored in association with the first user account.

[0111] According to another embodiment, a first user account may receive rating information for the first user account from a second user account. As shown in a second operation (1220), a pretty icon may be received. The received pretty icon may be stored in association with the first user account.

[0112] The information processing system may collect evaluation information for the first user account from one or more second user accounts. The information processing system may store the type and number of times of the Swaggs icon for the first user account collected from one or more second user accounts as evaluation information for the first user account. The information processing system may also be configured to analyze the Swaggs icons used by a plurality of users to determine the gender of the user who used the type and number of times of the Swaggs icon. For example, if a relatively large number of Handsome icons, Stylish icons, and / or Humorous icons are given, it is highly likely that the gender corresponding to such icons is determined to be male. As yet another example, if a relatively large number of Pretty icons, Cute icons, and / or Lovely icons are given, it is highly likely that the gender corresponding to such icons is determined to be female. Thus, the information processing system may be configured to verify the gender of the first user account based on the collected evaluation information for the first user account (i.e., the type and number of icons in Swaggs). According to one embodiment, the evaluation information of the first user account may be used to adjust a weighting used when the gender associated with the first user account is output by the data recognition module, or to adjust the reliability of the output gender. In FIG. 12, Swags is illustrated as including six icons, but is not limited thereto, and Swags may be composed of more than six icons.

[0113] FIG. 13 is a diagram showing an example of using a lock-in item to prevent a party from leaving during a video call session with a party according to an embodiment of the present disclosure. According to an embodiment, the information processing system may collect lock-in items used during a video call session to verify the gender of a first user account. Here, the collected lock-in items may include the type and number of times of the lock-in items. For example, information about lock-in items used by a first user account for one or more second user accounts that are the other party of the video call may be collected as user activity information of the first user account. As another example, information about lock-in items used by one or more second user accounts for the first user account may be stored in association with the first user account.

[0114] In one embodiment, as illustrated in the first operation (1310), the first user account may be provided with a list (1312) of selectable lock-in items during a video call session with the second user account. Here, the list (1312) of lock-in items may include a plurality of lock-in items that provide a function of preventing the other party from leaving the video call session for a certain period of time. For example, as illustrated, the list (1312) of lock-in items may include a 10-second lock-in item, a 20-second lock-in item, and a 30-second lock-in item. Such lock-in items may be purchased with coins that the first user account may use in an instant messaging application. The lock-in items used in this manner may be stored as user activity information of the first user account and may be used to verify the gender of the first user account. The information processing system may be configured to analyze information on the plurality of lock-in items used by a plurality of users to determine the gender of the user who used the lock-in items by type and number of times.

[0115] According to one embodiment, as illustrated in the second operation (1320), the first user account may receive a lock-in item from the second user account during the video call session of the second user account and display it on the screen. For example, the received item may be a 10 second lock-in item (1322), and the received 10 second lock-in item (1322) may be displayed on the screen of the first user account. In this case, the first user account cannot leave the video call session of the second user account. The information processing system may collect the lock-in items received by the first user account from multiple video call parties and store the collected lock-in items in association with the first user account. The collected lock-in items may be used to verify a gender associated with the first user account.

[0116] FIG. 14 is a diagram illustrating an example of using a shake item of a user terminal during a video call with a counterpart according to an embodiment of the present disclosure. Here, the shake item may be used when the counterpart has a favorable intention during a video call session. For example, during a video call session between a first user account and a second user account, if the first user account uses a shake item on the second user account, a first operation (1410) may be performed. As another example, during a video call session between the first user account and the second user account, if the second user account uses a shake item on the first user account, a second operation (1420) may be performed.

[0117] According to an embodiment, a user of a first user account may use a shake item by shaking a user terminal on which the first user account is operated during a video call session with a second user account. As illustrated in a first operation (1410), when the shake item is used, a first special effect expressing affection may be displayed on the screen. And, when the second user account uses the shake item during a video call session between the first user account and the second user account, a second special effect indicating mutual affection may be displayed. As illustrated in a second operation (1420), the second special effect may include a larger amount of effects than the first special effect. When the first user account uses a shake item for the second user account during a video call session between the first user account and the second user account, the used shake item may be stored as user activity information of the first user account. The information processing system may collect information about the shake items used by the first user account for one or more user accounts with which the first user account was a video call partner, as user activity information of the first user account. User activity information for the first user account can be used to verify the gender of the first user account, and shake items used by one or more second user accounts with respect to the first user account can be stored as information associated with the first user account and can be used to verify the gender of the first user account.

[0118] 15 is a diagram illustrating an example of sending a report item during a video call with a counterpart according to an embodiment of the present disclosure. According to an embodiment, a second user account may report a first user account if the user of the first user account exhibits inappropriate behavior or information different from the profile information of the first user account is found during a video call session with the first user account. When reporting the first user account, the second user account may select or write a report item for the first user account.

[0119] As shown in FIG. 15, the second user account may select an icon (1510) for reporting the first user account during a video call session with the first user account. When the icon (1510) is selected, a list of reporting items (1520) may be displayed on the screen. For example, the list of reporting items (1520) may include items such as "Violence or harmful behavior", "Sexual harassment", and "Other", and may include any items that may be reported if the first user account behaves inappropriately toward the other party or is different from the other party's profile information. According to an embodiment, if the gender of the first user account grasped on the video call is male and the profile of the first user account is displayed as female, the user of the second user account may report the first user account, and as shown in FIG. 15, may select the "Other" item and report the fact that the gender of the first user account is different from the actual gender. Such reporting items may be provided to an information processing system and may be used to verify the gender of the first user account.

[0120] 16 is a diagram illustrating an example of querying messages and a friend list associated with a user account according to an embodiment of the present disclosure. A user can search for information associated with the user account, i.e., messages exchanged between the user and other users, a plurality of user accounts registered in association with the user account (i.e., a friend list), etc., through a first operation (1610) and a second operation (1620) in a user terminal. Such text entered during a text chat with other users and the friend list can be provided to an information processing system and used to verify the gender of the user account.

[0121] As illustrated in the first operation (1610), when a user touches the "Message" text (1612) displayed on the screen, a list (1614) of multiple user accounts that have had a text chat with the user's user account may be displayed. When one of the lists (1614) of multiple user accounts is selected, text entered during the text chat may be displayed. Here, the text entered during the text chat may include all text entered from the user account and / or text entered from other user accounts in the chat box. Such text entered during the text chat may be provided to an information processing system and analyzed, and the gender of the user account may be verified based on the analyzed text. For example, any analysis algorithm or technique already known in the related field may be used as the text analysis algorithm or technique, for example, keyword-based analysis, natural language processing analysis technique, etc. may be used.

[0122] As illustrated in the second operation (1620), when the user touches the "Friends" text (1622) displayed on the screen, a plurality of user accounts associated with the user account, i.e., a friend list (1624), may be displayed on the screen. Information (e.g., gender, age, etc.) for the plurality of user accounts included in the friend list (1624) may be provided to the information processing system, and the gender of the user account may be verified based on the information for the plurality of user accounts included in the friend list. According to an embodiment, if the proportion of males among the plurality of user accounts included in the friend list is higher than a predetermined proportion, the gender of the user account is more likely to be female than male. In this case, when performing an algorithm for determining the gender of the user account in combination with other information related to the user account, the information processing system may perform any operation of assigning a higher weight and / or confidence level to the user account when the gender of the user account is determined to be female.

[0123] FIG. 17 is a diagram illustrating an example of outputting profile information related to a user account according to an embodiment of the present disclosure. In an embodiment, in order to verify the gender of a user account, the information processing system may collect the profile information of the user account as information related to the user account. Here, the profile information of the user account may include any information indicating the characteristics of the user account, and may include information input from the user account and / or information about the user account input from another user account. For example, the profile information of the user account may include information about a profile image, ratings (swaggs), interests (Interests), language (Language), region, etc. The information processing system may use such profile information when verifying the gender of the user account.

[0124] According to an embodiment, the information processing system may collect information on the Swaggs icons received by the user account as the evaluation information of the user account. As illustrated, for example, the Swaggs list (1710) may include the type and number of Swaggs icons received by the user account. Thus, when verifying the gender of the user account, the information processing system may assign a higher weight to the top Swaggs icons that the user account has received more than others among the Swaggs icons stored in the profile information. For example, if the user account receives the Handsome icon, the Stylish icon, and / or the Humorous icon more than other icons, the information processing system may perform any operation that can assign a higher weight and / or reliability to determining that the gender of the user account is male when determining the gender of the user account in combination with other information related to the user account. In contrast, if the user account receives the Pretty icon, the Cute icon, and / or the Lovely icon more than other icons, any operation that can assign a higher weight and / or reliability to determining that the gender of the user account is female may be performed.

[0125] In one embodiment, the information processing system may receive a list of interest items (1720) received by the user account as interest information of the user account. As illustrated, for example, the interest information may be displayed with tags in front of the interest items. The information processing system may also store weight information indicating gender corresponding to each reference keyword indicating an interest. Thus, the information processing system may determine weights indicating gender for the interest items included in the received list of interest items (1720) and use the weights to verify the gender of the user account.

[0126] FIG. 18 is a diagram illustrating an example of outputting one or more user accounts that have had a video call with a user account according to an embodiment of the present disclosure. A user account (e.g., a first user account) may store one or more other user accounts (second user accounts) that have previously been matched with the user account. Such one or more second user accounts may be displayed through a history in an instant messaging application. For example, as illustrated in FIG. 18, a list (1810) of multiple user accounts may be displayed in the history of the first user account as user accounts that have previously been matched with the first user account.

[0127] The information processing system may be configured to receive one or more second user accounts previously matched with the first user account. The information processing system may verify the gender of the first user account based on information for the received one or more second user accounts. According to an embodiment, the gender of the received one or more second user accounts may be used to verify the gender of the first user account. For example, if there are more males than females in the gender of the second user account, a more weighted value may be assigned to the gender of the second user account determined to be male.

[0128] The method for verifying information received through an instant messaging application providing a video call service as described above may be embodied as computer readable code in a computer readable recording medium. The computer readable recording medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of the computer readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. Also, the computer readable recording medium may be distributed in computer systems connected to a network, and the computer readable code may be stored and executed in a distributed manner. Functional programs, codes, and code segments for implementing the above embodiments may be easily construed by a programmer skilled in the art to which the present invention pertains.

[0129] The methods, operations, or techniques of the present disclosure may be embodied by a variety of means. For example, these techniques may be embodied by hardware, firmware, software, or a combination thereof. Those skilled in the art will appreciate that the various exemplary logic blocks, modules, circuits, and algorithmic steps described in conjunction with the present disclosure may be embodied in electronic hardware, computer software, or a combination of both. To clearly illustrate such interchangeability of hardware and software, the various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is embodied as hardware or software will depend on the particular application and design requirements imposed on the overall system. Those skilled in the art may also embody the described functionality in various ways for each particular application, but such embodying should not be interpreted as departing from the scope of the present disclosure.

[0130] In a hardware implementation, the processing units used to perform the techniques may be embodied among one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this disclosure, computers, or any combination thereof.

[0131] Thus, the various example logic blocks, modules, and circuits described in connection with this disclosure may be embodied or implemented with a general purpose processor, a DSP, an ASIC, an FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein. A general purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be embodied with a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other configuration.

[0132] In a firmware and / or software implementation, the techniques may also be embodied with instructions stored on a computer-readable medium, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage devices, etc. The commands may be executed by one or more processors and may cause the processors to perform certain aspects of the functions described in this disclosure.

[0133] If embodied in software, the techniques may be stored on or transmitted through a computer-readable medium as one or more commands or codes. Computer-readable media includes both computer storage media and communication media, including any medium that facilitates transfer of a computer program from one place to another. Storage media may be any available medium accessible by a computer. By way of non-limiting example, these computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to transport or store desired program code in the form of commands or data structures and that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium.

[0134] For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted wire, digital subscriber line (DSL), or wireless technologies such as infrared, radio and microwave, the coaxial cable, fiber optic cable, twisted wire, digital subscriber line, or wireless technologies such as infrared, radio and microwave are included within the definition of media. As used herein, disk and disc include CDs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically while discs reproduce data optically using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0135] A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium may be coupled to the processor such that the processor can read information from, and record information on, the storage medium. Alternatively, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. Alternatively, the processor and the storage medium may reside as discrete components in a user terminal.

[0136] Although the embodiments described above have been described as utilizing aspects of the presently disclosed subject matter on one or more stand-alone computer systems, the present disclosure is not limited thereto and may be implemented in connection with any computing environment, such as a network or distributed computing environment. Additionally, aspects of the subject matter in the present disclosure may be implemented on multiple processing chips or devices, and storage may be affected across multiple devices as well. These devices may include PCs, network servers, and handheld devices.

[0137] Although the present disclosure has been described in relation to some embodiments, various modifications and changes that can be understood by those of ordinary skill in the art to which the present disclosure pertains can be made without departing from the scope of the present disclosure, and such modifications and changes should be considered as falling within the scope of the claims appended hereto. [Explanation of symbols]

[0138] 112, 114, 116: User terminal 120: Network 130: Information processing systems 212: Input / output device 214, 232: Input / output interface 216, 234: Memory 218, 236: Processor 220, 238: communication module 310: Data collection module 320: Data learning module 330: Data Recognition Module 340: Gender Verification Module

Claims

1. 1. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising: receiving a gender of a user specified by a first user account; receiving an image including a face captured through an image sensor while the application is running; inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image; and verifying the received gender based on the output gender, further comprising receiving evaluation information for the first user account from a second user account; A method of verifying information, wherein verifying the received gender based on the output gender includes verifying the received gender based on the received evaluation information and the output gender.

2. 2. The method of claim 1, wherein the artificial neural network model is generated by performing machine learning based on data indicative of a plurality of training images and data indicative of gender for people in the plurality of training images.

3. the received image includes clothing; The step of outputting the gender of the user of the face contained in the received image includes: extracting image features from the received image; and inputting the extracted image features into the artificial neural network model to output the gender.

4. The method of any one of claims 1 to 3, wherein the step of verifying the received gender based on the output gender includes the step of providing the received image to a separate monitoring system if the output gender is different from the received gender.

5. 5. The method of claim 4, wherein verifying the received gender based on the output gender comprises providing the received image to the separate monitoring system if the output gender is the same as the received gender and a reliability of the output gender is equal to or less than a predetermined reliability.

6. 6. The method of claim 5, wherein if the separate monitoring system determines that the received gender is different from the user gender specified by the first user account, a penalty is imposed on the first user account.

7. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising: receiving a gender of a user specified by a first user account; receiving an image including a face captured through an image sensor while the application is running; inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image; and verifying the received gender based on the output gender. A method of verifying information, wherein verifying the received gender based on the output gender comprises verifying the received gender based on the subject of interest information and the output gender.

8. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising: receiving a gender of a user specified by a first user account; receiving an image including a face captured through an image sensor while the application is running; inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image; and verifying the received gender based on the output gender, further comprising receiving evaluation information provided by the first user account for one or more second user accounts; A method for verifying information, wherein the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on reputation information provided by the received first user account for one or more second user accounts and the output gender.

9. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising: receiving a gender of a user specified by a first user account; receiving an image including a face captured through an image sensor while the application is running; inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image; and verifying the received gender based on the output gender. The method of verifying information further comprising receiving one or more second user accounts that have been previously matched with the first user account; A method for verifying information, wherein verifying the received gender based on the output gender includes verifying the received gender based on the received information for one or more second user accounts and the output gender.

10. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising: receiving a gender of a user specified by a first user account; receiving an image including a face captured through an image sensor while the application is running; inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image; and verifying the received gender based on the output gender. A method for verifying information, wherein the step of verifying the received gender based on the output gender includes the step of verifying the received gender based on the received declaration information and the output gender.

11. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising: receiving a gender of a user specified by a first user account; receiving an image including a face captured through an image sensor while the application is running; inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image; and verifying the received gender based on the output gender, further comprising receiving information for a plurality of user accounts associated with the first user account within the application; A method of verifying information, wherein verifying the received gender based on the output gender includes verifying the received gender based on information and the output gender for a plurality of user accounts associated with the first user account.

12. collecting user activity information for the first user account; The method of verifying information described in any one of claims 1 to 3, wherein the step of verifying the received gender based on the output gender includes the step of verifying the received gender based on the collected user activity information and the output gender.

13. The method of claim 12, wherein the user activity information for the first user account includes information on at least one of a blur item, a face effect item, a lock-in item, a shake item, or a sticker item used by the first user account while making a video call with a second user account.

14. 14. The method of verifying information according to any one of claims 1 to 13, wherein the step of receiving the user's gender specified by the first user account comprises the step of receiving at least one of a gender entered while the first user account was subscribed to the application or a gender extracted from information for an account associated with the first user account.

15. The method for verifying information described in any one of claims 1 to 14, wherein the step of receiving an image including the face includes a step of receiving an image including the detected face when the face is detected in video data captured through the image sensor operated after the first user account is registered to the application.

16. receiving text entered during a text chat between the first user account and one or more second user accounts; 4. The method of verifying information according to any one of claims 1 to 3, wherein the step of verifying the received gender based on the output gender comprises the step of verifying the received gender based on the received text and the output gender.

17. A computer program for executing on a computer the method for verifying information received via an instant messaging application running on a user terminal and providing a video calling service according to any one of claims 1 to 16.

18. 1. A system for verifying information received via an instant messaging application that provides a video calling service, comprising: a communication module configured to receive, from the user terminal, a user's gender specified by a first user account, and to receive an image including a face captured through an image sensor while the application is being operated; a processor configured to input the received image into an artificial neural network model to output a gender of a user of a face contained within the received image, and to verify the received gender based on the output gender; The communication module is further configured to receive rating information for the first user account from a second user account; The system, wherein the processor is configured to, when validating the received gender based on the output gender, verify the received gender based on the received assessment information and the output gender.

19. The communication module is further configured to receive rating information for the first user account from a second user account; 20. The system of claim 18, wherein the processor is further configured to verify the received gender based on the received assessment information and the output gender.

Images