Method and system for fairly charging for video call duration for introducing new people

Abstract

To provide a technique for charging according to a speech time of a video call.SOLUTION: A charging method realized by a computer according to an embodiment includes the steps of displaying video data related to the other party terminal to which a video call is connected on a video call screen, recognizing reaction information input to the other party terminal from the video data related to the other party terminal displayed on the video call screen, and generating billing data for the reaction information of the recognized other party terminal on the basis of preset charging policy.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The following description relates to a technology for charging according to the duration of a video call. [Background technology]

[0002] With the development of communication technology, video calling services are now available not only on mobile communication devices such as mobile phones but also on large electronic devices such as TVs. When a calling terminal makes a video call, a call message is sent to a switching device via a base station / base station control device, and the switching device obtains routing information from the home location registration device to the called terminal, and sets up a session with the called terminal via the called terminal's switching device. Through this process, the calling terminal and called terminal can send and receive audio and video, and can make a video call while seeing each other's faces.

[0003] An increasing number of users are seeking new encounters through online dating applications. When making video calls to meet new people online, it is common for users to be charged according to the duration of the call. However, even if there is no response from the other party during a video call, users are still charged according to the duration of the call, which has led to some users complaining that the charges are unfair. Summary of the Invention [Problem to be solved by the invention]

[0004] To provide a method and system for fairly charging for video calls for introducing new people based on the call time. [Means for solving the problem]

[0005] The billing method implemented by a computer may include the steps of: displaying video data related to a remote terminal connected to a video call on a video call screen; recognizing reaction information input to the remote terminal from the video data related to the remote terminal displayed on the video call screen; and generating billing data for the recognized reaction information of the remote terminal based on a preset billing policy.

[0006] The billing system realized by a computer may include a video call display unit that displays video data related to the other terminal connected in a video call on a video call screen, a reaction recognition unit that recognizes reaction information input to the other terminal from the video data related to the other terminal displayed on the video call screen, and a billing generation unit that generates billing data for the reaction information of the recognized other terminal based on a preset billing policy. Effect of the Invention

[0007] By recognizing the reaction information of the other terminal from the video data related to the other terminal displayed on the video call screen, it is possible to charge fairly according to the actual time the video call took place. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of a network environment in one embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an internal configuration of an electronic device and a server according to an embodiment. [Diagram 3] FIG. 2 is a block diagram illustrating components that may be included in a processor of an electronic device in one embodiment. [Figure 4] 1 is a flow chart illustrating a billing method that can be performed by an electronic device in one embodiment. [Diagram 5] FIG. 2 is an exemplary diagram illustrating a video call being performed between electronic devices according to an embodiment. [Figure 6]1 is an illustrative diagram for explaining the use of items in an electronic device in one embodiment. [Figure 7] 10A and 10B are exemplary diagrams illustrating how the electronic device recognizes reaction information of a partner terminal in an embodiment. [Figure 8] 10 is a flowchart for explaining generation of billing data in an electronic device based on response information of a partner terminal in one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] <Summary of the Invention> The billing method implemented by a computer may include the steps of: displaying video data related to a remote terminal connected to a video call on a video call screen; recognizing reaction information input to the remote terminal from the video data related to the remote terminal displayed on the video call screen; and generating billing data for the recognized reaction information of the remote terminal based on a preset billing policy.

[0010] The step of generating the billing data may include setting a billing policy for generating the billing data according to response information of the counterpart terminal.

[0011] The step of generating the billing data may include a step of interrupting generation of the billing data based on the set billing policy when reaction information input from the counterpart terminal is absent or is recognized to be for less than a preset time.

[0012] The step of generating the billing data may include a step of counting time information during which the response information of the counterpart terminal is recognized, and generating or interrupting billing data for the counted time information based on the set billing policy.

[0013] The recognizing step may include a step of determining recognition of reaction information of the other terminal based on any one of facial information of the other user recognized in the video data, voice data of the other user, or text data of the other user from video data related to the other terminal displayed on the video call screen.

[0014] The recognizing step may include a step of performing voice recognition on the voice data of the other user when face recognition of the face information of the other user is not detected for a predetermined time or more, performing text input recognition on the text data of the other user when voice recognition of the voice data of the other user is not detected for a predetermined time or more, and determining the reaction information of the other user as absent when text input recognition of the text data of the other user is not detected for a predetermined time or more.

[0015] The recognizing step may include determining that reaction information to the facial information of the other user has been recognized based on ratio information of area information including components that constitute the facial information of the other user.

[0016] The recognizing step may include recognizing that reaction information to the voice data of the other user has been input by distinguishing voice data of the other user from voice data generated during the video call.

[0017] The recognizing step may include providing a user interface for inputting a message on the video call screen, and recognizing that text data of the other user has been input based on the message input using the user interface.

[0018] The step of generating the billing data may include a step of determining that the reaction information of the other terminal is not recognized and interrupting generation of the billing data when reaction information of the user of the terminal displayed on the video call screen is recognized but reaction information of the other terminal displayed on the video call screen is not recognized.

[0019] The displaying step may include a step of displaying image data related to the other terminal to which the video call is connected on the video call screen for a certain period of time by connecting the video call with the other terminal searched in accordance with the video call connection request.

[0020] The displaying step may include a step of controlling a time of the video call with the other terminal by using an item during the video call by identifying a remote user of the other terminal to which the video call is connected.

[0021] The generating step may include a step of counting a connection time of the video call with the counterpart terminal based on result information of performing recognition of reaction information of the counterpart terminal based on video call time information set in an item used during the video call.

[0022] The displaying step may include operating a video call mode by connecting a video call with the counterpart terminal, and displaying image data related to the counterpart terminal on a video call screen based on the operating video call mode.

[0023] The generating step may include a step of terminating the video call screen when a video call mode operated by connecting a video call with the counterpart terminal is switched to a voice mode, and interrupting generation of the billing data based on time information of the switching to the voice mode.

[0024] The method may include a computer program recorded on a computer-readable recording medium for causing the computer system to execute the billing method.

[0025] The billing system realized by a computer may include a video call display unit that displays video data related to the other terminal connected in a video call on a video call screen, a reaction recognition unit that recognizes reaction information input to the other terminal from the video data related to the other terminal displayed on the video call screen, and a billing generation unit that generates billing data for the reaction information of the recognized other terminal based on a preset billing policy.

[0026] The billing generation unit may set a billing policy for generating billing data according to reaction information of the other terminal, and if reaction information input from the other terminal is recognized to be absent or for less than a preset time, may interrupt generation of billing data based on the set billing policy.

[0027] The reaction recognition unit may determine recognition of the reaction information of the other user's terminal based on any one of facial information of the other user recognized in the video data related to the other user's terminal displayed on the video call screen, voice data of the other user, or text data of the other user.

[0028] The video call display unit may include controlling a video call time with the other terminal by using an item during the video call by confirming a user of the other terminal to which the video call is connected, and the charge generation unit may count a connection time of the video call with the other terminal according to information on a result of executing recognition of reaction information of the other terminal based on video call time information set in the item used during the video call.

[0029] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0030] Fig. 1 is a diagram showing an example of a network environment in one embodiment. The network environment in Fig. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0031] The electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals realized by computer systems. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. As an example, FIG. 1 shows a smartphone as an example of the electronic device 110, but in the embodiment of the present invention, the electronic device 110 may mean one of various physical computer systems that can communicate with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0032] The communication method is not limited, and may include not only a communication method using a communication network (such as a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) that the network 170 can include, but also short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, etc.

[0033] Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, and 140 via the network 170 to provide instructions, codes, files, content, services, and the like. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (e.g., a messaging service, for example) targeted by an application, which is a computer program installed and executed in the multiple electronic devices 110, 120, 130, and 140, as a first service to the multiple electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and executing the above-mentioned application to the multiple electronic devices 110, 120, 130, and 140.

[0034] Fig. 2 is a block diagram for explaining the internal configuration of an electronic device and a server in an embodiment of the present invention. In Fig. 2, the internal configuration of electronic device 110 and the internal configuration of server 150 will be explained as examples of electronic devices. In addition, other electronic devices 120, 130, 140 and server 160 may have the same or similar internal configuration as electronic device 110 or server 150 described above.

[0035] The electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 may be non-transitory computer-readable recording media and may include persistent mass storage devices such as random access memory (RAM), read only memory (ROM), disk drives, solid state drives (SSD), flash memories, and the like. Here, persistent mass storage devices such as ROM, SSD, flash memories, and disk drives may be included in the electronic device 110 and the server 150 as persistent storage devices separate from the memories 211 and 221. In addition, the memories 211 and 221 may store an operating system and at least one program code (for example, a browser installed and executed in the electronic device 110, or a code for an application installed in the electronic device 110 to provide a specific service, etc.). Such software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 211, 221 through a communication module 213, 223 that is not a computer-readable recording medium. For example, at least one program may be loaded into the memory 211, 221 based on a computer program (for example, the above-mentioned application) that is installed by a file provided via the network 170 by a developer or a file distribution system that distributes an installation file of the application (for example, the above-mentioned server 160).

[0036] The processors 212, 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memory 211, 221 or the communication modules 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program code stored in a storage device such as the memory 211, 221.

[0037] The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 110 and / or the server 150 to communicate with other electronic devices (for example, the electronic device 120) or other servers (for example, the server 160). For example, a request generated by the processor 212 of the electronic device 110 according to a program code recorded in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, a control signal, an instruction, a content, a file, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 110 through the communication module 213 of the electronic device 110 via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the electronic device 110 may further include.

[0038] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include a device such as a keyboard, a mouse, a microphone, or a camera, and the output device may include a device such as a display, a speaker, or a haptic feedback device. As another example, the input / output interface 214 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 215 may be configured as one device together with the electronic device 110. Also, the input / output interface 224 of the server 150 may be a means for interfacing with a device for input or output (not shown) that may be connected to the server 150 or included in the server 150. As a more specific example, when the processor 212 of the electronic device 110 processes the instructions of the computer program loaded in the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 120 may be displayed on a display through the input / output interface 214.

[0039] Also, in other embodiments, the electronic device 110 and the server 150 may include more components than those in FIG. 2. However, it is not necessary to clearly show most of the conventional technical components in the figure. For example, the electronic device 110 may be realized to include at least some of the above-mentioned input / output devices 215, and may further include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 110 is a smartphone, various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input / output port, a vibrator for vibration, etc., which are generally included in a smartphone, may be realized to be further included in the electronic device 110.

[0040] In an embodiment, a billing system implemented by a computer may be configured in the electronic device 110. For example, the billing system may be implemented in the form of an independently operating program, or may be implemented in the form of an in-app of a specific application so as to be operable on the specific application, and in some cases, billing data may be generated in conjunction with the server 150.

[0041] FIG. 3 is a block diagram illustrating components that may be included in a processor of an electronic device in one embodiment, and FIG. 4 is a flowchart illustrating a billing method that may be performed by an electronic device in one embodiment.

[0042] The processor 212 of the electronic device may include a video call display unit 310, a reaction recognition unit 320, and a billing generation unit 330. The components of the processor 212 may represent different functions executed by the processor 212 according to control instructions provided by program code recorded in the electronic device. The processor 212 and the components of the processor 212 may control the electronic device to execute steps 410 to 430 included in the billing method of Fig. 4. In this case, the processor 212 and the components of the processor 212 may be realized to execute instructions according to the code of an operating system and the code of at least one program included in the memory.

[0043] The processor 212 may load the program code recorded in a program file for the billing method into the memory. For example, when the program is executed in the electronic device, the processor may control the electronic device to load the program code from the program file into the memory under the control of the operating system. At this time, the processor 212 and the video call display unit 310, the reaction recognition unit 320, and the billing generation unit 330 included in the processor 212 may each represent a different function of the processor 212 for executing the instructions of the corresponding parts of the program code loaded into the memory and executing the subsequent steps 410 to 430.

[0044] In step 410, the video call display unit 310 may display video data related to the other terminal to which the video call is connected on a video call screen. The video call display unit 310 may display video data related to the other terminal to which the video call is connected on a video call screen for a certain period of time as the video call is connected to the other terminal searched according to the video call connection request. At this time, a video call connection time may be set. For example, the video call display unit 310 may display a message asking whether to connect the video call to the other terminal searched according to the video call connection request. The video call with the other terminal may be connected or disconnected as a response to the video call connection with the other terminal is input by the user. According to the response that the video call with the other terminal is not to be connected, another other terminal may be further searched for and the video call may be connected. Similarly, the other terminal may also connect or disconnect the video call with the terminal as a response to the video call connection with the terminal is input from the other user. In other words, the video call may be connected between the terminals for a certain period of time by receiving a response from the terminal and the other terminal when the video call is connected. Alternatively, the video call display unit 310 may operate a video call mode by connecting the video call with the other terminal, and display video data related to the other terminal on the video call screen based on the operating video call mode. For example, each terminal may be provided with a front camera mode for executing the in-camera and an out-camera mode for executing the out-camera. Each terminal may switch to the video call mode by connecting the video call, and the in-camera mode may be executed. The video call display unit 310 may control the video call time with the other terminal by using an item during the video call by confirming the other user of the other terminal to which the video call is connected.

[0045] In step 420, the reaction recognition unit 320 may recognize reaction information input by the other terminal from video data related to the other terminal displayed on the video call screen. The reaction recognition unit 320 may determine whether there is reaction information of the other terminal including any one of the other user's face information, the other user's voice data, or the other user's text data recognized in the video data from the video data related to the other terminal displayed on the video call screen. For example, the reaction recognition unit 320 may perform voice recognition on the other user's voice data when face recognition of the other user's face information is not detected for a predetermined time or more, perform text input recognition on the other user's text data when voice recognition of the other user's voice data is not detected for a predetermined time or more, and determine the other user's reaction information as absent when text input recognition of the other user's text data is not detected for a predetermined time or more.

[0046] As an example, the reaction recognition unit 320 may determine that the reaction information of the other terminal is not recognized when the reaction information of the user of the terminal displayed on the video call screen is recognized but the reaction information of the other terminal displayed on the video call screen is not recognized. Alternatively, the reaction recognition unit 320 may determine that the reaction information of the other terminal is recognized when the reaction information of the user of the terminal displayed on the video call screen is not recognized but the reaction information of the other terminal displayed on the video call screen is recognized. There may be various other methods for determining the recognition of the reaction information of the other terminal.

[0047] In addition, the reaction recognition unit 320 may determine that the reaction information of the other user is not recognized when the face of the other user of the other terminal is replaced with a doll or another user. The reaction recognition unit 320 may determine that the reaction information of the other user is not recognized when other voice data is determined instead of the voice data of the other user. For example, the reaction information of the other user may be recognized by recording the face information of the other user in advance and comparing the recorded face information with the face information input on the video call screen. Similarly, the reaction information of the other user may be recognized by recording the voice information of the other user in advance and comparing the recorded voice information with the voice data input during the video call.

[0048] In step 430, the billing generation unit 330 may generate billing data for the recognized reaction information of the other terminal based on a preset billing policy. If the reaction information input from the other terminal is absent or is recognized for less than a preset time, the billing generation unit 330 may suspend generation of billing data based on the set billing policy. The billing generation unit 330 may set a billing policy for generating billing data according to the reaction information of the other terminal, and count the recognized reaction information of the other terminal based on the set billing policy. In this case, the billing policy may simply mean a policy for determining whether the reaction information of the other terminal has been recognized, and more specifically, may mean a policy set for generating billing data for the time during which the reaction information of the other terminal has been recognized and a video call has been performed. The billing generation unit 330 may count time information during which the reaction information of the other terminal has been recognized, and generate billing data based on the set billing policy for the counted time information. As an example, the billing generation unit 330 may count the video call connection time with the other terminal according to the result information of performing recognition of the reaction information of the other terminal based on the video call time information set in the item used during the video call, and may generate billing data based on the counted video call connection time. As another example, when the reaction information of the user of the terminal displayed on the video call screen is recognized but the reaction information of the other terminal displayed on the video call screen is not recognized, the billing generation unit 330 may determine that the reaction information of the other terminal is not recognized and may interrupt the generation of billing data. Alternatively, when the reaction information of the user of the terminal displayed on the video call screen is not recognized but the reaction information of the other terminal displayed on the video call screen is recognized, the billing generation unit 330 may determine that the reaction information of the other terminal is recognized and generate billing data.

[0049] FIG. 5 is an exemplary diagram illustrating a video call being performed between electronic devices according to an embodiment.

[0050] A video call between the electronic devices 110a and 110b will be described. In this case, the electronic devices 110a and 110b will be described by dividing them into a first electronic device (e.g., a calling terminal) 110a and a second electronic device (e.g., a receiving terminal) 110b. The electronic devices 110a and 110b may include a function for providing a video call service, and the video call service can be used by installing a separate application. In the embodiment, an example in which a separate application is installed to use the video call service will be described. Here, the application installed in the electronic devices 110a and 110b may provide not only the video call service but also various other services. As an example, a social interaction service will be described assuming that the social interaction service matches a user with a second user whom the user does not know and provides an online encounter by connecting a video call between the user and the second user. Such a social interaction service may provide various functions such as a video call function, a messaging function, a camera function, etc., in order to connect the encounter with the second user.

[0051] For example, when each user uses electronic device 110a, 110b to register with the social networking service, the user may register with the social networking service by selecting another SNS service, search service, etc. and linking the user information, or the user may register with the service by entering user identification information through membership registration. At this time, gender information recorded in another service may be linked, or gender information may be registered by selecting gender in the social networking service. In addition, each user may be allowed to select condition information including the gender, regional information (international or domestic), and interests of the user they wish to meet.

[0052] Assume that the electronic devices 110a and 110b execute the social networking service, and the first electronic device 110a requests a video call. When the first electronic device 110a requests a video call connection, the server may search for a partner user from the user accounts registered in the social networking service based on the condition information selected by the first electronic device 110a. Assume that a video call is connected to the first electronic device 110a with the second electronic device 110b, which is the partner user searched for by the server, and the first electronic device 110a and the second electronic device 110b execute a video call. At this time, a connection time of the video call between the first electronic device 110a and the second electronic device 110b may be set. After the video call is connected based on the time set for the first electronic device 110a and the second electronic device 110b, when the time has elapsed, each electronic device may be connected to a video call with another partner.

[0053] The other user of the second electronic device 110b may be displayed on the video call screen 510 of the first electronic device 110a, and the user of the first electronic device 110a may be displayed on the video call screen 520 of the second electronic device 110b. In this way, the first electronic device 110a and the second electronic device 110b can talk to each other using one or more of voice data and text data while looking at each other's faces. In addition, the video call screen 510 of the first electronic device 110a may display not only the face of the other user of the second electronic device 110a but also the face of the user of the first electronic device 110a, and the video call screen of the second electronic device 110b may display not only the face of the user of the first electronic device 110a but also the face of the user of the second electronic device 110b. For example, each of the video call screens 510 and 520 may include an area for displaying the other user's face and an area for displaying one's own face. In this case, the area displaying the other person's face may be set as the main area, and the area displaying one's own face may be set as the sub-area, and the main area may be set to be displayed larger than the sub-area.

[0054] FIG. 6 is an exemplary diagram illustrating the use of an item in an electronic device according to an embodiment.

[0055] The user of the first electronic device 110a may wish to make a video call with the other user of the second electronic device 110b for a longer time than the connection time with the other user's electronic device by checking the other user's electronic device for the second electronic device 110b. The first electronic device 110a may control the video call time with the second electronic device 110b by using the item 610 during the video call with the other user of the second electronic device 110b. For example, the first electronic device 110a may purchase the item 610 in advance, or may purchase the item 610 from the item information displayed on the video call screen. The item 610 for controlling the video call time may mean an item that allows an additional video call with the other user in addition to the execution time of the video call between users set in the social interaction service. In this case, the price of the item 610 may vary depending on the time for which the video call is enabled. When the user of the first electronic device 110a uses the item 610, the other user of the second electronic device 110b cannot interrupt the video call, and must perform an additional video call during the video call time set in the user's item 610. In other words, the video call screen of the second electronic device 110b is switched to a locked state, and the first electronic device 110a can control the video call time with the second electronic device 110b during the time set for the item used by the first electronic device 110a.

[0056] The first electronic device 110a may recognize the reaction information of the second electronic device 110b based on the time information of the video call set in the item used during the video call. The first electronic device 110a may determine the recognition of the reaction information of the second electronic device 110b based on any one of the facial information of the other user recognized in the video data, the voice data of the other user, or the text data of the other user from the video data related to the second electronic device 110b displayed on the video call screen. The first electronic device 110a may count the connection time of the video call with the second electronic device 110b based on the result information acquired by executing the recognition of the reaction information of the second electronic device 110b. For example, by using a 5-second item during a video call with the second electronic device 110b in the first electronic device 110a, an additional 5-second video call may be executed in addition to the time given as the video call. At this time, the other user of the second electronic device 110b may not respond to the video call screen because the other user cannot interrupt the video call with the user of the first electronic device 110a. In such a case, the first electronic device 110a may end the time set for the item without feeling the effect of the item that was purchased with great effort. When the reaction information from the other user of the second electronic device 110b is not recognized during the time when the item is used by the first electronic device 110a, the first electronic device 110a may count the time during which the reaction information of the other user of the second electronic device 110b was not recognized. The first electronic device 110a may suspend the generation of billing data for the counted time information. For example, the first electronic device 110a may restore the time set for the item or add additional time only for the time information during which the reaction information from the other user of the second electronic device 110b was not recognized. Alternatively, the first electronic device 110a may suspend the generation of billing data for the time information during which the reaction information from the other user of the second electronic device 110b was not recognized, for the billing data generated according to the video call time, and reduce or exempt the fee charged to the first electronic device 110a.

[0057] FIG. 7 is an exemplary diagram illustrating how the electronic device recognizes reaction information of a partner terminal in an embodiment.

[0058] The first electronic device 110a and the second electronic device 110b carry out a conversation while looking at each other's faces displayed on their respective video call screens 510 during a video call. The first electronic device 110a may recognize reaction information input by the second electronic device 110b from video data related to the second electronic device 110b displayed on the video call screen 510. In this case, the reaction information may mean information for recognizing that an interaction between users is carried out during a video call. The electronic device 110a may determine reaction information of the other terminal including any one of face information of the other user recognized in the video data, voice data of the other user, or text data of the other user, from video data related to the other terminal displayed on the video call screen 510.

[0059] Referring to FIG. 7a, the first electronic device 110a may determine whether the other user exists by checking the other user 710 of the second electronic device 110b displayed on the video call screen 510 of the first electronic device 110b. For example, the first electronic device 110a may recognize the face of the other user 710 of the second electronic device 110b from the video call screen of the first electronic device 110b. At this time, the first electronic device 110a may determine the recognition of the reaction information to the facial information of the other user 710 based on the ratio information of the area information including the components (e.g., eyes, nose, mouth, etc.) that constitute the facial information of the other user 710 of the second electronic device 110b. For example, the first electronic device 110a may recognize that the facial information of the other user 710 exists by determining that the ratio of the area information including the components that constitute the facial information of the other user 710 in the video call screen 510 occupies 50% of the face. As a result, it may be recognized that the reaction information of the other user has been input. Alternatively, the first electronic device 110a may recognize that facial information of the other user 710 is present by determining that at least one or more components (e.g., eyes, nose, mouth, etc.) of the components constituting the facial information of the other user 710 are present on the video call screen 510. The first electronic device 110a may recognize a video call with the other user 710 of the second electronic device 110b.

[0060] 7b, the first electronic device 110a may determine the recognition of the reaction information of the other user by receiving voice data of the other user of the second electronic device 110b during a video call. For example, even if the other user of the second electronic device is not displayed on the video call screen 510 of the first electronic device 110a and only voice data is received, it may be recognized as a video call with the other user. Alternatively, if the other user of the second electronic device is displayed on the video call screen 510 of the first electronic device 110a and voice data is received while looking at the other user's face, it may be recognized as a video call with the other user.

[0061] Referring to FIG. 7c, the first electronic device 110a may determine recognition of the reaction information of the other user by transmitting and receiving text data with the other user of the second electronic device 110b during the video call. A messenger service available during the video call between the first electronic device 110a and the second electronic device 110b may be provided, thereby providing a user interface for inputting a message. The first electronic device 110a and the second electronic device 110b may carry out a conversation by transmitting and receiving messages using the provided user interface. The first electronic device 110a may recognize it as a video call with the other user by receiving the text data input from the second electronic device 110b.

[0062] The first electronic device 110a may determine the reaction information of the second electronic device 110b based on at least one of the face information of the other user, the voice data of the other user, and the text data of the other user. At this time, an order for determining the reaction information of each other user may be set, and the reaction information of the second electronic device 110b may be recognized according to the set order.

[0063] FIG. 8 is a flowchart for explaining generation of billing data in an electronic device based on response information of a partner terminal in one embodiment.

[0064] For the purpose of explaining FIG. 8, the electronic device will be divided into a terminal and a counterpart terminal.

[0065] In step 810, the terminal may be connected to a video call with a new person (a counterpart terminal). For example, the terminal may start a video call with a new person randomly selected from a server. At this time, a connection time may be set for the video call with the new person, and when the set time has elapsed, a video call with another new person may be connected.

[0066] In step 820, the terminal may determine whether the face of the other user is recognized for n seconds (n is a natural number) from video data related to the other terminal displayed on the video call screen. If the face of the other user is recognized, the terminal may start a call with a new person after a preset time has elapsed. On the other hand, if the face of the other user is not recognized, the terminal may recognize voice data of the other user.

[0067] In step 830, the terminal may determine whether voice data is recognized for m seconds (m is a natural number) by recognizing the face of the other user from video data related to the other terminal displayed on the video call screen. If the voice data of the other user is not recognized, the terminal may recognize text data input by the other user. On the other hand, if the voice data of the other user is recognized, the terminal may start a video call with a new person after a preset time has elapsed.

[0068] In step 840, the terminal may determine whether input of text data is recognized for p seconds (p is a natural number) by recognizing voice data of the other user from video data related to the other terminal displayed on the video call screen. The terminal may provide a user interface for messages on the video call screen and recognize that a message is input using the provided user interface. The terminal may start a video call with a new person after a preset time has elapsed by recognizing that a message from the other terminal is input on the video call screen. On the other hand, if the terminal does not recognize that a message is input from the other terminal on the video call screen, the terminal may determine that there is no response from the other user and may stop generating billing data. In this case, the billing data may mean the usage amount of the video call time, and the generation of the billing data may be stopped by determining that there is no response from the other user in the above steps 810 to 840. In this way, the generated or stopped billing data may be calculated by the server based on the usage amount for the video call time based on the fee information set for each unit time for the video call time.

[0069] In an embodiment, order information for recognizing the reaction information of the other user may be set. For example, the terminal may set the order to recognize the reaction information of the other user in the order of the face information, voice data, and text data of the other user, but such order information is changeable. Additionally, the time (e.g., n seconds, m seconds, p seconds) set for recognizing the reaction information of each other user may also be changeable. For example, the time set for recognizing the face information of the other user may be shorter or longer than the time set for recognizing the voice data and text data of the user.

[0070] As another example, the terminal may operate a video call mode by connecting a video call with the other terminal. Based on the video call mode operated by the terminal, video data related to the other terminal may be displayed on the video call screen. If the video call mode is switched to the voice mode, the terminal may end the video call screen and suspend the generation of billing data based on time information when the video call mode is switched to the voice mode. In this case, the video call mode may mean a mode in which a call is performed while viewing a video (e.g., a face) related to the other terminal by operating a camera of an electronic device. In more detail, the operation of the video call mode may switch to a front camera mode that operates an in-camera of the electronic device or an out-camera mode that operates an out-camera. Also, the voice mode may mean a mode in which a general call is performed. In other words, when one of the electronic devices of the terminal or the other terminal is switched to the voice mode, the terminal may determine that the video call is terminated / interrupted because the user's face is no longer recognized, and may suspend the generation of billing data.

[0071] The above-mentioned devices may be realized by hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software to access, record, manipulate, process, and generate data. For convenience of understanding, a single processing device may be described as being used, but those skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0072] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, virtual device, computer storage medium, or device to be interpreted based on the processing device or to provide instructions or data to the processing device. The software may be distributed and stored or executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0073] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer readable medium. The computer readable medium may include, alone or in combination, program instructions, data files, data structures, and the like. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be available to those skilled in the art of computer software. Examples of computer readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, flash memories, and the like. Examples of program instructions include high-level language codes executed by a computer using an interpreter, etc., as well as machine language codes such as those generated by a compiler.

[0074] Although the embodiments have been described based on the limited embodiments and drawings as above, those skilled in the art will be able to make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from that described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a manner different from that described, or may be counterbalanced or replaced by other components or equivalents, and still achieve suitable results.

[0075] Therefore, different embodiments are within the scope of the appended claims provided they are equivalent to the claims.

[0076] The present invention further provides a method and system for suspending generation of billing data based on reaction information of a remote terminal recognized during a video call.

[0077] The present invention further improves user satisfaction by generating or interrupting billing data by recognizing reaction information of the other party connected to the video call. [Explanation of symbols]

[0078] 212: Processor 310: Video call display unit 320: Response recognition unit 330: Billing generation unit

Claims

1. 1. A computer-implemented billing method, comprising: displaying video data related to the other terminal connected to the video call on the video call screen; recognizing reaction information input by the other terminal from video data related to the other terminal displayed on the video call screen; generating billing data for the recognized response information of the remote terminal based on a preset billing policy; including, billing methods.

2. The step of generating billing data comprises: Setting a charging policy for generating charging data based on the response information of the remote terminal The charging method of claim 1 , comprising:

3. The step of generating billing data comprises: When the response information input from the other terminal is absent or is recognized to be within a preset time, generation of billing data based on the set billing policy is interrupted. The charging method according to claim 2 , comprising:

4. The step of generating billing data comprises: Counting time information in which the response information of the counterpart terminal is recognized, and generating or suspending billing data for the counted time information based on the set billing policy. The charging method according to claim 2 , comprising:

5. The step of recognizing includes: determining recognition of reaction information of the other terminal based on any one of face information of the other user, voice data of the other user, and text data of the other user, which are recognized from image data related to the other terminal displayed on the video call screen; The charging method of claim 1 , comprising:

6. The step of recognizing includes: performing voice recognition for the voice data of the other user when face recognition of the face information of the other user is not detected for a predetermined time or more; performing text input recognition for the text data of the other user when voice recognition of the voice data of the other user is not detected for a predetermined time or more; and determining that reaction information of the other user is absent when text input recognition of the text data of the other user is not detected for a predetermined time or more. The charging method according to claim 5 , comprising:

7. The step of recognizing includes: determining that the reaction information to the facial information of the other user is recognized based on ratio information of area information including components constituting the facial information of the other user; The charging method according to claim 5 , comprising:

8. The step of recognizing includes: and recognizing that reaction information to the voice data of the other user is input by distinguishing the voice data of the other user from the voice data generated during the video call. The charging method according to claim 5 , comprising:

9. The step of recognizing includes: providing a user interface for inputting a message on the video call screen, and recognizing that text data of the other user has been input based on the message input using the user interface; The charging method according to claim 5 , comprising:

10. The step of generating billing data comprises: and when the reaction information of the terminal user displayed on the video call screen is recognized but the reaction information of the other terminal displayed on the video call screen is not recognized, determining that the reaction information of the other terminal is not recognized and suspending generation of billing data. The charging method according to claim 3 , comprising:

11. The displaying step includes: displaying image data related to the other terminal connected to the video call on the video call screen for a certain period of time when the video call is connected to the other terminal found in response to the video call connection request; The charging method of claim 1 , comprising:

12. The displaying step includes: and controlling a time of the video call with the other terminal by using an item during the video call by identifying the other user of the other terminal to which the video call is connected. The charging method of claim 1 , comprising:

13. The generating step includes: Counting a connection time of the video call with the other terminal according to information resulting from recognition of reaction information of the other terminal based on time information of the video call set in an item used during the video call. The charging method of claim 1 , comprising:

14. The displaying step includes: activating a video call mode by connecting the video call with the other terminal, and displaying image data related to the other terminal on a video call screen based on the activated video call mode. The charging method of claim 1 , comprising:

15. The generating step includes: When a video call mode operated by connecting the video call with the other terminal is switched to a voice mode, the video call screen is terminated and generation of the billing data based on time information of the switching to the voice mode is interrupted. The charging method of claim 1 , comprising:

16. A computer program causing a computer to execute the billing method according to any one of claims 1 to 15.

17. 1. A computer-implemented billing system, comprising: a video call display unit for displaying video data related to a remote terminal connected to the video call on a video call screen; a reaction recognition unit that recognizes reaction information input by the other terminal from video data related to the other terminal displayed on the video call screen; a billing generation unit that generates billing data for the recognized response information of the other terminal based on a preset billing policy; A billing system comprising:

18. The charge generation unit is A charging policy for generating charging data according to response information of a remote terminal is set, and when the response information inputted by the remote terminal is recognized as absent or for less than a preset time, generation of charging data based on the set charging policy is interrupted.

18. The charging system according to claim 17.

19. The reaction recognition unit is From the video data related to the other terminal displayed on the video call screen, recognition of reaction information of the other terminal is determined based on any one of face information of the other user recognized in the video data, voice data of the other user, and text data of the other user.

18. The charging system according to claim 17.

20. The video call display unit is and controlling a video call time with the other terminal by using an item during the video call by identifying a user of the other terminal to which the video call is connected; The charge generation unit is Based on video call time information set in the item used during the video call, the video call connection time with the other terminal is counted according to result information of recognition of reaction information of the other terminal.

18. The charging system according to claim 17.

Images