Method, system, and computer program for providing communication by using video call bot

Abstract

To provide a method, a system, and a computer program for providing communication by using a video call bot.SOLUTION: A method according to the present invention includes the steps of: displaying a bot corresponding to a request of at least one of a plurality of users as a participant of a video call for the video call in which the plurality of users including a user of a computer device participate; transmitting, to a server, a portion of input relating to the bot of inputs which are input to the computer device during the video call; and outputting a response to the portion of the input through the bot who participates in the video call in response to the portion of the input.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The following description relates to techniques for providing video calling functionality. [Background technology]

[0002] In recent years, communication devices have provided a variety of services, such as voice call services, text services, wireless Internet services, terrestrial / satellite broadcasting services, and the like.

[0003] In particular, advances in image compression and restoration technologies and the widespread use of devices equipped with cameras have led to the provision of video calling services that allow users to enjoy calls while seeing the other person's face.

[0004] As an example of a technology for providing a video call service, Patent Document 1 (registered on September 29, 2003) discloses a technology for providing a video call service to a mobile telephone terminal in mobile communications in a wireless environment. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Korean Patent Registration No. 10-0401262 Summary of the Invention [Problem to be solved by the invention]

[0006] A video call bot can be provided to assist communication in video call situations.

[0007] The bot can be invited as a participant in a video call, and an image associated with the bot can be displayed on the video call screen that includes images of the participants.

[0008] A bot participating in a video call can provide content corresponding to images and audio at a specific point in time as a response. [Means for solving the problem]

[0009] A video call method executed by a computer device, the computer device including at least one processor configured to execute computer-readable instructions contained in a memory, the video call method including the steps of: displaying, by the at least one processor, a bot responding to a request of at least one of a plurality of users participating in a video call, including a user of the computer device, as a participant in the video call; transmitting, by the at least one processor, a portion of inputs input to the computer device during the video call that are associated with the bot, to a server; and responding, by the at least one processor, to the portion of inputs and outputting a response to the portion of inputs through the bot participating in the video call.

[0010] According to one aspect, the displaying step may include receiving an image associated with the bot from the server and rendering an image of at least one user of the plurality of users participating in the video call and the image associated with the bot as a single video call screen.

[0011] According to another aspect, the displaying step may include recognizing a command for inviting a bot input to the computer device, and displaying a bot corresponding to the command as a participant of the video call in accordance with the command.

[0012] According to another aspect, the video call method may further include setting, by the at least one processor, a wake-up word for each bot that can participate in the video call.

[0013] According to another aspect, before the bot joins the video call, the wake-up word may be used as a command word for inviting the bot, and after the bot joins the video call, the wake-up word may be used as a command word for requesting a response through the bot.

[0014] According to another aspect, the transmitting step may include a step of recognizing a command for the bot input to the computer device, and a step of transmitting audio or an image input to the computer device after the command is recognized to the server.

[0015] According to another aspect, the step of transmitting the voice or image input to the computer device to the server may include transmitting the voice or image input to the server within a predetermined time from when the command is recognized.

[0016] According to another aspect, the outputting step may include outputting a response retrieved by the server in response to the part of the input by voice or image through the bot participating in the video call.

[0017] According to another aspect, the outputting step may include displaying a response to the part of the input in an area occupied by an image of the bot on a video call screen for the video call.

[0018] According to another aspect, the outputting may include outputting a response to the part of the input using a voice corresponding to the bot participating in the video call.

[0019] A computer program is provided that is recorded on a non-transitory computer-readable recording medium to cause the computer system to execute the video calling method.

[0020] A video call device is provided, which includes: a video call providing unit that displays a bot corresponding to a request of at least one of a plurality of users, including a user of the video call device, as a participant in the video call, for a video call in which the plurality of users, including the user of the video call device, participate; a call input sending unit that sends a portion of the input related to the bot among the inputs input to the video call device during the video call to a server; and a response output unit that responds to the portion of the input and outputs a response to the portion of the input through the bot that participates in the video call. [Brief explanation of the drawings]

[0021] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. [Figure 3] FIG. 2 illustrates example components that may be included in an electronic device according to an embodiment of the present invention. [Figure 4] 1 is a flowchart illustrating an example method that can be performed by an electronic device in accordance with an embodiment of the present invention. [Figure 5] FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. [Figure 6] FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. [Figure 7] FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. [Figure 8] FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. [Figure 9]FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. [Figure 10] FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. [Figure 11] FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. [Figure 12] FIG. 10 is an exemplary diagram illustrating a process of providing communication using a video call bot according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0023] SUMMARY OF THE INVENTION Embodiments of the present invention relate to techniques for providing video calling functionality.

[0024] Embodiments including those specifically disclosed herein provide a video call bot that assists communication in video call situations.

[0025] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including multiple electronic devices 110, 120, 130, and 140, multiple servers 150 and 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0026] The electronic devices 110, 120, 130, and 140 may be fixed or mobile terminals implemented by computers. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), laptops, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, Internet of Things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. While FIG. 1 illustrates a smartphone as an example of the electronic device 110, in embodiments of the present invention, the electronic device 110 may represent one of a variety of physical computer devices capable of communicating with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0027] The communication method is not limited, and may include not only communication methods using communication networks (for example, a mobile communication network, a wired Internet, a wireless Internet, and a broadcast network) that can be included in network 170, but also short-range wireless communication between devices. For example, network 170 may include any one or more of networks such as a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), and the Internet. Furthermore, network 170 may include any one or more of network topologies including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or hierarchical network, etc.

[0028] Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the plurality of electronic devices 110, 120, 130, and 140 via the network 170 and provide instructions, code, files, content, services, etc. For example, the server 150 may be a system that provides a first service to the plurality of electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may be a system that provides a second service to the plurality of electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide a service (e.g., a video calling service) targeted by an application, which is a computer program installed and executed in the plurality of electronic devices 110, 120, 130, and 140, as a first service to the plurality of electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and executing the above-mentioned application to the multiple electronic devices 110, 120, 130, and 140.

[0029] 2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. In FIG. 2, the internal configuration of electronic device 110 and the internal configuration of server 150 are described as examples of electronic devices. Furthermore, other electronic devices 120, 130, 140 and server 160 may also have the same or similar internal configuration as electronic device 110 or server 150 described above.

[0030] The electronic device 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 are non-transitory computer-readable recording media and may include persistent mass storage devices such as random access memory (RAM), read only memory (ROM), a disk drive, a solid state drive (SSD), and flash memory. The persistent mass storage devices such as ROM, SSD, flash memory, and disk drive may be included in the electronic device 110 and the server 150 as separate persistent storage devices distinct from the memories 211 and 221. The memories 211 and 221 may also store an operating system and at least one program code (e.g., code for a browser installed and executed on the electronic device 110, or code for an application installed on the electronic device 110 to provide a particular service). Such software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In other embodiments, software components may be loaded into memory 211, 221 through communication modules 213, 223 that are not computer-readable recording media. For example, at least one program may be loaded into memory 211, 221 based on a computer program (for example, the above-mentioned application) to be installed by a file provided over network 170 by a developer or a file distribution system that distributes application installation files (for example, the above-mentioned server 160).

[0031] The processors 212, 222 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memories 211, 221 or the communication modules 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program code stored in a storage device such as the memories 211, 221.

[0032] The communication modules 213 and 223 may provide a function for the electronic device 110 and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 110 and / or the server 150 to communicate with other electronic devices (for example, the electronic device 120) or other servers (for example, the server 160). For example, a request generated by the processor 212 of the electronic device 110 in accordance with program code recorded in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, a control signal, instruction, content, file, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 110 via the communication module 213 of the electronic device 110 via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the electronic device 110 may further include.

[0033] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include a keyboard, a mouse, a microphone, a camera, etc., and the output device may include a display, a speaker, a haptic feedback device, etc. As another example, the input / output interface 214 may be a means for interfacing with a device that integrates input and output functions into one, such as a touchscreen. The input / output device 215 may be configured as a single device together with the electronic device 110. Furthermore, the input / output interface 224 of the server 150 may be a means for interfacing with an input or output device (not shown) that may be connected to or included in the server 150. As a more specific example, when the processor 212 of the electronic device 110 processes instructions of a computer program loaded in the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 120 may be displayed on a display via the input / output interface 214.

[0034] In other embodiments, the electronic device 110 and the server 150 may include more components than those shown in FIG. 2 . However, it is not necessary to explicitly illustrate most of the conventional components. For example, the electronic device 110 may be implemented to include at least some of the input / output devices 215 described above, and may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 110 is a smartphone, the electronic device 110 may further include various components that are typically included in smartphones, such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, buttons using a touch panel, input / output ports, a vibrator for vibration, etc.

[0035] Specific embodiments of a method and system for providing communication using a video calling bot are described below.

[0036] FIG. 3 is a block diagram illustrating example components that may be included in an electronic device according to an embodiment of the present invention, and FIG. 4 is a flowchart illustrating an example method that may be performed by an electronic device according to an embodiment of the present invention.

[0037] A computer-implemented video call system may be configured in the electronic device 110 according to the present embodiment. For example, the video call system may be implemented as an independently operating program, or may be implemented as an in-app for a specific application (e.g., a messenger) so as to be operable on the specific application. In some cases, the video call system may provide a video call service in conjunction with the server 150.

[0038] Based on instructions provided by an application installed on the electronic device 110, the video calling system implemented in the electronic device 110 may perform the video calling method shown in FIG.

[0039] To perform the video call method according to Fig. 4, the processor 212 of the electronic device 110 may function as a video call providing unit 310, a call input transmitting unit 320, and a response output unit 330, as shown in Fig. 3. Depending on the embodiment, the components of the electronic device 110 may be selectively included or excluded from the electronic device 110. Also, depending on the embodiment, the components of the electronic device 110 may be separated or combined to express the functionality of the electronic device 110.

[0040] The processor 212 may control the electronic device 110 to execute steps 410 to 430 included in the video call method of Fig. 4. For example, the processor 212 may be implemented to execute instructions according to the code of an operating system and the code of at least one program included in the memory 211.

[0041] 3 may represent different functions of the processor 212 that are executed by the processor 212 in accordance with instructions provided by program code recorded in the electronic device 110 (e.g., instructions provided by an application executed on the electronic device 110). For example, a video call providing unit 310 may be used as a functional representation of the processor 212 that controls the electronic device 110 in accordance with the instructions described above so that the electronic device 110 provides a video call.

[0042] The processor 212 may read necessary instructions from the memory 211 loaded with instructions related to the control of the electronic device 110. In this case, the read instructions may include instructions for controlling the processor 212 to execute steps 410 to 430 described below.

[0043] Referring to FIG. 4 , in operation 410, the video call providing unit 310 may provide a video call in which multiple users, including the user of the electronic device 110, and a bot participate. When a user of one of the electronic devices 110, 120, 130, or 140 requests a video call, the server 150 may transmit the video call request to the other electronic device. Accordingly, the server 150 may connect a video call channel to users who accept the video call. The video call providing unit 310 may transmit the user of the electronic device 110's intention to participate in the video call to the server 150, receive individual images of the video call participants from the server 150, and then render the received participant images as a single screen to form a video call screen. Instead of generating a single image including multiple participant images and providing it to the electronic device 110, the server 150 may transmit the image of each participant as an individual image to the electronic device 110, and the electronic device 110 may then form a single video call screen with the multiple participant images.

[0044] The video call providing unit 310 may include a bot as a participant in the video call. In this case, an image associated with the bot (hereinafter referred to as a "bot image") may be received from the server 150, and the bot image may be displayed on the video call screen in the same manner as an image of a single participant. As an example, a bot may be selected during the process of selecting participants for the video call, and the bot may join the video call from the start of the video call. As another example, a bot may be invited to join the video call in the middle of the video call, just as one participant in the video call invites a friend.

[0045] When a user of the electronic device 110 requests a bot invitation, the video call providing unit 310 may call a bot corresponding to the request in cooperation with the server 150 and include the bot as a participant in the video call. A command word for inviting a user to a video call may be predefined for each bot participating in the video call, or the command word may be determined through personal settings by the user of the electronic device 110. Thus, the video call providing unit 310 may recognize an invitation command word input by the user based on voice or text, and may allow different bots to participate in the video call according to the recognized invitation command word. In addition to inviting a bot using an invitation command word, it is also possible to invite a bot included in a friend list to a video call in a scenario similar to inviting a friend by selecting the friend from the friend list.

[0046] In operation 420, the call input transmitting unit 320 may transmit to the server 150 a portion of input (call image or call audio) selectively identified through the bot during input related to the video call of the electronic device 110. For example, if the call input transmitting unit 320 recognizes a call command for the bot from the user of the electronic device 110 while the bot is participating in a video call, the call input transmitting unit 320 may transmit to the server 150 input within a certain time period from the time of recognizing the call command. The call input transmitting unit 320 may selectively share with the server 150 a portion of packets of the video call content based on the call command, thereby identifying call audio input that is continuously input following the bot's call command, or may identify a certain number of call image frames from call images after the time of recognizing the call command, and transmit them to the server 150. The input related to the video call may include all types of data that can be input during a video call, such as text and images, in addition to call images and call audio.

[0047] In operation 430, the response output unit 330 may receive a response corresponding to the input specified by the bot call command from the server 150 and output the received response through a corresponding bot participating in the video call. The server 150 may share a packet of some of the video call content through a bot participating in the video call, including the user of the electronic device 110, and may provide various types of content, such as an image, audio, or text, as a response to the shared packet. As an example, the response output unit 330 may output the content received as a response corresponding to the input in an area occupied by the bot image on the video call screen. As another example, the response output unit 330 may output the content received as a response corresponding to the input using the audio of a bot participating in the video call.

[0048] The server 150 may use the input specified by the call command of the bot during the video call as a query for selecting content within the service corresponding to the bot. In this case, the input transmitted to the server 150 may include some images or some audio delivered as the content of the video call. In addition, various inputs that can be used as criteria for selecting content, such as input values ​​from various input interfaces included in the electronic device 110, for example, sensor values ​​sensed before and after the recognition of the call command, may be additionally included and transmitted to the server 150.

[0049] Therefore, the video call system of the present invention can invite a bot to participate in a video call as if it were a single user, and can provide content corresponding to the call image or call audio at a specific time as a response through the bot participating in the video call.

[0050] 5 to 12 are exemplary diagrams illustrating a process of providing communication using a video call bot according to an embodiment of the present invention.

[0051] 5, the server 150 may provide a video call service by receiving and transmitting images 511, 512, and 513 in real time between the electronic devices 110, 120, and 130 of participants participating in the video call. When a user of the electronic device 110 participates in the video call, images 511, 512, and 513 of the participants participating in the video call may be transmitted to the electronic device 110 as individual images. In this case, the processor 212 may display a video call screen 500 by rendering the image 511 input by the camera of the electronic device 110 and the participant images 512 and 513 received as individual images from the server 150 as a single screen.

[0052] 6, the processor 212 may provide a menu screen 610 related to the video call on the video call screen 500 in accordance with a request from the user of the electronic device 110. In this case, the menu screen 610 may include a “Bot” menu 611 for inviting a bot.

[0053] When a user of electronic device 110 selects "Bots" menu 611 from menu screen 610, processor 212 may provide bot list screen 620 including at least one bot that can be invited to a video call. As an example, bot list screen 620 may include a list of bots specified by the user of electronic device 110, such as bots recently invited to a video call, bots previously set as favorites, and bots recommended for the user. In addition to the bot list described above, bot list screen 620 may further include a menu for accessing the entire list of bots that can be invited to a video call.

[0054] 7, the processor 212 may invite a specific bot selected by the user of the electronic device 110 from the bot list screen 620 to a video call. In this case, the processor 212 may receive a bot image 714 from the server 150 as one participant image, and then configure and display the video call screen 500 including the bot image 714.

[0055] In other words, when one of the participants in a video call invites a bot to the video call at the start of the video call or during the video call, the processor 212 may receive the bot image 714 as a participant image from the server 150, and then construct and display the video call screen 500 including the bot image 714.

[0056] In addition to using a menu associated with a video call, the processor 212 may invite a specific bot to a video call by using a wake-up word based on voice or text as a command for inviting the bot. Referring to FIG. 8, the processor 212 may record a wake-up word 820 for each bot 810 in a local storage space (for example, the memory 211). In this case, the wake-up word 820 for each bot 810 may be predefined or may be directly set by the user of the electronic device 110.

[0057] The processor 212 may call different characters or tool bots and invite them into a video call based on the wake-up word entered by the user of the electronic device 110.

[0058] The processor 212 may work in conjunction with the server 150 to provide a list of bots that can participate in a video call, and may record a wake-up word 820 for each bot 810 in the bot list for bots that the user of the electronic device 110 has requested to be added to their friend list.

[0059] If the wake-up word 820 entered by the user of the electronic device 110 is recognized by voice or text, the processor 212 may call the bot 810 corresponding to the entered wake-up word 820 and include it as a participant in the video call.

[0060] The wake-up word 820 may be used as a command for inviting the bot before the bot is invited to a video call, and may be used as a call command for requesting a response from the bot after the bot is invited to a video call. The invite command and the call command may be set differently.

[0061] In addition to using the wake-up word 820 to send an invitation, the processor 212 may also use a friend list to invite bots included in the friend list to a video call.

[0062] 9, the processor 212 may provide an interface screen 900 including a friend list as one of interfaces related to a video call in response to a request from a user of the electronic device 110, and may provide a list of bots 901 that can participate in the video call via the interface screen 900. In this case, the bot list 901 may include bots that the user has added as friends or bots recommended by the server 150.

[0063] The video call bot may be realized as a character of a celebrity such as a popular entertainer, or as a bot that serves as a tool with a specific function. Furthermore, the video call bot may be traded as a type of commodity on a platform linked to the server 150, and a user of the electronic device 110 may add a purchased bot to the user's friend list. Furthermore, the server 150 may generate and provide a personalized character or tool bot desired by the user in accordance with a request from the user of the electronic device 110. Furthermore, the server 150 may recommend at least one bot based on the participants of the video call, the user's profile information, the user's content consumption history, etc.

[0064] The processor 212 may output a reaction of a character in the bot image based on a response received from the server 150 in response to a sharing packet of the video call content. In other words, a video call bot may provide a reaction based on audio or an image to the video call content. For example, when a user of the electronic device 110 utters a call command "brown" followed by "Today is Sarah's birthday" during a video call, the processor 212 may transmit to the server 150 an audio packet "Today is Sarah's birthday" that was uttered immediately after the call command "brown" was recognized. Referring to FIG. 10 , the processor 212 may output audio celebrating a birthday as a reaction of a character in the bot image 714 based on a response received from the server 150 in response to the call audio packet "Today is Sarah's birthday" that was uttered immediately after the call command "brown" was recognized during the video call. In this case, while the audio celebrating a birthday is being output, a user interface 1020 indicating that audio is being output may be additionally displayed within the bot image 714. Although not shown in the figure, the processor 212 may provide an image-based reaction, such as changing the appearance of the character in the bot image 714, such as by putting on a different outfit or a tricorn hat, or applying a birthday-related filter on the bot image 714, based on a response received from the server 150 to the call voice packet "Today is Sarah's birthday" immediately after the call command "brown" is recognized during the video call.

[0065] The processor 212 may output map information on the bot image based on a response received from the server 150 in response to a sharing packet of the video call content. In other words, the video call bot may serve as a tool for providing location-based services, such as a map service, within the video call environment. For example, when a user of the electronic device 110 utters a call command "brown" followed by "Where is the nearest cafe from here?" during a video call, the processor 212 may transmit to the server 150, via the bot operating as a map tool, a voice packet "Where is the nearest cafe from here?" uttered immediately after the call command "brown" is recognized. Referring to FIG. 11 , the processor 212 may output a map screen 1130 for a certain period of time in the area occupied by the bot image 714 based on a response received from the server 150 in response to the call voice packet "Where is the nearest cafe from here?" immediately after the call command "brown" is recognized during the video call.

[0066] The processor 212 may output a translation result to the bot image based on a response received from the server 150 in response to a sharing packet of the video call content. In other words, the video call bot may serve as a tool that provides a translation service within the video call environment. For example, referring to FIG. 12 , when a user of the electronic device 110 captures a translation target with the camera of the electronic device 110 while uttering a call command “brown” followed by “translate this” during a video call, the processor 212 may transmit, via a bot operating as a translation tool, an image packet delivered from the electronic device 110 immediately after the call command “brown” is recognized, i.e., the captured original image 1201, to the server 150 through an area occupying the image 511 of the user of the electronic device 110. The processor 212 may output an image 1240 including a translation result for the text in the original image 1201 in an area occupied by the bot image 714 for a certain period of time based on a response received from the server 150 in response to a call image packet immediately after the call command “brown” is recognized during the video call.

[0067] Similarly, assuming that a video call bot operates as a shopping tool, if a user captures a product image with the camera of electronic device 110 while uttering a call command such as "I want to buy this" followed by the call command "brown" during a video call, the image packet delivered by electronic device 110 immediately after the call command "brown" is recognized, i.e., the captured product image, may be transmitted to server 150 through the area occupied by user image 511 of electronic device 110. Processor 212 may output website information for purchasing the product for a certain period of time in the area occupied by bot image 714 based on a response received from server 150 in response to the call image packet immediately after the call command "brown" is recognized during the video call.

[0068] In the present embodiment, the content provided through the video call bot is described as being output in the area occupied by the bot image 714 on the video call screen 500, but this is not intended to be limiting. In some embodiments, the content provided by the video call bot may be temporarily displayed in the entire area of ​​the video call screen 500. For example, the processor 212 may display the content in the entire area of ​​the video call screen 500 or selectively display it in the area occupied by the bot image 714 depending on the type of video call bot or the type of content provided by the video call bot. For another example, the processor 212 may overlay the content provided by the video call bot in a pop-up format on a partial area of ​​the video call screen 500, regardless of the bot image 714.

[0069] The content that can be provided through a bot during a video call may include reactions to the content of the call, map information, translation information, shopping information, etc. These contents are just examples, and may also include all kinds of information on the Internet that can respond based on audio and image packets delivered during a video call, such as image search, video search, news search, dictionary information, movie information, music information, book information, palmistry and facial reading interpretation, and couple matching.

[0070] In another embodiment, at least a portion of the content provided through the bot during the video call may be sent as a message in a chat room associated with the video call. The content provided by the bot during the video call may be sent as a message from the bot based on a user selection or a preset value.

[0071] As such, according to an embodiment of the present invention, by inviting a bot as a participant in a video call as if it were a single user, it is possible to respond with various information through the bot in a video call environment, thereby supporting communication with infinite functions.

[0072] The above-described devices may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also access, record, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device may be described. However, those skilled in the art will understand that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0073] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may independently or collectively instruct the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0074] Methods according to embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. Here, the medium may continuously record a computer-executable program or temporarily record it for execution or download. Furthermore, the medium may be various recording or storage means in the form of a single piece of hardware or multiple pieces of hardware combined together. It is not limited to media directly connected to a computer system, but may also be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; ROMs, RAMs, flash memories, and the like, configured to record program instructions. Other examples of media include recording media or storage media managed by application stores that distribute applications, or by sites, servers, and the like that provide or distribute various software.

[0075] Although the embodiments have been described above based on limited examples and drawings, those skilled in the art will appreciate that various modifications and variations may be made from the above description. For example, the described techniques may be performed in an order different from that described, and / or the described system, structure, device, circuit, or other element may be coupled or combined in a manner different from that described, or may be substituted or replaced by other elements or equivalents, and still achieve suitable results.

[0076] Therefore, different embodiments that are equivalent to the claims are within the scope of the appended claims. [Explanation of symbols]

[0077] 212: Processor 310: Video Call Provider 320: Call input transmission unit 330: Response output section

Claims

1. 1. A video calling method executed by a computer device, comprising: the computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The video calling method includes: displaying, on the same display screen, a plurality of participant windows showing images transmitted from a plurality of users participating in the video call, respectively, during the video call by the at least one processor; responsive to a request to invite a bot to the video call, the at least one processor rendering on the display screen a graphic user interface (GUI) element identifying the bot as a participant in the video call; transmitting, by the at least one processor, a portion of inputs entered into the computing device during the video call that are associated with the bot to a server; and the at least one processor responding to the portion of the input and outputting a response to the portion of the input through an area of ​​the display screen associated with the bot. Video calling methods, including:

2. The video call method according to claim 1 , wherein the region is a window arranged adjacent to the plurality of participant windows.

3. The video call method of claim 1 , wherein the graphic user interface element includes an image associated with the bot.

4. The displaying step includes: receiving an image associated with the bot from the server, and rendering an image of at least one user among the plurality of users participating in the video call and the image associated with the bot as one video call screen; The video calling method of claim 1 , comprising:

5. The displaying step includes: Recognizing a command for inviting a bot input to the computer device; and and displaying a bot corresponding to the command as a participant of the video call according to the command. The video calling method of claim 1 , comprising:

6. The video calling method includes: The at least one processor sets a wake-up word for each bot that can join the video call. The video calling method of claim 1 , further comprising:

7. The transmitting step includes: Recognizing a command for the bot input to the computer device; and transmitting the voice or image input to the computer device to the server after the command is recognized. The video calling method of claim 1 , comprising:

8. The outputting step includes: outputting a response retrieved by the server in response to the partial input by voice or image through the bot participating in the video call; The video call method according to claim 1 ,

9. The outputting step includes: and displaying a response to the part of the input in an area occupied by an image of the bot on a video call screen for the video call. The video call method according to claim 1, comprising:

10. The outputting step includes: outputting a response to the part of the input by a voice corresponding to the bot participating in the video call; The video call method according to claim 1 ,

11. A computer program recorded on a non-transitory computer-readable recording medium for causing the computer device to execute the video call method according to any one of claims 1 to 10.

12. 1. A computer device comprising: at least one processor configured to execute computer-readable instructions contained in the memory; Including, The at least one processor a video call providing unit that, for a video call in which multiple users including the user of the computer device participate, displays multiple participant windows on the same display screen, each showing an image sent from the multiple users participating in the video call, and, in response to a request to invite a bot to the video call, renders a graphic user interface (GUI) element on the display screen that identifies the bot as a participant in the video call; a call input sending unit that sends a portion of inputs related to the bot among inputs input to the computer device during the video call to a server; and a response output unit that outputs a response to the part of the input through an area of ​​the display screen associated with the bot in response to the part of the input; 2. A computer device comprising:

13. 13. The computer device of claim 12, wherein the region is a window disposed adjacent to the plurality of participant windows.

14. The computer device of claim 12 , wherein the graphic user interface element includes an image associated with the bot.

15. The video call providing unit receiving an image associated with the bot from the server, and rendering an image of at least one user of the plurality of users participating in the video call and the image associated with the bot as one video call screen; 13. The computer device of claim 12.

16. The video call providing unit Recognizing a command for inviting a bot input to the computer device; According to the command, displaying a bot corresponding to the command as a participant in the video call.

13. The computer device of claim 12.

17. The at least one processor Setting a wake-up word for each bot that can join the video call 13. The computer device of claim 12.

18. The call input transmitting unit Recognizing a command for the bot input to the computer device; After the command is recognized, the voice or image input to the computer device is transmitted to the server.

13. The computer device of claim 12.

19. The response output unit Displaying a response to the part of the input in an area occupied by an image of the bot on a video call screen for the video call.

13. The computer device of claim 12.

20. The response output unit outputting a response to the part of the input by a voice corresponding to the bot participating in the video call; 13. The computer device of claim 12.

Images