Method and system for applying virtual lighting in video call

Abstract

To provide a method for applying virtual lighting in a video call.SOLUTION: A method includes the steps of: starting, from a first user terminal, a video call between a first user and a second user using a first video of the first user captured by the first user terminal and a second video of the second user captured by a second user terminal; recognizing a shape of the first user from the first video; receiving, via the first user terminal, a user input related to virtual lighting in the first video from the first user; applying the virtual lighting to the shape of the first user on the basis of the user input; and outputting the first video with the virtual lighting applied thereto on a display of the first user terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a method and system for applying virtual lighting to video in a video call, and more particularly, to a method and system for applying virtual lighting to a user's shapes and outputting the shapes on a display using an instant messaging application based on user input associated with the virtual lighting. [Background technology]

[0002] Recently, with the proliferation of mobile devices such as smartphones and the development of the Internet, instant messaging applications that enable voice and video calls between multiple users are widely used, and applications that allow users to change the overall brightness and hue of an image by applying a camera filter to the image are also widely used.

[0003] Meanwhile, in existing video call providing services, images taken from the user terminals of the users participating in the video call are provided. In addition, recent video call providing services can provide images in which the overall brightness or hue of the image is changed by adding effects to the actually taken image of the user. However, such images have a problem in that the user cannot be seen well when making a video call in a dark place. In addition, even if the overall brightness or hue of the image is changed by effects, the user's shape may be blurred or an unnatural image may be provided. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Korean Patent Publication No. 10-2023-0120668 Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure provides a method and apparatus (system) for applying virtual lighting to video during a video call to solve the above problems. [Means for solving the problem]

[0006] The present disclosure can be embodied in numerous ways, including as a method, an apparatus (system), or a computer program stored on a computer readable storage medium.

[0007] According to one embodiment of the present disclosure, a method for applying virtual lighting to an image in a video call may include the steps of: initiating a video call between a first user and a second user from a first user terminal using a first image captured by the first user terminal of the first user and a second image captured by the second user terminal of the second user; recognizing a shape of the first user from the first image; receiving a user input related to the virtual lighting in the first image from the first user via the first user terminal; applying virtual lighting to the shape of the first user based on the user input; and outputting the first image to which the virtual lighting has been applied on a display of the first user terminal.

[0008] A computer readable computer program may be provided for carrying out a method according to an embodiment of the present disclosure on a computer.

[0009] An apparatus according to one embodiment of the present disclosure includes a communication module, a memory, a display, and at least one processor coupled to the memory and configured to execute at least one computer-readable program included in the memory, wherein the at least one program may include instructions to recognize a first user in a video call between a first user and a second user using a first image taken by the first user terminal of the first user and a second image taken by the second user terminal of the second user, recognize a shape of the first user from the first image, receive user input related to virtual lighting in the first image from the first user via the first user terminal, apply virtual lighting to the shape of the first user based on the user input, and output the first image to which the virtual lighting has been applied on a display of the first user terminal. Effect of the Invention

[0010] According to various embodiments of the present disclosure, the shape of a user can be expressed more three-dimensionally by applying virtual lighting during a video call. Also, the user can freely change the atmosphere in his / her own image through the virtual lighting. In addition, a sense of immersion can be provided to the user through the image of another user to which virtual lighting is applied.

[0011] According to various embodiments of the present disclosure, a user can apply various virtual lighting during a video call, which allows the user to conveniently experience the user's shape being changed by the virtual lighting.

[0012] According to various embodiments of the present disclosure, users can apply virtual lighting to their own images during a video call. Users can also apply virtual lighting to images of other users participating in the video call. This can promote interaction between users while the video call is in progress. In addition, by using virtual lighting at the same or symmetrical positions, it is possible to provide users with a feeling of being face-to-face.

[0013] The effects of the present disclosure are not limited to these, and other effects not mentioned therein should be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains (hereinafter referred to as a "person skilled in the art") from the description in the claims. [Brief description of the drawings]

[0014] BRIEF DESCRIPTION OF THE DRAWINGS Exemplary embodiments of the present disclosure will now be described with reference to the accompanying drawings, in which like reference numerals refer to like elements, but are not limited to the drawings, in which: FIG. [Figure 1] FIG. 13 is a diagram illustrating an example of a method for applying virtual lighting in a video call according to one embodiment of the present disclosure. [Diagram 2] 1 is a schematic diagram showing a configuration in which an information processing system is communicatively connected to multiple user terminals to provide a video call service according to one embodiment of the present disclosure. [Diagram 3] 2 is a block diagram showing an internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure. FIG. [Figure 4] FIG. 11 is a diagram illustrating an example of an image to which virtual lighting is applied according to an embodiment of the present disclosure. [Diagram 5] FIG. 11 is a diagram illustrating an example of an image to which virtual lighting is applied according to an embodiment of the present disclosure. [Figure 6] FIG. 11 is a diagram illustrating an example of an image to which virtual lighting is applied according to an embodiment of the present disclosure. [Figure 7] FIG. 11 is a diagram illustrating an example of an image to which virtual lighting is applied according to an embodiment of the present disclosure. [Figure 8] FIG. 13 is a diagram showing another example in which virtual lighting is applied according to an embodiment of the present disclosure. [Figure 9] FIG. 13 is a diagram showing an example in which a virtual lighting effect is applied during a video call according to an embodiment of the present disclosure. [Figure 10] 1 is a flowchart illustrating an example of a method according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] <Summary of the Invention> According to one embodiment of the present disclosure, the step of recognizing the shape of the first user may include the steps of generating a depth map for the shape of the first user, and generating a three-dimensional model for the shape of the first user based on the depth map.

[0016] According to one embodiment of the present disclosure, the step of receiving user input may include a step of receiving a first user input selecting a position of a source of virtual lighting in a virtual space centered on the shape of the first user.

[0017] According to one embodiment of the present disclosure, the step of receiving user input may include a step of selecting a position of a virtual lighting light source in a virtual two-dimensional space centered on the first user's shape, and then receiving a first user input selecting a position of a virtual lighting light source in a virtual three-dimensional space centered on the first user's shape.

[0018] According to one embodiment of the present disclosure, the step of receiving a user input may further include a step of receiving a second user input selecting at least one of a direction of light emitted from the virtual lighting source or a type of the virtual lighting source.

[0019] According to one embodiment of the present disclosure, the step of receiving the user input may further include a step of receiving a third user input selecting at least one of a color value or an intensity of the light emitted from the light source of the virtual lighting.

[0020] According to one embodiment of the present disclosure, the step of receiving a user input further includes a step of receiving a fourth user input selecting a number of virtual lighting light sources, whereby light source images of the selected number of virtual lighting are output on the display, and settings associated with the virtual lighting can be input for each of the light source images of the selected number of virtual lighting.

[0021] According to an embodiment of the present disclosure, the method may further include applying virtual lighting to the background of the first user.

[0022] According to one embodiment of the present disclosure, the step of applying virtual lighting to a background of a first user may include a step of generating a virtual lighting image layer based on a virtual lighting setting input by a user, and a step of superimposing the generated virtual lighting image layer on an image layer including a shape of the first user.

[0023] According to one embodiment of the present disclosure, the method may further include a step of receiving a user input related to virtual lighting to be applied to the second image from a first user, a step of transmitting virtual lighting information corresponding to the user input related to the virtual lighting to be applied to the second image to a second user terminal, and a step of outputting the second image to which virtual lighting has been applied based on the virtual lighting information on a display of the first user terminal.

[0024] According to one embodiment of the present disclosure, the method may further include a step of recognizing a shape of the second user from the second image, and a step of outputting the second image to which virtual lighting has been applied on a display of the first user terminal based on user input.

[0025] According to one embodiment of the present disclosure, the step of receiving user input includes a step of receiving user input selecting a position of a virtual lighting light source in a virtual space centered on the shape of a first user, and the position of the virtual lighting light source in the first image to which virtual lighting is applied and the position of the virtual lighting light source in the second image to which virtual lighting is applied may be identical.

[0026] According to one embodiment of the present disclosure, the step of receiving user input includes a step of receiving user input selecting a position of a virtual lighting light source in a virtual space centered on the shape of a first user, and the position of the virtual lighting light source in the first image to which the virtual lighting is applied and the position of the virtual lighting light source in the second image to which the virtual lighting is applied may be symmetrical.

[0027] According to an embodiment of the present disclosure, the second image to which the virtual lighting is applied may be output on a display of a second user terminal.

[0028] According to one embodiment of the present disclosure, the method may further include a step of outputting a second image to which virtual lighting has been applied on a display of the first user terminal, and the second image to which virtual lighting has been applied may be generated from the second user terminal and may correspond to an image to which virtual lighting set by the second user has been applied.

[0029] According to one embodiment of the present disclosure, the method may further include a step of overlaying the image onto the first image and displaying it on a display of the first user terminal in response to receiving an image input from the first user.

[0030] According to one embodiment of the present disclosure, the method may include the steps of recognizing a shape of a second user from a second image, receiving user input associated with virtual lighting in the second image from the first user via a first user terminal, applying virtual lighting to the shape of the second user based on the user input associated with the virtual lighting in the second image, and outputting the second image to which the virtual lighting has been applied from a display of the first user terminal.

[0031] <Detailed Description of the Invention> Hereinafter, specific contents for carrying out the present disclosure will be described in detail with reference to the accompanying drawings. However, in the following description, detailed descriptions of known functions and configurations will be omitted if they may unnecessarily obscure the gist of the present disclosure.

[0032] In the accompanying drawings, the same or corresponding components are given the same reference numerals. In addition, in the following description of the embodiments, duplicated descriptions of the same or corresponding components may be omitted. However, even if the description of a component is omitted, it is not intended that such a component is not included in a certain embodiment.

[0033] The advantages and features of the disclosed embodiments and the methods of achieving them will become apparent from the following examples, taken in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, and may be embodied in various different forms. However, the embodiments are provided only to make the disclosure complete and to allow those skilled in the art to accurately recognize the category of the invention.

[0034] The terms used in this disclosure are briefly explained, and the disclosed embodiments are specifically described. The terms used in this disclosure are selected as currently widely used general terms as much as possible while taking into consideration the functions in this disclosure, but these may change depending on the intentions or precedents of engineers engaged in related fields, the emergence of new technologies, etc. In addition, in certain cases, there may be terms arbitrarily selected by the applicant, but the meanings of these will be described in detail in the description of the invention. Therefore, the terms used in this disclosure should be defined based on the meanings of the terms and the overall content of this disclosure, rather than simply the names of the terms.

[0035] In this disclosure, unless otherwise clearly specified in the context, singular expressions can include plural expressions, and plural expressions can include singular expressions. Throughout the specification, when a part "comprises" a certain element, this does not mean that other elements are excluded, and other elements can also be included, unless otherwise specified to the contrary.

[0036] In addition, the term "module" or "unit" as used in the specification means a software or hardware component, and the "module" or "unit" performs a certain function. However, the term "module" or "unit" is not limited to software or hardware. The "module" or "unit" may be configured to reside on an addressable storage medium and may be configured to execute one or more processors. Thus, by way of example, a "module" or "unit" may include components such as software components, object-oriented software components, class components, and task components, as well as at least one of a process, a function, an attribute, a procedure, a subroutine, a segment of program code, a driver, firmware, microcode, a circuit, data, a database, a data structure, a table, an array, or a variable. The functionality provided within the components and "modules" or "units" may be combined into a smaller number of components and "modules" or "units" or may be further separated into additional components and "modules" or "units".

[0037] According to an embodiment of the present disclosure, a "module" or a "unit" may be embodied with a processor and a memory. A "processor" should be broadly construed to include a general purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, and the like. In some environments, a "processor" may also refer to an application specific semiconductor (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), and the like. A "processor" may also refer to a combination of processing devices, such as, for example, a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors in conjunction with a DSP core, or any other such configuration. Additionally, a "memory" should be broadly construed to include any electronic component capable of storing electronic information. "Memory" may also refer to various types of processor-readable media such as Random Access Memory (RAM), Read Only Memory (ROM), Non-Volatile Random Access Memory (NVRAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash memory, magnetic or optical data storage devices, registers, etc. A memory is said to be in electronic communication with a processor when the processor can read information from the memory and write information read into the memory. Memory that is integrated into a processor is in electronic communication with the processor.

[0038] In the present disclosure, a "system" may include at least one of a server device and a cloud device, but is not limited thereto. For example, the system may be composed of one or more server devices. As another example, the system may be composed of one or more cloud devices. As yet another example, the system may be operated by being composed of all of the server device and the cloud device.

[0039] In this disclosure, a "display" may refer to any display device associated with a computing device, such as any display device capable of displaying any information / data controlled by or provided by a computing device.

[0040] In the present disclosure, "each of a plurality of A's" can refer to each of all of the components included in the plurality of A's, or each of some of the components included in the plurality of A's.

[0041] In this disclosure, a "user" may refer to a person who is engaged in a video call with another user in a chat room of an instant messaging application or a video calling application, or alternatively, a "user" may refer to an image or a portion of an image of such a person displayed on a display.

[0042] In the present disclosure, a "machine learning model" may include any model used to infer an answer to a given input. According to one embodiment, the machine learning model may include an artificial neural network model including an input layer, a plurality of hidden layers, and an output layer, where each layer may include a plurality of nodes. In the present disclosure, each of the plurality of machine learning models is described as a separate machine learning model, but is not limited thereto, and some or all of the plurality of machine learning models may be embodied as one machine learning model. Also, one machine learning model may include multiple machine learning models. In the present disclosure, the terms machine learning model and artificial neural network model, etc. may be used interchangeably to refer to the same or similar models.

[0043] In the present disclosure, "virtual lighting" may refer to lighting that is virtually generated by a user to three-dimensionally impart a virtual lighting effect to a captured image. Here, the effect of virtual lighting may include being three-dimensionally imparted to a user's shape after the user recognizes the user's shape on a layer of the captured image.

[0044] 1 is a diagram illustrating an example of a method for applying virtual lighting in a video call according to an embodiment of the present disclosure. As shown in the figure, a user uses a video call service via an instant messaging application or a video call application in a user terminal 110. In addition, the user can use the video call service to make a video call with another user.

[0045] Figures 1, 4 to 7 show, as one embodiment, a virtual lighting interface for setting virtual lighting provided from a display of a user terminal used by a first user among multiple users including a first user and a second user using video calling.

[0046] In one embodiment, the virtual lighting setting process operated by the first user does not need to be shared with the second user. During the virtual lighting setting process of the first user, an image without the virtual lighting effect applied may be shared with the second user. After the first user completes the virtual lighting setting, the first user may have the image with the virtual lighting effect applied to the second user.

[0047] In one embodiment, the shape of a user can be recognized from a video of the user during an ongoing video call. Specifically, a machine learning model can generate a depth map for the shape of the user from the video of the user. Based on the depth map, a 3D model of the shape of the user can be generated.

[0048] In one embodiment, virtual lighting 140 may be applied to a user's shape. Specifically, a user may select settings related to virtual lighting in the virtual lighting interface 120 by touch input, etc. Here, the settings related to virtual lighting may include settings for the position, number, and type of a light source of the virtual lighting, and the intensity, direction, and color value of light emitted from the light source of the virtual lighting. The color value refers to any one of a hue value, a brightness value, and a saturation value, or a combination thereof. Also, virtual lighting 140 may be applied to the user's shape based on the settings related to the virtual lighting selected by the user.

[0049] For example, the user can select one of the virtual lighting light source typesets 150 of the virtual lighting interface 120 by touch input or the like. Here, the virtual lighting light source typeset 150 can include light source types such as a circular type, a linear type, a unidirectional emission type, an omnidirectional emission type, a backlight type, and the like. In addition, the user can select a specific hue emitted from the light source of the virtual lighting 140 in the virtual lighting color bar 160 of the virtual lighting interface 120 by touch input or the like. This allows the user to confirm on the display the image 130 in which the virtual lighting selected by the user is applied to the user's shape. Additionally, the user can cancel the application of the virtual lighting 140 from the image 130 to which the virtual lighting is applied by selecting the virtual lighting off button 170 by touch input or the like.

[0050] In one embodiment, a user can apply virtual lighting to an image of another user with whom a video call is in progress. Specifically, the shape of the other user is recognized, and virtual lighting set by the user can be applied to the shape of the other user. In this case, the position of the light source of the virtual lighting applied to the image of the other user may be the same as the position of the light source of the virtual lighting applied to the image of the user. Alternatively, the position of the light source of the virtual lighting applied to the image of the other user may be symmetrical to the position of the light source of the virtual lighting applied to the image of the user. Additionally, the image of the other user to which the virtual lighting set by the user is applied may be output from the user terminal of the other user. An example of applying virtual lighting to the image of the other user will be described in detail below with reference to FIG. 9.

[0051] With this configuration, the shape of the user can be expressed more three-dimensionally by applying virtual lighting during the video call. In addition, the user can freely change the atmosphere in his / her own image through the virtual lighting. In addition, a sense of immersion can be provided to the user through the image of another user to which virtual lighting is applied.

[0052] 2 is a schematic diagram illustrating a configuration in which an information processing system 230 is connected to a plurality of user terminals 210_1, 210_2, and 210_3 so as to be capable of communicating with each other in order to provide a video call service according to an embodiment of the present disclosure. As shown in the figure, the plurality of user terminals 210_1, 210_2, and 210_3 may be connected to the information processing system 230 capable of providing the video call service via a network 220. Here, the plurality of user terminals 210_1, 210_2, and 210_3 may include terminals of users who will receive the video call service.

[0053] In one embodiment, the information processing system 230 may include one or more server devices and / or databases capable of storing, providing, and executing computer-executable programs (e.g., downloadable applications) and data related to providing a video calling service, or one or more distributed computing devices and / or distributed databases based on a cloud computing service.

[0054] The video call service provided by the information processing system 230 may be provided to a user via a video call application web browser or a web browser extension program installed in each of the user terminals 210_1, 210_2, and 210_3. For example, the information processing system 230 may provide information corresponding to a virtual lighting application request received from the user terminals 210_1, 210_2, and 210_3 via the video call application or perform a corresponding process.

[0055] The plurality of user terminals 210_1, 210_2, and 210_3 can communicate with the information processing system 230 via the network 220. The network 220 can be configured to enable communication between the plurality of user terminals 210_1, 210_2, and 210_3 and the information processing system 230. The network 220 can be composed of a wired network such as Ethernet (registered trademark), PLC (Power Line Communication), telephone line communication device, and RS-serial communication, a wireless network such as a mobile communication network, WLAN (Wireless LAN), Wi-Fi (registered trademark), Bluetooth (registered trademark), and ZigBee (registered trademark), or a combination thereof, depending on the installation environment. The communication method is not limited, and can include not only a communication method utilizing a communication network (e.g., a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) that can include the network 220, but also a short-distance wireless communication between the user terminals 210_1, 210_2, and 210_3.

[0056] 2, a mobile phone terminal 210_1, a tablet terminal 210_2, and a PC terminal 210_3 are shown as examples of user terminals, but are not limited thereto, and the user terminals 210_1, 210_2, and 210_3 may be any computing device capable of wired and / or wireless communication and capable of installing and executing a video call application or a web browser. For example, the user terminal may include an AI speaker, a smartphone, a mobile phone, a navigation system, a desktop computer, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), a tablet PC, a game console, a wearable device, an IoT (internet of things) device, a VR (virtual reality) device, an AR (augmented reality) device, a set-top box, and the like. Also, while FIG. 2 shows three user terminals 210_1, 210_2, and 210_3 communicating with the information processing system 230 via the network 220, this is not limited thereto, and a different number of user terminals may be configured to communicate with the information processing system 230 via the network 220.

[0057] 3 is a block diagram showing the internal configuration of a user terminal 210 and an information processing system 230 according to an embodiment of the present disclosure. The user terminal 210 may refer to any computing device capable of executing applications, a web browser, and the like, and capable of wired / wireless communication, and may include, for example, a mobile phone terminal 210_1, a tablet terminal 210_2, and a PC terminal 210_3 in FIG. 2. As shown in the figure, the user terminal 210 may include a memory 312, a processor 314, a communication module 316, and an input / output interface 318. Similarly, the information processing system 230 may include a memory 332, a processor 334, a communication module 336, and an input / output interface 338. As shown in FIG. 3, the user terminal 210 and the information processing system 230 may be configured to communicate information and / or data via the network 220 using the respective communication modules 316 and 336. Additionally, the input / output device 320 may be configured to input information and / or data to the user terminal 210 or output information and / or data generated by the user terminal 210 via the input / output interface 318.

[0058] The memory 312, 332 may include any non-transitory computer-readable recording medium. According to an embodiment, the memory 312, 332 may include a permanent mass storage device such as a read only memory (ROM), a disk drive, a solid state drive (SSD), and a flash memory. As another example, a permanent mass storage device such as a ROM, an SSD, a flash memory, and a disk drive may be included in the user terminal 210 or the information processing system 230 as a permanent storage device separate from the memory. In addition, the memory 312, 332 may store an operating system and at least one program code.

[0059] Such software components can be loaded from a computer-readable recording medium other than the memory 312, 332. Such another computer-readable recording medium can include a recording medium directly connectable to such a user terminal 210 and information processing system 230, and can include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, and a memory card. As another example, the software components, etc. can be loaded into the memory 312, 332 via the communication module 316, 336 instead of a computer-readable recording medium. For example, at least one program can be loaded into the memory 312, 332 based on a computer program to be installed by a file provided via the network 220 by a developer or a file distribution system that distributes an installation file of an application.

[0060] The processor 314, 334 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processor 314, 334 by the memory 312, 332 or the communication module 316, 336. For example, the processor 314, 334 may be configured to execute instructions received by program code stored in a storage device, such as the memory 312, 332.

[0061] The communication modules 316, 336 may provide configurations and functions for the user terminal 210 and the information processing system 230 to communicate with each other via the network 220, and may provide configurations and functions for the user terminal 210 and / or the information processing system 230 to communicate with other user terminals or other systems (e.g., another cloud system, etc.). As an example, a request or data (e.g., a request to apply virtual lighting, etc.) generated by the processor 314 of the user terminal 210 using a program code stored in a storage device such as the memory 312 may be transmitted to the information processing system 230 via the network 220 under the control of the communication module 316. Conversely, a control signal or command provided by the processor 334 of the information processing system 230 may be received by the user terminal 210 via the communication module 316 of the user terminal 210 through the communication module 336 and the network 220.

[0062] The input / output interface 318 may be a means for interfacing with the input / output device 320. As an example, the input device may include a device such as a camera, keyboard, microphone, mouse, etc., including an audio sensor and / or an image sensor, and the output device may include a device such as a display, a speaker, a haptic feedback device, etc. As another example, the input / output interface 318 may be a means for interfacing with a device having a configuration or function for performing input and output integrated into one, such as a touch screen. For example, when the processor 314 of the user terminal 210 processes the instructions of a computer program loaded in the memory 312, a service screen, etc., configured using information and / or data provided by the information processing system 230 or another user terminal, may be displayed on the display via the input / output interface 318. In FIG. 3, the input / output device 320 is illustrated as not being included in the user terminal 210, but is not limited thereto, and may be configured integrally with the user terminal 210. Additionally, the input / output interface 338 of the information processing system 230 may be a means for interfacing with an input or output device (not shown) that may be coupled to or included in the information processing system 230. Although the input / output interfaces 318, 338 are shown in FIG. 3 as elements configured separately from the processors 314, 334, this is not limiting, and the input / output interfaces 318, 338 may also be configured to be included in the processors 314, 334.

[0063] The user terminal 210 and the information processing system 230 may include more components than those shown in FIG. 3. However, it is not necessary to explicitly show most of the conventional technical components. According to an embodiment, the user terminal 210 may be embodied to include at least a part of the above-mentioned input / output device 320. The user terminal 210 may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. For example, if the user terminal 210 is a smartphone, it may include components that a smartphone typically has, and may be embodied to further include various components such as an acceleration sensor, a gyro sensor, a microphone module, a camera module, various physical buttons, a button using a touch panel, an input / output port, and a vibrator for vibration.

[0064] When a program for a video call application or the like is operated, the processor 314 can receive text, images, videos, voices, and / or actions, etc., input or selected by an input device such as a touch screen, keyboard, camera including an audio sensor and / or image sensor, microphone, etc., connected to the input / output interface 318, and can store the received text, images, videos, voices, and / or actions, etc. in the memory 312 or provide them to the information processing system 230 via the communication module 316 and the network 220. The processor 314 of the user terminal 210 can be configured to manage, process, and / or store information and / or data received from the input / output device 320, other user terminals, the information processing system 230, and / or multiple external systems. The information and / or data processed by the processor 314 can be provided to the information processing system 230 via the communication module 316 and the network 220. The processor 314 of the user terminal 210 can transfer information and / or data to the input / output device 320 via the input / output interface 318 and output it. For example, the processor 314 may display the received information and / or data on a screen of the user terminal 210 .

[0065] The processor 334 of the information processing system 230 may be configured to manage, process, and / or store information and / or data received from the plurality of user terminals 210 and / or the plurality of external systems. The information and / or data processed by the processor 334 may be provided to the user terminal 210 via the communication module 336 and the network 220.

[0066] FIG. 4 is a diagram illustrating an example of an image 440 to which virtual lighting is applied according to an embodiment of the present disclosure. In an embodiment, a user can select the number of light sources of the virtual lighting in a virtual lighting interface 410. Also, light source images of the virtual lighting can be displayed on the display based on the number of light sources of the virtual lighting selected by the user. For example, when the user selects the number of light sources of the virtual lighting to be two, a first virtual lighting 420 and a second virtual lighting 430 can be displayed on the display. Here, the user can input settings related to the virtual lighting by selecting each of the light source images of the displayed virtual lighting by touch input or the like.

[0067] In one embodiment, the user can select the direction of light emitted from the light sources of the virtual lights in the virtual light interface 410. Here, the user can individually select the direction of light emitted from each light source of the virtual lights. For example, the user can position a first virtual light 420 to the left of the user's shape and set the light emitted from the light source of the first virtual light 420 to emit to the right. Also, the user can position a second virtual light 430 to the right of the user's shape and set the light emitted from the second virtual light 420 to emit to the left. Alternatively, the emission direction of the light source can be preset to automatically be toward the center of the user's shape.

[0068] In one embodiment, the user can see on the display the image 440 to which the virtual lighting has been applied. For example, the first virtual lighting 420 and the second virtual lighting 430 irradiate light from both sides of the user's shape in the direction of the user's shape according to the settings selected by the user, so that the user can see that the brightness, shading, etc. of the user's shape has been changed.

[0069] In Fig. 4, the number of virtual lights is two, but the present invention is not limited to this. Also, in Fig. 4, all of the light emitted from the light sources of first virtual light 420 and second virtual light 430 is directed toward the direction of the user's shape, but the present invention is not limited to this, and the light emitted from the light sources of the virtual lights can be directed in all directions in the three-dimensional space.

[0070] FIG. 5 is a diagram illustrating an example of an image 540 to which virtual lighting according to an embodiment of the present disclosure is applied. In an embodiment, a user can select a position of a virtual lighting light source in a virtual lighting interface 510. At this time, the user can select a position of a virtual lighting light source in a virtual two-dimensional space in which the user's shape is placed at the center. Additionally or alternatively, the user can select a position of a virtual lighting light source in a virtual three-dimensional space in which the user's shape is placed at the center after selecting a position of a virtual lighting light source in a virtual two-dimensional space in which the user's shape is placed at the center. For example, the position of the light source can be selected to be placed on the back side of the user's shape and emit light in the direction of the user's shape. Such a light source position can be used to provide an effect of illuminating a subject from behind, i.e., a backlight effect.

[0071] In addition, the user can select the position of each of the light sources of the multiple virtual lightings. For example, when the number of light sources of the virtual lightings is two, the user can select the position of each of the light sources of the first virtual lighting 520 and the second virtual lighting 530.

[0072] In one embodiment, the user can select the intensity of light emitted from the light sources of the virtual lighting in the virtual lighting interface 510. Here, the user can individually select the intensity of light emitted from each of the light sources of the virtual lighting. For example, the user can set the intensity of light emitted from the light source of the first virtual lighting 520 to be low and the intensity of light emitted from the light source of the second virtual lighting 530 to be high. Although not shown in FIG. 5, the user can set the light intensity by inputting a number in watts or lux. Alternatively, the user can set the light intensity by using a light intensity adjustment bar to select a point by touch input or the like.

[0073] In one embodiment, the user can check on the display the image 540 to which the virtual lighting has been applied. For example, according to the settings selected by the user, the first virtual lighting 520 and the second virtual lighting 530 irradiate light from below the user's shape toward the user's shape, so that the user can check that the brightness, shading, etc. of the user's shape has been changed.

[0074] 6 is a diagram illustrating an example of an image 640 to which virtual lighting is applied according to an embodiment of the present disclosure. In an embodiment, a user can select a type of a light source of virtual lighting in a virtual lighting interface 610. For example, the user can select one of a set of types of light sources of virtual lighting 620 by touch input, etc. Here, the set of types of light sources of virtual lighting 620 can include light source types such as a circular type, a linear type, a unidirectional emission type, an omnidirectional emission type, a backlight type, etc.

[0075] In one embodiment, the user can see on the display an image 640 to which virtual lighting has been applied. For example, if the user selects the first type (or circular type) 622, light may be emitted from a light source of the circular type virtual lighting centered on the user's shape. This allows the user to see that the brightness, shading, and other aspects of the user's shape have been changed.

[0076] 7 is a diagram illustrating an example of an image 740 to which virtual lighting is applied according to an embodiment of the present disclosure. In one embodiment, a user can select a color value of light emitted from a light source of the virtual lighting in a virtual lighting interface 710. For example, a user can select a hue of light emitted from a light source of the virtual lighting 730 using a virtual lighting color bar 720 by touch input or the like.

[0077] In one embodiment, the user can see on the display the image 740 to which the virtual lighting has been applied. For example, if the user selects a first color 722, the light source of the virtual lighting may emit light of the hue of the first color 722. This allows the user to see that the hue or tone of the user's shape has changed.

[0078] With this configuration, the user can apply various virtual lighting during the video call, and can conveniently experience the user's shape being changed by the virtual lighting.

[0079] FIG. 8 is a diagram illustrating another example in which virtual lighting is applied according to an embodiment of the present disclosure. A first operation 810 illustrates an example in which both a first virtual lighting 812 and a second virtual lighting 814 are applied. Here, the first virtual lighting 812 and the second virtual lighting 814 may be located above the user in a virtual space in which the user's shape is placed at the center. In addition, the user may select the first virtual lighting 812 or the second virtual lighting 814 by touch input or the like to change the color value of the light emitted from the light source of the virtual lighting. Additionally, the user may cancel the application of the first virtual lighting 812 or the second virtual lighting 814.

[0080] A second operation 820 shows an example where the first virtual lighting 812 is removed and only the second virtual lighting 814 is applied to the user's shape. The user can use the virtual lighting color bar at the bottom to change the color value of the light emitted from the virtual lighting source. If the user selects the color red using the virtual lighting color bar, the second virtual lighting 814 can be applied to the user's shape, as in a third operation 830.

[0081] In one embodiment, virtual lighting can be applied to a user's background. Specifically, a virtual lighting image layer can be generated based on virtual lighting settings input by a user. The generated virtual lighting image layer can be superimposed on an image layer including the user's shape to apply virtual lighting to the user's shape and / or background.

[0082] 8 illustrates the first virtual lighting 812 and the second virtual lighting 814 applied to the shape of a user, but is not limited to this. For example, the first virtual lighting 812 may be applied to the shape of a user who is in the middle of a video call, and the second virtual lighting 814 may be applied to the shape of another user who is in the middle of a video call.

[0083] FIG. 9 is a diagram illustrating an example in which a virtual lighting effect is applied during a video call according to an embodiment of the present disclosure.

[0084] FIG. 9 illustrates, as an embodiment, a video call interface provided on a display of a user terminal used by a first user among a plurality of users including a first user and a second user who are engaged in a video call.

[0085] A first operation 910 shows an example before a virtual lighting effect is applied during a video call. A first image 912 of a first user and a second image 914 of a second user may be output on a display of a first user terminal associated with the first user. The first user may apply virtual lighting during a video call by selecting a virtual lighting activation button 918 by touch input or the like.

[0086] In one embodiment, the first user can input an image 916 including text, stickers, graffiti, etc. In this case, the input image 916 can be displayed on the display by overlaying the first image 912 or the second image 914. That is, the input image 916 can be displayed on a layer higher than the layer of the first image 912 or the second image 914. In addition, when the first user displays the input image 916, the image can also be displayed on the display of the second user terminal associated with the second user. Alternatively, the image can be displayed on the display of the second user terminal only if the second user allows the image input.

[0087] A second operation 920 illustrates an example after a virtual lighting effect is applied during a video call. The first user can perform settings related to virtual lighting using, for example, any one or a combination of the virtual lighting interfaces illustrated in FIG. 4 to FIG. 7. The first image 922 to which the virtual lighting is applied can be used for a video call on the display of the first user terminal. Here, the first user can output the first image 922 to which the virtual lighting is applied on the display of the first user terminal by selecting settings related to virtual lighting during a video call. Alternatively, the first image 922 to which the virtual lighting is applied can be output on the display of the first user terminal based on settings related to virtual lighting previously selected by the first user.

[0088] In one embodiment, the first image 922 to which virtual lighting is applied may also be output on the display of the second user terminal. Alternatively, the first image 922 to which virtual lighting is applied may also be output on the display of the second user terminal only if the second user allows it. Here, an image generated during an intermediate process in which the first user selects settings related to virtual lighting may be output on the display of the second user terminal in real time. Alternatively, after the first user completes settings related to virtual lighting, a final image to which virtual lighting is applied may be output on the display of the second user terminal.

[0089] In one embodiment, the first user can apply virtual lighting to the second image 914. Specifically, the shape of the second user can be recognized from the second image 914. In addition, the virtual lighting can be applied to the second image 914 based on a setting associated with the virtual lighting selected by the first user. Here, the setting associated with the virtual lighting selected by the first user can be the same as or different from the setting applied to the first image 922 to which the virtual lighting is applied. For example, the virtual lighting can be applied to the second image 914 so as to be the same as the position of the light source of the virtual lighting in the first image 922 to which the virtual lighting is applied. Alternatively, the virtual lighting can be applied to the second image 914 so as to be symmetrical (e.g., point symmetrical or plane symmetrical) with the position of the light source of the virtual lighting in the first image 922 to which the virtual lighting is applied. Additionally, the second image to which the virtual lighting is applied can also be output on the display of the second user terminal. This allows the second user to also check the second image with the virtual lighting set by the first user.

[0090] In one embodiment, the first user can view the second image to which the virtual lighting is applied on the display of the first user terminal. Here, the second image to which the virtual lighting is applied can be generated from the second user terminal. Also, the second image to which the virtual lighting is applied can correspond to an image to which the virtual lighting set by the second user is applied. Alternatively, the second image to which the virtual lighting is applied can be output on the display of the first user terminal only if the first user allows it.

[0091] In one embodiment, the first user can view the second image to which the virtual lighting is applied on the display of the first user terminal. Specifically, the first user can select a setting associated with the virtual lighting to be applied to the second image. In this case, virtual lighting information corresponding to the setting associated with the virtual lighting to be applied to the second image can be transmitted to the second user terminal. In addition, the second user terminal can generate the second image to which the virtual lighting is applied based on the received virtual lighting information. Additionally, the first user terminal can receive the second image to which the virtual lighting is applied from the second user terminal and output it on the display.

[0092] With this configuration, users can apply virtual lighting to their own images during a video call. Users can also apply virtual lighting to images of other users participating in the video call. This can promote interaction between users while the video call is in progress. In addition, by using virtual lighting at the same or symmetrical positions, it is possible to provide users with a feeling of being face-to-face.

[0093] 10 is a flow chart illustrating an example of a method 1000 according to an embodiment of the present disclosure. In one embodiment, the method 1000 may be performed by at least one processor of a first user terminal. The method 1000 may start by the processor initiating a video call between a first user and a second user from the first user terminal using a first image captured by the first user terminal of the first user and a second image captured by the second user terminal of the second user (S1010).

[0094] Thereafter, the processor may recognize a shape of the first user from the first image (S1020). Specifically, the processor may generate a depth map for the shape of the first user. The processor may also generate a 3D model for the shape of the first user based on the depth map.

[0095] Then, the processor may receive a user input related to the virtual lighting in the first image from the first user terminal from the first user (S1030). Specifically, the processor may receive a first user input selecting a position of a light source of the virtual lighting in a virtual space with the shape of the first user at its center. Alternatively, the processor may receive a first user input selecting a position of a light source of the virtual lighting in a virtual three-dimensional space with the shape of the first user at its center after selecting a position of a light source of the virtual lighting in a virtual two-dimensional space with the shape of the first user at its center.

[0096] Thereafter, based on the user input, the processor may apply virtual lighting to the first user's shape (S1040). The processor may also apply virtual lighting to the first user's background. As an example, the processor may generate a virtual lighting image layer based on the user-input virtual lighting settings (e.g., at least one of a position of a virtual lighting light source, a color of light emitted from the virtual lighting light source, a light intensity, a light direction, or a virtual lighting light source type setting). Additionally, the processor may apply virtual lighting to the first user's shape and / or the first user's background by superimposing the generated virtual lighting image layer on an image layer including the first user's shape.

[0097] The processor may then output the first image to which the virtual lighting has been applied on the display of the first user terminal (S1050). In addition, the processor may overlay the image on the first image in response to receiving an image input from the first user and display the image on the display of the first user terminal. For example, the image input by the first user may correspond to an input related to image decoration that adds images such as text, graffiti, stickers, etc. to the image.

[0098] In one embodiment, the processor can receive a second user input selecting at least one of a direction of light emitted from the virtual lighting source or a type of virtual lighting source, and the processor can receive a third user input selecting at least one of a color value of light emitted from the virtual lighting source or a light intensity.

[0099] In one embodiment, the processor may receive a fourth user input selecting a number of virtual lighting sources, whereupon light source images of the selected number of virtual lighting sources may be output on the display, and settings associated with the virtual lighting may be input for each of the selected number of virtual lighting source images.

[0100] In one embodiment, the processor may receive an input for applying virtual lighting to the second image. Specifically, the processor of the first user terminal may receive a user input (e.g., an input for at least one of the position, number, and type of the virtual lighting light source, or the hue, intensity, and direction of the light emitted from the virtual lighting light source) related to the virtual lighting to be applied to the second image from the first user. The processor of the first user terminal may also transmit virtual lighting information corresponding to the user input related to the virtual lighting to be applied to the second image to the second user terminal of the second user. Thus, the processor of the second user terminal may transmit the second image to which the virtual lighting has been applied to the first user terminal using the virtual lighting information. The processor of the first user terminal may receive the second image to which the virtual lighting has been applied and output it on the display of the first user terminal.

[0101] In one embodiment, the processor can recognize the shape of the second user from the second image. Also, based on the user input, the processor can output the second image to which virtual lighting is applied on the display of the first user terminal. Here, the position of the light source of the virtual lighting in the first image to which virtual lighting is applied and the position of the light source of the virtual lighting in the second image to which virtual lighting is applied may be the same. Alternatively, the position of the light source of the virtual lighting in the first image to which virtual lighting is applied and the position of the light source of the virtual lighting in the second image to which virtual lighting is applied may be symmetrical. Additionally, the second image to which virtual lighting is applied may be output on the display of the second user terminal.

[0102] In one embodiment, the processor may output a second image to which virtual lighting is applied on a display of the first user terminal, where the second image to which virtual lighting is applied may be generated from the second user terminal and may correspond to an image to which virtual lighting set by the second user is applied.

[0103] In one embodiment, the processor may recognize a shape of the second user from the second image. The processor may also receive a user input associated with virtual lighting in the second image from the first user via the first user terminal. Additionally, the processor may apply virtual lighting to the shape of the second user based on the user input associated with the virtual lighting in the second image. In this case, the processor may output the second image to which the virtual lighting has been applied from a display of the first user terminal.

[0104] The above-mentioned method may be provided as a computer program stored in a computer-readable recording medium for execution by a computer. The medium may be a medium for continuously storing a computer-executable program or a medium for temporarily storing the program for execution or download. The medium may be various recording means or storage means in the form of a single or multiple hardware components combined, and may be distributed over a network without being limited to a medium directly connected to a computer system. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, etc., configured to store program instructions. Other examples of the medium include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various other software, and servers.

[0105] The methods, operations, or techniques of the present disclosure may be embodied in a variety of ways. For example, such techniques may be embodied in hardware, firmware, software, or a combination thereof. Those skilled in the art will appreciate that the various exemplary logical blocks, modules, circuits, and algorithmic steps described in the present disclosure may be embodied in electronic hardware, computer software, or a combination of both. To clearly illustrate such alternatives between hardware and software, the various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is embodied as hardware or software will vary depending on the particular application and design requirements imposed on the overall system. Those skilled in the art may also embody the described functionality in various ways for each particular application, but such embodying should not be interpreted as departing from the scope of the present disclosure.

[0106] In a hardware implementation, the processing units used to perform the techniques may be embodied within one or more ASICs, DSPs, digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units, computers designed to perform the functions described in this disclosure, or any combination thereof.

[0107] Thus, the various example logical blocks, modules, and circuits described in this disclosure may be embodied or performed with any combination of general purpose processors, DSPs, ASICs, FPGAs, other programmable logic devices, discrete gate and transistor logic, discrete hardware components, or the like designed to perform the functions described herein. A general purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be embodied with a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other configuration.

[0108] In a firmware and / or software implementation, the techniques may be embodied as instructions stored on a computer-readable medium, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage devices, etc. The instructions are executable by one or more processors to cause the processors to perform certain aspects of the functions described in this disclosure.

[0109] If embodied as software, the techniques may be stored on or transferred via a computer-readable medium as one or more instructions or code. A computer-readable medium includes any medium that facilitates transfer of a computer program from one place to another, and includes both computer storage media and communication media. A storage medium may be any available medium that can be accessed by a computer. By way of non-limiting example, such computer-readable media may include RAM, ROM, EEPROM, CD-ROM, other optical disk storage, magnetic disk storage, other magnetic storage devices, or any other medium that can be used to transport or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection may be properly termed a computer-readable medium.

[0110] For example, if the software is transferred from a website, server, or other remote source using coaxial cable, fiber optic cable, lead wire, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, the coaxial cable, fiber optic cable, lead wire, digital subscriber line, or wireless technologies such as infrared, radio, and microwave are included within the definition of medium. As used herein, disk and disc include CDs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically while discs reproduce data optically using lasers. Combinations of the above should also be included within the scope of computer-readable media, etc.

[0111] A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium may be coupled to the processor such that the processor reads information from, and writes information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.

[0112] Although the embodiments described above are described as utilizing aspects of the presently disclosed subject matter on one or more stand-alone computer systems, the present disclosure is not limited thereto and may be embodied in any computing environment, such as a network or distributed computing environment. Moreover, aspects of the subject matter in the present disclosure may be embodied in multiple processing chips or devices, and storage may be affected across multiple devices as well. Such devices may include PCs, network servers, and handheld devices.

[0113] Although the present disclosure has been described in the present specification by way of some embodiments, various modifications and alterations can be made without departing from the present disclosure, which can be understood by those of ordinary skill in the art to which the present disclosure pertains. In addition, such modifications and alterations should be understood to fall within the scope of the claims appended hereto. [Explanation of symbols]

[0114] 110 User terminal 120 Virtual Lighting Interface 130 Images with Virtual Lighting 140 Virtual Lighting 150 Virtual Lighting Source Typesetting 160 Virtual Lighting Color Bar 170 Virtual Lighting Off Button

Claims

1. 1. A method for applying virtual lighting to video in a video call, performed by at least one processor of a first user terminal, comprising: Initiating a video call between a first user and a second user from a first user terminal using a first video captured by the first user terminal and a second video captured by a second user terminal; Recognizing a shape of the first user from the first image; receiving a user input related to virtual lighting in the first image from the first user via the first user terminal; applying virtual lighting to the first user's shape based on the user input; outputting the first image to which the virtual lighting is applied on a display of the first user terminal; A method comprising:

2. The step of recognizing a shape of the first user includes: generating a depth map for the first user's shape; generating a three-dimensional model of the shape of the first user based on the depth map; The method of claim 1 , comprising:

3. The step of receiving a user input includes: receiving a first user input selecting a location of a source of the virtual lighting in a virtual space centered on the shape of the first user; The method of claim 1 , comprising:

4. The step of receiving a user input includes: after selecting a location of a source of virtual lighting in a virtual two-dimensional space centered on the shape of the first user, receiving a first user input selecting a location of a source of virtual lighting in a virtual three-dimensional space centered on the shape of the first user; The method of claim 1 , comprising:

5. The step of receiving a user input includes: receiving a second user input selecting at least one of a direction of light emitted from a source of the virtual illumination or a type of source of the virtual illumination; The method of claim 3 further comprising:

6. The step of receiving a user input includes: receiving a third user input selecting at least one of a color value or an intensity of light emitted from a light source of the virtual lighting; The method of claim 3 further comprising:

7. The step of receiving a user input includes: receiving a fourth user input selecting a number of light sources for the virtual lighting; outputting light source images of the selected number of virtual lights on the display; For each of the selected number of virtual lighting source images, settings associated with the virtual lighting are input. The method according to claim 3.

8. The method further comprises: applying virtual lighting to a background of the first user; The method of claim 1 , comprising:

9. The step of applying virtual lighting to a background of the first user includes: generating a virtual lighting image layer based on the user-inputted virtual lighting settings; superimposing the generated virtual lighting image layer on an image layer including the shape of the first user; The method of claim 8 , comprising:

10. The method further comprises: receiving a user input from the first user related to virtual lighting to be applied to the second image; transmitting virtual lighting information corresponding to a user input related to virtual lighting to be applied to the second image to the second user terminal; outputting a second image to which virtual lighting is applied on a display of the first user terminal based on the virtual lighting information; The method of claim 1 , comprising:

11. The method further comprises: Recognizing a shape of the second user from the second image; outputting a second image to which the virtual lighting is applied on a display of the first user terminal based on the user input; The method of claim 1 , comprising:

12. The step of receiving a user input includes: receiving a user input selecting a location of a source of the virtual lighting in a virtual space centered on the shape of the first user; a position of a light source of the virtual lighting in the first image to which the virtual lighting is applied is the same as a position of a light source of the virtual lighting in the second image to which the virtual lighting is applied; The method of claim 11.

13. The step of receiving a user input includes: receiving a user input selecting a location of a source of the virtual lighting in a virtual space centered on the shape of the first user; a position of a light source of the virtual lighting in the first image to which the virtual lighting is applied is symmetrical to a position of a light source of the virtual lighting in the second image to which the virtual lighting is applied; The method of claim 11.

14. The second image to which the virtual lighting is applied is output on a display of the second user terminal. The method of claim 11.

15. The method further comprises: outputting the second image to which virtual lighting is applied on a display of the first user terminal; The second image to which the virtual lighting is applied is generated from the second user terminal and corresponds to an image to which virtual lighting set by the second user is applied. The method of claim 1.

16. The method further comprises: responsive to receiving an image input from the first user, overlaying the image onto the first video and displaying the image on a display of the first user terminal; The method of claim 1 , comprising:

17. The method further comprises: Recognizing a shape of the second user from the second image; receiving a user input related to virtual lighting in the second image from the first user via the first user terminal; applying virtual lighting to the second user's shape based on user input associated with virtual lighting in the second image; outputting the second image to which the virtual lighting is applied from a display of a first user terminal; The method of claim 1 , comprising:

18. A computer readable computer program comprising: The method includes the steps of:

18. A method for implementing the method according to any one of claims 1 to 17, Computer program.

19. A user terminal, A communication module; Memory, A display and at least one processor coupled to the memory and configured to execute at least one computer readable program contained in the memory; Including, The at least one program comprises: Recognizing a first user in a video call between a first user and a second user using a first video captured by a first user terminal of a first user and a second video captured by a second user terminal of a second user; Recognizing a shape of the first user from the first image; receiving a user input related to virtual lighting in the first image from the first user via the first user terminal; applying virtual lighting to the first user's shape based on the user input; outputting the first image to which the virtual lighting is applied on a display of the first user terminal; A user terminal including an instruction word for

Images