Effect providing method, computer device, and computer program
The method and system enhance video calls by applying clothing and body effects based on user information and call purpose, allowing users to present themselves aesthetically appropriate and professionally, addressing the limitations of existing video call technologies.
Patent Information
- Application Number
- JP2022174556
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-11-01
- Filing Date
- 2022-10-31
- Publication Date
- 2026-01-21
- Estimated Expiration
- 2042-10-31
AI Technical Summary
Existing video call technologies do not provide the ability to enhance or modify a user's appearance during a video call based on user information or call purpose, limiting the aesthetic and professional presentation options.
A method and system that uses a computer device to recommend and apply clothing or body effects to a user's image during a video call, combining user information, call purpose, and augmented reality to overlay desired effects on detected body parts, and display a composite video call screen.
Enables users to present themselves in a visually enhanced manner suited to their information or call purpose, providing options for clothing changes, groupwear, and face-only modes, enhancing the video call experience.
Smart Images

Figure 0007803835000001 
Figure 0007803835000002 
Figure 0007803835000003
Abstract
Description
[Technical Field]
[0001] The following description relates to techniques for providing a body effect during a video call. [Background technology]
[0002] Recent communication devices provide a variety of services, including voice calls, messaging services, wireless Internet services, and terrestrial / satellite broadcasting services.
[0003] In particular, with the development of video compression and restoration technologies and the widespread use of devices equipped with cameras, video calling services have been provided that allow users to see the faces of the people they are talking to.
[0004] As an example of a technology for providing a video call service, Patent Document 1 (registered on September 29, 2003) discloses a technology for providing a video call service to each mobile telephone terminal over a wireless mobile telephone network. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Korean Patent Registration No. 10-0401262 Summary of the Invention [Problem to be solved by the invention]
[0006] It is an object of the present invention to provide a method, an apparatus, and a computer program for providing a body effect during a video call. [Means for solving the problem]
[0007] Provided is an effect providing method executed on a computer device, the computer device including at least one processor configured to execute computer-readable instructions contained in a memory, the effect providing method including a step of the at least one processor recommending an outfit body effect for a video call based on at least one of user information or a call purpose, a step of the at least one processor transmitting a user image in which the outfit body effect is combined with a body part detected from a camera image to a terminal of a party participating in the video call, and a step of the at least one processor displaying a video call screen including an image of the party participating in the video call and an image of the user.
[0008] According to one aspect, the recommending step may include extracting the user information from a pre-registered user profile or an analysis result of the camera image.
[0009] According to another aspect, the recommending step may include extracting the call purpose from meeting information set in a calendar in conjunction with the calendar.
[0010] According to another aspect, the recommending step may include determining a dress code using at least one of the user information or the purpose of the call, and recommending clothing and body effects having attribute information matching the dress code.
[0011] According to another aspect, the transmitting step may include transmitting an image in which the clothing body effect of an AR (augmented reality) image is overlaid on the body part to the other device as the user image.
[0012] According to another aspect, the displaying step may include receiving the other party's image as an individual image and rendering the image together with the user's image on one screen to form the video call screen.
[0013] According to another aspect, the effect providing method may further include a step in which the at least one processor provides a color selection interface, and a step in which the at least one processor changes the color of a clothing object included in the body portion to a color selected in the color selection interface.
[0014] According to another aspect, the effect providing method may further include a step in which the at least one processor provides an object selection interface and a color selection interface, and a step in which the at least one processor changes the color of an object selected in the object selection interface among the clothing objects included in the body part to a color selected from the color selection interface.
[0015] According to another aspect, the effect providing method may further include a step in which, when a specific body effect is selected from the clothing body effects as groupware for the video call, the at least one processor transmits information about the specific body effect to the other party's terminal, and the displaying step may include a step of receiving from the other party's terminal an image of the other party in which the specific body effect is superimposed on the body part.
[0016] According to yet another aspect, the effect providing method may further include a step in which the at least one processor provides a body-off effect corresponding to a face-only mode as a list of effects applicable to the camera image, and if the body-off effect is selected from the effect list, the at least one processor transmits an image in which the remaining parts of the camera image, excluding the face part, are hidden using a transparency effect to the other party's terminal as the user image.
[0017] A computer program is provided that is recorded on a computer-readable recording medium to cause a computer to execute the effect providing method.
[0018] A computer device is provided, comprising at least one processor configured to execute computer-readable instructions contained in a memory, wherein the at least one processor recommends clothing body effects for a video call based on at least one of user information or a call purpose, transmits user video in which the clothing body effects are combined with body parts detected from a camera image to a terminal of a party participating in the video call, and displays a video call screen including video of the party participating in the video call and the user video. [Effects of the Invention]
[0019] According to the present invention, during a video call, it is possible to provide body effects of clothing suited to user information or the purpose of the call. [Brief explanation of the drawings]
[0020] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Figure 2] FIG. 1 is a block diagram illustrating an example of a computing device according to an embodiment of the present invention. [Figure 3]1 is a flowchart illustrating an example method that may be performed by a computing device in accordance with an embodiment of the present invention. [Figure 4] 10 is an exemplary diagram illustrating a process of providing a clothing body effect during a video call according to an embodiment of the present invention. [Figure 5] 10 is an exemplary diagram illustrating a process of providing a clothing body effect during a video call according to an embodiment of the present invention. [Figure 6] 10 is an exemplary diagram illustrating a process of providing a clothing body effect during a video call according to an embodiment of the present invention. [Figure 7] 10 is a flowchart illustrating another example of a method that may be performed by a computing device in accordance with an embodiment of the present invention. [Figure 8] 1 is an exemplary diagram illustrating a process of providing a groupware body effect in a video call according to an embodiment of the present invention; [Figure 9] 10 is a flowchart illustrating another example of a method that may be performed by a computing device in accordance with an embodiment of the present invention. [Figure 10] 10 is an exemplary diagram illustrating a process of providing a body-off effect in a video call according to an embodiment of the present invention. [Figure 11] 10 is an exemplary diagram illustrating a process of providing a body-off effect in a video call according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0021] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0022] SUMMARY OF THE INVENTION An embodiment of the present invention relates to a technique for providing a body effect during a video call.
[0023] Embodiments including those specifically disclosed in this specification may provide clothing body effects that can be applied to body parts or body effects that can hide the remaining parts of the body except for the face during video calls.
[0024] An effect providing system according to an embodiment of the present invention may be realized by at least one computer device, and an effect providing method according to an embodiment of the present invention may be executed by at least one computer device included in the effect providing system. In this case, a computer program according to an embodiment of the present invention may be installed and executed in the computer device, and the computer device may execute the effect providing method according to an embodiment of the present invention under the control of the executed computer program. The computer program may be recorded on a computer-readable recording medium in combination with the computer device to cause the computer to execute the effect providing method.
[0025] FIG. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in FIG. 1 shows an example including multiple electronic devices 110, 120, 130, and 140, multiple servers 150 and 160, and a network 170. FIG. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in FIG. 1. Furthermore, the network environment in FIG. 1 is merely an example of an environment applicable to this embodiment, and environments applicable to this embodiment are not limited to the network environment in FIG. 1.
[0026] The electronic devices 110, 120, 130, and 140 may be fixed or mobile terminals implemented by computer devices. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), and tablets. While FIG. 1 illustrates a smartphone as an example of the electronic device 110, in embodiments of the present invention, the electronic device 110 may represent one of a variety of physical computer devices capable of communicating with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.
[0027] The communication method is not limited, and may include not only a communication method using a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, or a broadcast network) that can be included in network 170, but also short-range wireless communication between devices. For example, network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. Furthermore, network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or hierarchical network, etc.
[0028] Each of the servers 150, 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, 140 via the network 170 to provide instructions, code, files, content, services, etc. For example, the server 150 may be a system that provides a service (such as a video calling service, for example) to the multiple electronic devices 110, 120, 130, 140 connected via the network 170.
[0029] 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the electronic devices 110, 120, 130, and 140 and each of the servers 150 and 160 described above may be realized by a computer device 200 shown in FIG.
[0030] As shown in FIG. 2 , such a computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input / output interface 240. The memory 210 is a computer-readable storage medium and may include random access memory (RAM), read-only memory (ROM), and a persistent mass storage device such as a disk drive. The persistent mass storage device such as a ROM or a disk drive may be included in the computer device 200 as a separate persistent storage device distinct from the memory 210. The memory 210 may also store an operating system and at least one program code. Such software components may be loaded into the memory 210 from a computer-readable storage medium separate from the memory 210. Such separate computer-readable storage medium may include a computer-readable storage medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, or a memory card. In another embodiment, the software components may be loaded into the memory 210 through a communication interface 230, which is not a computer-readable storage medium. For example, the software components may be loaded into the memory 210 of the computer device 200 based on a computer program that is installed by a file received over the network 170 .
[0031] Processor 220 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to processor 220 by memory 210 or by communication interface 230. For example, processor 220 may be configured to execute instructions received according to program code stored in a storage device such as memory 210.
[0032] The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (e.g., the above-mentioned storage device) via the network 170. For example, requests, instructions, data, files, etc. generated by the processor 220 of the computer device 200 in accordance with program code stored in a storage device such as the memory 210 may be transmitted to other devices via the network 170 under the control of the communication interface 230. Conversely, signals, instructions, data, files, etc. from other devices may be received by the computer device 200 via the communication interface 230 of the computer device 200 via the network 170. The signals, instructions, data, etc. received via the communication interface 230 may be transmitted to the processor 220 or the memory 210, and files, etc. may be recorded on a storage medium (e.g., the above-mentioned permanent storage device) that the computer device 200 may further include.
[0033] The input / output interface 240 may be a means for interfacing with the input / output device 250. For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display or speaker. As another example, the input / output interface 240 may be a means for interfacing with a device that integrates input and output functions into one, such as a touch screen. The input / output device 250 may be configured as a single device together with the computer device 200.
[0034] Also, in other embodiments, computing device 200 may include fewer or more components than those shown in Figure 2. However, most prior art components need not be explicitly shown in the figures. For example, computing device 200 may be implemented to include at least some of the input / output devices 250 described above, and may further include other components such as transceivers, databases, etc.
[0035] Specific embodiments of a method and apparatus for providing body effects during a video call are described below.
[0036] The computer device 200 according to the present embodiment may provide a video call service to a client by connecting to a dedicated application installed on the client or a web / mobile site associated with the computer device 200. A computer-implemented effect providing system may be configured in the computer device 200. For example, the effect providing system may be implemented as an independently operating program, or may be implemented as an in-app for a specific application so as to be operable on the specific application.
[0037] The processor 220 of the computer device 200 may be implemented with components for executing the following effect providing method. Depending on the embodiment, the components of the processor 220 may be selectively included or excluded from the processor 220. Also, depending on the embodiment, the components of the processor 220 may be separated or combined to express the functions of the processor 220.
[0038] Such processor 220 and its components may control computer device 200 to perform steps included in the following effect providing method: For example, processor 220 and its components may be implemented to execute instructions from operating system code and at least one program code contained in memory 210.
[0039] Here, the components of the processor 220 may represent different functions that are performed by the processor 220 according to instructions provided by program code stored on the computer device 200 .
[0040] The processor 220 may read the necessary instructions from the memory 210, which is loaded with instructions related to the control of the computing device 200. In this case, the read instructions may include instructions for controlling the processor 220 to perform the steps described below.
[0041] The steps described below may be performed in a different order than that shown in the figures, some steps may be omitted, or additional processes may be included.
[0042] FIG. 3 is a flowchart illustrating an example method that may be performed by a computing device in accordance with an embodiment of the present invention.
[0043] Referring to FIG. 3, in step 310, when providing a list of effects applicable to camera images for a video call, the processor 220 may recommend clothing and body effects based on at least one of information about the user who requested the effects list or the purpose of the call specified by the user.
[0044] In this specification, the term "effect" may refer to an effect filter that can be combined with a camera image as content composed of image objects. The term "body effect" refers to an effect that can be applied to a body part excluding a face in a camera image. In particular, the term "clothing body effect" may refer to a body effect composed of image objects representing clothing.
[0045] Dress codes such as clothing style, formality, pattern, and color may be defined according to gender, age, occupation, time, place, situation, etc., and clothing body effects may include information about the dress code to which the clothing belongs as attribute information related to the effect.
[0046] The processor 220 may recommend clothing and body effects for a dress code that matches user information such as gender, age, and occupation, or clothing and body effects for a dress code that matches the user's purpose for participating in a video call. In this case, the processor 220 may extract necessary information from a user profile registered on the service, or may predict the user's gender, age, etc. from video analysis results obtained by analyzing camera footage. In addition, the processor 220 may extract the user's purpose for the call from meeting information set in the calendar by linking with a calendar. In some embodiments, the user may directly set the purpose for the call in a setting environment for participating in a video call.
[0047] The processor 220 may determine a dress code using the user information or the purpose of the call, and may provide a clothing body effect corresponding to the determined dress code as one type of recommended effect.
[0048] In step 320, if the user selects a specific clothing body effect, the processor 220 may detect body parts from the camera image and apply the corresponding clothing body effect. The processor 220 may detect and track the user's face and body parts, which are subject areas, from the camera image using computer vision techniques including object detection and object tracking. In this case, the processor 220 may extract body parts excluding the face from the camera image and then overlay and synthesize the clothing body effect on the extracted body parts.
[0049] In step 330, the processor 220 may transmit the camera image in which the clothing body effect is applied to the body part as a user image. In other words, the processor 220 may transmit the camera image in which the clothing body effect selected by the user is superimposed on the body part as a user image for the video call to each terminal of the other party participating in the video call.
[0050] In this specification, a video call may refer to a video call in which a user and the other party exchange images and audio, and as an example, may refer to Internet telephony (VoIP), a technology that converts images and audio into digital packets and transmits them over a network using IP addresses.
[0051] In a streaming environment where video captured by a camera of computer device 200 is distributed in real time via an Internet connection, processor 220 may combine the camera video with an augmented reality (AR) image clothing and body effect to provide a single video image. As a result, the user video shows the user wearing virtual clothing, rather than the clothing the user actually wears.
[0052] In step 340, the processor 220 may receive a remote image for the video call from the remote terminal and display a video call screen including the user's image and the remote image. The processor 220 may receive the remote images participating in the video call as separate images, and then render the received remote images together with the user's image onto a single screen to form a video call screen.
[0053] Instead of generating one video including videos of multiple participants on the server side providing the video call service and providing it to the client, each participant's video is transmitted as an individual video, and the client side receives the multiple participant images as individual videos to compose one video call screen.
[0054] 4 to 6 are exemplary diagrams illustrating a process of providing clothing body effects during a video call according to an embodiment of the present invention.
[0055] FIG. 4 shows a settings screen 400 for a video call.
[0056] Referring to FIG. 4, processor 220 may display an image captured by a camera of computing device 200, ie, camera image 410, on video call setup screen 400.
[0057] The processor 220 may provide an outfit body effect list 420 on the video call setup screen 400 when the user requests an outfit change in the video call setup environment before joining the video call.
[0058] In this case, recommended information about clothing may be included in the clothing body effect list 420. For example, clothing body effects that match user information such as gender, age, and occupation, or clothing body effects that match the user's purpose for participating in a video call may be included.
[0059] For example, if the user is a woman in her twenties, the system may recommend clothing categorized as suitable for women in their twenties. For a video call for a school class, the system may recommend a uniform, and for a video call for an interview, the system may recommend a suit. For a video call for a private home party, the system may recommend a dress code (e.g., pajamas) that the user has set directly.
[0060] When the user selects a specific clothing body effect from clothing body effect list 420, processor 220 may detect body part 512 excluding face part 511 from camera image 410, as shown in FIG. 5, and then display the detected body part 512 combined with the clothing body effect selected by the user.
[0061] The processor 220 may change the user's outfit for the video call by following the process described above.
[0062] The processor 220 may prepare a camera image 410 of a virtual outfit combined with an outfit body effect as a user's image for a video call, instead of the actual outfit.
[0063] When the user changes their outfit on the video call setting screen 400 and then presses the video call join button 530, the processor 220 may transmit the camera image 410 with the outfit body effect synthesized to the terminals of each person participating in the video call.
[0064] Referring to FIG. 6, when a user participates in a video call, the processor 220 may receive other party images 650 to 670 for the video call from the other party's terminal and display a video call screen 600 including the user image 610 and the other party images 650 to 670.
[0065] In this case, the processor 220 may receive the images 650 to 670 of the other parties participating in the video call as individual images, and then construct the video call screen 600 by rendering the received images 650 to 670 of the other parties and the user image 610 on a single screen.
[0066] The user image 610 does not correspond to an image of actual clothing, but corresponds to a camera image combined with clothing and body effects selected by the user.
[0067] In addition to compositing clothing body effects onto the body part 512 of the camera image 410, the processor 220 can also provide a function to change only the color of the clothing that the user is actually wearing.
[0068] If the user requests to change the color of the clothing, the processor 220 may provide an interface for color selection on the video call setting screen 400 and may change the color of the clothing in the body portion 512 to the color selected by the user.
[0069] The processor 220 may transmit the camera image in which the color of the clothing has been changed as a user image for the video call to the terminals of the other parties participating in the video call.
[0070] It is possible to change the overall color of a clothing object, and also to selectively change the color of clothing objects when multiple clothing objects (for example, a shirt, a cardigan, etc.) are detected from the body part 512.
[0071] When a user requests to change the color of clothing, the processor 220 may provide an interface for object selection and an interface for color selection on the video call setting screen 400, and may use this to change the color of the clothing object selected by the user to the color selected by the user.
[0072] As the user image 610 participating in the video call, a clothing camera image can be provided that has been changed to a color selected by the user, rather than the actual color of the clothing.
[0073] FIG. 7 is a flowchart illustrating another example method that may be performed by a computing device in accordance with an embodiment of the present invention.
[0074] The processor 220 may provide a body effect that allows video call participants to wear matching group wear suited to the purpose of the call.
[0075] Referring to FIG. 7, in step 710, the processor 220 may recommend clothing and body effects based on the purpose of the call specified by the user when providing a list of effects applicable to camera images for a video call.
[0076] The processor 220 may work in conjunction with a calendar to determine the user's call purpose from meeting information set in the calendar, or may recognize the call purpose set directly by the user in the settings environment for participating in a video call.
[0077] Depending on the purpose of the call, the processor 220 may recommend a uniform as attire for a video call for a school class, for example, or may recommend a dress code directly set by the user (e.g., pajamas) for a video call for a non-face-to-face home party.
[0078] The processor 220 may determine a dress code by using the purpose of the user's call, and may provide a clothing body effect that matches the determined dress code as one type of recommended effect.
[0079] In step 720, if a user-specified clothing body effect from among the recommended clothing is selected as groupware for the video call, the processor 220 may send body effect information regarding the clothing selected for groupware application to the terminals of each party participating in the video call.
[0080] In operation 730, the processor 220 may detect a body part from the camera image, apply a groupware body effect to the body part, and then transmit the camera image with the groupware body effect applied to the body part as a user image. In other words, the processor 220 may transmit the camera image with the groupware body effect selected by the user superimposed on the body part to the terminals of the other parties participating in the video call as a user image for the video call.
[0081] Each other's terminal may also receive information about the groupware body effect, synthesize the corresponding groupware body effect in the body portion of the camera image, and provide this as a call video.
[0082] In operation 740, the processor 220 may receive the other party's video to which the groupware body effect has been applied from the other party's terminal and display a video call screen including the user's video and the other party's video. The processor 220 may receive the other party's video participating in the video call as individual videos, and then render the received other party's video and the user's video on a single screen to form a video call screen.
[0083] As shown in FIG. 8, the processor 220 may receive partner images 850 to 870 for a video call from the partner's terminal, and display a video call screen 800 including a user image 810 and the partner images 850 to 870.
[0084] The user video 810 and the partner videos 850 to 870 are not videos of actual clothing, but are camera videos synthesized with groupware body effects selected by the user.
[0085] In the case of groupware, whether or not to apply the groupware may be decided based on the consent of the other party, and at least some of the other party's images 850 to 870 may be provided as images of the actual clothing or images with clothing and body effects selected directly by the person themselves applied if the application of groupware is refused.
[0086] FIG. 9 is a flowchart illustrating yet another example method that may be performed by a computing device in accordance with an embodiment of the present invention.
[0087] Referring to FIG. 9, in step 910, the processor 220 may provide a body off effect as one of the body effects when providing a list of effects applicable to a camera image for a video call.
[0088] The body-off effect may correspond to a face-only mode in which only the face is displayed and the rest of the image, including the body and background, is not displayed. In other words, the body-off effect may display only the face and hide the rest of the image by applying a transparency effect.
[0089] In operation 920, if the user selects a body-off effect, the processor 220 may detect a face portion from the camera image and apply the body-off effect to the remaining portion excluding the face portion. The processor 220 may detect and track the user's face portion and body portion, which are subject areas, from the camera image using computer vision techniques including object detection and object tracking. In this case, the processor 220 may extract the face portion from the camera image and composite the body-off effect onto the remaining portion including the body portion and background portion.
[0090] In operation 930, the processor 220 may transmit the camera image, in which the body-off effect is applied to the remaining parts excluding the face, as the user image. In other words, the processor 220 may transmit the camera image, in which the body-off effect is applied to the remaining parts excluding the face, as the user image for the video call to each terminal of the other party participating in the video call.
[0091] In operation 940, the processor 220 may receive a remote image for the video call from the remote terminal and display a video call screen including the user image and the remote image. The processor 220 may receive the remote images of the remote terminals participating in the video call as separate images, and then render the received remote image and the user image on a single screen to form a video call screen.
[0092] 10 and 11 are exemplary diagrams illustrating a process of providing a body-off effect in a video call according to an embodiment of the present invention.
[0093] FIG. 10 shows a video setting screen 1000 for a video call.
[0094] Referring to FIG. 10, processor 220 may display an image captured by a camera of computing device 200, ie, a camera image 1010, on image setting screen 1000.
[0095] The processor 220 may provide a body effect list 1020 on the video setting screen 1000 when the user requests effect setting in the video setting environment before joining a video call.
[0096] In this case, the body effect list 1020 may include a clothing body effect that changes the user's clothing, as well as a body-off effect 1021 that is a face-only mode that displays only the face and does not display the body other than the face or the background.
[0097] When a user selects body-off effect 1021 from body effect list 1020 on video setting screen 1000, processor 220 may provide a camera image in which the rest of the image except for the face is hidden by a transparency effect as the user's image for a video call.
[0098] Referring to FIG. 11, the processor 220 may receive partner images 1150 to 1170 for a video call from a partner terminal and display a video call screen 1100 including a user image 1110 and the partner images 1150 to 1170.
[0099] In this case, the processor 220 may receive the video call participant images 1150 to 1170 as individual images, and then construct the video call screen 1100 by rendering the received video call participant images 1150 to 1170 and the user image 1110 on a single screen.
[0100] The user video 1110 corresponds to a camera video synthesized with a body-off effect in which only the face is displayed without the actual clothing or background being displayed.
[0101] As described above, according to an embodiment of the present invention, it is possible to provide clothing body effects suitable for user information or the purpose of a video call, and to provide groupware body effects that can be applied to multiple participants in a video call. Furthermore, according to an embodiment of the present invention, it is possible to provide a body effect that can display only the face during a video call while hiding the rest of the body using a transparency effect.
[0102] It is also possible to provide a groupware body effect that can be applied to multiple participants in a video call.
[0103] It also provides a body effect that allows you to show only your face and hide the rest of your body during video calls.
[0104] The above-described devices may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also access, record, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device may be described. However, those skilled in the art will recognize that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.
[0105] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may independently or collectively instruct the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.
[0106] Methods according to embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. Here, the medium may continuously store the computer-executable program or may temporarily store it for execution or download. Furthermore, the medium may be various recording or storage means in the form of a single piece of hardware or multiple pieces of hardware combined together. It is not limited to media directly connected to a computer system, but may also be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; ROMs, RAMs, flash memories, etc., which may be configured to store program instructions. Other examples of media include recording media or storage media managed by application stores that distribute applications, or by sites, servers, etc. that provide or distribute various software.
[0107] Although the embodiments have been described above based on limited examples and drawings, those skilled in the art will appreciate that various modifications and variations may be made from the above description. For example, the described techniques may be performed in an order different from that described, and / or the described system, structure, device, circuit, or other element may be coupled or combined in a manner different from that described, or may be substituted or replaced by other elements or equivalents, and still achieve suitable results.
[0108] Therefore, different embodiments that are equivalent to the claims are within the scope of the appended claims. [Explanation of symbols]
[0109] 110, 120, 130, 140: Electronic equipment 150, 160: Server 170: Network
Claims
1. 1. A method for providing effects executed on a computer device, comprising: the computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The effect providing method includes: the at least one processor recommending an outfit body effect for the video call based on at least one of user information or a call purpose; The at least one processor transmits a user image in which the clothing body effect is superimposed on a body part detected from a camera image to a terminal of a person participating in the video call; and The at least one processor may display a video call screen including an image of a party participating in the video call and an image of the user; The recommending step includes: The effect providing method includes a step of extracting the call purpose from meeting information set in a calendar in conjunction with the calendar.
2. The recommending step includes: extracting the user information from a pre-registered user profile or an analysis result of the camera image; The effect providing method according to claim 1 , comprising:
3. The recommending step includes: determining a dress code using at least one of the user information or the purpose of the call; and recommending clothing body effects having attribute information matching the dress code; The effect providing method according to claim 1 , comprising:
4. The transmitting step includes: transmitting an image in which the clothing body effect of the AR (Augmented Reality) image is overlaid on the body part to the other terminal as the user image. The effect providing method according to claim 1 , comprising:
5. The displaying step includes: receiving the other party's video as an individual video and rendering the video together with the user's video onto one screen to form the video call screen; The effect providing method according to claim 1 , comprising:
6. The effect providing method includes: the at least one processor providing a color selection interface; and the at least one processor changing the color of clothing objects included in the body portion to the color selected in the color selection interface. The method of claim 1 further comprising:
7. The effect providing method includes: the at least one processor providing an object selection interface and a color selection interface; and The at least one processor changes a color of an object selected in the object selection interface from among clothing objects included in the body part to a color selected in the color selection interface. The method of claim 1 further comprising:
8. A method of providing effects executed on a computer device, comprising: the computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The effect providing method includes: the at least one processor recommending an outfit body effect for the video call based on at least one of user information or a call purpose; The at least one processor transmits a user image in which the clothing body effect is superimposed on a body part detected from a camera image to a terminal of a person participating in the video call; and The at least one processor may display a video call screen including an image of a party participating in the video call and an image of the user; The effect providing method includes: The method further includes transmitting, when a specific body effect is selected as groupware for the video call from the clothing body effects, information about the specific body effect to the other party's terminal, The displaying step includes: The effect providing method includes receiving, from the other party's terminal, a video of the other party in which the specific body effect is superimposed on a body part.
9. A method of providing effects executed on a computer device, comprising: the computing device includes at least one processor configured to execute computer-readable instructions contained in a memory; The effect providing method includes: the at least one processor recommending an outfit body effect for the video call based on at least one of user information or a call purpose; The at least one processor transmits a user image in which the clothing body effect is superimposed on a body part detected from a camera image to a terminal of a person participating in the video call; and The at least one processor may display a video call screen including an image of a party participating in the video call and an image of the user; The effect providing method includes: providing a body-off effect corresponding to a face-only mode as a list of effects applicable to the camera image by the at least one processor; and The effect providing method further includes a step of transmitting, when the body-off effect is selected from the effect list, an image in which the remaining parts of the camera image except for the face part are hidden by a transparency effect to the other party's terminal as the user image, by the at least one processor.
10. A computer program for causing a computer to execute the effect providing method according to any one of claims 1 to 9.
11. 1. A computer device comprising: at least one processor configured to execute computer-readable instructions contained in the memory; Including, The at least one processor recommending clothing body effects for a video call based on at least one of user information or a call purpose; transmitting a user image in which the clothing body effect is superimposed on a body part detected from a camera image to a terminal of a person participating in the video call; displaying a video call screen including an image of the other party participating in the video call and an image of the user; By linking with a calendar, the purpose of the call is extracted from meeting information set in the calendar. A computer device comprising:
12. The at least one processor Extracting the user information from a pre-registered user profile or an analysis result of the camera image. The computer device of claim 11 .
13. The at least one processor determining a dress code using at least one of the user information or the purpose of the call; Recommending clothing body effects having attribute information matching the dress code. The computer device of claim 11 .
14. The at least one processor Transmitting an image in which the clothing body effect of the AR image is overlaid on the body part to the other party's terminal as the user image. The computer device of claim 11 .
15. The at least one processor Provide a color selection interface; changing the color of the clothing object included in the body part to the color selected from the color selection interface; The computer device of claim 11 .
16. The at least one processor providing an object selection interface and a color selection interface; changing the color of the object selected in the object selection interface among the clothing objects included in the body part to the color selected in the color selection interface; The computer device of claim 11 .
17. A computer device comprising: at least one processor configured to execute computer-readable instructions contained in the memory; Including, The at least one processor recommending clothing body effects for a video call based on at least one of user information or a call purpose; transmitting a user image in which the clothing body effect is superimposed on a body part detected from a camera image to a terminal of a person participating in the video call; displaying a video call screen including an image of the other party participating in the video call and an image of the user; When a specific body effect is selected as groupware for the video call from the clothing body effects, information about the specific body effect is transmitted to the other party's terminal; receiving from the other party's terminal an image of the other party in which the specific body effect has been superimposed on the body part; A computer device comprising:
18. A computer device comprising: at least one processor configured to execute computer-readable instructions contained in the memory; Including, The at least one processor recommending clothing body effects for a video call based on at least one of user information or a call purpose; transmitting a user image in which the clothing body effect is superimposed on a body part detected from a camera image to a terminal of a person participating in the video call; displaying a video call screen including an image of the other party participating in the video call and an image of the user; A body-off effect corresponding to a face-only mode is provided as an effect list applicable to the camera image, When the body-off effect is selected from the effect list, an image in which the remaining part of the camera image except for the face part is hidden by a transparency effect is transmitted to the other party's terminal as the user image. A computer device comprising:
Citation Information
Patent Citations
Image transmission method for talking device
JP2002058001A
Home video communication system
JP2010529738A
Video conversation method and system using bidirectional transmission of visual or auditory effect
JP2017112609A
Conversation system and control method for conversation system
JP2017175544A
Information providing device, method and program
JP2019128923A