An electronic device that uses a three-dimensional avatar corresponding to a face to generate an image including a 3D avatar that reflects facial movements

Abstract

To provide an electronic device for generating an image including a 3D avatar with the facial movements of a face reflected thereon, using a 3D (three-dimensional) avatar for the face.SOLUTION: The electronic device according to the present invention includes: a camera, a display, and a processor. The processor acquires a first image including at least one external object by the camera, provides through a display, a 3D (three-dimensional) object of the at least one external object which is generated on the basis of attributes related to a face, and generates a 3D avatar for the face based on at least one of graphic attributes to be applied to the 3D object. Using the 3D avatar, a second image, which includes at least one object with a predetermined expression or motion reflected thereon, is generated.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an electronic device that uses a three-dimensional (3D) avatar corresponding to a face to generate images including a 3D avatar that reflects facial movements. [Background technology]

[0002] The electronic device can provide various services using the avatar. The electronic device uses a 3D avatar corresponding to the user to display the user's emotions or intentions in various applications. The electronic device provides a user with an avatar generation feature, allowing the user to create their own avatar. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Korean Patent Publication No. 10-2017-0112406 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention has been made in consideration of the above-mentioned prior art, and an object of the present invention is to provide an electronic device and an operating method thereof that provide a 3D avatar based on a two-dimensional (2D) image including an object corresponding to a face. It is also an object of the present invention to provide an electronic device that generates a 3D avatar corresponding to a user based on attributes associated with the user's face. Another object of the present invention is to provide an electronic device that generates a 2D image including avatar facial expressions, avatar gestures, and background screens or objects with various animation effects applied thereto, using a 3D avatar generated based on a 2D image including a user. [Means for solving the problem]

[0005] In order to achieve the above object, an electronic device according to one aspect of the present invention includes a touch screen display and at least one processor, the at least one processor displays an execution screen of a message application via the touch screen display, the execution screen of the message application including a plurality of icons each associated with a content to be sent to a counterparty, acquires a first user input for a first icon of the plurality of icons on the execution screen of the message application, and based on the acquisition of the first user input, displays at least one 3D face template including a first 3D face template on the execution screen of the message application, and displays a first 3D face template including an animation effect based on the first 3D face template and a moving facial expression of a user in response to a second user input received via the execution screen of the message application. a first 3D avatar of the user; an icon configured to receive a user input for sending the first 3D avatar to the other party on an execution screen of the message application; a preview showing the animation effect of the first 3D avatar is displayed; the icon is displayed while the preview of the first 3D avatar is displayed; a third user input for the icon is received on the execution screen of the message application while the preview of the first 3D avatar is displayed on the execution screen of the message application; and based on the receipt of the third user input, the first 3D avatar is sent to the other party; and the execution screen of the message application is configured to enable the moving facial expression of the user applied to the first 3D avatar to be applied to a second 3D avatar different from the first 3D avatar.

[0006] In order to achieve the above object, a method of controlling an electronic device according to one aspect of the present invention includes the steps of: displaying an execution screen of a message application via a touch screen display of the electronic device; the execution screen of the message application includes a plurality of icons each associated with a content to be sent to a counterparty; acquiring a first user input for a first icon of the plurality of icons on the execution screen of the message application; displaying at least one 3D face template on the execution screen of the message application based on the acquisition of the first user input; and generating a first 3D avatar including the first 3D face template and an animation effect based on a moving facial expression of the user in response to a second user input received via the execution screen of the message application. The message application execution screen includes an icon configured to acquire user input for sending the first 3D avatar to the other party on the execution screen of a message application, an operation of displaying a preview showing the animation effect of the first 3D avatar, the icon being displayed while the preview of the first 3D avatar is being displayed, an operation of acquiring a third user input for the icon on the execution screen of the message application while the preview of the first 3D avatar is being displayed on the execution screen of the message application, and an operation of sending the first 3D avatar to the other party based on the acquisition of the third user input, wherein the execution screen of the message application is configured so that the moving facial expression of the user applied to the first 3D avatar can be applied to a second 3D avatar different from the first 3D avatar.

[0007] According to another aspect of the present invention, which has been made to achieve the above object, an electronic device includes a touch screen display and at least one processor, the at least one processor displays an execution screen of a message application via the touch screen display, the execution screen of the message application including a plurality of icons each associated with a content to be sent to a counterparty, acquires a first user input for a first icon of the plurality of icons on the execution screen of the message application, and based on the acquisition of the first user input, displays at least one 3D face template including a first 3D template on the execution screen of the message application, and displays the first 3D template in response to a second user input received via the execution screen of the message application. a send button configured to receive a user input for sending the first 3D avatar to the other party on a running screen of the message application, and a preview showing an animation effect of the first 3D avatar is displayed, the send button is displayed while the preview of the first 3D avatar is displayed, a third user input for the send button is received on the running screen of the message application while the preview of the first 3D avatar is displayed on the running screen of the message application, and based on the receipt of the third user input, the first 3D avatar is sent to the other party, and the moving facial expressions of the first 3D avatar are applied to a second 3D avatar. Effect of the Invention

[0008] According to the present invention, there is provided an electronic device that generates a 3D avatar corresponding to an external object included in a 2D image captured using a camera. In addition, the electronic device according to the present invention can provide a 2D image including an object generated using a 3D avatar that reflects an avatar's facial expression, an avatar's gesture, a background screen, or an animation effect. Additionally, one or more applications may be provided that utilize a 3D avatar generated based on a 2D image that includes a user's face. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram illustrating electronic devices in a network environment according to one embodiment of the present invention. [Diagram 2] 4 is a flowchart illustrating a method of operating an electronic device for generating a 3D avatar according to one embodiment of the present invention. [Diagram 3] FIG. 13 is a diagram illustrating an example of an operation of an electronic device according to an embodiment of the present invention for generating a 3D avatar to be provided to a user. [Figure 4A] 2A-2C are diagrams illustrating examples of 3D graphical objects generated by an electronic device according to an embodiment of the present invention and graphical attributes applied to the 3D graphical objects. [Figure 4B] 2A-2C are diagrams illustrating examples of 3D graphical objects generated by an electronic device according to an embodiment of the present invention and graphical attributes applied to the 3D graphical objects. [Figure 4C] 2A-2C are diagrams illustrating examples of 3D graphical objects generated by an electronic device according to an embodiment of the present invention and graphical attributes applied to the 3D graphical objects. [Diagram 5] FIG. 2 illustrates an example of an operation of an electronic device according to an embodiment of the present invention for generating a 3D avatar based on a 2D image. [Figure 6] FIG. 2 illustrates an example of a 2D image including at least one object generated using a 3D avatar by an electronic device according to an embodiment of the present invention. [Figure 7]1 is a diagram illustrating a function of editing a photo using an avatar character by an electronic device according to an embodiment of the present invention. [Figure 8] 13 is a diagram illustrating an example of a function of an electronic device according to an embodiment of the present invention transmitting a selected object of an avatar character in a message. [Figure 9] FIG. 13 illustrates an example of a function for editing contacts using an avatar character in an electronic device according to an embodiment of the present invention. [Figure 10] FIG. 2 shows an example of a 3D avatar generated by an electronic device according to an embodiment of the present invention based on a 2D image including an animal's head. [Figure 11] FIG. 2 illustrates an example of a 3D avatar generated based on a 2D image containing a character by an electronic device according to an embodiment of the present invention. [Figure 12] FIG. 2 illustrates an example of a 3D avatar generated based on a 2D image containing an object by an electronic device according to an embodiment of the present invention. [Figure 13] FIG. 2 illustrates an example of facial related expression attributes according to one embodiment of the present invention. [Figure 14] FIG. 2 illustrates an example of facial related expression attributes according to one embodiment of the present invention. [Figure 15] 1A-1C are diagrams illustrating examples of 3D avatars generated using various 3D templates by an electronic device according to an embodiment of the present invention. [Figure 16] FIG. 13 illustrates an example of attributes associated with a 3D graphical object generated based on a 2D image containing an object by an electronic device according to an embodiment of the present invention. [Figure 17] FIG. 13 illustrates an example of attributes associated with a 3D graphical object generated based on a 2D image containing an object by an electronic device according to an embodiment of the present invention. [Figure 18] FIG. 2 illustrates an example of a 3D avatar generated by an electronic device according to an embodiment of the present invention based on a 2D image including an external object corresponding to a face and an additional object. [Figure 19A]FIG. 1 illustrates an example of an operation of an electronic device according to an embodiment of the present invention generating an image including multiple 3D avatars based on multiple external objects. [Figure 19B] FIG. 1 illustrates an example of an operation of an electronic device according to an embodiment of the present invention generating an image including multiple 3D avatars based on multiple external objects. [Figure 20] FIG. 2 illustrates an example of expression attributes for a 3D avatar according to one embodiment of the present invention. [Figure 21] 1 is a diagram illustrating an example of an operation of an electronic device according to an embodiment of the present invention generating a 3D avatar with a video call function. [Figure 22] 1 is a diagram illustrating an example of an operation of an electronic device according to an embodiment of the present invention sharing a 3D avatar with a video call partner electronic device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0011] Figure 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to one embodiment of the present invention. With reference to Figure 1, in the network environment 100, the electronic device 101 communicates with an external electronic device 102 via a first network 198 (e.g., short-range wireless communication) and communicates with an electronic device 104 or a server 108 via a second network 199 (e.g., long-range wireless communication). In one embodiment, the electronic device 101 communicates with the electronic device 104 via the server 108.

[0012] According to an embodiment of the present invention, the electronic device 101 includes a processor 120, a memory 130, an input device 150, an audio output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identity module 196, and an antenna module 197. In some embodiments, the electronic device 101 omits at least one of these components (e.g., the display device 160 or the camera module 180) or adds other components. In some embodiments, some components may be embodied in an integrated manner. For example, the sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented to be integrated into the display device 160 (e.g., a display).

[0013] The processor 120 executes, for example, software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120 and executes various data processing and calculations. The processor 120 loads instructions or data received from other components (e.g., the sensor module 176 or the communication module 190) into the volatile memory 132 for processing, and stores the result data in the non-volatile memory 134. The non-volatile memory 134 includes an internal memory 136 and an external memory 138.

[0014] In one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) and an auxiliary processor 123 (e.g., a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor) that operates separately from the main processor 121 and that additionally or alternatively has lower power consumption than the main processor 121 or is specialized for a certain function. Here, the auxiliary processor 123 operates separately from or integrated with the main processor 121.

[0015] The auxiliary processor 123 controls at least a part of the functions or states associated with at least one of the components of the electronic device 101 (e.g., the display device 160, the sensor module 176, or the communication module 190), for example, instead of the main processor 121 when the main processor 121 is inactive (e.g., sleep, low power mode, standby mode), or together with the main processor 121 when the main processor 121 is active (e.g., executing an application). In one embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) is realized by a part of the components of another component (e.g., the camera module 180 or the communication module 190) that is functionally associated with the auxiliary processor 123.

[0016] The memory 130 stores various data, such as input data or output data for software (e.g., program 140) and associated instructions used by at least one component (e.g., processor 120 or sensor module 176) of the electronic device 101. The memory 130 includes a volatile memory 132 or a non-volatile memory 134.

[0017] The programs 140 are software stored in the memory 130 and include, for example, an operating system 142 , middleware 144 , or applications 146 .

[0018] The input device 150 is a device for receiving instructions or data from outside the electronic device 101 (e.g., a user) for use by a component of the electronic device 101 (e.g., the processor 120), and includes, for example, a microphone, a mouse, or a keyboard.

[0019] The audio output device 155 is a device for outputting an audio signal to the outside of the electronic device 101, and includes, for example, a speaker used for general purposes such as multimedia playback or recording playback, and a receiver used exclusively for receiving telephone calls. In one embodiment, the receiver is formed integrally with the speaker or separately.

[0020] The display device 160 is a device for visually presenting information to a user of the electronic device 101, and may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling the device. In one embodiment, the display device 160 includes touch circuitry or a pressure sensor for measuring the strength of pressure applied by a touch.

[0021] The audio module 170 converts between sound and electrical signals. In one embodiment, the audio module 170 obtains sound through the input device 150 and outputs sound through the audio output device 155 or an external electronic device connected to the electronic device 101 by wire or wirelessly (e.g., the external electronic device 102 (e.g., a speaker or headphones)).

[0022] The sensor module 176 generates an electrical signal or data value corresponding to an internal operating condition (e.g., power or temperature) or an external environmental condition of the electronic device 101. The sensor module 176 includes, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0023] The interface 177 supports a specific protocol for wired or wireless connection to an external electronic device (e.g., the external electronic device 102). In one embodiment, the interface 177 includes a High Definition Multimedia Interface (HDMI), a Universal Serial bus (USB) interface, an SD card interface, or an audio interface.

[0024] The connection terminal 178 includes a connector that physically connects the electronic device 101 to an external electronic device (e.g., the external electronic device 102), such as an HDMI (registered trademark) connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0025] Haptic module 179 converts electrical signals into mechanical (e.g., vibration or movement) or electrical stimuli that can be perceived by the user through touch or kinesthetic sensation. Haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0026] Camera module 180 captures still and video images and, in one embodiment, includes one or more lenses, an image sensor, an image signal processor, or a flash.

[0027] The power management module 188 is a module for managing the power supplied to the electronic device 101, and is configured as at least a part of a PMIC (Power Management Integrated Circuit), for example.

[0028] Battery 189 is a device for supplying power to at least one component of electronic device 101 and includes, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0029] The communications module 190 supports establishing a wired or wireless communication channel between the electronic device 101 and an external electronic device (e.g., the external electronic device 102, the external electronic device 104, or the server 108) and performing communications over the established communications channel. The communications module 190 includes one or more communications processors that support wired or wireless communications and that operate separately from the processor 120 (e.g., an application processor). In one embodiment, the communication module 190 includes a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a Global Navigation Satellite System (GNSS) communication module) or a wired communication module 194 (e.g., a Local Area Network (LAN) communication module, or a power line communication module), among which the corresponding communication module is used to communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, BLE (Bluetooth Low Energy), WiFi Direct, or IrDA (Infrared Data Association)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., LAN or WAN)). Such various types of communication modules 190 may be implemented on one chip or each may be implemented on a separate chip.

[0030] The wireless communication module 192 uses user information stored in the subscriber identity module 196 to identify and authenticate the electronic device 101 within the communication network.

[0031] The antenna module 197 includes one or more antennas for transmitting and receiving signals or power to and from the outside. In one embodiment, the communication module 190 (e.g., the wireless communication module 192) transmits and receives signals to and from an external electronic device via an antenna compatible with a communication method.

[0032] Some of the above components are connected to each other via a peripheral communication method (e.g., a bus, a General Purpose Input / Output (GPIO), a Serial Peripheral Interface (SPI), or a Mobile Industry Processor Interface (MIPI)) to exchange signals (e.g., commands or data) with each other.

[0033] In one embodiment, commands or data are sent or received between the electronic device 101 and the external electronic device 104 through a server 108 connected to the second network 199. The external electronic devices (102, 104) are of the same type as the electronic device 101 or of a different type. In one embodiment, all or part of the operations performed by the electronic device 101 are performed by one or more other external electronic devices. In one embodiment, when the electronic device 101 must perform any function or service automatically or upon request, the electronic device 101 requests at least some of the functions related thereto from the external electronic device instead of or in addition to automatically performing the function or service. The external electronic device that receives the request performs the requested function or additional function and delivers the result to the electronic device 101. The electronic device 101 processes the received result as it is or additionally to provide the requested function or service. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology is used.

[0034] FIG. 2 is a flow chart illustrating a method of operation of an electronic device for generating a 3D avatar according to one embodiment of the present invention.

[0035] Referring to FIG. 2, an electronic device (e.g., electronic device 101 or processor 120 in FIG. 1) according to an embodiment of the present invention acquires a first image of one or more external objects using a camera (e.g., camera module 180 in FIG. 1) in step 210. The electronic device 101 acquires a 2D image using the 2D camera module 180, and the first image is a 2D image. The one or more external objects include a person, an animal, or an object. For example, the electronic device 101 acquires a 2D image of a user's face. The electronic device 101 detects an external object corresponding to the face from the first image acquired using the camera module 180. If an external object corresponding to the face is not detected, the electronic device 101 provides a message informing the user that a face is not detected.

[0036] In step 220, the electronic device 101 provides, via a display (e.g., display device 160 of FIG. 1), a 3D graphical object generated based on attributes associated with an external object that corresponds to a face among one or more external objects included in the first image.

[0037] The attributes related to the external object are defined for various features related to the face, for example, the attributes related to the external object include at least one of the shape of each element constituting the face (eyes, eyebrows, nose, cheekbones, lips, teeth, cheeks, chin, forehead, hair, beard, dimples, ears, back of the head, side of the head), color, relative position between each element, relative size ratio between each element, or head accessories (e.g., earrings, piercings, glasses, nose piercing).

[0038] The electronic device 101 generates a 3D graphic object by arranging at least one attribute related to an external object corresponding to a face in a 3D template for a face or head. The electronic device 101 extracts at least one attribute related to the external object corresponding to a face in a first image, and applies the extracted attribute value to the 3D template to generate a 3D graphic object. The electronic device 101 applies at least one attribute value for, for example, a face length, a face width, a face shape, a complexion, a width between the eyebrows, a size of an eye, a presence or absence of a double eyelid, a color of an eyebrow, a length of a nose, a position of a nose, a size of a lip, a position of a lip, a position of a cheekbone, a size of a cheekbone, or a presence or absence of a dimple to the 3D template, for example, of an external object. The electronic device 101 generates a 3D graphic object by using a predetermined attribute value (default value) for the 3D template. The electronic device 101 generates a 3D graphic object by applying the attribute value determined for the 3D template as it is for attributes related to ears, hair, or a back of the head, which are attributes not extracted from the first image, as is, for example. The 3D graphical object includes both the face-related attribute values ​​extracted from the acquired first image and the attribute values ​​defined for the 3D template. The 3D template for the face or head is stored in a database. The database is included in a memory (e.g., memory 130 in FIG. 1 ) or a server (e.g., server 108 in FIG. 1 ). The electronic device 101 generates one or more 3D graphical objects by modifying at least one of the attributes and the 3D template associated with the external object corresponding to the face. The electronic device 101 displays at least one of the generated one or more 3D graphical objects on a display (e.g., display device 160 in FIG. 1 ).

[0039] In step 230, the electronic device 101 generates a 3D avatar for the external object based on the selected at least one of a plurality of graphic attributes applied to the 3D graphical object and the 3D graphical object, where the plurality of graphic attributes applied to the 3D graphical object include brightness, color contrast, lip color, eyebrow color, beard, hairstyle, or face-related accessories (e.g., glasses, hats, earrings, piercings, etc.).

[0040] In various embodiments of the present invention, the plurality of graphic attributes applied to the 3D graphic object includes motion parameters for facial motion. The motion parameters include a direction and magnitude of motion of each of the facial details (e.g., eyebrows, eyelids, nose, mouth, etc.). The electronic device 101 sets the motion parameter values ​​based on attributes associated with an external object corresponding to the face. For example, the electronic device 101 sets the direction and magnitude of the mouth motion among the motion parameters based on a size or shape of the mouth extracted from the external object.

[0041] The electronic device 101 provides at least one of the plurality of graphic attributes together with the 3D graphic object through a display (e.g., the display device 160 of FIG. 1). The electronic device 101 applies at least one graphic attribute selected by a user input from the plurality of graphic attributes to the 3D graphic object. The electronic device 101 displays, for example, brightness from the plurality of graphic attributes on a display (e.g., the display device 160 of FIG. 1), and applies the sensed input value for brightness to the 3D graphic object when it senses an input for brightness. The electronic device 101 provides a preview of the 3D graphic object to which the input value has been applied through a display (e.g., the display device 160 of FIG. 1) in response to a user input for a displayed graphic attribute from the plurality of graphic attributes.

[0042] The electronic device 101 provides the user with the ability to edit the 3D graphical objects by displaying attributes applied to the 3D graphical objects and receiving input for the displayed attributes.

[0043] The electronic device 101 applies at least one selected graphic attribute of the plurality of graphic attributes to the 3D graphical object to generate the 3D avatar. The electronic device 101 applies at least one selected graphic attribute of the plurality of graphic attributes to the 3D graphical object to re-process the 3D graphical object to generate the 3D avatar. As part of re-processing the 3D graphical object, the electronic device 101 removes unnecessary information from the 3D graphical object and simplifies simplified information to generate the 3D avatar.

[0044] The 3D avatar is stored in a memory (e.g., memory 130 in FIG. 1) or a server (e.g., server 108 in FIG. 1). If the 3D avatar is stored in a server (e.g., server 108 in FIG. 1), the electronic device 101 provides the 3D avatar to the server (e.g., server 108 in FIG. 1) through the communication module 190. The 3D avatar is stored, for example, in glTF (gl transmission format) format.

[0045] In step 240, the electronic device 101 generates a second image including at least one object reflecting a predetermined facial expression or movement using a 3D avatar. For example, the electronic device 101 generates an object by reflecting one or more pre-specified facial expressions or movements in the 3D avatar. The electronic device generates an object by reflecting one or more body gestures. For example, the electronic device 101 detects a person's body shape (e.g., detects the boundary of a body image) and movement from an image (e.g., a still image or a moving image), and generates an object reflecting the detected body shape and movement (e.g., generates skeleton information corresponding to the detected body shape and movement, and reflects the skeleton information in the shape and movement of each body part so that the object performs a body gesture with a high similarity).

[0046] The electronic device generates an object reflecting one or more background effects. The electronic device 101 generates at least one object based on a 3D avatar to which a pre-specified facial expression or movement is applied to at least one of a facial expression, a body gesture, and a background effect, and generates a 2D image based on the at least one object. The electronic device 101 generates a second image including at least one object using a 3D avatar based on a predetermined number of facial expressions or movements. For example, the electronic device 101 reflects a predetermined expression set on the 3D avatar based on a predetermined expression set in which at least one of an avatar facial expression, an avatar gesture, a background screen, and an animation effect is transformed, and generates an object corresponding to the number of the expression set. The second image including the generated object is an avatar character. The second image is a 2D image including at least one object. The electronic device 101 stores the second image in a still image or a moving image.

[0047] In various embodiments, the electronic device 101 generates the second image using a 3D avatar that reflects at least one of the avatar's facial expressions, the avatar's gestures, the animation effects, and the background effects. The second image is stored in a memory (e.g., memory 130 of FIG. 1) or a server (e.g., server 108 of FIG. 1). If the second image is stored in a server (e.g., server 108 of FIG. 1), the electronic device 101 provides the second image to the server (e.g., server 108 of FIG. 1) via the communication module 190. The second image is stored, for example, in a video file (e.g., mp4, AGIF, etc.) format.

[0048] The electronic device 101 provides various applications using the generated avatar character. The electronic device 101 provides the avatar character through a keyboard application. For example, the electronic device 101 provides a message sending application, a photo editing application, or a video calling application using the avatar character included in the keyboard application. The avatar character is provided in various other applications.

[0049] 3 is a diagram showing an example of an operation of generating a 3D avatar provided to a user by an electronic device according to an embodiment of the present invention. An electronic device (e.g., electronic device 101 in FIG. 1) provides a function of generating a 3D avatar using a camera module (e.g., camera module 180 in FIG. 1). The electronic device 101 activates the camera module 180 and provides an execution screen including an icon for generating a 3D avatar through a display (e.g., display device 160 in FIG. 1).

[0050] 3A, the execution screen includes a preview screen area 301 for taking an image, an icon 302 for creating a 3D avatar, a 3D avatar list 303, and an icon 304 for taking a picture with a camera. The electronic device 101 displays the icon 302 including text such as "Create Avatar". When the icon 302 for creating an avatar is selected, the electronic device 101 uses the camera module 180 to capture a facial image of the user.

[0051] 3(b), the electronic device 101 provides a preview screen area 311 for taking a picture of an object including a face for which a 3D avatar is to be generated, and an icon 312 for taking a picture with a camera. In order to obtain images corresponding to various angles and expressions of the face when taking a picture with the camera, guide information instructing the direction of head direction or expression (e.g., head direction guide, emotional expression mimicry guide, etc.) is further displayed. When taking a picture with the camera, multiple taken images can be received by taking a video image.

[0052] Referring to FIG. 3C, the electronic device 101 provides an area for displaying a captured face image 321, an icon 322 for selecting gender when generating an avatar, and an icon 323 for indicating completion of selection. The electronic device 101 generates one or more 3D graphic objects based on face-related attributes in one or more captured face images. The electronic device 101 extracts face-related attributes from the face image and applies the extracted attributes to a 3D template corresponding to the face to generate a realistic 3D graphic object. The electronic device 101 extracts face-related attributes from the face image, modifies the extracted attributes, and applies them to a 3D template corresponding to the face to generate a corrected 3D graphic object. The face-related attributes include at least one of the shapes of each element constituting a face (eyes, eyebrows, nose, cheekbones, lips, teeth, cheeks, chin, forehead, beard, dimples, and ears), the relative positions between each element, the relative size ratio between each element, color, and movement direction. The electronic device 101 provides at least one of the generated one or more 3D graphic objects through a display (e.g., display device 160 of FIG. 1) and displays a selected 3D graphic object of the provided at least one 3D graphic object on the screen.

[0053] Referring to FIG. 3D, the electronic device 101 provides one or more icons (332, 333) corresponding to at least one 3D graphic object and a preview screen area 331 displaying a selected 3D graphic object. For example, the electronic device 101 displays an icon 332 corresponding to a first 3D graphic object and an icon 333 corresponding to a second 3D graphic object, and displays the selected first 3D graphic object in the preview screen area 331. The electronic device 101 extracts face-related attributes from the face image 321 and applies the extracted attribute values ​​to a 3D template to generate a first 3D graphic object. The electronic device 101 extracts face-related attributes from the face image 321, applies the extracted attribute values ​​to a 3D template, and corrects the 3D template according to a predetermined condition to generate a second 3D graphic object. In one embodiment, a 3D graphic object from which a glasses attribute is removed is generated by not extracting or removing an accessory (e.g., glasses, earrings)-related attribute from the face-related attributes when generating the 3D graphic object. The electronic device 101 uses predetermined attribute values ​​(default values) of the 3D template for face-related attributes that are difficult to obtain from a 2D image. The electronic device 101 provides at least one of a plurality of graphic attributes to be applied to the 3D graphic object together with the 3D graphic object.

[0054] The electronic device 101 provides a selection bar 334 for adjusting a skin color attribute for a 3D graphic object. The electronic device adjusts the skin color darker in response to an input of moving the selection bar 334 to the (-) side, and adjusts the skin color brighter in response to an input of moving the selection bar 334 to the (+) side. In response to the input, the electronic device 101 provides a preview in the preview screen area 331 in which the input skin color value is applied to the 3D graphic object. In one embodiment, the initial position of the selection bar 334 is determined according to attributes (e.g., color and brightness) of a face area extracted from an image in the preview screen area 311 received through the camera module 180 of the electronic device 101. To this end, an additional operation is performed to determine the attributes of the face area. As an example, the electronic device 101 measures the illuminance of the ambient light when the camera module 180 captures an image through an illuminance sensor included in the sensor module 176, and corrects the attributes of the extracted face area based on the measured illuminance.

[0055] Referring to FIG. 3(e), the electronic device 101 generates a 3D avatar for the user's face based on the graphic attributes and the 3D graphic object selected by the user input. The electronic device 101 displays the generated 3D avatar 341 in a preview area. The electronic device 101 provides an avatar list area 342 that displays one or more 3D avatars. The electronic device 101 adds an icon 343 corresponding to the generated 3D avatar 341 to the avatar list area 342 and displays it. The electronic device 101 generates a 2D image including at least one object reflecting a predetermined expression or movement using the 3D avatar. For example, the electronic device 101 generates an object based on the 3D avatar to which a laughing expression is applied, and generates a 2D image including the object. For example, an accessory icon is added to the avatar list area 342 using an accessory attribute already extracted from the 3D avatar, and an object included in the 3D avatar is generated by selecting the accessory icon. The electronic device 101 provides a function of inputting an avatar character using a 2D image. For example, the electronic device 101 provides a photo editing function including a function of inputting an avatar character. In various embodiments of the present invention, the electronic device 101 provides a function of adding a selected object from at least one object included in a 2D image to a photo and adjusting a position, size, or orientation of the added object during photo editing to edit the photo.

[0056] Referring to FIG. 3(f), the electronic device 101 displays, on a screen for editing a photo, an area 351 for displaying a photo to be edited, an icon 352 for providing a function of inputting an avatar character, and an area 353 for displaying one or more objects included in a selected avatar character. The one or more objects included in the avatar character include at least one of an avatar facial expression, an avatar gesture, a background screen, and an animation effect. The electronic device 101 adds a first object 354 selected from the one or more objects included in the selected avatar character to a photo to be edited, and displays the photo including the object 355 in the area 351 for displaying a photo to be edited. The first object 354 includes a grimacing facial expression 3541, a gesture 3542 of covering the face with both hands, and a background of clouds 3543 overhead. The electronic device 101 changes the position, size, or orientation of the object 355 displayed on the area 351 for displaying a photo to be edited, according to a user input.

[0057] 4A-4C are diagrams illustrating examples of 3D graphical objects and graphical attributes applicable to the 3D graphical objects generated by an electronic device according to an embodiment of the present invention.

[0058] Referring to FIG. 4A, the electronic device 101 displays a screen (410, 420) including at least one 3D graphic object generated based on a user's facial image. The electronic device 101 generates various 3D graphic objects by applying various face-related attribute values. The electronic device 101 generates a first 3D graphic object by applying the eyes, nose, and mouth extracted from the user's facial image to a 3D template. The electronic device 101 corrects the eyes, nose, and mouth extracted from the user's facial image according to a predetermined correction criterion and applies the corrected eyes, nose, and mouth to the 3D template to generate a second 3D graphic object. For example, the predetermined correction criterion is set to change the size of the eyes, the position and shape of the nose, and the shape and color of the lips extracted from the user's facial image to a predetermined value.

[0059] Referring to FIG. 4A , the electronic device 101 displays a first icon 411 corresponding to a first 3D graphical object and a second icon 412 corresponding to a second 3D graphical object, and when the first icon 411 is selected by user input, the electronic device 101 displays the first 3D graphical object on the screen 410, and when the second icon 412 is selected by user input, the electronic device 101 displays the second 3D graphical object on the screen 420.

[0060] The electronic device 101 displays both the 3D graphical object and an icon indicating an attribute applicable to the 3D graphical object. Referring to Fig. 4B, the electronic device 101 displays a selection bar 413 as an icon for setting an attribute for the skin tone of the 3D graphical object, and darkens or lightens the skin tone according to a user input on the selection bar 413. The electronic device 101 displays a screen 430 in which a dark skin tone is applied to the 3D graphical object in response to a user input for darkening the skin tone, and displays a screen 440 in which a light skin tone is applied to the 3D graphical object in response to a user input for lightening the skin tone.

[0061] The electronic device 101 defines one or more attributes applicable to the 3D graphical object as parameters and assigns predetermined attribute values ​​(default values) to the parameters. The electronic device 101 extracts attribute values ​​corresponding to the one or more attributes applicable to the 3D graphical object from the 2D image. The one or more attributes applicable to the 3D graphical object correspond to one or more attributes applicable to an external object included in the 2D image. For example, eyes, nose, mouth, hairstyle, or glasses applicable to the external object are applied to the 3D graphical object. The electronic device 101 selects attribute values ​​designated for the one or more attributes applicable to the 3D graphical object corresponding to the 3D template. The electronic device 101 generates one or more attribute values ​​applicable to the 3D graphical object based on a user input.

[0062] For example, referring to FIG. 4C , the electronic device 101 provides a screen 450 for editing hairstyle attributes applicable to a 3D graphic object, a screen 460 for editing glasses accessory attributes, and a screen 470 for editing 3D avatar clothing attributes. The electronic device 101 provides a hairstyle list 451 and a hair color list 452 for hairstyle attributes applicable to a 3D graphic object. The electronic device 101 first applies a first hairstyle selected from the hairstyle list 451 based on attributes extracted from a 2D image or attributes set corresponding to a 3D template to the 3D graphic object and displays it. For example, the electronic device 101 selects a hairstyle matching a face type attribute based on a face type attribute extracted from a 2D image as a first hairstyle and applies it preferentially. The electronic device 101 displays a 3D graphic object to which the selected hairstyle and hair color are applied. The electronic device 101 provides a glasses accessory list 461 applicable to a 3D graphic object, and applies the selected glasses accessory to the 3D graphic object and displays it. The electronic device 101 provides a list of 3D avatar costumes 471 that can be applied to the 3D graphic object, and displays the 3D graphic object with the selected 3D avatar costume applied.

[0063] FIG. 5 is a diagram illustrating an example of an operation of an electronic device according to an embodiment of the present invention for generating a 3D avatar based on a 2D image.

[0064] Referring to FIG. 5, the electronic device 101 extracts an external object corresponding to a face from a 2D image including one or more external objects. Specifically, the electronic device 101 extracts an external object 511 corresponding to a face from a 2D image 510 including a user's face. The electronic device 101 determines whether the 2D image 510 includes a face using a face detection algorithm. For example, at least a part of the method for extracting the external object utilizes an artificial intelligence model trained by at least one of a rule-based model, machine learning, a neural network, and a deep learning algorithm. The electronic device 101 receives the artificial intelligence model from a server. For example, the electronic device 101 extracts the external object 511 corresponding to a face from the 2D image 510 using a multi-task cascaded neural network (MTCNN).

[0065] The external object 511 includes eyes (521, 522), a nose 523, or lips 524 that indicate attributes related to a face. The electronic device 101 defines attributes applicable to the external object 511 as parameters, and specifies attribute values ​​extracted from the external object 511 as values ​​of the parameters. The attributes applicable to the external object 511 include at least one of, for example, gender, race, age, attractiveness, facial expression, hair color, parting, hair length, cheekbones, face shape, skin color, eye position, eye size, eyebrow length, eyebrow shape, eyebrow size, nose length, nose position, nose shape, lip shape, lip color, lip length, hat, glasses, earrings, necklace, lip color, and tie style. For example, the electronic device 101 defines a parameter for gender and specifies a value of female or male.

[0066] The electronic device 101 determines a 3D template 530 for generating a 3D avatar. The 3D template varies depending on the type of 3D avatar to be generated. For example, the electronic device 101 uses different 3D templates according to gender, race, nationality, or age. As another example, the electronic device 101 generates a 3D avatar for an animal, character, or object, and uses various 3D templates according to the shape of the animal, the shape of the character, or the shape of the object. The electronic device 101 receives at least one 3D template from an external electronic device. The electronic device 101 applies attributes related to the external object 511 extracted from the 2D image 510 to the 3D template to generate a 3D avatar 540. The electronic device 101 provides a 3D graphic object (not shown) generated by applying attributes related to the external object 511 extracted from the 2D image 510 to the 3D template. The attributes applied to the external object are applied to the 3D graphic object.

[0067] The electronic device 101 generates a 3D graphic object by reflecting the attributes extracted from the external object and the attributes selected by the user input, and generates a 3D avatar 540 based on the 3D graphic object. The electronic device 101 applies the eyes 521 of the external object 511 to the eye area of ​​the 3D template 530 to generate the 3D avatar 540. The electronic device 101 generates the 3D avatar 540 with a predetermined attribute value in the 3D template 530 for an attribute not extracted from the external object 511, for example, a hairstyle. The electronic device 101 provides one or more sample attributes for attributes applicable to the external object to the user through a display (for example, the display device 160 in FIG. 1). The electronic device 101 applies a selected attribute from the one or more sample attributes according to a user's selection to generate the 3D avatar 540. The electronic device 101 selects and provides a recommended attribute from the one or more sample attributes based on the attributes extracted from the 2D image or the predetermined 3D template. The electronic device 101 provides the 3D graphic object reflecting the sample attributes through a display (e.g., the display device 160) to provide a preview to the user.

[0068] FIG. 6 is a diagram illustrating an example of a 2D image including at least one object generated by an electronic device using a 3D avatar according to an embodiment of the present invention. The electronic device 101 generates one or more objects by applying one or more specified facial expressions or movements to the 3D avatar. The object is determined according to at least one of the facial expressions of the avatar, the gestures of the avatar, the background screen, and the animation effect. For example, the one or more specified facial expressions or movements are specified for at least one of the facial expressions of the avatar, the gestures of the avatar, the background screen, and the animation effect. For example, the facial expressions of the avatar are specified as a laughing expression, a crying expression, or a neutral expression, and the gestures of the avatar are specified as a gesture of making a heart with hands, or a gesture of nodding the head of the avatar. At least one of the facial expressions of the avatar, the gestures of the avatar, the background screen, and the animation effect is specified as a moving action.

[0069] The electronic device 101 applies a specified facial expression or movement to generate at least one object using an avatar generated for an external object corresponding to a face extracted from a 2D image acquired using a camera (e.g., the camera module 180 in FIG. 1). The electronic device 101 applies a predetermined number of specified facial expressions or movements to a 3D avatar to generate a predetermined number of objects at once. For example, the electronic device 101 applies a set of 18 types of specified expressions to a 3D avatar to generate 18 types of objects. The set of 18 types of specified expressions is specified by modifying at least one of the facial expression of the avatar, the gesture of the avatar, the background screen, and the animation effect. The 2D image including one or more objects is an avatar character. The electronic device 101 provides the avatar character through a display (the display device 160 in FIG. 1).

[0070] The electronic device 101 generates one or more avatar characters using one or more 3D avatars, and provides a 3D avatar character list through a display (e.g., the display device 160). For example, the electronic device 101 displays an avatar character 610 on a display (e.g., the display device 160), and displays one or more objects included in the avatar character 610 in a first area 611. The first area 611 includes a plurality of objects having at least one of different avatar facial expressions, avatar gestures, background screens, and animation effects. A first object 620 among the one or more objects included in the avatar character 610 includes an avatar 621 and a background screen 622. The avatar 621 of the first object 620 is generated according to a pre-specified facial expression or gesture, and the background screen 622 of the first object 620 includes an additional object 623. An animation effect is applied to the avatar 621 or the background screen 622 of the first object 620. For example, the additional object 623 of the background screen 622 has an effect of moving left and right. The avatar character is a still image or a moving image. When the avatar character is a moving image, at least one of the avatar facial expression, the avatar gesture, the background screen, and the additional object of the object moves.

[0071] FIG. 7 is a diagram illustrating an example of a function of an electronic device according to an embodiment of the present invention for editing a photo using an avatar character.

[0072] The electronic device 101 displays a selected object of an avatar character in a predetermined first position 711 on a photo editing screen 710. The electronic device 101 moves the object from the first position 711 to another position according to user input. The electronic device 101 displays the photo editing screen 720 in which the object has been moved to a second position 721. The electronic device 101 changes a size or orientation of the object according to user input. The electronic device 101 displays the photo editing screen 730 including the object 731 whose size or orientation has been changed.

[0073] FIG. 8 is a diagram illustrating an example of a function of an electronic device according to an embodiment of the present invention to transmit a selected object among avatar characters in a message. The electronic device 101 provides an avatar character generated using a 3D avatar through a keyboard application. The electronic device 101 provides an avatar character included in the keyboard application through a message transmission application. For example, as shown in FIG. 8(a), the electronic device 101 provides a screen area 810 in which an application for transmitting a message is executed. The screen area 810 includes a first area 811 for displaying message contents, a second area 812 for displaying a list of items for message creation, and a third area 813 for displaying an object included in a selected item among the items for message creation. The items for message creation include a character input item, a photo input item, a file attachment item, a voice input item, a location transmission item, or an avatar character input item.

[0074] The electronic device 101 provides a second image including at least one object reflecting a predetermined facial expression or movement as an avatar character by using a 3D avatar generated corresponding to an external object included in a first image acquired using a camera (e.g., the camera module 180 in FIG. 1). An avatar character input item for inputting the avatar character generated by the electronic device 101 is included in the items for creating a message. The electronic device 101 displays the avatar character input item 814 in the second area 812. In response to a selection of the avatar character input item 814 from the displayed item list, the electronic device 101 provides the avatar character in the third area 813.

[0075] As shown in Fig. 8(b), the electronic device 101 displays one or more objects included in a selected first avatar character 821 among one or more avatar characters in a screen area 820 where an application for transmitting a message is executed in a first area 822. The electronic device 101 provides the one or more avatar characters in a list. The one or more objects included in the first avatar character 821 include different facial expressions or movements. For example, the first object 823 includes a laughing facial expression.

[0076] 8(c), in response to a selection of a first object 831 from among at least one object displayed in a screen area 830 in which an application for transmitting a message is executed, the electronic device 101 displays a preview 832 of the first object 831 and a send button 833 in a first area 835 displaying the contents of the message. If the first object 831 is a moving image, the electronic device 101 plays the first object 831 to provide the preview 832. In response to the sending button 833 being clicked, the electronic device 101 transmits the selected first object 831 through a message.

[0077] As shown in (d) of FIG. 8, the electronic device 101 displays a selected first object 842 of the avatar characters in a first area 841 that displays the contents of the message in a screen area 840 where an application for transmitting a message is executed.

[0078] 9 illustrates an example of a function of an electronic device editing a contact using an avatar character according to an embodiment of the present invention. The electronic device 101 displays a photo item 911 and a name item 912 in an application execution screen area 910 for storing and managing contacts. The electronic device 101 displays a selected object of one or more objects included in the avatar character in the contact's photo item 911. In one embodiment, in response to receiving a phone call, the electronic device 101 provides the contact's photo item and name item to a display (e.g., display device 160 of FIG. 1 ) and displays the objects stored in the contact's photo item.

[0079] FIG. 10 is a diagram illustrating an example of a 3D avatar generated based on a 2D image including an animal's head by an electronic device according to an embodiment of the present invention. When the external object is an animal, the electronic device 101 generates a 3D avatar using a 3D template corresponding to the animal. The electronic device 101 obtains a 2D image 1001 including a mouse's head. The electronic device 101 detects attributes related to the head from the 2D image 1001 including the mouse's head. Or, the electronic device 101 transmits the 2D image 1001 to an external electronic device or server, and the external electronic device or server detects attributes related to the head. The electronic device 101, the external electronic device, or the server determines a 3D template 1002 corresponding to attributes of the mouse's head based on the attributes related to the head. The electronic device 101 receives the 3D template 1002 corresponding to the mouse from the external electronic device or server. The electronic device 101 applies attributes related to the mouse's head extracted from the 2D image 1001 to the 3D template 1002 to generate a 3D avatar 1003. For example, attributes related to the head of a mouse include at least one of the following: shape, color, relative position between each element constituting the head (eyes, eyebrows, nose, cheekbones, lips, teeth, cheeks, chin, forehead, hair, whiskers, ears, back of the head), and relative size ratio between each element. The electronic device 101 uses the information obtained by analyzing and determining the features of the animal's head to extract an external object corresponding to the animal's head from the 2D image 1001.

[0080] FIG. 11 is a diagram illustrating an example of a 3D avatar generated based on a 2D image including a character by an electronic device according to an embodiment of the present invention. When the external object is a character, the electronic device 101 generates a 3D avatar using a 3D template corresponding to the character. The electronic device 101 receives a 3D template corresponding to the character from an external electronic device or a server. The electronic device 101 obtains a 2D image 1101 including the character. For example, the character includes at least one of a cartoon character, an animal character, a plant character, a character for a specific person, a character for an object, and a movie hero character. The electronic device 101 determines a 3D template 1102 corresponding to the character. The electronic device 101 applies an attribute related to the character extracted from the 2D image 1101 to the 3D template 1102 to generate a 3D avatar 1103. For example, attributes associated with a character may include one or more of the shape and color of each feature that makes up the character (head, arms, legs, body), the relative position of each feature, the relative size of each feature, and accessories applied to each feature (hairband, bag, glasses, accessories).

[0081] FIG. 12 illustrates an example of a 3D avatar generated based on a 2D image including an object by an electronic device according to an embodiment of the present invention. The electronic device 101 obtains a 2D image 1210 including an outlet. The electronic device 101 extracts features corresponding to face-related attributes from the outlet using a facial feature extraction algorithm. In one embodiment, the electronic device 101 specifies face-related attributes from the 2D image 1210 according to user input. The electronic device 101 specifies a first feature 1201 of the outlet in the 2D image 1220 as a face feature, a second feature 1202 of the outlet as an eye, and a third feature 1203 of the outlet as a mouth according to user input. The electronic device 101 specifies a 3D template 1230 to generate a 3D avatar corresponding to the outlet. The electronic device 101 selects a 3D template similar to the outlet from one or more 3D templates, or uses a predefined 3D template. The electronic device 101 applies face-related attribute values ​​(1201, 1202, 1203) specified for the 2D image 1210 to a 3D template 1230 to generate a 3D avatar. The electronic device 101 uses the 3D avatar to generate one or more objects (1241, 1242, 1243) reflecting expression attributes associated with predetermined facial expressions. The electronic device 101 provides a 2D image 1240 including one or more objects.

[0082] 13 and 14 are diagrams illustrating examples of face-related expression attributes according to an embodiment of the present invention. An electronic device (e.g., electronic device 101 or processor 120 in FIG. 1) uses at least the face-related expression attributes to vary the facial expression of a 3D avatar. The face-related expression attributes are classified according to circumstances and are defined by components included in the face.

[0083] 13, the situations include normal, laughing 1, and laughing 2, and expression attributes corresponding to the eyes are defined by shapes, and expression attributes corresponding to the mouth are defined by shapes. In the normal situation, the electronic device 101 does not specify attributes for the eyes, and specifies an attribute value for the mouth as a semicircular shape having a rounded top. In order to generate a 3D avatar for the normal situation, the electronic device 101 applies the attribute value for the eyes extracted from the 2D image as is, and applies the attribute value for the mouth extracted from the 2D image by changing it to a semicircular shape according to the expression attributes. The electronic device 101 classifies and specifies similar situations as one situation.

[0084] 12 and 13, the outlet in Fig. 12 shows an expression corresponding to a normal situation in Fig. 13. In one embodiment, the electronic device 101 detects attributes of facial components from an image including a facial object received through the camera module 180, determines expression attributes corresponding to the attributes of the detected facial components, and transforms the 3D avatar according to the determined expression attributes. Thus, changes are detected from the facial image received in real time, and the 3D avatar 1230 is modified accordingly, thereby modifying one or more objects (1241, 1242, 1243).

[0085] Referring to FIG. 14, the electronic device 101 classifies a general situation, a basic situation (default situation), and a standby situation as one situation, and defines expression attributes corresponding to the eyes as expression attribute set 1 and expression attribute set 2. FIG. 14 shows a plurality of expression attribute sets related to the eyes, and although not shown, other components (e.g., nose, mouth, ears, etc.) also have a plurality of expression attribute sets. In one embodiment, the expression attribute sets are correlated with different components. For example, the expression attribute set 1 of the eyes is correlated with the expression attribute set 1 of the mouth, and the expression attribute set 2 of the eyes is correlated with the expression attribute set 2 of the mouth. For example, one attribute group includes expression attribute sets that are correlated with each other. For example, in the case of an avatar character 1, the corresponding attribute group 1 has a correlation including the expression attribute set 1 of the eyes and the expression attribute set 1 of the mouth.

[0086] FIG. 15 is a diagram illustrating an example of a 3D avatar generated by an electronic device using various 3D templates according to an embodiment of the present invention. The electronic device 101 generates a 3D avatar based on a 2D image including an external object. The electronic device 101 determines whether the external object included in the 2D image 1510 includes a face, and extracts the face if the external object includes a face. The electronic device 101 extracts a face region 1520 including ears, eyes, and a mouth from the external object. The electronic device 101 selects an object 1530 to which an expression attribute is applied from the face region 1520. For example, the electronic device 101 provides the extracted face region 1520 through a display (e.g., the display device 160 in FIG. 1 ) and selects eyes as an object 1530 from the displayed face region 1520 according to a user input. The electronic device 101 determines a 3D template 1540 for generating a 3D avatar. The electronic device 101 selects a 3D template 1540 that is different from the external object corresponding to the face in the 2D image 1510. For example, the electronic device 101 determines a 3D template corresponding to a 3D avatar according to a user input. If the 3D template 1540 does not include a feature corresponding to a face, the electronic device 101 selects a matching region of the 3D template 1540 to apply the face of the external object extracted from the 2D image 1510 to the 3D template 1540. The electronic device 101 determines to match the face region 1520 of the external object to a first position 1551 of the 3D template 1550. At this time, the electronic device 101 further includes an operation of displaying a candidate region where the face region 1520 of the external object matches on the 3D template 1550 and selecting the candidate region. For example, the electronic device 101 further includes an operation of determining whether the position of the candidate region 1520 of the external object satisfies a condition (e.g., the size and shape of the template) for being placed on the 3D template 1550. In one embodiment, the shape of the 3D template 1550 is deformed based on the face region 1520 of the external object to be matched.For example, the electronic device 101 determines another 3D template (not shown) that is highly similar to a portion (e.g., an ear) of the face region 1520 that does not match the first position 1551 of the 3D template 1540 and is deformed accordingly.

[0087] The electronic device 101 applies the attribute value of the face region 1520 to a first position 1551 of the 3D template 1540. The electronic device 101 displays a 3D graphic object 1560 in which the attributes of the external object 1510 are applied to the 3D template 1540. The electronic device 101 applies a predetermined expression attribute to an object selected to apply the expression attribute to in the 3D graphic object 1560. The electronic device 101 applies a smiling expression attribute to a selected eye 1571 in the 3D graphic object 1560 to generate a 3D avatar 1570. In one embodiment, when the electronic device 101 selects an object and an expression attribute to apply to the expression attribute of the 3D graphical object 1560, the electronic device 101 detects attributes of facial components from a face (e.g., a face of a person, animal, or character) image additionally received through the camera module 180, and based on this detection (e.g., attribute change detection), determines one or more objects (e.g., components of the external 3D graphical object 1560 (e.g., eyes 1571)) and expression attributes corresponding to the objects, and generates a 3D avatar 1570.

[0088] 16 and 17 are diagrams illustrating examples of attributes associated with a 3D graphical object generated based on a 2D image containing an object by an electronic device according to an embodiment of the present invention. The electronic device 101 generates graphical attributes to be applied to the 3D graphical object.

[0089] 16, the electronic device 101 acquires a 2D image 1601 including an object to be applied to a 3D graphic object. The electronic device 101 generates one or more attributes to be applied to the 3D graphic object based on the acquired 2D image using a camera (e.g., the camera module 180 of FIG. 1). The one or more attributes to be applied to the 3D graphic object include at least one of gender, race, age, attractiveness, facial expression, hair color, hair parting, hair length, cheekbones, face shape, skin color, eye position, eye size, eyebrow length, eyebrow shape, eyebrow size, nose length, nose position, nose shape, lip shape, lip color, lip length, hat, glasses, earrings, necklace, lip color, and tie style.

[0090] The electronic device 101 provides guide information for explaining an operation of generating one or more attributes to be applied to a 3D graphic object through a display (e.g., the display device 160 of FIG. 1). For example, the electronic device 101 provides a list of one or more attributes to be applied to a 3D graphic object through a display (e.g., the display device 160). The electronic device 101 provides guide information for camera shooting through a display (e.g., the display device 160) to generate an attribute selected by a user input. The electronic device 101 provides guide information such as "Put the glasses in the center of the screen when taking a picture" to generate a glasses attribute. The electronic device 101 acquires a 2D image 1601 including glasses using the camera module 180.

[0091] The electronic device 101 determines a 3D template 1602 corresponding to the glasses extracted from the 2D image 1601. In order to determine a 3D template corresponding to the object extracted from the 2D image 1601, the electronic device 101 requests and receives at least one 3D template related to the object extracted from the 2D image 1601 from an external electronic device or server. For example, the electronic device 101 obtains a 3D template by searching for a name of the object. The electronic device 101 extracts attributes related to the glasses based on the glasses extracted from the 2D image 1601, and applies the extracted attribute value of the glasses to the 3D template 1602 to generate a graphic attribute 1603. The electronic device 101 displays the generated graphic attribute 1603 in a graphic attribute list area. The electronic device 101 applies the generated graphic attribute 1603 to a 3D graphic object 1604 to provide a preview to a user, and displays the graphic attribute 1603. The electronic device 101 provides a function of modifying or deleting the generated graphic attribute 1603. The electronic device 101 acquires another 2D image using the camera module 180 to modify the generated graphical attributes 1603. The electronic device 101 modifies the 3D template 1602 corresponding to the glasses to modify the generated graphical attributes 1603.

[0092] Referring to FIG. 17, the electronic device 101 obtains a 2D image 1701 including attributes to be applied to a 3D graphic object. The electronic device 101 extracts attributes from the 2D image 1701. The attributes to be applied to the 3D graphic object include color, pattern, or shape. For example, the attribute is a red check pattern. The electronic device 101 selects a 3D template 1702 to which the attributes extracted from the 2D image 1701 are applied. The electronic device 101 selects a 3D template 1702 corresponding to a jacket, and applies the extracted attributes to the selected 3D template 1702 to generate graphic attributes 1703. The electronic device 101 provides the generated graphic attributes 1703 through a display (e.g., the display device 160), and when the graphic attributes 1703 are selected, the electronic device 101 applies the graphic attributes 1703 to a 3D graphic object 1704 and displays it.

[0093] FIG. 18 is a diagram illustrating an example of a 3D avatar generated based on a 2D image including an external object corresponding to a face and an additional object by an electronic device according to an embodiment of the present invention. The electronic device 101 extracts one or more external objects (1811, 1812, 1813) included in the 2D image 1810. The electronic device 101 determines whether the extracted one or more external objects (1811, 1812, 1813) correspond to a face. For example, the electronic device 101 determines that the first external object 1811 and the second external object 1812 correspond to a human face, and the third external object 1813 does not correspond to a face. The electronic device 101 generates a 3D avatar including an external object that does not correspond to a face. The electronic device 101 determines whether the one or more external objects are included in a predetermined additional object. The additional object indicates an object that does not correspond to a face but is included in the 3D avatar, such as a landmark, a character, or an object specified by a user. If one or more external objects included in the 2D image correspond to a landmark, character, or object specified by the user, the electronic device 101 generates a 3D avatar that includes the external objects.

[0094] Referring to FIG. 18, a 2D image 1810 includes two people and the Eiffel Tower. The electronic device 101 determines the Eiffel Tower as an additional object and generates a 3D avatar including the Eiffel Tower. The electronic device 101 generates a 3D avatar 1820 including a first external object 1811 corresponding to a face, a second external object 1812 corresponding to a face, and an external object 1813 corresponding to an additional object among one or more external objects (1811, 1812, 1813). The electronic device 101 generates respective 3D graphic objects based on the first external object 1811, the second external object 1812, and the third external object 1813, and determines graphic attributes to be applied to the 3D graphic objects to generate the 3D avatar 1820. The electronic device 101 applies an avatar facial expression, an avatar gesture, a background screen, or an animation effect to at least one of the first external object 1811, the second external object 1812, and the third external object 1813 to generate a 3D avatar 1820. For example, the electronic device 101 applies a surprised facial expression to the first external object 1811, applies a finger heart body gesture to the second external object 1812, or adjusts the size of the third external object 1813.

[0095] 19A and 19B are diagrams illustrating an example of an operation of an electronic device generating an image including multiple 3D avatars based on multiple external objects according to an embodiment of the present invention. FIG. 20 is a diagram illustrating an example of expression attributes for a 3D avatar according to an embodiment of the present invention. The electronic device 101 selects one or more external objects corresponding to a face based on a 2D image including multiple external objects, and generates a 3D avatar corresponding to the selected external objects.

[0096] First, referring to FIG. 19A , the electronic device 101 obtains a 2D image 1910 including three faces. The electronic device 101 extracts one or more external objects from the 2D image 1910 and determines whether the extracted external objects correspond to the faces. The electronic device 101 displays an identifier (e.g., a dotted rectangle) indicating the external objects (1911, 1912, 1913) corresponding to the extracted faces in the 2D image 1920. The electronic device 101 sequentially generates 3D avatars for the first external object 1911, the second external object 1912, and the third external object 1913 corresponding to the faces. The electronic device 101 uses the one or more 3D avatars to generate multiple 3D avatars corresponding to multiple external objects. The electronic device 101 provides one or more 3D avatars through a display (e.g., the display device 160) to select a 3D avatar corresponding to the external object, and determines that the 3D avatar selected by the user input corresponds to the external object. In response to a first external object 1931 being selected from among the multiple external objects by a user input received via the input device 150, the electronic device 101 displays an identifier (e.g., a circular shape) indicating the selected first external object 1931 in the 2D image 1930. The electronic device 101 displays one or more 3D avatars 1935 corresponding to the selected first external object 1931. The one or more 3D avatars 1935 include an animal 3D set 19341 related to animals and a female set 19352 related to female heroes according to categories. One category includes an associated character's set of expression attributes, which includes a context-corresponding subset of expression attributes (e.g., expression attribute set (eyes)) for each of the character's components (e.g., body, eyes, nose, mouth, hands, feet).

[0097] The electronic device 101 selects and displays a first 3D avatar 1942 corresponding to a first external object 1941 from among the one or more 3D avatars in the 2D image 1940. The electronic device 101 generates the first 3D avatar reflecting an expression corresponding to a situation of at least one of the faces and body gestures based on at least one of attributes related to the face and body gestures of the first external object 1941.

[0098] Referring to Fig. 20, one or more 3D avatars include predetermined expression attributes related to facial expressions according to a predetermined situation. The electronic device 101 defines one or more situations and defines expression attributes related to facial expressions of the 3D avatars according to the situation. The expression attributes of the 3D avatars include shapes and movements for the eyes, nose, or mouth corresponding to the face, and shapes and movements for the head, ears, arms, legs, or abdomen corresponding to features other than the face. For example, the electronic device 101 defines a general situation 2011 and defines expression attributes (2021, 2031) for one or more avatars.

[0099] 19B , the electronic device 101 generates a first 3D avatar reflecting attributes of a laughing expression in response to the laughing expression of the first external object 1951. In response to the selection of the first 3D avatar 1952 corresponding to the first external object 1951 in the 2D image 1950, the electronic device 101 recommends a 3D avatar 1955 belonging to the same category as the first 3D avatar 1952 for generating a 3D avatar corresponding to another external object. For example, if the first 3D avatar 1952 belongs to a category related to animals, the electronic device 101 displays a 3D avatar 1955 including an animal 3D set.

[0100] The electronic device 101 selects a second 3D avatar 1962 corresponding to the second external object 1961 selected from the 2D image 1960, which in turn selects a third 3D avatar 1972 corresponding to the third external object 1971 selected from the 2D image 1970. The electronic device 101 generates an image 1980 including 3D avatars (1981, 1982, 1983) that apply selected facial attributes based on facial associated attributes of the multiple external objects to the multiple 3D avatars (1952, 1962, 1972) selected corresponding to the multiple external objects (1951, 1961, 1971).

[0101] In one embodiment, when there are multiple external objects, the electronic device 101 determines the 3D avatar 1955 to be recommended and displayed for the other selected external objects according to the facial expression attributes of the selected external objects and the selected avatar category. For example, when a first person has a laughing expression and a second person has a crying expression, when selecting an external object corresponding to a third person, the facial expression characteristics of the recommended 3D avatar 1955 include the 3D avatar corresponding to laughing or crying among the characters included in the same category.

[0102] 21 is a diagram illustrating an example of an operation of an electronic device according to an embodiment of the present invention generating a 3D avatar using a video call function, and FIG. 22 is a diagram illustrating an example of an operation of an electronic device according to an embodiment of the present invention sharing a 3D avatar with a video call partner electronic device. The electronic device 101 provides a video call function and generates a 3D avatar for an external object corresponding to a face among external objects displayed on a video call screen. The electronic device 101 shares the 3D avatar with the electronic device of the video call partner.

[0103] Referring to (a) of FIG. 21, the electronic device 101 executes a video call function, and when the video call is connected, a video call screen 2101 is displayed. The electronic device 101 extracts one or more external objects (2110, 2120) from the displayed video call screen 2101 and determines whether the extracted external objects correspond to a face. The electronic device 101 sequentially generates 3D avatars corresponding to the first external object 2110 and the second external object 2120. Referring to (b) of FIG. 21, the electronic device 101 displays one or more 3D avatars 2130 in response to a selection for the second external object 2120. Referring to (c) of FIG. 21, the electronic device 101 determines that the first 3D avatar 2131 selected by a user's input corresponds to the second external object 2120. Referring to FIG. 21(d), in response to a selection of the first external object 2110, the electronic device 101 displays one or more 3D avatars 2140 selected based on the first 3D avatar.

[0104] The electronic device 101 determines that the selected second 3D avatar 2132 of the one or more 3D avatars 2140 corresponds to the first external object 2110. In one embodiment, the electronic device 101 transmits the one or more 3D avatars 2140 selected based on the first 3D avatar to the other electronic device in response to the selection of the first external object 2110. The other electronic device receives the one or more 3D avatars 2140 selected based on the first 3D avatar transmitted by the electronic device 101, displays them on the video call screen 2210, and performs an operation of selecting one of them (e.g., the 3D avatar 2132). The electronic device 101 receives a signal corresponding to the 3D avatar 2132 selected by the other electronic device.

[0105] In one embodiment, based on the category or facial expression attributes of a 3D avatar 2131 selected corresponding to a selected external object 2120, the electronic device 101 determines and displays a 3D avatar 2130 of the same category or facial expression attributes corresponding to a subsequently selected external object 2110.

[0106] Referring to (e) of FIG. 21, the electronic device 101 displays and provides 3D avatars (2111, 2121) corresponding to external objects on the video call screen.

[0107] 22(a), when the electronic device 101 makes a video call with a counterpart electronic device, the electronic device 101 displays an external object 2211 corresponding to the user and an external object 2212 corresponding to the counterpart on a video call screen 2210 of the electronic device 101, and displays an external object 2221 corresponding to the counterpart and an external object 2222 corresponding to the user on a video call screen 2220 of the counterpart electronic device. At this time, the counterpart electronic device also selects an external object, and displays and selects a corresponding 3D avatar. The electronic device 101 transmits the indicator and 3D avatar displayed for this purpose to the counterpart electronic device.

[0108] 22(b), the electronic device 101 generates 3D avatars corresponding to an external object 2211 corresponding to the user and an external object 2212 corresponding to the other party. The electronic device 101 displays the generated 3D avatars (2231, 2232) on a video call screen 2230 and transmits the 3D avatars (2231, 2232) to the other party's electronic device. The other party's electronic device displays the received 3D avatars (2241, 2242) on a video call screen 2240.

[0109] An electronic device (e.g., electronic device 101 of FIG. 1) according to one embodiment of the present invention includes a camera (e.g., camera module 180 of FIG. 1), a display (e.g., display device 160 of FIG. 1), and a processor (e.g., processor 120 of FIG. 1), in which processor 120 uses camera module 180 to acquire a first image of one or more external objects, provides through display device 160 a 3D graphical object generated based on attributes associated with the external objects corresponding to faces of the one or more external objects included in the first image, generates a 3D avatar for the external object based at least on at least one selected graphical attribute of a plurality of graphical attributes applied to the 3D graphical object and the 3D graphical object, and generates a second image including at least one object reflecting a specified facial expression or action using the 3D avatar.

[0110] In one embodiment, as at least a part of the operation of generating the 3D graphic object, the processor 120 determines a 3D template including at least one attribute corresponding to the external object, extracts an attribute related to the external object from the first image, and applies the extracted attribute to at least one corresponding attribute of the 3D template to generate the 3D graphic object. In one embodiment, as at least a part of the operation of extracting an attribute related to the external object from the first image, the processor 120 extracts at least one element constituting a face from the first image and checks the shape, color, relative position between each element, relative size ratio between each element, or attribute value for each element's accessory. In one embodiment, the processor 120 applies a predetermined attribute to the 3D template for an attribute of the 3D template that is not related to the extracted attribute to generate the 3D graphic object. In one embodiment, the processor 120 determines a 3D template different from the external object corresponding to the face. In one embodiment, the object is determined in response to an avatar's facial expression, an avatar's gesture, a background image, or an animation effect, and the processor 120 generates at least one object reflecting a specified value for at least one of the avatar's facial expression, the avatar's gesture, the background image, and the animation effect using the 3D avatar as at least a part of the operation of generating a second image including at least one object reflecting a specified facial expression or movement using the 3D avatar. In one embodiment, the processor 120 causes at least one configuration corresponding to a face by a user input to correspond to a configuration of the first external object for a first external object of the one or more external objects. In one embodiment, the processor 120 generates the graphic attribute based on a first external object of the one or more external objects that satisfies a predetermined condition. In one embodiment, the processor 120 determines a 3D template corresponding to the first external object or a predetermined 3D template by a user input, and applies the attribute of the first external object to the determined 3D template to generate the graphic attribute.In one embodiment, the processor 120 selects additional objects from the one or more external objects that do not correspond to a face, and generates a 3D avatar including the selected additional objects. In one embodiment, the processor 120 transmits the generated second image to an external electronic device. In one embodiment, the first image corresponds to a 2D image and the second image corresponds to a still or dynamic 2D image.

[0111] An electronic device (e.g., electronic device 101 in FIG. 1 ) according to an embodiment of the present invention includes a camera (e.g., camera module 180 in FIG. 1 ) and a processor (e.g., processor 120 in FIG. 1 ). The processor 120 obtains a first image of one or more external objects using the camera module 180, selects a 3D avatar corresponding to the external object among the one or more 3D avatars based on an external object corresponding to a face among the one or more external objects included in the first image, and generates a second image including an object generated using the 3D avatar reflecting an expression corresponding to the face of the external object. The electronic device according to the present embodiment further includes a communication module (e.g., communication module 190 in FIG. 1 ), and the processor 120 receives one or more 3D avatars through the communication module 190. In one embodiment, the processor 120 reflects a first expression attribute selected based on an expression corresponding to the face of the external object among expression attributes associated with a predetermined facial expression corresponding to one or more situations, in the 3D avatar. In one embodiment, the expression attribute associated with the predetermined facial expression corresponding to one or more situations is defined to correspond to an eye, a nose, or a mouth. In one embodiment, the object includes an avatar's facial expression, an avatar's gesture, a background screen, or an animation effect. In one embodiment, the processor receives video data including a 3D avatar of a partner based on the start of a video call with the partner, and displays the 3D avatar and the partner's 3D avatar on one screen during the video call.

[0112] An electronic device (e.g., electronic device 101 of FIG. 1) according to an embodiment of the present invention includes a camera (e.g., camera module 180 of FIG. 1) and a processor (e.g., processor 120 of FIG. 1). The processor 120 obtains a first image of one or more external objects using the camera module 180 and checks whether the one or more external objects included in the first image include an external object corresponding to a face. As a result, the processor 120 is configured to generate a 3D avatar based on attributes related to the external object if the one or more external objects included in the first image include an external object corresponding to a face, and not to perform an operation of generating a 3D avatar if the one or more external objects included in the first image do not include an external object corresponding to a face. The electronic device according to the present embodiment further includes a display (e.g., display device 160 of FIG. 1), and the processor 120 provides whether the one or more external objects include an external object corresponding to a face through the display 160.

[0113] In the above detailed description of the present invention, specific embodiments have been described, but it is clear to those skilled in the art that various modifications are possible without departing from the technical scope of the present invention. Therefore, the present invention is not limited to the above-described embodiments, but is defined based on the claims and their equivalents. [Explanation of symbols]

[0114] 100 Network Environment 101, 102, 104 Electronic equipment 108 Server 120 processors 121 Main Processor 123 Auxiliary Processor 130 Memory 132 Volatile Memory 134 Non-volatile memory 136 Internal Memory 138 External Memory 140 Programs 142 Operating Systems 144 Middleware 146 Applications 150 Input Device 155 Audio output device 160 Display device 170 Audio Module 176 Sensor Module 177 Interface 178 Connection terminal 179 Haptic Module 180 Camera Module 188 Power Management Module 189 Battery 190 Communication Module 192 Wireless communication module 194 Wired communication module 196 Subscriber Identity Module 197 Antenna Module 198 The First Network 199 Second Network 301, 311, 331 Preview screen area 302, 304, 312, 322, 323, 332, 333, 343, 352, 411, 412 Icons 303 3D Avatar List 321 Face Image 334, 413 Selection bar 341, 540, 1003, 1103, 1570, 1820, 1935, 1942, 1952, 1955, 1962, 1972, 1981, 1982, 1983, 2111, 2121, 2130, 2131, 2132, 2140, 2231, 2232, 2241, 2242 3D Avatars 342 Avatar List Area 351, 353, 611, 811, 812, 813, 822, 835, 841 area 354, 355, 620, 731, 823, 831, 842, 1241, 1242, 1243 Objects 410, 420, 430, 440, 450, 460, 470 screen 451 Hairstyle List 452 Hair Color List 461 Glasses Accessories List 471 3D Avatar Costume List 510, 1001, 1101, 1210, 1220, 1240, 1510, 1601, 1701, 1810, 1910, 1920, 1930, 1940, 1950, 1960, 1970 2D Images 511, 1510, 1811, 1812, 1813, 1911, 1912, 1913, 1931, 1941, 1951, 1961, 1971, 2110, 2120, 2211, 2212, 2222 External Objects 521, 522, 1571 eyes 523 Nose 524 Lips 530, 1002, 1102, 1230, 1540, 1550, 1602, 1702 3D Templates 610, 821 Avatar Character 621 Avatar 622 Background screen 623 Additional Objects 710, 720, 730 Photo editing screen 711, 721, 1551 positions 810, 820, 830, 840 screen area 814 Avatar Character Input Item 832 Preview 833 Send button 910 Application execution screen area 911 Photo Items 912 Name Items 1201, 1202, 1203 Configuration (attribute value) 1520 Face Area 1530 Target 1560, 1604, 1704 3D graphic objects 1603, 1703 Graphic Attributes 1980 Image 2011 General Situation 2021, 2031 Expression attributes 2101, 2210, 2220, 2230, 2240 video call screen 3541 Frowning Face 3542 Gesture 3543 Cloud Background 19341 Animal 3D Set 19352 Women's Set

Claims

1. 1. An electronic device comprising: a touch screen display and at least one processor; The at least one processor displaying an execution screen of a message application via the touch screen display, the execution screen of the message application including a plurality of icons each associated with a content sent to the other party; obtaining a first user input for a first icon of the plurality of icons on an execution screen of the message application; displaying at least one 3D face template, including a first 3D face template, on an execution screen of the message application based on obtaining the first user input; generating a first 3D avatar in response to a second user input received via an execution screen of the messaging application, the first 3D avatar including an animation effect based on the first 3D face template and the user's moving facial expressions; an icon configured to receive a user input for sending the first 3D avatar to the other person and a preview showing the animation effect of the first 3D avatar are displayed on an execution screen of the message application, and the icon is displayed while the preview for the first 3D avatar is displayed; obtaining a third user input for the icon on the running screen of the message application while the preview for the first 3D avatar is displayed on the running screen of the message application; and transmitting the first 3D avatar to the other person based on obtaining the third user input; An electronic device, characterized in that the execution screen of the message application is configured to enable the moving facial expression of the user applied to the first 3D avatar to be applied to a second 3D avatar different from the first 3D avatar.

2. 2. The electronic device of claim 1, wherein the at least one processor is further configured to display a virtual keyboard on the execution screen of the message application after the second 3D avatar is sent to the other party.

3. 2. The electronic device of claim 1, wherein the at least one processor is further configured to display the second 3D avatar on the execution screen of the message application in response to sending the second 3D avatar to the other party.

4. 1. A method for controlling an electronic device, comprising: displaying, via a touch screen display of the electronic device, an execution screen of a message application, the execution screen of the message application including a plurality of icons each associated with a content sent to the other party; obtaining, on an execution screen of the message application, a first user input for a first icon of the plurality of icons; displaying at least one 3D face template, including a first 3D face template, on an execution screen of the message application based on obtaining the first user input; generating a first 3D avatar in response to a second user input received via an execution screen of the messaging application, the first 3D avatar including an animation effect based on the first 3D face template and the user's moving facial expressions; an icon configured to receive user input for sending the first 3D avatar to the other person on an execution screen of the message application; an operation of displaying a preview showing the animation effect of the first 3D avatar; and displaying the icon while the preview for the first 3D avatar is displayed; obtaining a third user input for the icon on a running screen of the message application while a preview for the first 3D avatar is displayed on the running screen of the message application; transmitting the first 3D avatar to the other person based on obtaining the third user input; A method for controlling an electronic device, characterized in that the execution screen of the message application is configured to enable the moving facial expression of the user applied to the first 3D avatar to be applied to a second 3D avatar different from the first 3D avatar.

5. The method of controlling an electronic device according to claim 4, further comprising the step of displaying a virtual keyboard on the execution screen of the message application after the second 3D avatar is sent to the other party.

6. 1. An electronic device comprising: A touch screen display, and At least one processor; The at least one processor displaying an execution screen of a message application via the touch screen display, the execution screen of the message application including a plurality of icons each associated with a content sent to the other party; obtaining a first user input for a first icon of a plurality of icons on an execution screen of the message application; Displaying at least one 3D face template, including a first 3D template, on an execution screen of the message application based on obtaining the first user input; generating a first 3D avatar reflecting the first 3D template and the user's animated facial expressions in response to a second user input received via an execution screen of the messaging application; a send button configured to receive a user input for sending the first 3D avatar to the other party and a preview showing an animation effect of the first 3D avatar are displayed on an execution screen of the message application, the send button being displayed while the preview of the first 3D avatar is being displayed; obtaining a third user input on the execution screen of the message application for the send button while the preview of the first 3D avatar is displayed on the execution screen of the message application; and transmitting the first 3D avatar to the other person based on obtaining the third user input; 13. An electronic device, comprising: a first 3D avatar having a first animated facial expression; a second 3D avatar having a second animated facial expression;

Images