Electronic device and control method therefor

Abstract

This electronic device comprises: a memory for storing at least one instruction; a display; and at least one processor for executing the at least one instruction. The at least one processor: generates a first notification screen including notification information when a notification event for providing the notification information to a user is identified; acquires at least one of characteristic information or environment information at a point in time when the notification event is generated; identifies a motion to be undertaken by a 3D character on the basis of at least one of the notification information, the characteristic information, or the environment information; generates a second notification screen including the notification information and the 3D character undertaking the motion; and controls the display to display the second notification screen.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device that provides notification information together with a 3D character and a control method thereof.

[0002] Home appliances can provide users with a variety of information. Notifications can be provided through displays or speakers. When notifications are simply presented as text, users often have difficulty understanding them or find them difficult to read.

[0003] Home appliances with touchscreens can be difficult to operate, depending on the user's age. It can be difficult to accurately determine where to touch on the touchscreen.

[0004] When providing guidance information for operating a home appliance that includes a touch screen, users who are not proficient in using the home appliance may not be able to use certain functions even if they have received guidance information.

[0005] When home appliances connect to an Internet of Things (IoT) network, they can provide information about external devices. However, the problem is that it's difficult to easily determine the location of external devices.

[0006] The present disclosure is designed to improve the above-described problems, and an object of the present disclosure is to provide an electronic device and a control method thereof that provides a 3D character of a specific motion together with notification information to improve user convenience.

[0007] According to one embodiment, an electronic device includes a memory storing at least one command, a display, and at least one processor executing the at least one command, wherein the at least one processor, when a notification event for providing notification information to a user is identified, generates a first notification screen including the notification information, acquires at least one of characteristic information or environment information at the time when the notification event occurs, identifies a motion to be taken by a 3D character based on at least one of the notification information, the characteristic information, or the environment information, generates a second notification screen including the notification information and the 3D character taking the motion, and controls the display to display the second notification screen.

[0008] The above notification information may include at least one of guide information related to the electronic device and UI (User Interface) information representing the guide information.

[0009] When the notification event is identified, the at least one processor can identify a screen context corresponding to the notification information among a plurality of contexts, and identify a motion corresponding to the screen context among a plurality of motions.

[0010] The at least one processor may identify a motion in which the 3D character suggests the specific action, if the notification information includes text requesting the user to perform the specific action.

[0011] The at least one processor, when the notification event is identified, can obtain the characteristic information including at least one of a function or a state, identify a characteristic context corresponding to the characteristic information among a plurality of contexts, and identify a motion corresponding to the characteristic context among a plurality of motions.

[0012] The at least one processor can identify a motion in which the 3D character performs the specific function if the characteristic information includes information for performing the specific function.

[0013] A communication interface is included, and the at least one processor, when the notification event is identified, acquires the environmental information related to a network connected to the electronic device through the communication interface, identifies an external environmental context corresponding to the environmental information among a plurality of contexts, and identifies a motion corresponding to the external environmental context among a plurality of motions.

[0014] The at least one processor may identify a motion of the 3D character indicating a location of the external device, if the environmental information includes information that provides a notification related to an external device connected to the network.

[0015] The at least one processor can identify a first area in which the notification information is displayed in the entire area of ​​the first notification screen, identify a second area excluding the first area in the entire area, and generate the second notification screen in which the 3D character making the motion is displayed in the second area.

[0016] A communication interface is included, and the at least one processor can identify a user account of the user, receive information related to the 3D character corresponding to the user account through the communication interface, and generate a second notification screen including the 3D character taking the motion based on the information related to the 3D character.

[0017] According to one embodiment, a method for controlling an electronic device includes the steps of: when a notification event for providing notification information to a user is identified, generating a first notification screen including the notification information; acquiring at least one of characteristic information or environment information at a time when the notification event occurs; identifying a motion to be taken by a 3D character based on at least one of the notification information, the characteristic information, or the environment information; generating a second notification screen including the notification information and the 3D character taking the motion; and displaying the second notification screen.

[0018] The above notification information may include at least one of guide information related to the electronic device and UI (User Interface) information representing the guide information.

[0019] The step of identifying the above motion may include, when the above notification event is identified, identifying a screen context corresponding to the notification information among a plurality of contexts, and identifying a motion corresponding to the screen context among a plurality of motions.

[0020] The step of identifying the above motion may include identifying a motion in which the 3D character suggests the specific action, if the notification information includes text requesting a specific action from the user.

[0021] The step of identifying the motion may include, when the notification event is identified, obtaining the characteristic information including at least one of a function or a state, identifying a characteristic context corresponding to the characteristic information among a plurality of contexts, and identifying a motion corresponding to the characteristic context among a plurality of motions.

[0022] The step of identifying the above motion can identify a motion in which the 3D character performs the specific function if the characteristic information includes information for performing a specific function.

[0023] The step of identifying the motion may include, when the notification event is identified, obtaining the environmental information related to the network connected to the electronic device, identifying an external environmental context corresponding to the environmental information among a plurality of contexts, and identifying a motion corresponding to the external environmental context among a plurality of motions.

[0024] The step of identifying the above motion may include, if the environmental information includes information providing a notification related to an external device connected to the network, identifying a motion in which the 3D character indicates the location of the external device.

[0025] The step of generating the second notification screen may include identifying a first area in which the notification information is displayed in the entire area of ​​the first notification screen, identifying a second area excluding the first area in the entire area, and generating the second notification screen in which the 3D character taking the motion is displayed in the second area.

[0026] The control method further includes a step of identifying a user account of the user and a step of receiving information related to the 3D character corresponding to the user account, and the step of generating the second notification screen may generate a second notification screen including the 3D character taking the motion based on the information related to the 3D character.

[0027] FIG. 1 is a drawing for explaining an operation of providing a notification screen according to one embodiment.

[0028] FIG. 2 is a block diagram illustrating an electronic device according to one embodiment.

[0029] FIG. 3 is a block diagram illustrating a specific configuration of the electronic device of FIG. 2, according to one embodiment.

[0030] FIG. 4 is a drawing for explaining an operation of providing a notification screen including a 3D character according to one embodiment.

[0031] FIG. 5 is a drawing for explaining an operation of providing a notification screen including a 3D character according to one embodiment.

[0032] FIG. 6 is a diagram for explaining a screen context according to one embodiment.

[0033] FIG. 7 is a diagram for explaining a characteristic context according to one embodiment.

[0034] FIG. 8 is a diagram for explaining an external environmental context according to one embodiment.

[0035] FIG. 9 is a drawing for explaining an operation of identifying the motion of a 3D character corresponding to a notification event, according to one embodiment.

[0036] FIG. 10 is a diagram illustrating an operation of generating a second notification screen including notification information and a 3D character taking motion, according to one embodiment.

[0037] FIG. 11 is a drawing for explaining an operation of identifying the motion of a 3D character corresponding to a screen context, according to one embodiment.

[0038] FIG. 12 is a diagram illustrating an operation for identifying a motion of a 3D character corresponding to a characteristic context, according to one embodiment.

[0039] FIG. 13 is a drawing for explaining an operation of identifying the motion of a 3D character corresponding to an external environmental context, according to one embodiment.

[0040] FIG. 14 is a drawing illustrating a 3D character in motion requesting a specific action, according to one embodiment.

[0041] FIG. 15 is a drawing illustrating a 3D character in motion pointing to a location of a specific hardware configuration, according to one embodiment.

[0042] FIG. 16 is a drawing for explaining a 3D character of a motion pointing to the position of an external device, according to one embodiment.

[0043] FIG. 17 is a drawing for explaining a notification screen including map information according to one embodiment.

[0044] FIG. 18 is a diagram for explaining an operation of requesting communication environment information according to one embodiment.

[0045] FIG. 19 is a diagram illustrating an operation of identifying a 3D character corresponding to a user account according to one embodiment.

[0046] FIG. 20 is a drawing for explaining an operation of identifying a 3D character corresponding to user information, according to one embodiment.

[0047] FIG. 21 is a drawing for explaining an operation of creating a 3D character according to one embodiment.

[0048] FIG. 22 is a drawing for explaining an operation for generating motion of a 3D character according to one embodiment.

[0049] FIG. 23 is a drawing for explaining the structure of a second notification screen according to one embodiment.

[0050] FIG. 24 is a drawing for explaining an operation for determining the motion of a 3D character according to one embodiment.

[0051] FIG. 25 is a drawing for explaining a notification screen including a 3D character according to one embodiment.

[0052] FIG. 26 is a drawing for explaining a notification screen including a 3D character according to one embodiment.

[0053] FIG. 27 is a diagram for explaining an operation for determining context according to one embodiment.

[0054] FIG. 28 is a drawing for explaining an operation of judging a physical element according to one embodiment.

[0055] FIG. 29 is a diagram for explaining an operation of determining information related to an external environment according to one embodiment.

[0056] FIG. 30 is a drawing for explaining a method for controlling an electronic device according to one embodiment.

[0057] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0058] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0059] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0060] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0061] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0062] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0063] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0064] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor, excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0065] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0066] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0067] FIG. 1 is a drawing for explaining an operation of providing a notification screen according to one embodiment.

[0068] Referring to FIG. 1, the electronic device (100) may include a display. The electronic device (100) may provide (or output) a notification screen to a user through the display.

[0069] A notification screen can be a screen designed to provide specific information to the user. For example, a notification screen can display information that needs to be communicated to the user or include information that guides the user to take a specific action.

[0070] The electronic device (100) may provide a notification screen including a 3D character. The 3D character may be a virtual object displayed in a virtual space. The 3D character may be implemented using computer technology to represent a person or living being in a virtual space, thereby providing a realistic sense of space or movement.

[0071] 3D characters can be replaced by 2D characters, character objects, avatars, 2D avatars, 3D avatars, etc.

[0072] 3D characters can perform a variety of motions. Motions can be described as gestures.

[0073] The motion taken by the 3D character may be determined based on at least one of the notification information included in the notification screen or other various information (e.g., characteristic information, communication environment information, etc.).

[0074] In FIG. 1, the 3D character is described as being displayed in a separate area from the content (or text) displayed on the notification screen. In various embodiments, the 3D character may be displayed overlapping the content (or text) displayed on the notification screen. When overlapping occurs, either the content or the 3D character may be displayed blurry (with the transparency adjusted).

[0075] How to determine the motion of a 3D character is explained below.

[0076] FIG. 2 is a block diagram illustrating an electronic device (100) according to one embodiment.

[0077] Referring to FIG. 2, the electronic device (100) may include at least one of a memory (110), at least one processor (120), a communication interface (130), or a display (140).

[0078] The electronic device (100) may include various devices including a display. The electronic device (100) may be an electronic whiteboard, a TV, a desktop PC, a laptop, a smartphone, a tablet PC, a server, etc. The above-described examples are merely examples for describing the electronic device and are not necessarily limited to the above-described devices.

[0079] The memory (110) can store at least one command. The memory (110) can store various information used to identify the motion of a 3D (3-dimensional) character. The memory (110) can store the motions of multiple 3D characters. The memory (110) can store a table that stores specific motions corresponding to specific contexts. A description related to this is described in FIGS. 6 to 8.

[0080] The display (140) can display at least one of the first notification screen or the second notification screen. Specific information can be provided to the user through the display (140).

[0081] At least one processor (120) can execute at least one instruction. At least one processor (120) can perform general operations of the electronic device (100) by executing at least one instruction. At least one processor (120) can control at least one hardware component included in the electronic device (100). Operations performed by at least one processor (120) are described. Operations performed by at least one processor (120) can be described as being performed by the electronic device (100).

[0082] At least one processor (120) can identify a notification event. A notification event may represent an event that provides a notification on the electronic device (100). The notification may include a notification message, a notification image, notification audio, etc. For example, a notification event may include an event that displays a warning message, an event for conveying information, etc.

[0083] A notification event can be an event that delivers notification information to the user. Notification information can represent information provided to the user.

[0084] At least one processor (120) can identify whether a notification event has occurred. When a notification event for providing notification information to a user is identified, the at least one processor (120) can generate a first notification screen including the notification information. The first notification screen may be a screen generated based on the notification information provided to the user. The first notification screen may be a screen including the notification information. The first notification screen may be an image including the notification information. The notification information may include at least one of notification content, notification text, notification image, and notification audio. The first notification screen may be a screen that does not include a 3D character.

[0085] At least one processor (120) may provide notification information along with a 3D character when a notification event is identified. At least one processor (120) may provide a new 3D character to the user along with the first notification screen.

[0086] In one embodiment, at least one processor (120) may control the display (140) to display a first notification screen and a 3D character.

[0087] In one embodiment, at least one processor (120) may combine the first notification screen and the 3D character to generate a second notification screen, and control the display (140) to display the second notification screen.

[0088] At least one processor (120) can identify a 3D character.

[0089] In one embodiment, the 3D character may be a preset virtual character. The 3D character may be described as a 3D avatar, 3D emoji, 3D emoticon, 3D object, etc. A 2D representation may be applied instead of a 3D representation.

[0090] In one embodiment, the 3D character may vary depending on the user account. The user account may be stored in the electronic device (100) or may be input. At least one processor (120) may identify the 3D character corresponding to the user account.

[0091] Since 3D characters are virtual, they can assume various motions. At least one processor (120) can identify a motion appropriate for the current situation among multiple motions. At least one processor (120) can identify a motion corresponding to a notification event. At least one processor (120) can identify a motion corresponding to notification information. At least one processor (120) can identify a motion corresponding to the first notification screen.

[0092] At least one processor (120) may acquire at least one of characteristic information or environmental information at the time a notification event occurs. At least one processor (120) may identify a motion to be taken by a 3D character based on at least one of the notification information, characteristic information, or environmental information.

[0093] The characteristic information may include at least one of device function information or device status information. The function information may be information indicating a function that the device currently provides (or can provide). The status information may be information indicating the current status of the device. The device may include at least one of an electronic device (100) or an external device (400) connected to an IoT network (200). The characteristic information may be described as function information, status information, attribute information, etc.

[0094] For example, when a notification event occurs, at least one processor (120) can obtain the function that the current electronic device (100) is performing (or executing) as characteristic information.

[0095] For example, when a notification event occurs, at least one processor (120) can obtain information related to the current state of the electronic device (100) (power saving state, degree of performance of a specific function) as characteristic information.

[0096] The environmental information may include at least one of information related to communication of the electronic device (100) itself or information related to communication of an external network connectable to the electronic device (100). The environmental information may include information on a communication method to which the electronic device (100) can connect (or perform).

[0097] For example, when a notification event occurs, at least one processor (120) can obtain information about the communication methods that the electronic device (100) can execute. The at least one processor (120) can obtain information indicating whether the electronic device (100) can connect to the Internet, information indicating whether the electronic device (100) can perform a Bluetooth function, information indicating whether the electronic device (100) can perform a Wi-Fi function, and the like.

[0098] For example, when a notification event occurs, at least one processor (120) can obtain information indicating whether the electronic device (100) can connect to an IoT (Internet of Things) network (200), information indicating a list of IoT devices that can connect to the IoT network (200), etc.

[0099] The environmental information may include information about an external device (400) included in the IoT network (200). Since the environmental information includes information about the external device (400), the environmental information may be described as external environmental information. The IoT network (200) may be a network to which the electronic device (100) can connect. The IoT network (200) may be a local network including the electronic device (100) and the external device (400). At least one processor (120) may identify a notification event for the external device (400). At least one processor (120) may identify a notification event related to the external device (400).

[0100] For example, assume that the electronic device (100) is a refrigerator and the external device (400) is a washing machine. Assume that the washing machine displays a notification message indicating that the washing process is complete on the refrigerator. At least one processor (120) can obtain information indicating that the washing process of the washing machine is complete via the IoT network (200). At least one processor (120) can identify that a notification event has occurred. At least one processor (120) can receive information indicating that the washing process of the washing machine is complete and environmental information including relative position information of the washing machine. At least one processor (120) can receive the environmental information via the IoT network (200). At least one processor (120) can receive the environmental information directly from the external device (400).

[0101] At least one processor (120) may generate a second notification screen including notification information and a 3D character making an identified motion. At least one processor (120) may control the display (140) to display the second notification screen.

[0102] Notification information may include at least one of guide information related to the electronic device (100) and UI (User Interface) information representing the guide information. The guide information may represent information delivered to the user for a specific purpose. The specific purpose may include the purpose of simply delivering information to the user, the purpose of providing a warning, or the purpose of requesting a specific action.

[0103] When a notification event is identified, at least one processor (120) can identify a screen context corresponding to the notification information among multiple contexts. At least one processor (120) can identify a motion corresponding to the screen context among multiple motions. A detailed description of this is provided in FIG. 6.

[0104] For example, if the notification information includes text requesting a specific action from the user, at least one processor (120) can identify a motion of the 3D character suggesting the specific action. Examples related to this are described in FIGS. 4, 5, 14, and 15.

[0105] When a notification event is identified, at least one processor (120) may acquire characteristic information including at least one of a function of the electronic device (100) or a state of the electronic device (100). At least one processor (120) may identify a characteristic context corresponding to the characteristic information among a plurality of contexts. At least one processor (120) may identify a motion corresponding to the characteristic context among a plurality of motions. A detailed description related thereto is described in FIG. 7.

[0106] For example, if the characteristic information includes information for performing a specific function, at least one processor (120) can identify a motion in which a 3D character performs the specific function. Examples related to this are described in FIGS. 16 and 17.

[0107] When a notification event is identified, at least one processor (120) may obtain environmental information related to a network connected to the electronic device (100) via the communication interface (130). At least one processor (120) may identify an external environmental context corresponding to the environmental information among a plurality of contexts. At least one processor (120) may identify a motion corresponding to the external environmental context among a plurality of motions. A detailed description thereof is provided in FIG. 8.

[0108] For example, if the environmental information includes information that provides notifications related to an external device connected to the network, at least one processor (120) can identify a motion of the 3D character indicating the location of the external device.

[0109] At least one processor (120) can identify a first area where notification information is displayed in the entire area of ​​the first notification screen. At least one processor (120) can identify a second area, excluding the first area, in the entire area. At least one processor (120) can generate a second notification screen where a 3D character making a motion is displayed in the second area. A detailed description related to this is provided in FIGS. 4 and 5 .

[0110] At least one processor (120) can identify a user account. At least one processor (120) can receive information related to a 3D character corresponding to the user account via a communication interface (130). At least one processor (120) can generate a second notification screen including a 3D character making a motion based on the information related to the 3D character. A detailed description of this is provided in FIGS. 19 and 20 .

[0111] The above-described operations can be applied to home appliances including touch screens. The above-described operations can provide suitable 3D characters by utilizing on-screen user experience (UX), physical elements (e.g., physical buttons), and connections between connectable devices based on a GUI (Graphical User Interface) framework. The electronic device (100) can utilize the 3D character to provide users with an intuitive and flexible experience through motion, speech, and 3D elements.

[0112] The above-described actions can also be applied to 3D AR (Argument Reality) emoji technology. Guidance, feature recommendations, notifications, and MDE (Multi-Device Environment) scenarios for providing 3D virtual characters can be applied to home appliances. When utilizing 3D characters, animation and speech functions can enhance multimodal usability.

[0113] The electronic device (100) can extract text information and analyze its linguistic structure and components. The electronic device (100) can improve accessibility and understandability by applying the linguistic structure and components to the motion of a 3D character.

[0114] For example, if a user is required to press a button, the electronic device (100) can provide a 3D character of the motion of pressing the button.

[0115] For example, the electronic device (100) may perform an AI (Artificial Intelligence) mode. The AI ​​mode may be a mode that outputs result information for user input using an artificial intelligence model. When the AI ​​mode is performed, the electronic device (100) may provide a 3D character of the search motion.

[0116] For example, the electronic device (100) may provide a 3D character with a motion that performs a representative action by utilizing a 3D object for each device / function. For example, when performing a washing function, the electronic device (100) may provide a 3D character doing laundry.

[0117] As an example, the electronic device (100) may provide a 3D character representing the UI and interaction method.

[0118] For example, the electronic device (100) may provide a 3D character pointing to a specific location based on the physical elements of the product and the layout of the product itself, depending on the function. The electronic device (100) may provide a 3D character with a motion that teaches the user how to operate it.

[0119] For example, the electronic device (100) may provide a 3D character with motion indicating an error, notification, device management, etc.

[0120] For example, the electronic device (100) can identify the relative position of an external device (400) based on the position of the electronic device (100). The electronic device (100) can provide a 3D character indicating the relative position of the identified external device (400).

[0121] For example, the electronic device (100) can determine the appearance information of a 3D character using account, language, GPS location, country settings, etc. The appearance information can indicate race, age, gender, etc. A description related to this is provided in the appearance generation module (2221) of FIG. 22.

[0122] For example, the electronic device (100) can express a 3D character using at least one language. When audio is applied, voices of different genders (male / female / neutral) can be provided.

[0123] For example, if account information has already been applied, the electronic device (100) can automatically obtain information about a 3D character already set in the account.

[0124] For example, the electronic device (100) can analyze graphic elements based on the display type, UI elements, and status. The electronic device (100) can determine the layout in which the 3D character is provided by numerically calculating the margin area. A description related to this is provided in FIGS. 4 and 5 .

[0125] For example, the electronic device (100) can identify whether a UI layout is repeatedly displayed. The electronic device (100) can provide a visualization effect based on whether the UI layout is repeatedly displayed. A description related to this is provided in the UI analysis module (2213) and visualization effect module (2223) of FIG. 22.

[0126] For example, the electronic device (100) can determine text information corresponding to a 3D character based on the motion of the 3D character. The electronic device (100) can determine where the determined text information will be displayed. The electronic device (100) can provide a 3D character that utters the text information using a UI representing a text box.

[0127] For example, the electronic device (100) can extract text information contained in notification information and isolate the language structure. The electronic device (100) can identify the context based on information about the extracted verb or information about the extracted word. A description related to this is provided in FIG. 24.

[0128] FIG. 3 is a block diagram for explaining a specific configuration of the electronic device (100) of FIG. 2, according to one embodiment.

[0129] Referring to FIG. 3, the electronic device (100) may include at least one of a memory (110), at least one processor (120), a communication interface (130), a display (140), an operation interface (150), an input / output interface (160), a speaker (170), a microphone (180), and a camera (190).

[0130] The memory (110) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in at least one processor (120), or may be implemented as a separate memory from at least one processor (120). The memory (110) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0131] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that can be detachably attached to the electronic device (100), it may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc.

[0132] The memory (110) can store at least one instruction. Based on the instruction stored in the memory (110), at least one processor (120) can perform various operations.

[0133] At least one processor (120) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machines (ARM) processor, or may be defined by the relevant terminology. At least one processor (120) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). At least one processor (120) may perform various functions by executing computer executable instructions stored in a memory.

[0134] The communication interface (130) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication interface (130) may include a wireless communication module or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.

[0135] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0136] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, various connection information, such as the service set identifier (SSID) and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received.

[0137] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which is between visible light and millimeter waves.

[0138] In addition to the above-described communication method, other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0139] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a paired cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0140] According to various embodiments, the communication interface (130) may utilize the same communication module (e.g., a Wi-Fi module) to communicate with an external device such as a remote control device and an external server.

[0141] According to various embodiments, the communication interface (130) may utilize different communication modules to communicate with external devices, such as remote control devices, and external servers. For example, the communication interface (130) may utilize at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may also utilize a Bluetooth module to communicate with an external device, such as a remote control device. However, this is merely an embodiment, and the communication interface (130) may utilize at least one of various communication modules when communicating with multiple external devices or external servers.

[0142] The display (140) may be implemented as a display in various forms, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. The display (140) may also include a driving circuit, a backlight unit, etc., which may be implemented in forms such as an a-si TFT (amorphous silicon thin film transistor), an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. The display (140) may be implemented as a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display, three-dimensional dispaly), etc. According to an embodiment of the present disclosure, the display (140) may include not only a display panel that outputs an image, but also a bezel that houses the display panel. In particular, according to an embodiment of the present disclosure, the bezel may include a touch sensor for detecting user interaction.

[0143] The operating interface (150) may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or as a touch screen capable of performing the above-described display function and operating input function. The button may be a mechanical button, a touch pad, a wheel, or any other type of button formed in any area of ​​the front, side, or back of the main body of the electronic device (100).

[0144] The input / output interface (160) may be any one of HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). The input / output interface (160) may input / output at least one of audio and video signals. Depending on the implementation example, the input / output interface (160) may include a port that inputs / outputs only audio signals and a port that inputs / outputs only video signals as separate ports, or may be implemented as a single port that inputs / outputs both audio signals and video signals. The electronic device (100) may transmit at least one of the audio and video signals to an external device (e.g., an external display device or an external speaker) through the input / output interface (160). An output port included in the input / output interface (160) can be connected to an external device, and the electronic device (100) can transmit at least one of an audio and video signal to the external device through the output port.

[0145] The input / output interface (160) can be connected to a communication interface. The input / output interface (160) can transmit information received from an external device to the communication interface or transmit information received through the communication interface to the external device.

[0146] The speaker (170) may be a component that outputs various audio data as well as various notification sounds or voice messages.

[0147] The microphone (180) is a component that receives a user's voice or other sounds and converts them into audio data. The microphone (180) can receive the user's voice in an activated state. For example, the microphone (180) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (180) can include various components such as a microphone that collects the user's voice in analog form, an amplifier circuit that amplifies the collected user's voice, an A / D conversion circuit that samples the amplified user's voice and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.

[0148] The camera (190) is a device configured to capture a subject and generate a captured image, and the captured image includes both moving images and still images. The camera (190) can acquire images for at least one external device and can be implemented with a camera, lens, infrared sensor, or the like.

[0149] The camera (190) may include a lens and an image sensor. The type of lens may include a general-purpose lens, a wide-angle lens, a zoom lens, etc., and may be determined according to the type, characteristics, usage environment, etc. of the electronic device (100). The image sensor may include a complementary metal oxide semiconductor (CMOS) and a charge-coupled device (CCD).

[0150] FIG. 4 is a drawing for explaining an operation of providing a notification screen including a 3D character according to one embodiment.

[0151] Referring to the embodiment (410) of FIG. 4, the electronic device (100) may provide a first notification screen (411). The first notification screen (411) may be a screen for providing information to a user. The first notification screen (411) may be an image generated based on notification information. The first notification screen (411) may include text information. In the embodiment (410) of FIG. 4, the first notification screen (411) may include text information such as "An emergency message has arrived. Please check your mobile phone."

[0152] The electronic device (100) may have a first notification screen (411) that does not include a 3D character. The electronic device (100) may provide a second notification screen (421, 422, 423) with a 3D character added to the first notification screen (411).

[0153] The electronic device (100) can identify the motion of a 3D character to be provided along with the first notification screen (411). The motion of the 3D character can be determined based on contextual information. The contextual information can include at least one of a screen context, a characteristic context, or an external environment context. The motion of the 3D character can be determined to be appropriate for the currently identified contextual information.

[0154] Referring to embodiment (410), the first notification screen (411) may be a notification related to a mobile phone. The electronic device (100) may determine a motion (412) of a 3D character corresponding to the first notification screen (411). The motion (412) of the 3D character may be a motion related to the mobile phone. The motion related to the mobile phone may be one of a motion of showing the mobile phone, a motion of holding the mobile phone, and a motion of talking on the mobile phone. The motion (412) of the 3D character may be described as an image or image information representing a 3D character performing a specific motion.

[0155] Referring to the embodiment (420) of FIG. 4, the electronic device (100) can generate a second notification screen (421, 422, 423) by combining the first notification screen (411) and the motion of the 3D character (412).

[0156] There may be various ways to combine the motions (412) of 3D characters.

[0157] For example, the electronic device (100) can identify a first area (421-1) where notification information is displayed on a first notification screen (411). The electronic device (100) can identify a second area (421-2) where the motion (412) of a 3D character is to be displayed among the remaining areas of the first area (421-1) in the entire area of ​​the first notification screen (411). The electronic device (100) can identify the size (or width) of the second area (421-2). The electronic device (100) can determine the size of the 3D character based on the size of the second area (421-2). The electronic device (100) can change the size of the 3D character (expand or reduce) so that the 3D character is displayed in the size of the second area (421-2). When the size of the 3D character is changed, the ratio between the horizontal and vertical sizes can be maintained.

[0158] For example, the electronic device (100) can identify a first area (422-1) where notification information is displayed on the first notification screen (411). The electronic device (100) can identify a second area (422-2) where the motion (412) of the 3D character is to be displayed among the remaining area of ​​the first area (422-1) in the entire area of ​​the first notification screen (411). The electronic device (100) can identify the size (or width) of the second area (422-2). The electronic device (100) can crop the 3D character based on the size of the second area (422-2). Cropping can refer to an operation of extracting (or cutting out) only a portion of an image representing the entire 3D character. The electronic device (100) can display only the cropped area of ​​the entire image representing the motion (412) of the 3D character in the second area (422-2).

[0159] For example, the electronic device (100) can identify a first area (423-2) where notification information is displayed on the first notification screen (411). The electronic device (100) can identify a second area (423-2) where the motion (412) of the 3D character is to be displayed among the remaining area of ​​the first area (423-1) in the entire area of ​​the first notification screen (411). The electronic device (100) can identify the size (or area) of the second area (423-2). The electronic device (100) can compare the size of the second area (423-2) with the size of the image representing the motion (412) of the 3D character.

[0160] If the size of the second area (423-2) is smaller than the size of the image representing the motion (412) of the 3D character, the electronic device (100) can expand (or change) the size of the second area (423-2) to the size of the image representing the motion (412) of the 3D character. The electronic device (100) can reduce the size of the first area (423-1) as the size of the second area (423-2) expands. The display size of the notification information (content, text, etc.) displayed in the first area (423-1) can also be reduced.

[0161] How the various methods described above are applied may vary depending on the user's settings.

[0162] FIG. 5 is a drawing for explaining an operation of providing a notification screen including a 3D character according to one embodiment.

[0163] The embodiment (510) of FIG. 5 may correspond to the embodiment (410) of FIG. 4. The electronic device (100) may provide a first notification screen (411). Unlike the first notification screen (411) of FIG. 4, the notification information may be displayed in the center area of ​​the first notification screen (511). The motion (512) of the 3D character may be determined in the same manner as the motion (412) of FIG. 4. Duplicate descriptions will be omitted.

[0164] Referring to the embodiment (520) of FIG. 5, the electronic device (100) can generate a second notification screen (521, 522) by combining the first notification screen (511) and the motion of the 3D character (512).

[0165] There may be various ways to combine the motions (512) of 3D characters.

[0166] For example, the electronic device (100) can identify a first area (521-1) where notification information is displayed on a first notification screen (511). The electronic device (100) can identify a second area (521-2) where the motion (512) of a 3D character is to be displayed among the remaining areas of the first area (521-1) in the entire area of ​​the first notification screen (511). The electronic device (100) can identify the size (or area) of the second area (521-2). The electronic device (100) can compare the size of the second area (521-2) with the size of the image representing the motion (512) of the 3D character.

[0167] If the size of the second area (521-2) is smaller than the size of the image representing the motion (512) of the 3D character, the electronic device (100) can move the first area (521-1). The electronic device (100) can move the first area (521-1) where notification information is displayed among the entire area of ​​the display to the nearest corner (corner area or edge area). The corner may be in at least one direction among up / down / left / right. After moving the first area (521-1) to the corner, the electronic device (100) can re-identify the second area (521-2). Since the first area (521-1) has been moved to the corner, the size of the re-identified second area (521-2) can be expanded.

[0168] The electronic device (100) can display a 3D character in the re-identified second area (521-2). If the size of the re-identified second area (521-2) is smaller than the size of the image representing the motion (512) of the 3D character, the electronic device (100) can change the resolution or display a cropped image, as in the second notification screen (421, 422) of FIG. 4. The second notification screen (521) may be a screen obtained by changing the resolution of the image representing the motion (512) of the 3D character.

[0169] For example, the electronic device (100) may display a first area (521-1) and an image (522-2) representing the motion (512) of a 3D character by overlapping them. The electronic device (100) may change the transparency of either the notification information displayed in the first area (521-1) or the image (522-2) representing the motion (512) of the 3D character.

[0170] FIG. 6 is a diagram for explaining a screen context according to one embodiment.

[0171] Referring to table (600) of FIG. 6, the electronic device (100) can identify a screen context based on notification information. The notification information may include at least one of text information or image information included in the first notification screen. The electronic device (100) can analyze the notification information to identify the screen context.

[0172] The electronic device (100) can obtain at least one of text information or image information included in the notification information. The electronic device (100) can identify the screen context based on at least one of text information or image information included in the notification information. Specific operations related thereto are described in FIG. 11.

[0173] The electronic device (100) can identify whether at least one of a preset keyword or a preset object is included based on the notification information.

[0174] The electronic device (100) can store multiple contexts in advance. The electronic device (100) can store multiple screen contexts in a screen context table (600). The screen context table (600) can include motions of 3D characters corresponding to preset keywords (or preset objects).

[0175] For example, when a preset keyword (or preset object) related to a preset guide action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a suggested motion. The suggested motion may include a motion of the 3D character suggesting a specific action.

[0176] For example, if a preset keyword (or preset object) related to a screen transition action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a transition motion. The transition motion may include a motion of the 3D character moving the UI (or screen) to transition the screen. The transition motion may be described as a movement motion.

[0177] For example, when a preset keyword (or preset object) related to a preset completion action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a celebratory motion. The celebratory motion may include a motion of the 3D character having a joyful expression or a clapping motion, etc.

[0178] For example, if a preset keyword (or preset object) related to a preset purchase action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a purchase motion. The purchase motion may include a motion of the 3D character purchasing a specific item (or service). The purchase motion may include a motion of the 3D character explaining a method for purchasing a specific item (or service).

[0179] For example, if a preset keyword (or preset object) related to an action of pressing a preset specific button is identified through notification information, the electronic device (100) can identify a motion of a 3D character corresponding to the notification information as a pressing motion. The pressing motion may include a motion of the 3D character pressing a specific button. The electronic device (100) can identify relative position information between the position of the specific button and the position at which the 3D character is displayed. Taking the relative position into account, the electronic device (100) can provide a motion in which the 3D character actually points to the position of the specific button.

[0180] For example, if a preset keyword (or preset object) related to a preset temperature action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a temperature motion. The temperature motion may include a motion of the 3D character indicating temperature. The temperature motion may include a motion indicating coolness / heat, etc.

[0181] For example, if a preset keyword (or preset object) related to a preset time action is identified through notification information, the electronic device (100) can identify the motion of a 3D character corresponding to the notification information as a time motion. The time motion may include a motion of the 3D character waiting for time. The time motion may include a motion of looking at a clock, a motion of counting numbers, a motion of waiting, etc.

[0182] For example, when a preset keyword (or preset object) related to a preset intensity control action is identified through notification information, the electronic device (100) can identify the motion of a 3D character corresponding to the notification information as an intensity motion. The intensity motion may include a motion of the 3D character indicating intensity. The intensity motion may include a motion indicating a reaction according to intensity, a motion for adjusting intensity, etc.

[0183] For example, when a preset keyword (or preset object) related to a preset search action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a search motion. The search motion may include a motion of the 3D character indicating a search. The search motion may include a motion of looking around, a motion of looking at a magnifying glass, a motion of holding a magnifying glass, etc.

[0184] For example, if a preset keyword (or preset object) related to a preset storage action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a storage motion. The storage motion may include a motion of the 3D character indicating storage. The storage motion may include a motion of putting a specific object into a box, a motion of pointing to a storage location, a motion of putting food into a container, etc.

[0185] For example, if a preset keyword (or preset object) related to a preset washing operation is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a washing motion. The washing motion may include a motion of the 3D character indicating washing. The washing motion may include a motion of holding laundry, a motion of operating a washing machine, etc.

[0186] For example, when a preset keyword (or preset object) related to a preset rinsing action is identified through notification information, the electronic device (100) can identify the motion of a 3D character corresponding to the notification information as a rinsing motion. The rinsing motion may include a motion of the 3D character indicating rinsing. The rinsing motion may include a motion of rinsing an object (laundry), a motion of stirring water, etc.

[0187] For example, when a preset keyword (or preset object) related to a preset drying action is identified through notification information, the electronic device (100) can identify the motion of a 3D character corresponding to the notification information as a drying motion. The drying motion may include a motion of the 3D character indicating drying. The drying motion may include a motion of drying an object (dry object), a motion of looking at sunlight, etc.

[0188] For example, when a preset keyword (or preset object) related to a preset cooking action is identified through notification information, the electronic device (100) can identify the motion of a 3D character corresponding to the notification information as a cooking motion. The cooking motion may include a motion of the 3D character indicating cooking. The cooking motion may include a motion of cooking an object (food), a motion of using a cooking tool (appliance), a motion requesting a specific action to perform a cooking function, etc.

[0189] For example, if a preset keyword (or preset object) related to a preset malfunction operation is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a malfunction motion. The malfunction motion may include a motion of the 3D character indicating a malfunction. The malfunction motion may include a motion indicating a troubled expression, a motion using a repair device, etc.

[0190] For example, if a preset keyword (or preset object) related to a preset replacement action is identified through notification information, the electronic device (100) may identify the motion of a 3D character corresponding to the notification information as a replacement motion. The replacement motion may include a motion of the 3D character indicating replacement. The replacement motion may include a motion pointing to a replacement target, a motion indicating that replacement is necessary, etc.

[0191] Table (600) is merely an example, and various contexts may be added. Table (600) only describes screen contexts, but different types of contexts may be stored in a single table according to various embodiments.

[0192] FIG. 7 is a diagram for explaining a characteristic context according to one embodiment.

[0193] Referring to table (700) of FIG. 7, the electronic device (100) can identify a characteristic context based on characteristic information. The characteristic information can indicate information related to the characteristics of the device. The characteristic information can include at least one of function information of the device or status information of the device. The function information can be information indicating a function that the device currently provides (or can provide). The status information can be information indicating the current status of the device. The device can include at least one of the electronic device (100) or an external device (400) connected to the IoT network (200). The characteristic information can be described as function information, status information, attribute information, etc.

[0194] When a notification event occurs, the electronic device (100) can identify characteristic information. The electronic device (100) can obtain characteristic information at the time when the notification event occurs. The electronic device (100) can identify a characteristic context based on the obtained characteristic information. The electronic device (100) can determine the motion of a 3D character corresponding to the characteristic context. The electronic device (100) can identify a characteristic context corresponding to the characteristic information among a plurality of contexts and determine the motion of the 3D character corresponding to the identified characteristic context.

[0195] Tables B-1 to B-11 of the table (700) may correspond to table A-6 to A-16 of FIG. 6. The motions of each 3D character may correspond. Duplicate descriptions are omitted. However, table A-6 to A-16 of the table (600) may be contexts (screen contexts) acquired based on notification information. Tables B-1 to B-11 of the table (700) may be contexts (characteristic contexts) identified by acquiring characteristic information.

[0196] For example, a context indicating laundry can be identified both through notification information and through characteristic information. If the electronic device (100) is a washing machine and performs a laundry function, a context indicating laundry can be identified through both the notification information and the characteristic information.

[0197] FIG. 8 is a diagram for explaining an external environmental context according to one embodiment.

[0198] Referring to table (800) of FIG. 8, the electronic device (100) can identify an external environmental context based on communication environment information.

[0199] The communication environment information may include at least one of information related to communication of the electronic device (100) itself or information related to communication of an external network connectable to the electronic device (100). The communication environment information may include information on a communication method to which the electronic device (100) can connect (or perform).

[0200] For example, if information related to an Internet connection completion operation is identified through communication environment information, the electronic device (100) can identify the motion of a 3D character corresponding to the communication environment information as a celebratory motion. The celebratory motion may include a motion of the 3D character having a joyful expression or a clapping motion, etc.

[0201] For example, if information related to an Internet connection failure is identified through communication environment information, the electronic device (100) may identify the motion of a 3D character corresponding to the communication environment information as a failure motion. The failure motion may include a motion of the 3D character indicating a failure. The failure motion may include a motion indicating a troubled expression, a motion using a repair device, etc.

[0202] The communication environment information may include information about the network to which the electronic device (100) belongs or information about an external communication environment other than the electronic device (100).

[0203] For example, when information related to a new device connection is identified through communication environment information, the electronic device (100) may identify a motion of a 3D character corresponding to the communication environment information as a celebratory motion, a confirmation motion, or a command motion. The celebratory motion may include a motion of the 3D character having a joyful expression or a clapping motion. The confirmation motion may include a motion requesting confirmation. The command motion may include a motion indicating the location of the new device.

[0204] For example, if information related to an IoT device is identified through communication environment information, the electronic device (100) can identify the motion of a 3D character corresponding to the communication environment information as a directional motion. The directional motion may include a motion indicating the location of a new device. The information related to the IoT device may be information that provides a notification related to the IoT device.

[0205] An electronic device (100) can receive the location of a new device (IoT device). The electronic device (100) can identify the relative location of the new device (IoT device) based on the location of the new device (IoT device) and the location of the electronic device (100). The electronic device (100) can identify the motion of a 3D character indicating the relative location of the new device (IoT device).

[0206] FIG. 9 is a drawing for explaining an operation of identifying a motion of a 3D character corresponding to a notification event, according to one embodiment.

[0207] Referring to FIG. 9, the electronic device (100) can identify a 3D character (S905). For example, the 3D character may be predetermined based on the user's settings. For example, the 3D character may be determined based on the user account of the electronic device (100).

[0208] The electronic device (100) can identify the occurrence of a notification event (S910). When the notification event is identified (S910-Y), the electronic device (100) can identify the motion of a 3D character corresponding to the notification event (S915).

[0209] The electronic device (100) can generate a notification screen including notification information and a 3D character taking motion (S920). The electronic device (100) can display the generated notification screen (S925).

[0210] FIG. 10 is a diagram illustrating an operation of generating a second notification screen including notification information and a 3D character taking motion, according to one embodiment.

[0211] Referring to FIG. 10, the electronic device (100) can identify a user account (S1005). The electronic device (100) can identify a 3D character corresponding to the user account (S1010). The electronic device (100) can identify a notification event (S1015).

[0212] When a notification event is identified (S1015-Y), the electronic device (100) can generate a first notification screen including notification information (S1020).

[0213] The electronic device (100) can obtain at least one of characteristic information or communication environment information at the time when a notification event occurs (S1025).

[0214] The electronic device (100) can identify a screen context based on notification information (S1030). The electronic device (100) can identify a characteristic context based on characteristic information (S1035). The electronic device (100) can identify an external environment context based on communication environment information (S1040).

[0215] The electronic device (100) can identify the motion of a 3D character based on at least one of a screen context, a characteristic context, or an external environment context (S1045). The motion of the 3D character can be identified through the tables (600, 700, 800) described in FIGS. 6 to 8. The electronic device (100) can generate a second notification screen including notification information and a 3D character making a motion (S1050). The electronic device (100) can provide (or display) the second notification screen.

[0216] FIG. 11 is a drawing for explaining an operation of identifying the motion of a 3D character corresponding to a screen context, according to one embodiment.

[0217] Referring to FIG. 11, the electronic device (100) can generate a first notification screen including notification information (S1120). The electronic device (100) can extract (or obtain) text information included in the notification information (S1125). The electronic device (100) can identify whether the text information includes a preset keyword (S1130). The preset keyword may be a keyword indicating a context corresponding to the motion of a 3D character. A description related to this is described in FIG. 6. If the text information includes a preset keyword (S1130-Y), the electronic device (100) can identify the preset keyword included in the text information as a target keyword (S1135).

[0218] After identifying the target keyword, the electronic device (100) can extract (or obtain) the image included in the notification information (S1140).

[0219] If the text information does not include a preset keyword (S1130-N), the electronic device (100) can extract (or obtain) image information included in the notification information.

[0220] The electronic device (100) can identify whether the image information includes a preset object (S1145). The preset object may be an object representing a context corresponding to the motion of a 3D character. A description related to this is described in FIG. 6. If the image information includes a preset object (S1145-Y), the electronic device (100) can identify the preset object included in the image information as a target object (S1150).

[0221] The electronic device (100) can identify a screen context based on at least one of a target keyword or a target object (S1155). The electronic device (100) can identify a motion of a 3D character corresponding to the screen context (S1160).

[0222] Depending on the various embodiments, the order of steps S1125 to S1135 and steps S1140 to S1150 may be changed.

[0223] In various embodiments, steps S1125 to S1135 and steps S1140 to S1150 may be performed simultaneously.

[0224] FIG. 12 is a diagram illustrating an operation for identifying the motion of a 3D character corresponding to a characteristic context, according to one embodiment.

[0225] Referring to FIG. 12, the electronic device (100) can generate a first notification screen including notification information (S1220). The electronic device (100) can obtain characteristic information of the electronic device (100) at the time when a notification event occurs (S1125).

[0226] The electronic device (100) can identify whether the characteristic information includes a preset characteristic (S1230). The preset characteristic may include information indicating a function or state preset by the user.

[0227] If the characteristic information includes a preset characteristic (S1230-Y), the electronic device (100) can identify the preset characteristic included in the characteristic information as a target characteristic (S1235). The electronic device (100) can identify a characteristic context based on the target characteristic (S1240). The electronic device (100) can identify the motion of a 3D character corresponding to the characteristic context (S1245). A description related to this is described in FIG. 7.

[0228] FIG. 13 is a drawing for explaining an operation of identifying the motion of a 3D character corresponding to an external environmental context, according to one embodiment.

[0229] Referring to FIG. 13, the electronic device (100) can generate a first notification screen including notification information (S1320). The electronic device (100) can obtain communication environment information at the time a notification event occurs (S1325). The electronic device (100) can identify whether the communication environment information includes preset environment information (S1330).

[0230] If the communication environment information includes preset environment information (S1330-Y), the electronic device (100) can identify the preset environment information included in the communication environment information as the target environment (S1335). The electronic device (100) can identify the external environment context based on the target environment (S1340). The electronic device (100) can identify the motion of the 3D character corresponding to the external environment context (S1345). A description related to this is described in FIG. 8.

[0231] FIG. 14 is a drawing illustrating a 3D character in motion requesting a specific action, according to one embodiment.

[0232] Screen (1400) of FIG. 14 illustrates a second notification screen including a 3D character. The notification information may include a cooking image (or a cooking context). The electronic device (100) may analyze the notification information to identify a cooking object (e.g., a food image). If the notification information includes a cooking object, the electronic device (100) may identify a screen context corresponding to the notification information as a cooking context. The electronic device (100) may identify a cooking motion corresponding to the cooking context. The electronic device (100) may provide a second notification screen including a 3D character of the cooking motion.

[0233] Cooking motions may include motions of a 3D character representing cooking. Cooking motions may include motions of cooking an object (food), motions of using cooking utensils (devices), motions of requesting specific actions to perform cooking functions, etc. The screen (1400) may display a 3D character in motion requesting specific actions to perform cooking functions.

[0234] FIG. 15 is a drawing illustrating a 3D character in motion pointing to a location of a specific hardware configuration, according to one embodiment.

[0235] Referring to FIG. 15, the electronic device (100) may display a second notification screen on the display (140). The second notification screen may include a first area (1510) indicating notification information or a second area (1520) indicating a 3D character. The first area (1510) may include guide information requesting a specific action from the user.

[0236] Assume that a specific action is an action requesting confirmation that the upper left door of a refrigerator is open. The electronic device (100) can identify the position of the display (140) and the position of the upper left door. Based on the position of the display (140) and the position of the upper left door, the electronic device (100) can identify the relative position of the upper left door relative to the position of the display (140). The electronic device (100) can generate a 3D character with a motion pointing to the identified relative position.

[0237] The electronic device (100) may provide a second notification screen in which a 3D character taking a motion pointing to a door in the upper left corner is displayed in a second area (1520).

[0238] FIG. 16 is a drawing for explaining a 3D character of a motion pointing to the position of an external device, according to one embodiment.

[0239] Referring to FIG. 16, the electronic device (100) may display a second notification screen on the display (140). The second notification screen may include a first area (1610) indicating notification information or a second area (1620) indicating a 3D character. The first area (1610) may include guide information requesting a specific action from the user.

[0240] Assume that a specific action requests the identification of an external device (e.g., a washing machine). The electronic device (100) can identify the location of the display (140) and the location of the external device. Based on the location of the display (140) and the location of the external device, the electronic device (100) can identify the relative location of the external device with respect to the location of the display (140). The electronic device (100) can generate a 3D character with a motion pointing to the identified relative location.

[0241] The electronic device (100) may provide a second notification screen in which a 3D character taking a motion pointing to an external device is displayed in a second area (1620).

[0242] FIG. 17 is a drawing for explaining a notification screen including map information according to one embodiment.

[0243] The screen (1700) of FIG. 17 may represent a second notification screen including a 3D character. The screen (1700) may include at least one of a UI (1710) displaying text information indicating notification information, a UI (1720) displaying a 3D character performing a specific motion, or a UI (1730) displaying map information related to the notification information. If the notification information related to the notification information includes information regarding an external device, the map information may represent a map for indicating the location of the external device (400).

[0244] The map information may include a UI indicating the location of the electronic device (100) and the location of the external device (400). It is assumed that the external device (400) is located to the right of the electronic device (100). The electronic device (100) may identify a motion of a 3D character pointing to the right and generate a 3D character with the motion pointing to the right. The electronic device (100) may generate a second notification screen including the 3D character pointing to the right. The electronic device (100) may display the second notification screen.

[0245] FIG. 18 is a diagram for explaining an operation of requesting communication environment information according to one embodiment.

[0246] Steps S1825, S1830, S1835, S1840, and S1845 of FIG. 18 may correspond to steps S1325, S1330, S1335, S1340, and S1345 of FIG. 13. Duplicate explanations are omitted.

[0247] Referring to FIG. 18, an electronic device (100) can communicate with an IoT network (200). The IoT network (200) may be a network that manages at least one IoT device. The IoT network (200) may be a router or management device that manages a local network. The IoT network (200) may be an IoT server that manages multiple local networks.

[0248] The electronic device (100) can generate a first notification screen based on a notification event (S1820). When a notification event occurs, the electronic device (100) can request communication environment information from the IoT network (200) (S1821). The electronic device (100) can transmit a signal requesting communication environment information to the IoT network (200).

[0249] The IoT network (200) can receive a signal requesting communication environment information from the electronic device (100). The IoT network (200) can search for (or acquire) the communication environment information (S1822). The IoT network (200) can transmit the communication environment information to the electronic device (100) (S1823).

[0250] The electronic device (100) can receive communication environment information from the IoT network (200). The electronic device (100) can perform steps S1825, S1830, S1835, S1840, and S1845.

[0251] FIG. 19 is a diagram illustrating an operation of identifying a 3D character corresponding to a user account according to one embodiment.

[0252] Referring to FIG. 19, the electronic device (100) can identify a user account (S1905). Once the user account is identified, the electronic device (100) can transmit the user account to the server (300) (S1910).

[0253] The server (300) can receive a user account from the electronic device (100). The server (300) can identify a 3D character corresponding to the user account (S1915). The server (300) can transmit the 3D character corresponding to the user account to the electronic device (100) (S1920). The transmitted subject can be described as information indicating the user account, information indicating the 3D character, etc.

[0254] The electronic device (100) can receive a 3D character from the server (300). The electronic device (100) can identify whether a notification event has occurred (S1925). If a notification event is identified (S1925-Y), the electronic device (100) can generate a first notification screen including notification information (S1930).

[0255] The electronic device (100) can identify at least one of the characteristic information or the communication environment information at the time when the notification event occurs (S1935). The electronic device (100) can transmit at least one of the notification information, the characteristic information, or the communication environment information to the server (300) (S1940).

[0256] The server (300) can receive at least one of notification information, characteristic information, or communication environment information from the electronic device (100). The server (300) can identify the motion of the 3D character based on at least one of the notification information, characteristic information, or communication environment information (S1945). The server (300) can store the motions of a plurality of 3D characters. The server (300) can identify a motion corresponding to information received from the electronic device (100) among the stored motions. The server (300) can transmit the motion of the 3D character to the electronic device (100) (S1950).

[0257] The electronic device (100) can receive the motion of a 3D character from the server (300). The electronic device (100) can generate a second notification screen including notification information and a 3D character making a motion (S1955). The electronic device (100) can provide the second notification screen.

[0258] FIG. 20 is a drawing for explaining an operation of identifying a 3D character corresponding to user information, according to one embodiment.

[0259] Referring to FIG. 20, the electronic device (100) can determine whether user information is identified (S2005). The user information may include at least one of a user account, a user language, and a user location. The user location may be described as the location of the electronic device (100).

[0260] Once user information is identified (S2005-Y), the electronic device (100) can transmit the user information to the server (300) (S2015).

[0261] The server (300) can receive user information from the electronic device (100). The server (300) can identify a 3D character corresponding to the user information (S2015). The electronic device (100) can identify a 3D character corresponding to the received user information among a plurality of pre-stored 3D characters. The server (300) can transmit the 3D character to the electronic device (100) (S2020).

[0262] The electronic device (100) can receive a 3D character from the server (300). The electronic device (100) can receive information about the 3D character from the server (300). Based on the information about the 3D character, the electronic device (100) can provide an image (or screen) of the 3D character taking a specific motion.

[0263] If user information is not identified (S2005-N), the electronic device (100) may display a guide screen for generating a 3D character (S2025). The electronic device (100) may receive user input through the guide screen (S2030). The electronic device (100) may transmit the user input to the server (300) (S2035).

[0264] The server (300) can receive user input from the electronic device (100). The server (300) can identify (or create) a 3D character corresponding to the user input (S2040). The server (300) can transmit the 3D character to the electronic device (100) (S2045).

[0265] According to various embodiments, even though the server (300) has identified a 3D character corresponding to user information, the user may wish to modify an existing 3D character. When a user command for modifying a 3D character is received, the electronic device (100) may display a guide screen for modifying the 3D character. Operations related to this may correspond to steps S2025, S2030, S2035, S2040, and S2045.

[0266] FIG. 21 is a drawing for explaining an operation of creating a 3D character according to one embodiment.

[0267] The screen (2100) of FIG. 21 may represent the guide screen of step S2025 of FIG. 20. The screen (2100) may include at least one 3D character set as a default. The screen (2100) may include information requesting a selection of one of the displayed 3D characters. The screen (2100) may include information requesting a user input (e.g., "Next") indicating that the selection has been completed.

[0268] Through Figure 21, a user can create or modify a 3D character. The created 3D character can be included and displayed on the notification screen.

[0269] FIG. 22 is a drawing for explaining an operation for generating motion of a 3D character according to one embodiment.

[0270] Referring to FIG. 22, the electronic device (100) may include at least one of a layout generation module (2210) or a 3D character generation module (2220).

[0271] The layout generation module (2210) may be a module that generates a layout used to create a 3D character. The layout generation module (2210) may include at least one of a layout determination module (2211), a data collection module (2212), or a UI analysis module (2213).

[0272] The layout determination module (2211) may be a module for determining a layout representing a 3D character. The layout determination module (2211) may determine the layout by calculating at least one of the resolution or ratio of the 3D character.

[0273] The data collection module (2212) may be a module that collects at least one of notification information, characteristic information, or communication environment information. The data collection module (2212) may collect element information (e.g., images, cards, text, buttons, etc.). The data collection module (2212) may collect status information (e.g., whether a specific function is activated). The data collection module (2212) may collect information about an area where a 3D character is displayed based on information displayed on the screen. A description thereof is provided in FIGS. 4 and 5 .

[0274] The UI analysis module (2213) may be a module that analyzes information related to a screen (or image) provided by the electronic device (100). The UI analysis module (2213) may analyze at least one of information about the UI provided by the electronic device (100) or a pattern about the UI. The UI analysis module (2213) may analyze a repetitive layout pattern based on at least one of a previous screen, a current screen, or a next screen (a predicted screen). The UI analysis module (2213) may compare an existing repetitive layout with a newly recognized layout to select one layout.

[0275] The layout generation module (2210) can generate a layout on which a 3D character will be displayed using information acquired based on at least one of the layout determination module (2211), the data collection module (2212), and the UI analysis module (2213). A description of the generated layout is provided in FIG. 23.

[0276] The 3D character generation module (2220) may be a module that generates motions to be taken by a 3D character. The 3D character generation module (2220) may include at least one of an appearance generation module (2221), a text generation module (2222), or a visualization effect module (2223).

[0277] The appearance generation module (2221) may be a module that generates a 3D character that takes a specific motion. The appearance generation module (2221) may obtain information about the 3D character. The appearance generation module (2221) may generate appearance information of the 3D character. The appearance information may include size, scale, location, area, etc.

[0278] The text generation module (2222) may be a module that generates text information displayed along with a 3D character. The generated text may differ from the text information included in existing notification information. For differentiation, the text information corresponding to existing notification information may be described as notification text (first text information), and the text information corresponding to the 3D character may be described as character text (second text information).

[0279] For example, text information can be obtained in a single language. For example, text information can be obtained in multiple languages. The text generation module (2222) can obtain text information in a language preset by the user.

[0280] The visualization effect module (2223) may be a module that generates a visualization effect applied to a 3D character. For example, the visualization effect module (22230) may apply a fade in / out effect when a 3D character appears or disappears. The visualization effect module (2223) may generate a visualization effect applied when the screen layout changes, a visualization effect applied when a 3D character newly appears or disappears, a visualization effect applied when a user touches a 3D character, etc.

[0281] FIG. 23 is a drawing for explaining the structure of a second notification screen according to one embodiment.

[0282] Referring to FIG. 23, the electronic device (100) can determine a layout for displaying a 3D character. The electronic device (100) can determine a second area for displaying the 3D character and determine a layout for the second area. The electronic device (100) can display the 3D character based on the layout of the second area.

[0283] According to embodiment (2310), a 3D character may be displayed in the center, and text information (character text) corresponding to the 3D character may be displayed in the upper left.

[0284] According to embodiment (2320), a 3D character may be displayed in the lower center, and text information (character text) corresponding to the 3D character may be displayed in the upper center.

[0285] According to embodiment (2330), a 3D character may be displayed in the center right, and text information (character text) corresponding to the 3D character may be displayed in the upper right. Notification information may be displayed in the center.

[0286] According to embodiment (2340), a 3D character may be displayed in the lower right corner, and text information (character text) corresponding to the 3D character may be displayed in the lower center corner. Notification information may be displayed in the center.

[0287] According to embodiment (2350), a 3D character may be displayed in the lower center, and text information (character text) corresponding to the 3D character may be displayed in the upper center. Notification information may be displayed in the center.

[0288] FIG. 24 is a drawing for explaining an operation for determining the motion of a 3D character according to one embodiment.

[0289] Referring to FIG. 24, the electronic device (100) may include at least one of a screen context module (2410), a characteristic context module (2420), an external environment context module (2430), or a motion determination module (2440).

[0290] The screen context module (2410) may be a module that identifies a screen context. The screen context module (2410) may include at least one of a text extraction module (2411), a sentence component analysis module (2412), a sentence structure analysis module (2413), and a screen context identification module (2414).

[0291] The text extraction module (2411) can extract text information included in notification information.

[0292] The sentence component analysis module (2412) may be a module that analyzes sentence components from extracted text information. The sentence component analysis module (2412) may identify subjects, verbs, objects, complements, modifiers, etc. from the text information. The sentence component analysis module (2412) may transmit information about objects among the identified components to the screen context identification module (2414).

[0293] The sentence structure analysis module (2413) may be a module that analyzes sentence structure from extracted text information. The sentence component analysis module (2412) may identify words, phrases, clauses, etc. from the text information. The sentence component analysis module (2412) may transmit information about words among the identified structures to the screen context identification module (2414).

[0294] The screen context identification module (2414) can receive information about verbs from the sentence component analysis module (2412). The screen context identification module (2414) can receive information about words from the sentence structure analysis module (2413). The screen context identification module (2414) can identify a screen context representing (indicating) the screen based on at least one of the information about verbs and the information about words.

[0295] The screen context module (2410) can transmit the identified screen context to the motion determination module (2440).

[0296] The characteristic context module (2420) can identify a characteristic context based on characteristic information. The characteristic context module (2420) can identify a characteristic context based on characteristic information related to a function or status of the electronic device (100). The characteristic context module (2420) can transmit the characteristic context to the motion determination module (2440). The characteristic information can include cleaning functions, clothing care functions, air management functions, cooking and storage functions, etc.

[0297] The external environment context module (2430) can identify an external environment context based on communication environment information. The communication environment information can include information about a Multi Device Environment (MDE) environment. The external environment context module (2430) can transmit the external environment context to the motion determination module (2440). The communication environment information can include information indicating notifications, warnings, recommendations, media, control commands, connections, etc. for external devices.

[0298] The motion determination module (2440) can receive a screen context from the screen context identification module (2414). The motion determination module (2440) can receive a characteristic context from the characteristic context module (2420). The motion determination module (2440) can receive an external environment context from the external environment context module (2430). The motion determination module (2440) can determine a motion of a 3D character based on at least one of the screen context, the characteristic context, or the external environment context.

[0299] The motion determination module (2440) may include at least one of a first motion determination module (2441), a second motion determination module (2442), and a third motion determination module (2443).

[0300] The first motion determination module (2441) can determine the appearance structure of a 3D character based on the screen context. The screen context can include information about verbs obtained from the sentence component analysis module (2412). The first motion determination module (2441) can determine the appearance structure of a 3D character based on the information about the verbs.

[0301] The second motion determination module (2442) can determine a gesture (partial motion) of a 3D character based on the screen context. The gesture may include a lip motion or a hand motion. The screen context may include text information acquired from the text extraction module (2411). The second motion determination module (2442) can determine a motion of a 3D character that utters the extracted text information.

[0302] The third motion determination module (2443) can identify the overall motion of the 3D character based on at least one of the screen context, the characteristic context, and the external environment context. The overall motion can include a reaction motion (positive, negative), a listening motion, a thinking motion, a directing motion, etc.

[0303] The electronic device (100) can determine information about the final 3D character based on the motion of the 3D character identified in the motion determination module (2440). The electronic device (100) can provide the determined 3D character by including it in a second notification screen.

[0304] FIG. 25 is a drawing for explaining a notification screen including a 3D character according to one embodiment.

[0305] The second notification screen (2510) of FIG. 25 may include at least one of notification information (let's learn about the BESPOKE function), a 3D character of the suggested motion, and a UI (Next) that is the target of the user's touch input.

[0306] The second notification screen (2520) of Fig. 25 may include at least one of notification information (induction structure), 3D character of suggested motion, and text information (you can control induction and check its status. Swipe forward to check other functions).

[0307] FIG. 26 is a drawing for explaining a notification screen including a 3D character according to one embodiment.

[0308] The second notification screen (2610) of FIG. 26 may include at least one of notification information (induction structure), 3D character of suggested motion, and text information (set desired firepower).

[0309] The second notification screen (2620) of Fig. 26 may include at least one of notification information (All processes have been completed. Let's use induction now), a 3D character of the completion motion, and a UI (start) that is the target of the user's touch input.

[0310] FIG. 27 is a diagram for explaining an operation for determining context according to one embodiment.

[0311] Referring to the embodiment (2700) of FIG. 27, the electronic device (100) may include at least one of a category module (2710), a UX module (2720), and a service management module (2730).

[0312] The category module (2710) may be a module that identifies a category for the electronic device (100). The category may represent a pre-defined group based on the user's settings. The category may include a residential product group, a kitchen product group, etc.

[0313] The residential product line may include cleaning appliances, clothing care appliances, and air conditioning appliances. Cleaning appliances may include stick vacuums and robot vacuums. Clothing care appliances may include dryers, washing machines, air dressers, and shoe dressers. Air conditioning appliances may include air conditioners, air purifiers, and dehumidifiers.

[0314] Kitchen appliances can include cooking appliances, storage appliances, and other appliances. Cooking appliances can include ranges, ovens, induction cooktops, and hoods. Storage appliances can include refrigerators, kimchi refrigerators, wine refrigerators, and cube refrigerators. Other appliances can include dishwashers, water purifiers, and more.

[0315] The electronic device (100) can use the results identified by the category module (2710) to identify the motion of a 3D character. The category module (2710) can identify the category of the electronic device (100) or the external device (400).

[0316] The UX module (2720) can identify information about the UX (User Experience) related to the device. The UX module (2720) can identify connection functions, description functions, control functions, monitoring functions, suggestion functions, notification (warning) functions, management (setting) functions, etc.

[0317] A connection function may represent a function related to a communication connection with an external server or external device.

[0318] A description function may represent a feature that describes the functionality provided by default on a device.

[0319] Control functions can include power on / off, mode entry / exit, option setting, etc.

[0320] Monitoring functions may refer to the ability to check the current status of a device.

[0321] A suggestion function may represent a function that performs a specific suggestion based on various collected information (or context).

[0322] The notification (alert) feature may indicate a function that provides information related to the device.

[0323] The management (settings) function may refer to the ability to change modes or settings to manage the device.

[0324] The service management module (2730) may be a module that determines the services provided based on the management (setting) functions included in the UX module (2720). The service management module (2730) may include a cooking service, a clothing management service, a power management service, an air quality management service, a pet management service, a home appliance management service, etc.

[0325] A cooking service may provide recipes or cooking instructions for food. A clothing management service may recommend clothing modes (courses) or manage detergents. A power management service may conserve energy or provide guidance (management) on electricity bills. An air quality service may control devices to improve air quality. A pet service may monitor the health of pets. A home device management service may be a management and repair service for at least one device included in an IoT network (200).

[0326] The electronic device (100) can identify a context based on information acquired based on at least one of the category module (2710), the UX module (2720), and the service management module (2730). The electronic device (100) can determine the motion of a 3D character corresponding to the context.

[0327] FIG. 28 is a drawing for explaining an operation of judging a physical element according to one embodiment.

[0328] Referring to the embodiment (2800) of FIG. 28, the electronic device (100) can obtain characteristic information using hardware information.

[0329] In the case of an oven, range, etc., the characteristic information may include the location of a button indicating a power function, the location of a button indicating a connection function, the location of an operating unit for manipulating detailed options, the location of an object input port, the location of detailed accessories and detailed consumables that constitute the electronic device (100), etc.

[0330] The characteristic information identified for each home appliance may vary due to their different structures. The electronic device (100) can identify information about detailed elements representing the hardware configuration (or structure) of the device. The electronic device (100) can identify the location of the hardware configuration and identify the relative location of the hardware configuration based on the location where the 3D character is displayed. The electronic device (100) can provide the motion of the 3D character indicating the location of the hardware configuration.

[0331] FIG. 29 is a diagram for explaining an operation of determining information related to an external environment according to one embodiment.

[0332] Referring to FIG. 29, it is assumed that the electronic device (100) must provide notification information related to an external device (400). When a notification event related to the external device (400) is identified, the electronic device (100) may provide a second notification screen.

[0333] Referring to the embodiment (2910) of FIG. 29, the electronic device (100) can obtain map information of the space in which the electronic device (100) is placed. The electronic device (100) can obtain map information about the space to which the electronic device (100) belongs. For example, the map information can be stored in the electronic device (100). For example, the map information can be stored in an IoT network (200) or a server (300), etc. The electronic device (100) can request map information from the IoT network (200) or the server (300), etc.

[0334] The electronic device (100) can identify a target device based on notification information. The target device may refer to a device that is the subject of the notification information. The target device may be the electronic device (100) or an external device (400).

[0335] Referring to embodiment 2920 of FIG. 29, the electronic device (100) can identify at least one of the location of the electronic device (100) and the location of the external device (400).

[0336] Referring to the embodiment (2930) of FIG. 29, the electronic device (100) can identify the relative position of the external device (400) based on the position of the electronic device (100). The electronic device (100) can identify the motion of a 3D character indicating the relative position of the identified external device (400). The electronic device (100) can provide a second notification screen including the motion of the 3D character.

[0337] FIG. 30 is a drawing for explaining a control method of an electronic device (100) according to one embodiment.

[0338] Referring to FIG. 30, a control method of an electronic device includes a step of generating a first notification screen including notification information (S3010) when a notification event for providing notification information to a user is identified (S3005), a step of acquiring at least one of characteristic information or environment information at the time when the notification event occurs (S3015), a step of identifying a motion to be taken by a 3D character based on at least one of the notification information, the characteristic information, or the environment information (S3020), a step of generating a second notification screen including the notification information and the 3D character taking the motion (S3025), and a step of displaying the second notification screen (S3030).

[0339] Notification information may include at least one of guide information related to the electronic device and UI (User Interface) information representing the guide information.

[0340] Step (S3020) of identifying a motion can identify a screen context corresponding to notification information among a plurality of contexts when a notification event is identified, and identify a motion corresponding to the screen context among a plurality of motions.

[0341] Step of identifying motion (S3020) can identify a motion in which a 3D character suggests a specific action if the notification information includes text requesting a specific action from the user.

[0342] Step (S3020) of identifying a motion may include, when a notification event is identified, obtaining characteristic information including at least one of a function or a state, identifying a characteristic context corresponding to the characteristic information among a plurality of contexts, and identifying a motion corresponding to the characteristic context among a plurality of motions.

[0343] The step of identifying motion (S3020) can identify a motion in which a 3D character performs a specific function if the characteristic information includes information for performing a specific function.

[0344] Step (S3020) of identifying a motion may include, when a notification event is identified, obtaining environmental information related to a network connected to an electronic device, identifying an external environmental context corresponding to the environmental information among a plurality of contexts, and identifying a motion corresponding to the external environmental context among a plurality of motions.

[0345] The step of identifying motion (S3020) can identify a motion in which a 3D character indicates a location of an external device if the environmental information includes information that provides a notification related to an external device connected to a network.

[0346] The step (S3025) of generating a second notification screen may identify a first area in which notification information is displayed in the entire area of ​​the first notification screen, identify a second area excluding the first area in the entire area, and generate a second notification screen in which a 3D character taking motion is displayed in the second area.

[0347] The control method further includes a step of identifying a user account of a user and a step of receiving information related to a 3D character corresponding to the user account, and the step of generating a second notification screen (S3025) can generate a second notification screen including a 3D character making a motion based on the information related to the 3D character.

[0348] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0349] The methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0350] The various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic device and the display device.

[0351] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When the instructions are executed by a processor, the processor may directly or under the control of the processor use other components to perform a function corresponding to the instructions. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain signals and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0352] According to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0353] Each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0354] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea of ​​the present disclosure.

Claims

1. In electronic devices, Memory that stores at least one instruction; display; and At least one processor for executing at least one instruction; At least one processor, When a notification event for providing notification information to a user is identified, a first notification screen including the notification information is generated, At the time the above notification event occurs, at least one of characteristic information or environment information is acquired, Identifying a motion to be taken by a 3D character based on at least one of the above notification information, the above characteristic information, or the above environmental information, Generate a second notification screen including the above notification information and the 3D character taking the above motion, An electronic device that controls the display to display the second notification screen.

2. In paragraph 1, The above notification information is, An electronic device comprising at least one of guide information related to the electronic device and UI (User Interface) information representing the guide information.

3. In paragraph 1, At least one processor, When the above notification event is identified, the screen context corresponding to the notification information among multiple contexts is identified, An electronic device that identifies a motion corresponding to the screen context among multiple motions.

4. In paragraph 3, At least one processor, An electronic device, wherein the 3D character identifies a motion suggesting the specific action, when the notification information includes text requesting a specific action from the user.

5. In paragraph 1, At least one processor, When the above notification event is identified, the characteristic information including at least one of a function or a state is obtained, Identify a characteristic context corresponding to the characteristic information among multiple contexts, An electronic device that identifies a motion corresponding to the characteristic context among a plurality of motions.

6. In paragraph 5, At least one processor, An electronic device that identifies a motion in which the 3D character performs the specific function, when the above characteristic information includes information for performing a specific function.

7. In paragraph 1, including a communication interface; At least one processor, When the above notification event is identified, the environmental information related to the network connected to the electronic device is obtained through the communication interface, Identifying an external environmental context corresponding to the above environmental information among multiple contexts, An electronic device that identifies a motion corresponding to the external environmental context among multiple motions.

8. In paragraph 7, At least one processor, An electronic device, wherein the 3D character identifies a motion indicating the location of the external device, when the environmental information includes information providing a notification related to an external device connected to the network.

9. In paragraph 1, At least one processor, Identify the first area where the notification information is displayed in the entire area of ​​the first notification screen, Identify a second area excluding the first area in the above entire area, An electronic device that generates a second notification screen in which the 3D character taking the motion is displayed in the second area.

10. In paragraph 1, including a communication interface; At least one processor, Identify the user account of the above user, Through the above communication interface, information related to the 3D character corresponding to the user account is received, An electronic device that generates a second notification screen including the 3D character making the motion based on information related to the 3D character.

11. In a method for controlling an electronic device, When a notification event for providing notification information to a user is identified, a step of generating a first notification screen including the notification information; A step of acquiring at least one of characteristic information or environmental information at the time when the above notification event occurs; A step of identifying a motion to be taken by a 3D character based on at least one of the above notification information, the above characteristic information or the above environmental information; A step of generating a second notification screen including the notification information and the 3D character taking the motion; and A control method, comprising: a step of displaying the second notification screen; 12. In paragraph 11, The above notification information is, A control method comprising at least one of guide information related to the electronic device and UI (User Interface) information representing the guide information.

13. In paragraph 11, The step of identifying the above motion is: When the above notification event is identified, the screen context corresponding to the notification information among multiple contexts is identified, A control method for identifying a motion corresponding to the above screen context among a plurality of motions.

14. In paragraph 13, The step of identifying the above motion is: A control method in which the 3D character identifies a motion suggesting the specific action, when the above notification information includes text requesting a specific action from the user.

15. In paragraph 11, The step of identifying the above motion is: When the above notification event is identified, the characteristic information including at least one of a function or a state is obtained, Identify a characteristic context corresponding to the characteristic information among multiple contexts, A control method for identifying a motion corresponding to the above characteristic context among a plurality of motions.

Images