Electronic device and control method thereof

Abstract

An electronic apparatus includes: a communication interface configured to perform a communication connection with an external device; a memory storing instructions; and a processor that executes the at least one instruction by being connected to the memory. The at least one instruction performs the following operations: while providing a food cooking image to the user terminal device, receiving a signal requesting a first cooking operation of a first cooking device for cooking food from the user terminal device; in response to the received signal requesting the first cooking operation, identifying whether the user has a first cooking device based on a list of cooking devices possessed by the user; and if it is recognized that the user does not have the first cooking apparatus, transmitting a signal for performing a second cooking operation to the external apparatus, the second cooking operation being capable of replacing the first cooking operation of the first cooking apparatus.

Description

Technical Field

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof capable of providing control of a cooking apparatus and a cooking method during a cooking course using a video call. Background Art

[0002] As network and data processing technologies have advanced in transmitting and sharing data online, technologies for bidirectionally transmitting and receiving images, audio, and other shared data in real time and sharing them have been developed.

[0003] Real-time video calls and chat services based on web real-time communication (WebRTC) can be referred to as representative examples of real-time two-way data communication. Image and audio data can be shared between chat participants through a point-to-point connection between the devices of the chat participants using the WebRTC technical standard.

[0004] The WebRTC technology standard can be used in areas that require real-time two-way image or audio data sharing (for example, online courses).

[0005] Unlike offline courses, online courses can be conducted in such a way that the instructor and the participants share information and data online only through images and audio when they are far away from each other. Therefore, it is difficult to provide appropriate guidance for unexpected situations that require the instructor's direct intervention or based on the personal circumstances of the participants during the course.

[0006] For unexpected situations or personalized guidance, it is desirable to provide solutions, such as solutions remotely proposed by a mentor, and remote device control technology may be utilized.

[0007] Remote device control technology can collectively refer to technology used to control multiple electronic devices. Remote device control technology can be used in various control systems such as smart homes, smart production lines, smart stores, etc., where direct and continuous human intervention is minimized.

[0008] It is expected that by grafting remote device control technology to online courses conducted based on real-time two-way communication (such as the aforementioned WebRTC technology standard), appropriate solutions can be provided in case unexpected situations arise during online courses or personalized guidance is required. Summary of the invention

[0009] Technical Solutions

[0010] An electronic device may include: a communication interface configured to perform a communication connection with an external device; a memory storing at least one instruction; and at least one processor connected to the memory and configured to execute the at least one instruction.

[0011] The at least one instruction may include instructions for the following operations: while providing a food cooking image to the user terminal device, receiving a signal from the user terminal device requesting a first cooking operation of a first cooking device for cooking food; in response to receiving the signal requesting the first cooking operation, identifying whether the user has the first cooking device based on a list of cooking devices owned by the user; and in response to identifying that the user does not have the first cooking device, sending a signal to an external device for performing a second cooking operation, which second cooking operation can replace the first cooking operation of the first cooking device.

[0012] The at least one instruction may also include: in response to recognizing that the user has the first cooking device, sending a control instruction for controlling the first cooking device to the first cooking device.

[0013] The at least one instruction may further include: in response to recognizing that the user does not have the first cooking device, sending cooking information about a method of cooking food without using the first cooking device to the user terminal device.

[0014] The at least one instruction may also include: in response to identifying that the user does not have the first cooking device, based on information about the first cooking device and information about the first cooking operation, attempting to obtain information about a second cooking device that can perform a second cooking operation, the second cooking operation being able to replace the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices the user has; and in response to identifying that the user has the second cooking device, sending a control instruction for controlling the second cooking device to the second cooking device.

[0015] The at least one instruction may also include instructions for the following operations: in response to identifying that the user does not have the first cooking device, based on information about the first cooking device and information about the first cooking operation, obtaining information about a second cooking device that can perform a second cooking operation, and the second cooking operation can replace the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices the user has; in response to identifying that the user has the second cooking device, receiving user input as to whether to control the second cooking device; and in response to receiving user input for controlling the second cooking device, sending a control instruction for controlling the second cooking device to the second cooking device.

[0016] The at least one instruction may further include: sending information about the second cooking device and information about the second cooking operation to the user terminal device to provide the information about the second cooking device and the information about the second cooking operation to the user.

[0017] The at least one instruction may also include: in response to (i) recognizing that the user does not have the second cooking device or (ii) failing to obtain information about the second cooking device, sending cooking information about a method of cooking food without using the first cooking device to the user terminal device.

[0018] The at least one instruction may also include instructions for the following operations: receiving a request for a food cooking image from a user terminal device; and in response to receiving the request for the food cooking image, sending data of the food cooking image to the user terminal device to provide the food cooking image to the user.

[0019] The food cooking image is provided through a video call between a plurality of users including the user. The food cooking image may include at least one cooking stage for cooking food and information on a cooking device for each of the at least one cooking stage.

[0020] A control method for an electronic device may include: while providing a food cooking image to a user terminal device, receiving a signal from the user terminal device requesting a first cooking operation of a first cooking device for cooking food; in response to receiving the signal requesting the first cooking operation, identifying whether the user has the first cooking device based on a list of cooking devices the user has; and in response to identifying that the user does not have the first cooking device, sending a signal for performing a second cooking operation to an external device, wherein the second cooking operation can replace the first cooking operation of the first cooking device.

[0021] Sending the signal may include sending a control instruction for controlling the first cooking device to the first cooking device in response to recognizing that the user has the first cooking device.

[0022] Transmitting the signal may include, in response to recognizing that the user does not have the first cooking apparatus, transmitting cooking information regarding a method of cooking food without using the first cooking apparatus to the user terminal device.

[0023] Sending the signal may include: in response to identifying that the user does not have the first cooking device, based on information about the first cooking device and information about the first cooking operation, attempting to obtain information about a second cooking device that can perform a second cooking operation, the second cooking operation being able to replace the first cooking operation of the first cooking device; in response to obtaining the information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices the user has; and in response to identifying that the user has the second cooking device, sending a control instruction for controlling the second cooking device to the second cooking device.

[0024] Sending the signal may include: in response to identifying that the user does not have the first cooking device, based on information about the first cooking device and information about the first cooking operation, attempting to obtain information about a second cooking device that can perform a second cooking operation, the second cooking operation being able to replace the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices the user has; in response to identifying that the user has the second cooking device, receiving user input as to whether to control the second cooking device; and in response to receiving user input for controlling the second cooking device, sending a control instruction for controlling the second cooking device to the second cooking device.

[0025] The method may further include transmitting the information about the second cooking device and the information about the second cooking operation to the user terminal device to provide the information about the second cooking device and the information about the second cooking operation to the user.

[0026] The method may further include transmitting cooking information about a method of cooking food without using the first cooking device to the user terminal device in response to (i) recognizing that the user does not have the second cooking device or (ii) failing to obtain information about the second cooking device.

[0027] The method may further include: receiving a request for a food cooking image from a user terminal device; and in response to receiving the request for the food cooking image, transmitting data of the food cooking image to the user terminal device to provide the food cooking image to a user.

[0028] The food cooking image is provided through a video call between a plurality of users including the user. The food cooking image may include at least one cooking stage for cooking food and information on a cooking device for each of the at least one cooking stage.

[0029] A non-transitory computer-readable recording medium may be configured to store at least one computer instruction configured to be executed by at least one processor of an electronic device to allow the electronic device to perform an operation. The operation may include: receiving a signal requesting a first cooking operation of a first cooking device for cooking food from a user terminal device while providing a food cooking image to the user terminal device; in response to receiving the signal requesting the first cooking operation, identifying whether the user has the first cooking device based on a list of cooking devices owned by the user; and in response to identifying that the user does not have the first cooking device, sending a signal for performing a second cooking operation to an external device, the second cooking operation being capable of replacing the first cooking operation of the first cooking device.

[0030] Sending the signal may include: in response to identifying that the user does not have the first cooking device, based on information about the first cooking device and information about the first cooking operation, attempting to obtain information about a second cooking device that can perform a second cooking operation, the second cooking operation being able to replace the first cooking operation of the first cooking device; in response to obtaining the information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices the user has; and in response to identifying that the user has the second cooking device, sending a control instruction for controlling the second cooking device to the second cooking device. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The aspects, features and advantages of specific embodiments of the present disclosure will become more apparent from the following description with reference to the accompanying drawings.

[0032] Figure 1 is a diagram for explaining a system for providing an online cooking course through video calling and remote device control technology according to one or more embodiments of the present disclosure.

[0033] Figure 2 is a block diagram for explaining the configuration of an electronic device according to one or more embodiments of the present disclosure.

[0034] Figure 3a is a sequence diagram for explaining an operation of an electronic device recognizing whether a user has a cooking device according to other embodiments of the present disclosure.

[0035] Figure 3b is a sequence diagram for illustrating an operation of identifying whether a user has a cooking device when a user terminal device can directly access a smart object server according to other embodiments of the present disclosure.

[0036] Figure 4a is a sequence diagram for explaining a process of performing a cooking operation by an electronic device according to other embodiments of the present disclosure, the electronic device identifying whether a user has a cooking device and then transmitting an instruction for controlling the cooking device to the cooking device.

[0037] Figure 4b is a sequence diagram for explaining a process of performing a cooking operation by an electronic device according to other embodiments of the present disclosure, the electronic device identifying whether a user has a cooking device and then transmitting an instruction for controlling the cooking device to the cooking device.

[0038] Figure 4c is a sequence diagram for illustrating an operation of an electronic device sending and displaying cooking information to a user terminal device according to other embodiments of the present disclosure.

[0039] Figure 4dis a sequence diagram for illustrating an operation of an electronic device sending and displaying cooking information to a user terminal device according to other embodiments of the present disclosure.

[0040] Figure 5a is a view of a screen for explaining an online cooking class conducted through a video call using a user terminal device according to other embodiments of the present disclosure.

[0041] Figure 5b is a view for explaining a user interface (UI) for controlling a cooking device displayed on a screen of a user terminal device according to other embodiments of the present disclosure.

[0042] Figure 5c is a view for explaining a UI for controlling a cooking device displayed on a screen of a user terminal device according to other embodiments of the present disclosure.

[0043] Figure 5d is a view for explaining a UI for providing cooking information displayed on a screen of a user terminal device according to other embodiments of the present disclosure.

[0044] Figure 6 is a sequence diagram for explaining an operation of an electronic device storing image and audio data of a video call of a cooking course according to other embodiments of the present disclosure.

[0045] Figure 7a is a sequence diagram for explaining a process in which an electronic device recognizes whether a user has cooking equipment in the process of replaying a cooking course based on image and audio data of a stored video call according to other embodiments of the present disclosure.

[0046] Figure 7b is a sequence diagram for explaining a process in which an electronic device recognizes whether a user has cooking equipment in the process of replaying a cooking course based on image and audio data of a stored video call according to other embodiments of the present disclosure.

[0047] Figure 8 is a flowchart for explaining the operation of the electronic device according to other embodiments of the present disclosure. DETAILED DESCRIPTION

[0048] The disclosed embodiments may be modified in various ways, so specific embodiments are shown in the drawings and described in detail in the detailed description. However, it should be understood that the scope of the disclosed embodiments is not limited to the specific embodiments, and includes various modifications, equivalents or alternatives according to the embodiments. Throughout the drawings, similar components are represented by similar reference numerals.

[0049] This description omits detailed descriptions of cases where detailed descriptions of known functions or configurations are determined to unnecessarily obscure the subject matter.

[0050] In addition, the following embodiments can be modified in various forms, and the scope and spirit of the disclosed embodiments are not limited to the following embodiments. On the contrary, these embodiments are provided to be comprehensive and complete, and the spirit of the disclosed embodiments is fully conveyed to those skilled in the art.

[0051] The terminology used is for describing particular embodiments only and is not intended to limit the scope. Unless the context clearly indicates otherwise, a singular term may include its plural form.

[0052] The expressions “have”, “may have”, “include”, “may include”, etc. indicate the existence of corresponding features (eg, values, functions, operations, or components such as parts), but do not exclude the existence of additional features.

[0053] The expression "A or B", "at least one of A and / or B", or "one or more of A and / or B", etc. may include all possible combinations of the items listed together. For example, "A or B", "at least one of A and B", or "at least one of A or B" may indicate all of the following situations: 1) including at least one A, 2) including at least one B, or 3) including both at least one A and at least one B.

[0054] The expressions "first", "second", etc. used may indicate various components regardless of the order or importance of the components. These expressions are only used to distinguish one component from other components, rather than limiting the corresponding components.

[0055] When mentioning that any component (e.g., a first component) is "(operably or communicatively) coupled" or "connected to" another component (e.g., a second component), it should be understood that any component may be directly coupled to the other component or may be coupled to the other component through another component (e.g., a third component).

[0056] On the other hand, when it is mentioned that any component (eg, a first component) is “directly coupled” or “directly connected” to another component (eg, a second component), it should be understood that there is no other component (eg, a third component) between the any component and the other component.

[0057] The expression “configured to (or set to)” may be replaced by the expression “suitable for”, “capable of…”, “designed to”, “suitable for”, “made to” or “capable of…” depending on the situation. The expression “configured to (or set to)” may not necessarily indicate that the hardware is “specially designed for”.

[0058] Alternatively, the expression that a device is “configured to” may indicate in any case that the device can “perform” together with another device or component. For example, “a processor configured to (or set to) perform A, B, and C” may indicate a dedicated processor (e.g., an embedded processor) for performing the corresponding operations or a general-purpose processor (e.g., a central processing unit (CPU) or an application processor) that can perform the corresponding operations by executing one or more software programs stored in a memory device.

[0059] In an embodiment, a "module" or "device" may perform at least one function or operation and may be implemented by hardware or software, or by a combination of hardware and software. In addition, in addition to a "module" or "device" that needs to be implemented by specific hardware, multiple "modules" or multiple "devices" may be integrated into at least one module and may be implemented by at least one processor.

[0060] Various elements and regions in the drawings are schematically shown. Therefore, the spirit of the disclosed embodiments is not limited by the relative sizes or intervals shown in the drawings.

[0061] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the disclosed embodiments pertain can easily practice the disclosed embodiments.

[0062] Figure 1 is a diagram for explaining a system for providing an online cooking course through video calling and remote device control technology according to one or more embodiments of the present disclosure.

[0063] refer to Figure 1 , the electronic device 200 may be the service bridge server 100 .

[0064] The service bridge server 100 (or referred to as the "first server") can act as a bridge for sending / receiving data by connecting the following servers and multiple user terminal devices to each other: a video call server 120 (or referred to as the "second server"), which manages video calls between multiple user terminal devices; a recipe server 130 (or referred to as the "third server"), which provides information about food cooking; and a smart object server 140 (or referred to as the "fourth server"), which connects and controls one or more cooking devices.

[0065] That is, the service bridge server 100 can receive image and audio data from one or more servers or multiple user terminal devices, and send various data request signals and / or device control instructions to one or more servers. However, the service bridge server 100 is not limited thereto, and can be implemented as an integrated server device including servers such as a recipe server 130, a smart object server 140, and the like.

[0066] In detail, in the system for providing online cooking courses using video calling including the service bridge server 100 , a plurality of user terminal devices may perform a video call for transmitting / receiving image and audio data to each other by using a point-to-point connection or the video call server 120 .

[0067] The service bridge server 100 may be wired / wirelessly connected to a plurality of user terminal devices performing a video call and the video call server 120, and receive image data, audio data, and a signal requesting control of a cooking device input by a user through the user terminal device during the video call.

[0068] In case a signal requesting control of a cooking device is received during a video call, the service bridge server 100 may request a user device list from the smart object server 140 to check whether the user has a cooking device.

[0069] The service bridge server 100 may receive information about a user device list from the smart object server 140, and identify whether the user has a cooking device. In the case where the user has a cooking device, the service bridge server 100 may send a signal for controlling a cooking operation of the cooking device to the smart object server 140. In the case where the user does not have a corresponding cooking device, the service bridge server 100 may send a signal for controlling a cooking operation of another cooking device to the smart object server 140. In the case where the user is identified as not having a corresponding cooking device, the service bridge server 100 may receive information about a cooking method that can replace the cooking device from the recipe server 130, thereby sending the information to the user terminal device, and the user terminal device may display the information about the cooking method on the screen.

[0070] In the case where the smart object server 140 receives an operation for controlling a cooking operation of a cooking device from the service bridge server 100, the smart object server 140 may transmit a signal for controlling the cooking device to the cooking device so that the cooking device performs the cooking operation.

[0071] As described above, the service bridge server 100 may be used to fully control the system for providing online cooking courses through video calling and remote device control technology.

[0072] Figure 2 2 is a block diagram for explaining the configuration of an electronic device 200 according to one or more embodiments of the present disclosure. The electronic device 200 may be a reference Figure 1 An electronic device 200 acting as a service bridge server 100 is described.

[0073] The electronic device 200 is not limited to a server apparatus and may be any of various electronic devices 200 that transmit / receive data by performing a communication connection with another electronic device 200 via the communication interface 210 , processes data, and includes a memory 220 that can store received or processed data.

[0074] refer to Figure 2 , the electronic device 200 may include a communication device 210 , a memory 220 , and a processor 230 .

[0075] The communication interface 210 may include a wireless communication interface, a wired communication interface, or an input interface. The wireless communication interface may perform communication with various external devices by using wireless communication technology or mobile communication technology. Wireless communication technology may include, for example, Bluetooth, low energy Bluetooth, controller area network (CAN) communication, wireless fidelity (Wi-Fi), Wi-Fi direct connection, ultra-wideband communication (UWB), Zigbee, infrared data association (IrDA), or near field communication (NFC), and mobile communication technology may include the third generation partnership project (3GPP), global interoperability for microwave access (Wi-Max), long term evolution (LTE) and / or fifth generation (5G). The wireless communication interface may be implemented using an antenna, a communication chip, and / or a substrate (capable of transmitting electromagnetic waves to the outside or receiving electromagnetic waves transmitted from the outside).

[0076] The wired communication interface can perform communication with various external devices based on a wired communication network. The wired communication network can be implemented using physical cables such as a pair of cables, a coaxial cable, an optical fiber cable, an Ethernet cable, and the like.

[0077] In some embodiments, any one of the wireless communication interface and the wired communication interface may be omitted. Accordingly, the electronic device 200 may include only the wireless communication interface or only the wired communication interface. In addition, the electronic device 200 may have an integrated communication interface that supports both wireless access through the wireless communication interface and wired connection through the wired communication interface.

[0078] The electronic device 200 is not limited to including one communication interface 210 that performs one type of communication connection, but may include a plurality of communication interfaces 210 .

[0079] The processor 230 may perform a communication connection with an external server (eg, the video call server 120 , the recipe server 130 , the smart object server 140 ) or an external device through the communication interface 210 , thereby transmitting or receiving image data, audio data, and other shared data.

[0080] The memory 220 may store various programs or data temporarily or non-temporarily and transmit the stored information to the processor 230 based on the call of the processor 230. In addition, the memory 220 may store various types of information required for the operation, processing or control of the processor 230 in an electronic format.

[0081] The memory 220 may include at least one of a main memory device or an auxiliary memory device, for example. The main memory device may be implemented using a semiconductor storage medium such as a read-only memory (ROM) or a random access memory (RAM). The ROM may include, for example, a conventional ROM, an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a mask ROM. The RAM may include, for example, a dynamic RAM (DRAM) or a static RAM (SRAM). The auxiliary memory device may be implemented using at least one storage medium capable of storing data permanently or semi-permanently, such as an optical medium including a flash memory 200, a secure digital (SD) card, a solid-state drive (SSD), a hard disk drive (HDD), a magnetic drum, a compact disk (CD), a digital versatile disk (DVD), or a laser disk, a magnetic tape, a magneto-optical disk, or a floppy disk.

[0082] The memory 220 may store image data, audio data, and shared data received from an external server or external device. The shared data stored in the memory 220 may be, for example, information about a food cooking method, information about a cooking device, information about a cooking operation of a cooking device, and information about instructions for controlling a cooking device.

[0083] The processor 230 may control the overall operation of the electronic device 200. Specifically, the processor 230 may be connected to components of the electronic device 200 (including the memory 220 as described above), and control the overall operation of the electronic device 200 by executing at least one instruction stored in the memory 120 as described above. Specifically, the processor 230 may be implemented as one processor 230 or multiple processors 230.

[0084] The processor 230 may be implemented in a variety of ways, for example, as at least one of an application specific integrated circuit (ASIC), an embedded processor 230 , a microprocessor 230 , hardware control logic, a hardware finite state machine (FSM), or a digital signal processor (DSP) 230 .

[0085] However, the processor 230 may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP) 230, a communication processor (CP) 230, or an advanced RISC machine (ARM) processor 230, or may be defined by these terms. In addition, the processor 230 may be implemented in a system on chip (SoC) or a large-scale integration (LSI) embedded with a processing algorithm, or may be implemented in the form of a field programmable gate array (FPGA). In addition, the processor 230 may perform various functions by executing computer-executable instructions stored in the memory 220. In addition, the processor 230 may include at least one of a graphics processing unit (GPU), a neural processing unit (NPU), or a visual processing unit (VPU), which is a separate artificial intelligence (AI) dedicated processor 230 to perform artificial intelligence functions.

[0086] When the food cooking image is provided to the user terminal device through the communication interface 210, the processor 230 may receive a signal from the user terminal device requesting the first cooking device to perform a first cooking operation of cooking food.

[0087] The processor 230 may identify whether the user has the first cooking device based on the list of cooking devices that the user has, upon receiving the signal.

[0088] When it is recognized that the user does not have the first cooking device, the processor 230 may send a control instruction for performing a second cooking operation to the smart object server 140 or the second cooking device through the communication interface 210, and the second cooking operation can replace the first cooking operation of the first cooking device. However, the processor 230 is not limited thereto, and may send a signal to the user terminal device for providing information about the cooking method to the user.

[0089] The processor 230 may send a control instruction for controlling the first cooking device to the smart object server 140 or the first cooking device when recognizing through the communication interface 210 that the user has the first cooking device.

[0090] This description refers to Figures 3a to 7b The control method of the electronic device 200 by the processor 230 is described in detail.

[0091] Figures 3a to 5d 2 is a diagram for explaining in detail a system including an electronic device 200 for providing an online cooking course through video calling and remote device control technology according to the present disclosure.

[0092] Figure 3a is a sequence diagram for explaining an operation of the electronic device 200 recognizing whether a user has a cooking device according to other embodiments of the present disclosure.

[0093] refer to Figure 3a , which cooking stage the current food cooking stage is can be specified through the first user terminal device 110 - 1 of the instructor conducting the online course ( S310 ).

[0094] The first user terminal device 110-1 may send information about the cooking stage specified by the user input to the second user terminal device 110-2 of the participant participating in the online course (S320). The first user terminal device 110-1 may send the information about the cooking stage to the second user terminal device 110-2 by performing a point-to-point communication connection through the communication interface 210. In addition, the first user terminal device 110-1 may send the information about the cooking stage to the video call server 120 constructed based on Web Real-Time Communication (WebRTC) through the communication interface 210, and the second user terminal device 110-2 may receive the information about the cooking stage from the video call server 120 constructed based on WebRTC through the communication interface.

[0095] The second user terminal device 110-2 may display a user interface (UI) indicating each cooking stage required for cooking food on the display. In the case where information about the cooking stage is received from the first user terminal device 110-1, the second user terminal device 110-2 may highlight the UI indicating the cooking stage corresponding to the received information about the cooking stage on the display (S330).

[0096] The cooking stage can be highlighted by highlighting the frame of the UI indicating information about the cooking stage. However, the disclosed embodiments are not limited thereto, and the UI indicating the cooking stage can be highlighted on the display in various ways so that some areas of the UI are highlighted to be distinguished from other areas.

[0097] However, the second user terminal device 110-2 is not limited thereto, and may include, for example, a speaker and / or a vibration output module. When receiving information about the cooking stage from the first user terminal device 110-1, the second user terminal device 110-2 may control the speaker to output the received information or notification about the cooking stage in the form of audio, or control the vibration output module to output the received information or notification about the cooking stage in the form of vibration.

[0098] The second user terminal device 110 - 2 may receive a user input for controlling a first cooking operation of the first cooking device through a UI displayed on the display ( S340 ).

[0099] For example, the second user terminal device 110 - 2 may receive a user input for controlling a “10-minute baking” operation of an “oven” through a UI displayed on the display.

[0100] However, the second user terminal device 110 - 2 is not limited thereto, and may receive a user input through various user interfaces such as a button, a lever, and a touch type button.

[0101] The second user terminal device 110 - 2 may transmit a signal requesting a first cooking operation of a first cooking device to the service bridge server 100 ( S350 - 1 ).

[0102] The service bridge server 100 may receive a signal requesting a first cooking operation of a first cooking device by performing a communication connection with the second user terminal device 110 - 2 via the communication interface 210 ( S350 - 1 ).

[0103] In the case of receiving the signal requesting the first cooking device to perform the first cooking operation, the service bridge server 100 may request a list of cooking devices owned by the user by performing a communication connection with the smart object server 140 via the communication interface 210 (S360-1). The service bridge server 100 may receive the list of cooking devices owned by the user by performing a communication connection with the smart object server 140 via the communication interface 210 (S370-1).

[0104] However, the disclosed embodiments are not limited thereto, and a list of cooking devices that a user has may be pre-stored in the memory 220 of the service bridge server 100 .

[0105] The service bridge server 100 may identify whether the user has a first cooking device based on the received cooking device list (S380-1). For example, the service bridge server 100 may identify whether the list of cooking devices owned by the user includes an "oven".

[0106] However, the service bridge server 100 is not limited thereto and may be implemented as an integrated server including the smart thing server 140 .

[0107] Figure 3b 1 is a sequence diagram for illustrating an operation of identifying whether a user has a cooking device when a user terminal device can directly access the smart object server 140 according to other embodiments of the present disclosure.

[0108] refer to Figure 3b The above description of the process (S310, S320, S330 and S340) of receiving an input for controlling a first cooking operation of a first cooking device through the second user terminal device 110-2 describes the operation of the first user terminal device receiving a user input for specifying a cooking stage.

[0109] The second user terminal device 110 - 2 may request a list of cooking devices that the user has from the smart object server 140 ( S350 - 2 ).

[0110] The smart object server 140 may send a list of cooking devices owned by the user to the second user terminal device 110-2 in response to a request from the second user terminal device 110-2. The second user terminal device 110-2 may receive the list of cooking devices owned by the user from the smart object server 140 (S360-2).

[0111] The second user terminal device 110 - 2 may identify whether the user has the first cooking device based on the received list of cooking devices ( S370 - 2 ).

[0112] Figure 4a 2 is a sequence diagram for explaining a process of performing a cooking operation by the electronic apparatus 200 according to other embodiments of the present disclosure, the electronic apparatus identifying whether a user has a cooking device and then transmitting an instruction for controlling the cooking device to the cooking device.

[0113] refer to Figure 4a The service bridge server 100 may identify whether the user has the first cooking device based on the list of cooking devices owned by the user. If the list of cooking devices does not include the first cooking device, the service bridge server 100 may identify that the user does not have the first cooking device (S405-1).

[0114] For example, in a case where an “oven” is included in the list of cooking devices owned by the user, the service bridge server 100 may recognize that the user does not own the “oven”.

[0115] The service bridge server 100 may obtain information about a second cooking device that can replace the first cooking device (S410-1). The service bridge server 100 may obtain information about the second cooking device based on information about the cooking operation of the first cooking device (e.g., information about the first cooking device or a cooking operation type of the first cooking device, or a time required for the cooking operation), the second cooking device may perform a cooking operation that produces substantially the same cooking effect as the cooking operation performed by the first cooking device.

[0116] For example, the first cooking device may be an "oven" and the first cooking operation may be "bake in the oven for 10 minutes". In this case, the service bridge server 100 may identify a cooking operation of "cook in an air fryer for 5 minutes" that produces substantially the same cooking effect based on the information about the "oven" and the information about the "bake in the oven for 10 minutes", and identify the second cooking device as an air fryer.

[0117] The service bridge server 100 may request a list of cooking devices that the user has by performing a communication connection with the smart object server 140 via the communication interface 210 (S415-1). The processor 230 may receive a list of cooking devices that the user has by performing a communication connection with the smart object server 140 via the communication interface 210 (S420-1). However, the disclosed embodiments are not limited thereto, and the list of cooking devices that the user has may be pre-stored in the memory 220 of the service bridge server 100.

[0118] The service bridge server 100 may identify whether the user has a second cooking device based on the received list of cooking devices (S425-1). For example, the service bridge server 100 may identify whether the list of cooking devices owned by the user includes an "air fryer".

[0119] In case of recognizing that the user has the second cooking device, the service bridge server 100 may transmit information about the second cooking device to the second user terminal device 110 - 2 by performing a communication connection with the second user terminal device 110 - 2 via the communication interface 210 ( S430 - 1 ).

[0120] The information on the second cooking device transmitted to the second user terminal device 110 - 2 may be displayed on a display of the second user terminal device 110 - 2 in the form of a UI ( S435 - 1 ).

[0121] The second user terminal device 110 - 2 may receive a user input for controlling a second cooking operation of the second cooking device through the displayed UI ( S440 - 1 ).

[0122] For example, the second user terminal device 110 - 2 may receive a user input for controlling a “5-minute cooking” operation of an “air fryer”.

[0123] However, the second user terminal device 110 - 2 is not limited thereto, and may receive a user input for controlling the second cooking operation of the second cooking device through a touch type user interface or a button type user interface.

[0124] The second user terminal device 110-2 may transmit a signal requesting a second cooking operation of the second cooking device to the service bridge server 100 (S445-1). The service bridge server 100 may receive the signal requesting a second cooking operation of the second cooking device by performing a communication connection with the second user terminal device 110-2 via the communication interface 210.

[0125] The service bridge server 100 may transmit a signal requesting a second cooking operation of the second cooking device to the smart object server 140 by performing a communication connection with the smart object server 140 via the communication interface 210 (S450-1). A signal requesting a second cooking operation of the second cooking device may be transmitted from the smart device to the cooking device (S455-1).

[0126] For example, a signal requesting a “5 minute cooking” operation of an “air fryer” may be sent to the cooking device. However, the service bridge server 100 is not limited thereto and may directly send a signal requesting a second cooking operation of a second cooking device by performing a communication connection with the cooking device via the communication interface 210.

[0127] The cooking apparatus 150 may perform a second cooking operation based on a signal requesting a second cooking operation of the second cooking apparatus (S460-1).

[0128] For example, an “air fryer” can perform a “cook for 5 minutes” operation.

[0129] However, the service bridge server 100 is not limited to the above embodiment and may be implemented as one integrated server together with the recipe server 130 or the smart object server 140. In addition, the second user terminal device 110-2 may directly transmit a signal requesting a second cooking operation of the second cooking device to the second cooking device.

[0130] Figure 4b 2 is a sequence diagram for explaining a process of performing a cooking operation by the electronic apparatus 200 according to other embodiments of the present disclosure, the electronic apparatus identifying whether a user has a cooking device and then transmitting an instruction for controlling the cooking device to the cooking device.

[0131] refer to Figure 4b The service bridge server 100 may identify whether the user has the first cooking device based on the list of cooking devices owned by the user. If the list of cooking devices does not include the first cooking device, the service bridge server 100 may identify that the user does not have the first cooking device (S405-2).

[0132] When recognizing that the user does not have the first cooking device, the service bridge server 100 may request cooking method information about a cooking operation that can replace the first cooking device or information about a second cooking device that can replace the first cooking device by performing a communication connection with the recipe server 130 via the communication interface 210 (S410-2).

[0133] The service bridge server 100 may receive information about a cooking method capable of replacing a cooking operation of the first cooking device or information about a second cooking device capable of replacing the first cooking device from the recipe server 130 by performing a communication connection with the recipe server 130 via the communication interface 210 ( S415 - 2 ).

[0134] However, the disclosed embodiments are not limited thereto, and the service bridge server 100 and the recipe server 130 may be implemented as one integrated server.

[0135] For example, the cooking stage may be a heating process or baking, and the first cooking device may be an “oven.” In this case, the service bridge server 100 may receive information about a cooking method (e.g., frying in a frying pan) or information about a cooking device (e.g., an air fryer) by requesting the recipe server 130 for information about a cooking method that can replace the “baking” operation of the “oven” or information about a cooking device that can replace the “oven.”

[0136] The service bridge server 100 may request a list of cooking devices owned by the user by performing a communication connection with the smart thing server 140 via the communication interface 210 (S420-2). The service bridge server 100 may request a list of cooking devices owned by the user by performing a communication connection with the smart thing server 140 via the communication interface 210 (S420-2).

[0137] The service bridge server 100 may identify whether the user has a second cooking device based on the list of cooking devices (S430-2). If it is identified that the user has a second cooking device, the service bridge server 100 may transmit information about the second cooking device by performing a communication connection with the second user terminal device 110-2 via the communication interface 210 (S435-2).

[0138] For example, the service bridge server 100 may identify whether the list of cooking devices owned by the user includes an “air fryer.” When the service bridge server 100 identifies that the user has an “air fryer,” information about the “air fryer” may be sent to the second user terminal device 110 - 2 .

[0139] In case that the information about the second cooking operation of the second cooking device is transmitted to the second user terminal device 110-2 (S440-2), the second user terminal device 110-2 may display a UI including the information about the second cooking operation of the second cooking device on a display of the second user terminal device 110-2.

[0140] For example, a UI including information about a “5-minute cooking” operation of an “air fryer” may be displayed on the display of the second user terminal device 110 - 2 .

[0141] The second user terminal device 110 - 2 may receive an input for controlling a second cooking operation of the second cooking device through a UI on the display ( S445 - 2 ).

[0142] However, the second user terminal device 110 - 2 is not limited thereto, and may receive a user input for controlling the second cooking operation of the second cooking device through a touch type user interface or a button type user interface.

[0143] In case of receiving an input for controlling the second cooking operation of the second cooking device, the second user terminal device 110 - 2 may transmit a signal requesting the second cooking operation of the second cooking device to the service bridge server 100 ( S450 - 2 ).

[0144] For example, an input for controlling the "5-minute cooking" operation of the "air fryer" may be received through a UI displayed on the user terminal device. Upon receiving the input, the second user terminal device 110-2 may send a signal requesting the "5-minute cooking" operation of the "air fryer" to the service bridge server 100.

[0145] Upon receiving the signal requesting the second cooking operation of the second cooking device, the service bridge server 100 may transmit the signal requesting the second cooking operation of the second cooking device to the smart object server 140 by performing a communication connection with the smart object server 140 via the communication interface 210 (S455-2). Then, a signal requesting the second cooking operation of the second cooking device may be transmitted from the smart object server 140 to the second cooking device (S460-2). The second cooking device may perform the second cooking operation upon receiving the signal requesting the second cooking operation of the second cooking device (S465-2).

[0146] For example, in the case of receiving a signal requesting a "5-minute cooking" operation of an "air fryer", the service bridge server 100 may send a signal requesting a "5-minute cooking" operation of an "air fryer" to the smart thing server 140. Then, the signal requesting a "5-minute cooking" operation of an "air fryer" may be sent from the smart thing server 140 to the "air fryer", and the "air fryer" may perform the "5-minute cooking" operation.

[0147] However, the service bridge server 100 is not limited to the above embodiment and may be implemented as one integrated server together with the recipe server 130 or the smart object server 140. In addition, the second user terminal device 110-2 may directly transmit a signal requesting a second cooking operation of the second cooking device to the second cooking device.

[0148] Figure 4c and Figure 4d is a sequence diagram for explaining an operation of the electronic apparatus 200 transmitting and displaying cooking information to a user terminal device according to other embodiments of the present disclosure.

[0149] refer to Figure 4c , the service bridge server 100 may not be able to obtain information about the cooking device, or recognize that the user does not have the cooking device based on the list of cooking devices owned by the user (S405-3). Specifically, the service bridge server 100 may recognize that the user does not have the first cooking device based on the list of cooking devices owned by the user. In addition, the service bridge server 100 may not be able to obtain information about the second cooking device that can replace the first cooking device, or recognize that the user does not have the second cooking device based on the list of cooking devices owned by the user.

[0150] For example, the service bridge server 100 may recognize that the user does not have an “oven” based on the list of cooking devices that the user has. In addition, the service bridge server 100 may not be able to obtain information about an “air fryer” that can replace the “oven”, or recognize that the user does not have an “air fryer” based on the list of cooking devices that the user has.

[0151] In case that the information on the cooking device cannot be obtained or it is recognized based on the list of cooking devices that the user does not have the cooking device, the service bridge server 100 may obtain cooking information on a method of cooking food without using the corresponding cooking device (S410-3).

[0152] refer to Figure 4d , the service bridge server 100 may request cooking information about a method of cooking food without using the corresponding cooking device by performing a communication connection with the recipe server 130 via the communication interface 210 (S410-4). Then, the service bridge server 100 may receive cooking information about a method of cooking food without using the corresponding cooking device by performing a communication connection with the recipe server 130 via the communication interface 210 (S415-4).

[0153] For example, if the user is identified based on the list of cooking devices owned by the user that the user does not have an “oven”, the service bridge server 100 may obtain information about a cooking method (e.g., “frying in a frying pan”) that does not use an “oven” to cook food. In addition, if information about an “air fryer” that can replace the “oven” cannot be obtained or if the user is identified based on the list of cooking devices owned by the user that the user does not have an “air fryer”, the service bridge server 100 may obtain information about a cooking method (e.g., “frying in a frying pan”) that does not use an “air fryer” to cook food.

[0154] In addition, the service bridge server 100 may also request cooking information for cooking food without using an “oven” or an “air fryer” from the recipe server 130 , and receive information on a cooking method such as “frying in a frying pan”.

[0155] The service bridge server 100 may transmit the cooking information received from the recipe server 130 to the second user terminal device 110-2 (S415-3) by performing a communication connection with the second user terminal device 110-2 via the communication interface 210. In the case where the cooking information is transmitted to the second user terminal device 110-2 (S420-3), the second user terminal device 110-2 may display a UI including the cooking information on a display.

[0156] For example, the second user terminal device 110-2 may receive information about a cooking method such as “frying in a frying pan.” In this case, the second user terminal device 110-2 may display a UI including information about the cooking method (eg, “frying in a frying pan”) on the display.

[0157] This description refers to Figure 5a to Figure 5d An image and a UI displayed on a display of a user terminal device in a system for providing an online cooking course through video calling and remote device control technology are described.

[0158] Figure 5a is a view of a screen for explaining an online cooking class conducted through a video call (using a user terminal device) according to other embodiments of the present disclosure.

[0159] refer to Figure 5a , an image 510 of an instructor performing a cooking demonstration and conducting a course can be displayed on the main screen of the display of the user terminal device. The image 510 of an instructor performing a cooking demonstration and conducting a course can be displayed on the display of the user terminal device through a real-time video call, or can be an image of a pre-recorded video call displayed on the display of the user terminal device.

[0160] Images 520-1, 520-2, and 520-3 (showing images of other participants who attend the cooking course through video calls) may be displayed on some areas of the display of the user terminal device. The area of ​​images 520-1, 520-2, and 520-3 of images of other participants who attend the cooking course through video calls displayed on the display of the user terminal device may be located at the lower end of image 510 (which is the main screen and in which the instructor performs a cooking demonstration and conducts the course), but is not limited thereto and may be located in various display areas.

[0161] Images 520-1, 520-2, and 520-3 showing the presence of other participants participating in the cooking course through the video call may depend on the number of participants of the cooking course, and may not be provided on the display of the user terminal device in the absence of other participants.

[0162] Figure 5b is a diagram for explaining a user interface (UI) for controlling a cooking device displayed on a screen of a user terminal device according to other embodiments of the present disclosure.

[0163] refer to Figure 5b , when an image 510 of an instructor performing a cooking demonstration and conducting a course is displayed on the main screen of the display of the user terminal device, a UI 610-1 or 610-2 including information about each stage of cooking food may also be displayed in a partial area of ​​the display of the user terminal device. The information about each stage of cooking food may include the title of each cooking stage and information about the specific cooking operation in each cooking stage. In addition, the UI 610-1 or 610-2 including information about each stage of cooking food may be displayed together with a UI for receiving input for controlling the cooking operation of the cooking device used in each cooking stage. User input for receiving a request to control the cooking operation of the cooking device may be received through the UI displayed on the display of the second user terminal device 110-2.

[0164] For example, the UI 610-1 of the first cooking stage may include a cooking stage title of "trimming vegetables" and information about a specific cooking operation of "cutting into the size of your thumb". The UI 610-2 of the second cooking stage may include a cooking stage title of "grilling meat" and information about a specific cooking operation of "oven / 190 degrees / 10 minutes". In addition, the UI 610-2 of the second cooking stage may also display a UI for receiving an input for controlling the operation of "grilling meat in an oven at 190 degrees for 10 minutes". A user input for "grilling meat" for receiving a request to control the operation of "grilling meat in an oven at 190 degrees for 10 minutes" may be received through the UI displayed on the display of the second user terminal device 110-2.

[0165] Figure 5c and Figure 5d is a diagram for explaining a UI for controlling a cooking device displayed on a screen of a user terminal device according to other embodiments of the present disclosure.

[0166] refer to Figure 5c In the case where the user is identified as not having the first cooking device used in the cooking stage designed by the instructor for the cooking course through the first user terminal device 110-1, the UI 610-3 includes information about the second cooking device that can replace the first cooking device and information about the second cooking operation performed by the second cooking device. A UI for receiving an input for controlling the second cooking operation of the second cooking device may be displayed together.

[0167] For example, the "grilling stage" may be a cooking stage designed by the instructor through the first user terminal device 110-1. In the case where the service bridge server 100 recognizes that the user does not have an "oven" used in the "grilling stage", a UI including information about the "cooker" used by replacing the "oven" and information about the cooking operation of "cooking for 10 minutes in steak mode using the cooker" may be displayed adjacent to the UI including information about the "grilling stage". In addition, a UI 610-3 including information about a second cooking device that can be used by replacing the first cooking device and information about a second cooking operation performed by the second cooking device may be displayed together with a UI for receiving an input for controlling the "cooker to grill for 10 minutes in steak mode". A user input for receiving a request to control the "cooker" to "grill for 10 minutes in steak mode" may be received through a UI displayed on the display of the second user terminal device 110-2.

[0168] refer to Figure 5d , in a case where a user is identified by the first user terminal device 110-1 as not having the first cooking device used in the cooking stage designed by the instructor for the cooking course, a UI 610-4 including information about a cooking method that can be used by replacing the cooking operation performed by the first cooking device can be displayed adjacent to a UI 610-2 including information about the cooking stage displayed in a partial area of ​​the second user terminal device 110-2.

[0169] For example, the "grilling stage" may be a cooking stage designed by the instructor through the first user terminal device 110-1. When the service bridge server 100 recognizes that the user does not have an "oven" used in the "grilling stage", a UI including information about a cooking method "grilling in a frying pan for 7 minutes" that can be substituted for the "baking operation of the oven" may be displayed.

[0170] As mentioned above, online cooking classes can be conducted via live video calls or remote equipment control technology.

[0171] Figure 6 , Figure 7a and Figure 7b is a diagram for illustrating in detail a system for providing a replay of an online cooking class conducted through an ended video call and remote device control technology.

[0172] Figure 6 is a sequence diagram for explaining an operation of the electronic device 200 storing image and audio data of a video call of a cooking course according to other embodiments of the present disclosure.

[0173] The first user terminal device 110 - 1 may transmit image and audio data of an instructor who conducts a cooking course through a video call to the video call server (or video call infrastructure server) 120 ( S605 ).

[0174] Then, the second user terminal device 110-2 may transmit the image and audio data of the participants participating in the cooking course conducted via the video call to the video call server 120 (S610). However, the first user terminal device 110-1 and the second user terminal device 110-2 are not limited thereto, and the image and audio data of the cooking course conducted via the video call may be transmitted and stored to the user local device and / or the external device.

[0175] However, the first user terminal device 110 - 1 and the second user terminal device 110 - 2 are not limited thereto and may transmit the image and audio data of the cooking course conducted through the video call to the service bridge server 100 through the communication interface 210 .

[0176] In case of ending the online cooking course, the second user terminal device 110 - 2 may send a request to end the video call to the first user terminal device 110 - 1 ( S615 ).

[0177] In case of receiving the request to end the video call from the second user terminal device 110 - 2 , the first user terminal device 110 - 1 may send a request to end the video call to the video call server 120 ( S620 ).

[0178] In case of receiving a request to end the video call from the first user terminal device 110 - 1 , the video call server 120 may end the video call ( S625 ).

[0179] In case the video call ends, the video call server 120 may transmit information on the fact that the video call ends to the first user terminal device 110 - 1 , the second user terminal device 110 - 2 , and the service bridge server 100 ( S630 , S635 , S640 ).

[0180] In the case of receiving the fact that the video call is ended, the service bridge server 100 may request information about the ended video call of the cooking course by performing a communication connection with the video call server 120 via the communication interface 210 (S645). The service bridge server 100 may receive information about the ended video call of the cooking course by performing a communication connection with the video call server 120 via the communication interface 210 (S650). However, the service bridge server 100 is not limited thereto, and may receive information about the ended video call of the cooking course stored in the user local device or the external device by performing a communication connection with the user local device or the external device via the communication interface 210.

[0181] The information of the video call may include image data, audio data, and other shared data included in the video call. The image data may also include a food cooking image. The food cooking image may be provided through a video call between multiple users and may include at least one cooking stage required for cooking food and information about cooking equipment required for each cooking stage.

[0182] In case image data, audio data, and other shared data of the ended video call of the cooking course are received from the video call server 120 , the service bridge server 100 may store the image data, audio data, and other shared data in the memory 220 ( S655 ).

[0183] Figure 7a and Figure 7b is a sequence diagram for explaining a process in which the electronic device 200 recognizes whether a user has cooking equipment in the process of replaying a cooking course based on image and audio data of a stored video call according to other embodiments of the present disclosure.

[0184] refer to Figure 7a , the second user terminal device 110 - 2 may receive a user input requesting to replay the cooking course to be watched again ( S705 - 1 ).

[0185] The service bridge server 100 may receive a signal requesting image and audio data of a cooking course from the second user terminal device 110-2 by performing a communication connection with the second user terminal device 110-2 via the communication interface 210 (S710-1). In addition, in the case where the cooking stage is switched by performing a communication connection with the second user terminal device 110-2 via the communication interface 210, the service bridge server 100 may receive shared data (e.g., chat data and data for adjusting UI layout synchronization) between participants in the cooking course conducted through a video call from the second user terminal device 110-2.

[0186] Upon receiving a signal requesting image and audio data of a cooking course, the service bridge server 100 may transmit image and audio data for a cooking course stored in the second user terminal device 110 - 2 by performing a communication connection with the second user terminal device 110 - 2 via the communication interface 210 ( S715 - 1 ).

[0187] In case the image and audio data of the cooking course are received from the service bridge server 100 , the second user terminal device 110 - 2 may replay the image and audio of the cooking course ( S720 - 1 ).

[0188] When the second user terminal device 110-2 replays the image and audio of the cooking course, the second user terminal device 110-2 may display a UI including information about at least one cooking stage required to cook food and cooking equipment required for each cooking stage on a partial area of ​​the display (S725-1).

[0189] The second user terminal device 110 - 2 may receive a user input for controlling a first cooking operation of a first cooking device used in a food cooking stage through a UI displayed on a display ( S730 - 1 ).

[0190] However, the second user terminal device 110 - 2 is not limited thereto and may receive a user input through a touch type user interface or a button type user interface.

[0191] In the case of receiving a user input for controlling a first cooking operation of the first cooking device, a signal requesting the first cooking operation of the first cooking device may be sent from the second user terminal device 110-2 to the service bridge server 100 (S735-1). In the case of receiving a signal requesting the first cooking operation of the first cooking device, the service bridge server 100 may send a signal requesting a list of cooking devices owned by the user to the smart object server 140 by performing a communication connection with the smart object server 140 via the communication interface 210 (S740-1).

[0192] Here, reference Figure 7b , the second user terminal device 110-2 may be connected to the smart thing server 140. In this case, a signal requesting a list of cooking devices owned by the user may be directly transmitted from the second user terminal device 110-2 to the smart thing server 140 (S735-2), and a list of cooking devices owned by the user may be directly transmitted from the smart thing server 140 to the second user terminal device 110-2 (S740-2).

[0193] The service bridge server 100 may receive a list of cooking devices that a user has by performing a communication connection with the smart thing server 140 via the communication interface 210 ( S745 - 1 ).

[0194] The service bridge server 100 may identify whether the user has a first cooking device based on a list of cooking devices that the user has ( S750 - 1 ).

[0195] The subsequent operation of the processor 230 is the same as that of the above reference Figures 4a to 5d The operations described are the same.

[0196] Figure 8 is a flowchart for explaining the operation of the electronic device 200 according to other embodiments of the present disclosure.

[0197] While providing the food cooking image to the user terminal device, the electronic apparatus 200 may receive a signal requesting a first cooking operation of a first cooking device for cooking food from the user terminal device (S810).

[0198] In case of receiving the signal, the electronic apparatus 200 may identify whether the user has the first cooking device based on the list of cooking devices that the user has (S820).

[0199] When it is recognized that the user does not have the first cooking device, the electronic device 200 may transmit a signal to the external device for performing a second cooking operation that can replace the first cooking operation of the first cooking device (S830). On the other hand, when it is recognized that the user has the first cooking device, the electronic device 200 may transmit a control instruction for controlling the first cooking device to the first cooking device.

[0200] Specifically, in a case where it is recognized that the user does not have the first cooking device, the electronic apparatus 200 may transmit cooking information on a method of cooking food without using the first cooking device to the user terminal device.

[0201] Furthermore, upon recognizing that the user does not have the first cooking apparatus, the electronic device 200 may obtain information about a second cooking apparatus capable of performing a second cooking operation that can replace the first cooking operation of the first cooking apparatus based on information about the first cooking apparatus and the first cooking operation.

[0202] In case of obtaining the information about the second cooking device, the electronic apparatus 200 may identify whether the user has the second cooking device based on the cooking device list.

[0203] In case of recognizing that the user has the second cooking device, the electronic apparatus 200 may transmit a control instruction for controlling the second cooking device to the second cooking device.

[0204] In case of recognizing that the user has the second cooking device, the electronic apparatus 200 may receive a user input as to whether to control the second cooking device.

[0205] In case of receiving the user input, the electronic device 200 may send a control instruction for controlling the second cooking device to the second cooking device.

[0206] The electronic apparatus 200 may transmit information about the second cooking device and the second cooking operation to the user terminal device to provide the information about the second cooking device and the second cooking operation to the user terminal device.

[0207] In case that the information about the second cooking device cannot be obtained or it is recognized that the user does not have the second cooking device, the electronic apparatus 200 may transmit cooking information about a method of cooking food without using the first cooking device to the user terminal device.

[0208] The method may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be available through an application store (e.g., PlayStore). TM ) online distribution (e.g., downloading or uploading), or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) may be at least temporarily stored or temporarily provided in a machine-readable storage medium (e.g., a manufacturer's server memory, an application store's server memory, or a relay server memory).

[0209] Although the embodiments are shown and described above, the disclosed embodiments are not limited to the above specific embodiments, and various modifications can be made by those skilled in the art to which the disclosed embodiments belong without departing from the scope and spirit of the embodiments of the present disclosure disclosed in the appended claims. These modifications also need to be understood to fall within the scope of the disclosed embodiments.

Claims

1. An electronic device, comprising: a communication interface configured to perform a communication connection with an external device; A memory storing at least one instruction; as well as at least one processor connected to the memory and configured to execute the at least one instruction, The at least one instruction includes an instruction for the following operations: while providing the food cooking image to the user terminal device, receiving a signal from the user terminal device requesting a first cooking operation of a first cooking device for cooking food, In response to receiving the signal requesting the first cooking operation, identifying whether the user has the first cooking device based on a list of cooking devices owned by the user, and In response to recognizing that the user does not have the first cooking device, a signal for performing a second cooking operation that can replace the first cooking operation of the first cooking device is sent to the external device.

2. The electronic device according to claim 1, wherein: The at least one instruction also includes instructions for, in response to identifying that the user has the first cooking device, sending a control instruction for controlling the first cooking device to the first cooking device.

3. The electronic device according to claim 1, wherein: The at least one instruction further includes an instruction for transmitting, in response to recognizing that the user does not have the first cooking device, cooking information on a method of cooking food without using the first cooking device to the user terminal device.

4. The electronic device according to claim 1, wherein: The at least one instruction further comprises: In response to recognizing that the user does not have the first cooking device, based on the information about the first cooking device and the information about the first cooking operation, attempting to obtain information about a second cooking device that can perform the second cooking operation, the second cooking operation being able to replace the first cooking operation of the first cooking device, In response to obtaining the information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user, and In response to recognizing that the user has the second cooking device, a control instruction for controlling the second cooking device is sent to the second cooking device.

5. The electronic device according to claim 1, wherein: The at least one instruction also includes instructions for: In response to recognizing that the user does not have the first cooking device, based on the information about the first cooking device and the information about the first cooking operation, obtaining information about a second cooking device that can perform the second cooking operation, the second cooking operation being able to replace the first cooking operation of the first cooking device, In response to obtaining the information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user, In response to recognizing that the user has the second cooking device, receiving user input regarding whether to control the second cooking device, and In response to receiving a user input for controlling the second cooking device, a control instruction for controlling the second cooking device is sent to the second cooking device.

6. The electronic device according to claim 4, wherein: The at least one instruction further includes an instruction for transmitting the information about the second cooking device and the information about the second cooking operation to the user terminal device to provide the information about the second cooking device and the information about the second cooking operation to the user.

7. The electronic device according to claim 4, wherein: The at least one instruction also includes an instruction for: in response to (i) recognizing that the user does not have the second cooking device or (ii) failing to obtain information about the second cooking device, sending cooking information about a method of cooking food without using the first cooking device to the user terminal device.

8. The electronic device according to claim 1, wherein: The at least one instruction also includes instructions for: receiving a request for the food cooking image from the user terminal device, and In response to receiving the request for the food cooking image, data of the food cooking image is transmitted to the user terminal device to provide the food cooking image to the user.

9. The electronic device according to claim 1, in, The food cooking image is provided through a video call between a plurality of users including the user, and The food cooking image includes at least one cooking stage for cooking food and information about cooking equipment in each of the at least one cooking stage.

10. A control method for an electronic device, the control method comprising: while providing the food cooking image to the user terminal device, receiving from the user terminal device a signal requesting a first cooking operation of a first cooking device for cooking food; in response to receiving the signal requesting the first cooking operation, identifying whether the user has the first cooking device based on a list of cooking devices owned by the user; as well as In response to recognizing that the user does not have the first cooking device, a signal for performing a second cooking operation that can replace the first cooking operation of the first cooking device is sent to an external device.

11. The control method according to claim 10, wherein: Sending the signal includes sending a control instruction for controlling the first cooking device to the first cooking device in response to recognizing that the user has the first cooking device.

12. The control method according to claim 10, wherein: The sending of the signal includes sending, in response to recognizing that the user does not have the first cooking device, cooking information about a method of cooking food without using the first cooking device to the user terminal device.

13. The control method according to claim 10, wherein: Sending the signal comprises: In response to recognizing that the user does not have the first cooking device, attempting to obtain information about a second cooking device capable of performing a second cooking operation based on the information about the first cooking device and the information about the first cooking operation, the second cooking operation being capable of replacing the first cooking operation of the first cooking device; In response to obtaining the information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user; and In response to recognizing that the user has the second cooking device, a control instruction for controlling the second cooking device is sent to the second cooking device.

14. The control method according to claim 10, wherein: Sending the signal comprises: In response to recognizing that the user does not have the first cooking device, attempting to obtain information about a second cooking device capable of performing a second cooking operation based on the information about the first cooking device and the information about the first cooking operation, the second cooking operation being capable of replacing the first cooking operation of the first cooking device; in response to obtaining the information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user; In response to recognizing that the user has the second cooking device, receiving a user input regarding whether to control the second cooking device; and In response to receiving a user input for controlling the second cooking device, a control instruction for controlling the second cooking device is sent to the second cooking device.

15. The control method according to claim 13, further comprising: The information about the second cooking device and the information about the second cooking operation are transmitted to the user terminal device to provide the information about the second cooking device and the information about the second cooking operation to the user.

Images