Electronic device and control method thereof

Abstract

An electronic device includes: a communication interface configured to perform a communication connection with an external device; a memory storing instructions; and a processor connected to the memory to execute at least one instruction. The at least one instruction performs the following operations: while providing a food cooking image to a user terminal device, receiving from the user terminal device a signal requesting a first cooking operation from a first cooking device for cooking the food; in response to receiving the signal requesting the first cooking operation, identifying whether the user possesses the first cooking device based on a list of cooking devices owned by the user; and if it is identified that the user does not possess the first cooking device, sending a signal to the external device to perform a second cooking operation, the second cooking operation capable of replacing the first cooking operation of the first cooking device.

Description

Technical Field

[0001] This disclosure relates to electronic devices and methods of controlling them, and more specifically, to electronic devices and methods of controlling them capable of providing control of cooking equipment and cooking methods during cooking classes using video calls. Background Technology

[0002] With the development of network and data processing technologies for sending and sharing data online, technologies have been developed for bidirectional real-time sending and receiving of images, audio, and other shared data, and for sharing them.

[0003] Real-time video calling and chat services based on Web Real-Time Communication (WebRTC) can be considered a representative example of real-time two-way data communication. Image and audio data can be shared between chat participants through peer-to-peer connections between their devices using the WebRTC technology standard.

[0004] The WebRTC technology standard can be used in fields that require real-time bidirectional sharing of image or audio data (e.g., online courses).

[0005] Unlike in-person courses, online courses can be conducted in a way that allows instructors and participants to share information and data online solely through images and audio, even when the instructors and participants are geographically separated. Therefore, it can be difficult to provide appropriate guidance for unforeseen circumstances requiring direct intervention from the instructor or based on the individual circumstances of the participants during the course.

[0006] For unexpected situations or personalized guidance, solutions are expected to be provided, such as solutions proposed remotely by the instructor, and remote device control technology can be utilized.

[0007] Remote device control technology can refer to any technology used to control multiple electronic devices. It can be used in various control systems such as smart homes, smart production lines, and smart stores, minimizing direct and continuous human intervention.

[0008] The aim is to provide appropriate solutions for unexpected situations or the need for personalized guidance during online courses by integrating remote device control technology with online courses based on real-time two-way communication (such as the WebRTC technology standard mentioned above). Summary of the Invention

[0009] Technical solutions

[0010] An electronic device may include: a communication interface configured to perform a communication connection with an external device; a memory storing at least one instruction; and at least one processor connected to the memory and configured to execute at least one instruction.

[0011] The at least one instruction may include instructions for the following operations: while providing a food cooking image to a user terminal device, receiving from the user terminal device a signal requesting a first cooking operation of a first cooking device for cooking food; in response to receiving the signal requesting the first cooking operation, identifying whether the user has the first cooking device based on a list of cooking devices owned by the user; and in response to identifying that the user does not have the first cooking device, sending a signal to an external device to perform a second cooking operation, the second cooking operation being capable of replacing the first cooking operation of the first cooking device.

[0012] The at least one instruction may further include: in response to recognizing that a user has a first cooking device, sending a control instruction to the first cooking device for controlling the first cooking device.

[0013] The at least one instruction may further include: in response to recognizing that the user does not have the first cooking equipment, sending cooking information to the user terminal device about a method of cooking food without using the first cooking equipment.

[0014] The at least one instruction may further include: in response to identifying that the user does not have the first cooking device, attempting to obtain information about a second cooking device capable of performing a second cooking operation, based on information about the first cooking device and information about the first cooking operation, the second cooking operation being able to replace the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices possessed by the user; and in response to identifying that the user has the second cooking device, sending a control instruction to the second cooking device for controlling the second cooking device.

[0015] The at least one instruction may further include instructions for: in response to identifying that the user does not have the first cooking device, obtaining information about a second cooking device capable of performing a second cooking operation, based on information about the first cooking device and information about the first cooking operation, the second cooking operation being able to substitute for the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user; in response to identifying that the user has the second cooking device, receiving user input regarding whether to control the second cooking device; and in response to receiving user input for controlling the second cooking device, sending a control instruction to the second cooking device for controlling the second cooking device.

[0016] The at least one instruction may further include: sending information about the second cooking device and information about the second cooking operation to the user terminal device, so as to provide the user with information about the second cooking device and information about the second cooking operation.

[0017] The at least one instruction may further include: in response to (i) recognizing that the user does not have a second cooking device or (ii) being unable to obtain information about the second cooking device, sending cooking information about a method of cooking food without using the first cooking device to the user terminal device.

[0018] The at least one instruction may also include instructions for: receiving a request for a food cooking image from a user terminal device; and in response to receiving the request for a food cooking image, sending data of the food cooking image to the user terminal device to provide the food cooking image to the user.

[0019] Food cooking images are provided via video calls between multiple users, including the user. The food cooking images may include at least one cooking stage for cooking the food, as well as information about the cooking equipment used in each of the at least one cooking stage.

[0020] A method for controlling an electronic device may include: while providing a food cooking image to a user terminal device, receiving from the user terminal device a signal requesting a first cooking operation of a first cooking device for cooking food; in response to receiving the signal requesting the first cooking operation, identifying whether the user possesses the first cooking device based on a list of cooking devices owned by the user; and in response to identifying that the user does not possess the first cooking device, sending a signal to an external device to perform a second cooking operation, the second cooking operation being capable of replacing the first cooking operation of the first cooking device.

[0021] Sending the signal may include: in response to recognizing that a user has a first cooking device, sending a control command to the first cooking device for controlling the first cooking device.

[0022] Sending the signal may include: in response to recognizing that the user does not have the first cooking equipment, sending cooking information to the user terminal device about a method of cooking food without using the first cooking equipment.

[0023] Sending the signal may include: in response to recognizing that the user does not have the first cooking device, attempting to obtain information about a second cooking device capable of performing a second cooking operation, based on information about the first cooking device and information about the first cooking operation, wherein the second cooking operation can replace the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user; and in response to recognizing that the user has the second cooking device, sending a control command to the second cooking device for controlling the second cooking device.

[0024] Sending the signal may include: in response to recognizing that the user does not have the first cooking device, attempting to obtain information about a second cooking device capable of performing a second cooking operation, based on information about the first cooking device and information about the first cooking operation, wherein the second cooking operation can replace the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user; in response to recognizing that the user has the second cooking device, receiving user input regarding whether to control the second cooking device; and in response to receiving user input for controlling the second cooking device, sending a control command for controlling the second cooking device to the second cooking device.

[0025] The method may further include: sending information about the second cooking device and information about the second cooking operation to a user terminal device, so as to provide the user with information about the second cooking device and information about the second cooking operation.

[0026] The method may further include: in response to (i) recognizing that the user does not have a second cooking device or (ii) being unable to obtain information about the second cooking device, sending cooking information about a method of cooking food without using the first cooking device to the user terminal device.

[0027] The method may further include: receiving a request for a food cooking image from a user terminal device; and in response to receiving the request for a food cooking image, sending data of the food cooking image to the user terminal device to provide the food cooking image to the user.

[0028] Food cooking images are provided via video calls between multiple users, including the user. The food cooking images may include at least one cooking stage for cooking the food, as well as information about the cooking equipment used in each of the at least one cooking stage.

[0029] A non-transitory computer-readable recording medium may be configured to store at least one computer instruction configured to be executed by at least one processor of an electronic device to allow the electronic device to perform operations. These operations may include: simultaneously providing a food cooking image to a user terminal device, receiving from the user terminal device a signal requesting a first cooking operation from a first cooking device for cooking food; in response to receiving the signal requesting the first cooking operation, identifying whether the user possesses the first cooking device based on a list of cooking devices possessed by the user; and in response to identifying that the user does not possess the first cooking device, sending a signal to an external device to perform a second cooking operation, the second cooking operation capable of replacing the first cooking operation of the first cooking device.

[0030] Sending the signal may include: in response to recognizing that the user does not have the first cooking device, attempting to obtain information about a second cooking device capable of performing a second cooking operation, based on information about the first cooking device and information about the first cooking operation, wherein the second cooking operation can replace the first cooking operation of the first cooking device; in response to obtaining information about the second cooking device, identifying whether the user has the second cooking device based on a list of cooking devices owned by the user; and in response to recognizing that the user has the second cooking device, sending a control command to the second cooking device for controlling the second cooking device. Attached Figure Description

[0031] Aspects, features, and advantages of specific embodiments of this disclosure will become clearer from the following description with reference to the accompanying drawings.

[0032] Figure 1 This is a diagram illustrating a system for providing online cooking classes via video calling and remote device control technology according to one or more embodiments of the present disclosure.

[0033] Figure 2 This is a block diagram illustrating the configuration of an electronic device according to one or more embodiments of the present disclosure.

[0034] Figure 3a This is a sequence diagram illustrating the operation of an electronic device identifying whether a user has cooking equipment according to other embodiments of the present disclosure.

[0035] Figure 3b This is a sequence diagram illustrating the operation of identifying whether a user has cooking equipment when the user terminal device can directly access the smart device server, according to other embodiments of this disclosure.

[0036] Figure 4a This is a sequence diagram illustrating a process in which an electronic device performs a cooking operation according to other embodiments of the present disclosure, the electronic device identifying whether a user has cooking equipment and then sending instructions to the cooking equipment for controlling the cooking equipment.

[0037] Figure 4b This is a sequence diagram illustrating a process in which an electronic device performs a cooking operation according to other embodiments of the present disclosure, the electronic device identifying whether a user has cooking equipment and then sending instructions to the cooking equipment for controlling the cooking equipment.

[0038] Figure 4c This is a sequence diagram illustrating the operation of an electronic device according to other embodiments of the present disclosure sending and displaying cooking information to a user terminal device.

[0039] Figure 4dThis is a sequence diagram illustrating the operation of an electronic device according to other embodiments of the present disclosure sending and displaying cooking information to a user terminal device.

[0040] Figure 5a This is a view of a screen used to illustrate an online cooking class conducted via video call (which uses a user terminal device) according to other embodiments of this disclosure.

[0041] Figure 5b This is a view used to illustrate a user interface (UI) for controlling a cooking appliance displayed on the screen of a user terminal device according to other embodiments of this disclosure.

[0042] Figure 5c This is a view used to illustrate a UI for controlling cooking equipment displayed on the screen of a user terminal device according to other embodiments of the present disclosure.

[0043] Figure 5d This is a view used to illustrate a UI displayed on the screen of a user terminal device to provide cooking information according to other embodiments of the present disclosure.

[0044] Figure 6 This is a sequence diagram illustrating the operation of an electronic device storing image and audio data of a video call for a cooking lesson according to other embodiments of the present disclosure.

[0045] Figure 7a This is a sequence diagram illustrating the process by which an electronic device, according to other embodiments of the present disclosure, identifies whether a user has cooking equipment during the replay of a cooking lesson based on stored image and audio data from a video call.

[0046] Figure 7b This is a sequence diagram illustrating the process by which an electronic device, according to other embodiments of the present disclosure, identifies whether a user has cooking equipment during the replay of a cooking lesson based on stored image and audio data from a video call.

[0047] Figure 8 This is a flowchart illustrating the operation of an electronic device according to other embodiments of the present disclosure. Detailed Implementation

[0048] Various modifications can be made to the disclosed embodiments, and therefore specific embodiments are shown in the accompanying drawings and described in detail in the detailed description. However, it should be understood that the scope of the disclosed embodiments is not limited to the specific embodiments and includes various modifications, equivalents, or alternatives according to the embodiments. Throughout the drawings, similar components are indicated by similar reference numerals.

[0049] This description omits detailed descriptions of known functions or configurations to avoid unnecessarily obscuring the main points.

[0050] Furthermore, the following embodiments can be modified in various different forms, and the scope and spirit of the disclosed embodiments are not limited to the following embodiments. Rather, these embodiments are provided for completeness and to fully convey the spirit of the disclosed embodiments to those skilled in the art.

[0051] The terminology used is for describing particular embodiments only and is not intended to limit the scope. Singular terms may include their plural forms unless the context clearly indicates otherwise.

[0052] The expressions “have,” “may have,” “include,” and “may include” indicate the presence of a corresponding feature (e.g., a value, function, operation, or component such as a part), without excluding the presence of additional features.

[0053] The expressions “A or B”, “at least one of A and / or B”, or “one or more of A and / or B” can include all possible combinations of the items listed together. For example, “A or B”, “at least one of A and B”, or “at least one of A or B” can indicate all of the following: 1) including at least one A, 2) including at least one B, or 3) including both at least one A and at least one B.

[0054] The terms "first," "second," etc., used can refer to various components, regardless of their order or importance. These terms are only used to distinguish one component from others, not to restrict the corresponding component.

[0055] When any component (e.g., the first component) is referred to as being "(operably or communicatively) coupled" or "connected" to another component (e.g., the second component), it should be understood that any component may be directly coupled to that other component, or may be coupled to that other component through yet another component (e.g., the third component).

[0056] On the other hand, when it is mentioned that any component (e.g., the first component) is “directly coupled” or “directly connected” to another component (e.g., the second component), it should be understood that there is no other component (e.g., the third component) between any component and the other component.

[0057] The phrase "configured as (or set to)" can be replaced with phrases such as "applicable to," "capable of," "designed to," "suitable for," "made as," or "capable of" depending on the context. The phrase "configured as (or set to)" does not necessarily indicate that the hardware is "specifically designed for."

[0058] Instead, stating that a device is “configured to” can in any case indicate that the device can “perform” together with another device or component. For example, “configured to (or set to) perform A, B, and C” can indicate a dedicated processor (e.g., an embedded processor) for performing the corresponding operations or a general-purpose processor (e.g., a central processing unit (CPU) or application processor) that can perform the corresponding operations by executing one or more software programs stored in a memory device.

[0059] In the embodiments, a "module" or "device" may perform at least one function or operation and may be implemented by hardware or software, or by a combination of hardware and software. Furthermore, aside from "modules" or "devices" that require implementation by specific hardware, multiple "modules" or multiple "devices" may be integrated into at least one module and may be implemented by at least one processor.

[0060] The various elements and areas in the accompanying drawings are shown schematically. Therefore, the spirit of the disclosed embodiments is not limited to the relative dimensions or spacing shown in the drawings.

[0061] In the following description, embodiments will be described in detail with reference to the accompanying drawings, so that those skilled in the art to which the disclosed embodiments pertain will be able to readily practice the disclosed embodiments.

[0062] Figure 1 This is a diagram illustrating a system for providing online cooking classes via video calling and remote device control technology according to one or more embodiments of the present disclosure.

[0063] refer to Figure 1 Electronic device 200 can be service bridge server 100.

[0064] Service bridge server 100 (or referred to as "first server") can act as a bridge for sending / receiving data by connecting the following servers and multiple user terminal devices to each other: video call server 120 (or referred to as "second server"), which manages video calls between multiple user terminal devices; recipe server 130 (or referred to as "third server"), which provides information on food cooking; and smart device server 140 (or referred to as "fourth server"), which connects to and controls one or more cooking devices.

[0065] That is, the service bridge server 100 can receive image and audio data from one or more servers or multiple user terminal devices, and send various data request signals and / or device control commands to one or more servers. However, the service bridge server 100 is not limited to this, and can be implemented as an integrated server device including servers such as recipe server 130 and smart device server 140.

[0066] In detail, in a system that uses video calls to provide online cooking courses (which includes a service bridge server 100), multiple user terminal devices can perform video calls to send / receive image and audio data to each other using a point-to-point connection or a video call server 120.

[0067] The service bridge server 100 can be wired / wirelessly connected to multiple user terminal devices performing video calls and the video call server 120, and during video calls, it can receive image data, audio data, and signals requesting control of cooking equipment input by users through their user terminal devices.

[0068] If a signal requesting control of a cooking device is received during a video call, the service bridge server 100 can request a list of user devices from the smart device server 140 to check if the user has a cooking device.

[0069] The service bridge server 100 can receive information about the user device list from the smart device server 140 and identify whether the user has a cooking device. If the user has a cooking device, the service bridge server 100 can send a signal to the smart device server 140 to control the cooking operation of that device. If the user does not have the corresponding cooking device, the service bridge server 100 can send a signal to the smart device server 140 to control the cooking operation of another cooking device. If the user is identified as not having the corresponding cooking device, the service bridge server 100 can receive information from the recipe server 130 about a cooking method that can replace that cooking device, and then send this information to the user terminal device, whereby the user terminal device can display information about the cooking method on its screen.

[0070] When the smart device server 140 receives an operation from the service bridge server 100 to control the cooking operation of the cooking device, the smart device server 140 can send a signal to the cooking device to control the cooking device so that the cooking device can perform the cooking operation.

[0071] As described above, the service bridge server 100 can be used to fully control the system providing online cooking classes via video calling and remote device control technology.

[0072] Figure 2 This is a block diagram illustrating the configuration of an electronic device 200 according to one or more embodiments of the present disclosure. The electronic device 200 may be a reference... Figure 1 The electronic device 200 described acts as a service bridge server 100.

[0073] The electronic device 200 is not limited to server equipment, but can be any of various electronic devices 200 that send / receive data, process data, and include a memory 220 (which can store the received or processed data) by performing a communication connection with another electronic device 200 via a communication interface 210.

[0074] refer to Figure 2 The electronic device 200 may include a communication interface 210, a memory 220, and a processor 230.

[0075] Communication interface 210 may include a wireless communication interface, a wired communication interface, or an input interface. The wireless communication interface can perform communication with various external devices using wireless communication technologies or mobile communication technologies. Wireless communication technologies may include, for example, Bluetooth Low Energy, Controller Area Network (CAN) communication, Wi-Fi, Wi-Fi Direct, Ultra Wideband (UWB), Zigbee, Infrared Data Association (IrDA), or Near Field Communication (NFC), and mobile communication technologies may include the 3rd Generation Partnership Project (3GPP), Wi-Max, LTE, and / or 5G. The wireless communication interface may be implemented using an antenna, a communication chip, and / or a substrate (capable of emitting or receiving electromagnetic waves emitted from the outside).

[0076] Wired communication interfaces enable communication with various external devices via wired communication networks. Wired communication networks can be implemented using physical cables such as a pair of cables, coaxial cables, fiber optic cables, or Ethernet cables.

[0077] In some embodiments, either the wireless communication interface or the wired communication interface may be omitted. Accordingly, the electronic device 200 may include only the wireless communication interface or only the wired communication interface. Furthermore, the electronic device 200 may have an integrated communication interface that supports both wireless access via the wireless communication interface and wired connection via the wired communication interface.

[0078] The electronic device 200 is not limited to including a single communication interface 210 that performs one type of communication connection, but may include multiple communication interfaces 210.

[0079] The processor 230 can establish a communication connection with an external server (e.g., video call server 120, recipe server 130, smart device server 140) or external device through the communication interface 210, thereby sending or receiving image data, audio data, and other shared data.

[0080] The memory 220 can temporarily or non-temporarily store various programs or data, and transfer the stored information to the processor 230 based on the processor 230's invocation. Furthermore, the memory 220 can store various types of information required for the operation, processing, or control of the processor 230 in electronic format.

[0081] Memory 220 may include at least one of a main memory device or an auxiliary memory device. The main memory device may be implemented using a semiconductor storage medium such as read-only memory (ROM) or random access memory (RAM). ROM may include, for example, a conventional ROM, an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a mask ROM. RAM may include, for example, dynamic RAM (DRAM) or static RAM (SRAM). The auxiliary memory device may be implemented using at least one storage medium capable of permanently or semi-permanently storing data, such as optical media including flash memory 200, a secure digital storage (SD) card, a solid-state drive (SSD), a hard disk drive (HDD), a magnetic drum, a compact disc (CD), a digital versatile disc (DVD), or a laser disc, magnetic tape, magneto-optical disc, or floppy disk.

[0082] The memory 220 can store image data, audio data, and shared data received from an external server or external device. The shared data stored in the memory 220 may include, for example, information about food cooking methods, information about cooking equipment, information about the cooking operation of the cooking equipment, and information about instructions for controlling the cooking equipment.

[0083] Processor 230 can control the overall operation of electronic device 200. Specifically, processor 230 can be connected to components of electronic device 200 (including memory 220 as described above), and controls the overall operation of electronic device 200 by executing at least one instruction stored in memory 220 as described above. Specifically, processor 230 can be implemented as one processor 230 or multiple processors 230.

[0084] The processor 230 can be implemented in a variety of ways. For example, the processor 230 can be implemented as at least one of an application-specific integrated circuit (ASIC), an embedded processor 230, a microprocessor 230, hardware control logic, a hardware finite state machine (FSM), or a digital signal processor (DSP) 230.

[0085] However, processor 230 may include one or more of a central processing unit (CPU), microcontroller unit (MCU), microprocessor unit (MPU), controller, application processor (AP) 230, communication processor (CP) 230, or advanced RISC machine (ARM) processor 230, or may be defined by these terms. Furthermore, processor 230 may be implemented in a system-on-a-chip (SoC) or large-scale integration (LSI) with embedded processing algorithms, or may be implemented in the form of a field-programmable gate array (FPGA). Additionally, processor 230 can perform various functions by executing computer-executable instructions stored in memory 220. Furthermore, processor 230 may include at least one of a graphics processing unit (GPU), neural processing unit (NPU), or visual processing unit (VPU), which is a separate artificial intelligence (AI) dedicated processor 230 for performing artificial intelligence functions.

[0086] When providing food cooking images to a user terminal device via communication interface 210, processor 230 can receive a signal from the user terminal device requesting the first cooking device to perform a first cooking operation to cook the food.

[0087] Upon receiving the signal, the processor 230 can identify whether the user has the first cooking device based on a list of cooking devices owned by the user.

[0088] If it is detected that the user does not have the first cooking device, the processor 230 can send a control command to the smart device server 140 or the second cooking device via the communication interface 210 to perform a second cooking operation, which can replace the first cooking operation of the first cooking device. However, the processor 230 is not limited to this and can also send signals to the user terminal device to provide the user with information about the cooking method.

[0089] When the processor 230 recognizes that the user has the first cooking device through the communication interface 210, it can send control commands to the smart device server 140 or the first cooking device to control the first cooking device.

[0090] This description references Figures 3a to 7b The method by which the processor 230 controls the electronic device 200 is described in detail.

[0091] Figures 3a to 5d This is a diagram illustrating in detail a system according to this disclosure, including an electronic device 200 that provides online cooking classes via video call and remote device control technology.

[0092] Figure 3a This is a sequence diagram illustrating the operation of an electronic device 200, according to other embodiments of the present disclosure, to identify whether a user has cooking equipment.

[0093] refer to Figure 3a The instructor of the online course can specify which cooking stage the food is currently cooking through the first user terminal device 110-1 (S310).

[0094] The first user terminal device 110-1 can send information about the cooking stage specified by user input to the second user terminal device 110-2, a participant in the online course (S320). The first user terminal device 110-1 can send information about the cooking stage to the second user terminal device 110-2 through a point-to-point communication connection via the communication interface 210. Furthermore, the first user terminal device 110-1 can send information about the cooking stage to a video call server 120 built on WebRTC (Web Real-Time Communication) via the communication interface 210, and the second user terminal device 110-2 can receive information about the cooking stage from the WebRTC-based video call server 120 via the communication interface.

[0095] The second user terminal device 110-2 can display a user interface (UI) on the screen indicating each cooking stage required for cooking food. Upon receiving information about the cooking stage from the first user terminal device 110-1, the second user terminal device 110-2 can highlight the UI on the screen indicating the cooking stage corresponding to the received information about the cooking stage (S330).

[0096] The cooking stage can be highlighted by highlighting the border of the UI indicating information about the cooking stage. However, the disclosed embodiments are not limited to this, and the UI indicating the cooking stage can be highlighted on the display in various ways so that some areas of the UI are highlighted to distinguish them from other areas.

[0097] However, the second user terminal device 110-2 is not limited to this, and may include, for example, a speaker and / or a vibration output module. Upon receiving information about the cooking stage from the first user terminal device 110-1, the second user terminal device 110-2 may control the speaker to output the received information or notification about the cooking stage in audio form, or control the vibration output module to output the received information or notification about the cooking stage in vibration form.

[0098] The second user terminal device 110-2 can receive user input for controlling the first cooking operation of the first cooking device through the UI displayed on the screen (S340).

[0099] For example, the second user terminal device 110-2 can receive user input for controlling the "10-minute baking" operation of the "oven" through the UI displayed on the screen.

[0100] However, the second user terminal device 110-2 is not limited to this and can receive user input through various user interfaces such as buttons, joysticks and touch buttons.

[0101] The second user terminal device 110-2 can send a signal to the service bridge server 100 requesting the first cooking operation of the first cooking device (S350-1).

[0102] The service bridge server 100 can receive a signal requesting the first cooking operation of the first cooking device by establishing a communication connection with the second user terminal device 110-2 via the communication interface 210 (S350-1).

[0103] Upon receiving a signal requesting the first cooking device to perform a first cooking operation, the service bridge server 100 can request a list of cooking devices owned by the user by establishing a communication connection with the smart device server 140 via the communication interface 210 (S360-1). The service bridge server 100 can receive a list of cooking devices owned by the user by establishing a communication connection with the smart device server 140 via the communication interface 210 (S370-1).

[0104] However, the disclosed embodiments are not limited thereto, and the list of cooking devices that the user has can be pre-stored in the memory 220 of the service bridge server 100.

[0105] The service bridge server 100 can identify whether a user has a first cooking device based on the received list of cooking devices (S380-1). For example, the service bridge server 100 can identify whether the list of cooking devices owned by the user includes "oven".

[0106] However, the service bridge server 100 is not limited to this and can be implemented as an integrated server including the smart object server 140.

[0107] Figure 3b This is a sequence diagram illustrating the operation of identifying whether a user has cooking equipment when the user terminal device can directly access the smart device server 140, according to other embodiments of this disclosure.

[0108] refer to Figure 3b The above description describes the process (S310, S320, S330 and S340) of receiving input for controlling the first cooking operation of the first cooking device through the second user terminal device 110-2, and describes the operation of the first user terminal device receiving user input for specifying the cooking stage.

[0109] The second user terminal device 110-2 can request a list of cooking devices owned by the user from the smart device server 140 (S350-2).

[0110] The smart device server 140 can respond to a request from the second user terminal device 110-2 by sending a list of cooking devices owned by the user to the second user terminal device 110-2. The second user terminal device 110-2 can receive the list of cooking devices owned by the user from the smart device server 140 (S360-2).

[0111] The second user terminal device 110-2 can identify whether the user has the first cooking device based on the received list of cooking devices (S370-2).

[0112] Figure 4a This is a sequence diagram illustrating a process in which an electronic device 200 performs a cooking operation according to other embodiments of the present disclosure, the electronic device identifying whether a user has cooking equipment and then sending instructions to the cooking equipment for controlling the cooking equipment.

[0113] refer to Figure 4a The service bridge server 100 can identify whether a user has a first cooking device based on a list of cooking devices the user possesses. If the first cooking device is not included in the list of cooking devices, the service bridge server 100 can identify that the user does not have a first cooking device (S405-1).

[0114] For example, if "oven" is included in the list of cooking appliances owned by a user, the service bridge server 100 can recognize that the user does not own an "oven".

[0115] The service bridge server 100 can obtain information about a second cooking device that can replace the first cooking device (S410-1). The service bridge server 100 can obtain information about the second cooking device based on information about the cooking operation of the first cooking device (e.g., information about the first cooking device, the type of cooking operation of the first cooking device, or the time required for the cooking operation), which can perform a cooking operation that produces substantially the same cooking effect as the cooking operation performed by the first cooking device.

[0116] For example, the first cooking device could be an "oven", and the first cooking operation could be "baking in the oven for 10 minutes". In this case, the service bridge server 100 can identify the cooking operation "cooking in an air fryer for 5 minutes" that produces substantially the same cooking effect based on the information about the "oven" and the information about "baking in the oven for 10 minutes", and identify the second cooking device as an air fryer.

[0117] The service bridge server 100 can request a list of cooking devices owned by the user by establishing a communication connection with the smart device server 140 via the communication interface 210 (S415-1). The processor 230 can receive the list of cooking devices owned by the user by establishing a communication connection with the smart device server 140 via the communication interface 210 (S420-1). However, the disclosed embodiments are not limited thereto, and the list of cooking devices owned by the user can be pre-stored in the memory 220 of the service bridge server 100.

[0118] The service bridge server 100 can identify whether a user has a second cooking device based on the received list of cooking devices (S425-1). For example, the service bridge server 100 can identify whether the list of cooking devices owned by the user includes "air fryer".

[0119] If the service bridge server 100 detects that the user has a second cooking device, it can send information about the second cooking device to the second user terminal device 110-2 via communication interface 210 (S430-1).

[0120] Information about the second cooking device sent to the second user terminal device 110-2 can be displayed on the display of the second user terminal device 110-2 in the form of a UI (S435-1).

[0121] The second user terminal device 110-2 can receive user input for controlling the second cooking operation of the second cooking device through the displayed UI (S440-1).

[0122] For example, the second user terminal device 110-2 can receive user input for controlling the "5-minute cooking" operation of the "air fryer".

[0123] However, the second user terminal device 110-2 is not limited to this, and can receive user input for controlling the second cooking operation of the second cooking device through a touch-type user interface or a button-type user interface.

[0124] The second user terminal device 110-2 can send a signal requesting a second cooking operation of the second cooking device to the service bridge server 100 (S445-1). The service bridge server 100 can receive the signal requesting the second cooking operation of the second cooking device by establishing a communication connection with the second user terminal device 110-2 via the communication interface 210.

[0125] The service bridge server 100 can send a signal requesting a second cooking operation from the second cooking device to the smart device server 140 via the communication interface 210 (S450-1). A signal requesting a second cooking operation from the second cooking device can also be sent from the smart device to the cooking device (S455-1).

[0126] For example, a signal requesting a "5-minute cooking" operation for an "air fryer" can be sent to a cooking device. However, the service bridge server 100 is not limited to this and can directly send a signal requesting a second cooking operation for a second cooking device by establishing a communication connection with the cooking device via the communication interface 210.

[0127] The cooking device 150 can perform a second cooking operation based on a signal requesting a second cooking operation from the second cooking device (S460-1).

[0128] For example, an air fryer can perform a "5-minute cooking" operation.

[0129] However, the service bridge server 100 is not limited to the above embodiments and can be implemented as an integrated server together with the recipe server 130 or the smart device server 140. Furthermore, the second user terminal device 110-2 can directly send a signal to the second cooking device requesting a second cooking operation from the second cooking device.

[0130] Figure 4b This is a sequence diagram illustrating a process in which an electronic device 200 performs a cooking operation according to other embodiments of the present disclosure, the electronic device identifying whether a user has cooking equipment and then sending instructions to the cooking equipment for controlling the cooking equipment.

[0131] refer to Figure 4b The service bridge server 100 can identify whether a user has a first cooking device based on a list of cooking devices the user possesses. If the first cooking device is not included in the list of cooking devices, the service bridge server 100 can identify that the user does not have a first cooking device (S405-2).

[0132] If it is detected that the user does not have the first cooking device, the service bridge server 100 can request cooking method information or information about a second cooking device that can replace the first cooking device by establishing a communication connection with the recipe server 130 via the communication interface 210 (S410-2).

[0133] The service bridge server 100 can establish a communication connection with the recipe server 130 via the communication interface 210, and receive information from the recipe server 130 about a cooking method that can replace the cooking operation of the first cooking device or about a second cooking device that can replace the first cooking device (S415-2).

[0134] However, the disclosed embodiments are not limited thereto, and the service bridge server 100 and the recipe server 130 can be implemented as an integrated server.

[0135] For example, the cooking stage can be a heating process or baking, and the first cooking device can be an "oven". In this case, the service bridge server 100 can receive information about the cooking method (e.g., grilling in a frying pan) or the cooking device (e.g., an air fryer) by requesting information from the recipe server 130 about the cooking method that can replace the "baking" operation of the "oven" or about the cooking device that can replace the "oven".

[0136] The service bridge server 100 can request a list of cooking devices owned by the user by establishing a communication connection with the smart device server 140 via the communication interface 210 (S420-2).

[0137] The service bridge server 100 can identify whether a user has a second cooking device based on a list of cooking devices (S430-2). If it is identified that a user has a second cooking device, the service bridge server 100 can send information about the second cooking device by establishing a communication connection with the second user terminal device 110-2 via the communication interface 210 (S435-2).

[0138] For example, the service bridge server 100 can identify whether the list of cooking devices owned by the user includes "air fryer". If the service bridge server 100 identifies that the user owns an "air fryer", it can send information about the "air fryer" to the second user terminal device 110-2.

[0139] When sending information about the second cooking operation of the second cooking device to the second user terminal device 110-2 (S440-2), the second user terminal device 110-2 can display a UI including information about the second cooking operation of the second cooking device on its display.

[0140] For example, a UI including information about the "5-minute cooking" operation of the "air fryer" can be displayed on the screen of the second user terminal device 110-2.

[0141] The second user terminal device 110-2 can receive input for controlling the second cooking operation of the second cooking device through the UI on the display (S445-2).

[0142] However, the second user terminal device 110-2 is not limited to this, and can receive user input for controlling the second cooking operation of the second cooking device through a touch-type user interface or a button-type user interface.

[0143] Upon receiving input for controlling a second cooking operation of a second cooking device, the second user terminal device 110-2 may send a signal to the service bridge server 100 requesting a second cooking operation of the second cooking device (S450-2).

[0144] For example, input for controlling the "5-minute cooking" operation of the "air fryer" can be received through the UI displayed on the user terminal device. Upon receiving this input, the second user terminal device 110-2 can send a signal to the service bridge server 100 requesting the "5-minute cooking" operation of the "air fryer".

[0145] Upon receiving a signal requesting a second cooking operation from the second cooking device, the service bridge server 100 can send the signal requesting the second cooking operation to the smart device server 140 via communication interface 210 (S455-2). Then, the smart device server 140 can send a signal requesting the second cooking operation to the second cooking device (S460-2). The second cooking device can then perform the second cooking operation upon receiving the signal requesting the second cooking operation (S465-2).

[0146] For example, upon receiving a signal requesting a "5-minute cooking" operation from an "air fryer," the service bridge server 100 can send the same signal to the smart device server 140. Then, the smart device server 140 can send the "5-minute cooking" operation request from the "air fryer," and the "air fryer" can perform the "5-minute cooking" operation.

[0147] However, the service bridge server 100 is not limited to the above embodiments and can be implemented as an integrated server together with the recipe server 130 or the smart device server 140. Furthermore, the second user terminal device 110-2 can directly send a signal to the second cooking device requesting a second cooking operation from the second cooking device.

[0148] Figure 4c and Figure 4d This is a sequence diagram illustrating the operation of an electronic device 200 sending and displaying cooking information to a user terminal device according to other embodiments of this disclosure.

[0149] refer to Figure 4c The service bridge server 100 may not be able to obtain information about the cooking equipment, or may identify that the user does not have a cooking equipment based on a list of cooking equipment owned by the user (S405-3). Specifically, the service bridge server 100 may identify that the user does not have a first cooking equipment based on a list of cooking equipment owned by the user. Furthermore, the service bridge server 100 may not be able to obtain information about a second cooking equipment that can replace the first cooking equipment, or may identify that the user does not have a second cooking equipment based on a list of cooking equipment owned by the user.

[0150] For example, the service bridge server 100 may identify that a user does not have an "oven" based on a list of cooking appliances the user owns. Furthermore, the service bridge server 100 may not have information about an "air fryer" that can replace an "oven," or may identify that a user does not have an "air fryer" based on a list of cooking appliances the user owns.

[0151] If information about cooking equipment is unavailable or if the user does not have cooking equipment is identified based on the list of cooking equipment, the service bridge server 100 can obtain cooking information about methods of cooking food without using the corresponding cooking equipment (S410-3).

[0152] refer to Figure 4d The service bridge server 100 can request cooking information about a method of cooking food without using a corresponding cooking device by establishing a communication connection with the recipe server 130 via the communication interface 210 (S410-4). Then, the service bridge server 100 can receive cooking information about a method of cooking food without using a corresponding cooking device by establishing a communication connection with the recipe server 130 via the communication interface 210 (S415-4).

[0153] For example, if the service bridge server 100 identifies that the user does not have an "oven" based on a list of cooking appliances the user possesses, it can obtain information about cooking methods that do not use an "oven" (e.g., "frying in a skillet"). Furthermore, if information about an "air fryer" that can replace an "oven" is not available, or if the service bridge server 100 identifies that the user does not have an "air fryer" based on a list of cooking appliances the user possesses, it can obtain information about cooking methods that do not use an "air fryer" (e.g., "frying in a skillet").

[0154] In addition, the service bridge server 100 can also request cooking information from the recipe server 130 for cooking food without using an "oven" or "air fryer", and receive information about cooking methods such as "frying in a skillet".

[0155] The service bridge server 100 can establish a communication connection with the second user terminal device 110-2 via the communication interface 210 and send the cooking information received from the recipe server 130 to the second user terminal device 110-2 (S415-3). When the cooking information is sent to the second user terminal device 110-2 (S420-3), the second user terminal device 110-2 can display a UI including the cooking information on the display.

[0156] For example, the second user terminal device 110-2 can receive information about cooking methods such as "frying in a frying pan". In this case, the second user terminal device 110-2 can display a UI on the display that includes information about the cooking method (e.g., "frying in a frying pan").

[0157] This description references Figures 5a to 5d The image and UI displayed on the monitor of a user terminal device in a system that provides online cooking classes via video call and remote device control technology are described.

[0158] Figure 5a This is a view of a screen used to illustrate an online cooking class conducted via video call (using a user terminal device) according to other embodiments of this disclosure.

[0159] refer to Figure 5a Images 510 of the instructor demonstrating cooking and conducting lessons can be displayed on the main screen of the user terminal device's monitor. These images 510 can be displayed on the user terminal device's monitor via live video call, or they can be images from a pre-recorded video call displayed on the user terminal device's monitor.

[0160] Images 520-1, 520-2, and 520-3 (showing images of other participants in the cooking class via video call) may be displayed on certain areas of the user terminal device's display. The areas of images 520-1, 520-2, and 520-3 displayed on the user terminal device's display may be located at the bottom of image 510 (which is the main screen where the instructor demonstrates cooking and conducts the class), but are not limited to this, and may be located in various display areas.

[0161] Images 520-1, 520-2, and 520-3 showing the presence of other participants in a cooking class via video call may be set on the user terminal device's display, depending on the number of participants in the cooking class, and may not be set on the display if there are no other participants.

[0162] Figure 5b This is a diagram illustrating a user interface (UI) for controlling a cooking appliance displayed on a screen of a user terminal device according to other embodiments of this disclosure.

[0163] refer to Figure 5b When an image 510 of an instructor demonstrating cooking and conducting a lesson is displayed on the main screen of the user terminal device's display, a UI 610-1 or 610-2 containing information about each stage of cooking the food can also be displayed in a portion of the user terminal device's display. The information about each stage of cooking the food may include a title for each cooking stage and information about the specific cooking operations within each cooking stage. Furthermore, the UI 610-1 or 610-2 containing information about each stage of cooking the food can be displayed together with a UI for receiving input for controlling the cooking operations of the cooking equipment used in each cooking stage. User input requesting control of the cooking equipment can be received via the UI displayed on the display of the second user terminal device 110-2.

[0164] For example, the UI 610-1 for the first cooking stage may include a cooking stage title of "trimming vegetables" and information about the specific cooking operation of "cutting into pieces the size of your thumb." The UI 610-2 for the second cooking stage may include a cooking stage title of "roasting meat" and information about the specific cooking operation of "oven / 190 degrees / 10 minutes." Furthermore, the UI 610-2 for the second cooking stage may also display a UI for receiving input for controlling "roasting meat in the oven at 190 degrees for 10 minutes." User input for receiving requests to control "roasting meat in the oven at 190 degrees for 10 minutes" can be received via the UI displayed on the monitor of the second user terminal device 110-2.

[0165] Figure 5c and Figure 5d This is a diagram illustrating a UI for controlling cooking equipment displayed on the screen of a user terminal device according to other embodiments of the present disclosure.

[0166] refer to Figure 5c If the user is identified by the first user terminal device 110-1 as not having the first cooking equipment used in the cooking phases designed by the instructor for the cooking course, the UI 610-3 includes information about a second cooking equipment that can replace the first cooking equipment and information about a second cooking operation performed by the second cooking equipment. This UI can be displayed together for receiving input for controlling the second cooking operation of the second cooking equipment.

[0167] For example, the "grilling stage" could be a cooking stage designed by the instructor through the first user terminal device 110-1. If the service bridge server 100 recognizes that the user does not have an "oven" for use in the "grilling stage," a UI including information about a "cooker" used in place of the "oven" and information about a cooking operation of "cooking in steak mode for 10 minutes using the cooker" can be displayed adjacent to a UI including information about the "grilling stage." Furthermore, a UI 610-3 including information about a second cooking device that can be used in place of the first cooking device and information about a second cooking operation performed by the second cooking device can be displayed together with a UI for receiving input for controlling "grilling in steak mode for 10 minutes using the cooker." User input for receiving a request to control the "cooker" for "grilling in steak mode for 10 minutes" can be received through the UI displayed on the monitor of the second user terminal device 110-2.

[0168] refer to Figure 5d In the case where the user is identified by the first user terminal device 110-1 as not having the first cooking equipment used in the cooking stage designed for a cooking course with an instructor, UI 610-4, which includes information about cooking methods that can be used in place of cooking operations performed by the first cooking equipment, may be displayed adjacent to UI 610-2, which includes information about the cooking stage displayed in a portion of the second user terminal device 110-2.

[0169] For example, the "grilling stage" could be a cooking stage designed by the instructor through the first user terminal device 110-1. If the service bridge server 100 recognizes that the user does not have an "oven" for use in the "grilling stage", it can display a UI that includes information about how to grill in a frying pan for 7 minutes instead of using an "oven baking operation".

[0170] As mentioned above, online cooking classes can be conducted via live video calls or remote device control technology.

[0171] Figure 6 , Figure 7a and Figure 7b This is a diagram illustrating in detail a system that provides replay of online cooking classes via video call and remote device control technology.

[0172] Figure 6 This is a sequence diagram illustrating the operation of an electronic device 200 storing image and audio data from a video call for a cooking lesson, according to other embodiments of the present disclosure.

[0173] The first user terminal device 110-1 can send image and audio data of the instructor conducting the cooking class via video call to the video call server (or video call infrastructure server) 120 (S605).

[0174] Then, the second user terminal device 110-2 can send the image and audio data of the participants in the cooking class conducted via video call to the video call server 120 (S610). However, the first user terminal device 110-1 and the second user terminal device 110-2 are not limited to this, and can also send and store the image and audio data of the cooking class conducted via video call to the user's local device and / or external device.

[0175] However, the first user terminal device 110-1 and the second user terminal device 110-2 are not limited to this, and can send the image and audio data of the cooking course conducted via video call to the service bridge server 100 through the communication interface 210.

[0176] Upon completion of the online cooking course, the second user terminal device 110-2 may send a request to the first user terminal device 110-1 to end the video call (S615).

[0177] Upon receiving a request to terminate the video call from the second user terminal device 110-2, the first user terminal device 110-1 may send a request to terminate the video call to the video call server 120 (S620).

[0178] Upon receiving a request to terminate the video call from the first user terminal device 110-1, the video call server 120 may terminate the video call (S625).

[0179] In the event that a video call has ended, the video call server 120 may send information about the end of the video call to the first user terminal device 110-1, the second user terminal device 110-2, and the service bridge server 100 (S630, S635, S640).

[0180] Upon receiving confirmation that a video call has ended, the service bridge server 100 can request information about the ended cooking class video call by establishing a communication connection with the video call server 120 via the communication interface 210 (S645). The service bridge server 100 can also receive information about the ended cooking class video call by establishing a communication connection with the video call server 120 via the communication interface 210 (S650). However, the service bridge server 100 is not limited to this and can also receive information about the ended cooking class video call stored on the user's local device or external device by establishing a communication connection with the user's local device or external device via the communication interface 210.

[0181] Information from a video call may include image data, audio data, and other shared data. Image data may also include images of food cooking. Food cooking images can be provided through video calls between multiple users and may include at least one cooking stage required for cooking the food and information about the cooking equipment required for each cooking stage.

[0182] Upon receiving image data, audio data, and other shared data from the video call server 120 of the completed cooking course video call, the service bridge server 100 may store the image data, audio data, and other shared data in the memory 220 (S655).

[0183] Figure 7a and Figure 7b This is a sequence diagram illustrating the process by which an electronic device 200, according to other embodiments of the present disclosure, identifies whether a user has cooking equipment during the process of replaying a cooking course based on image and audio data from a stored video call.

[0184] refer to Figure 7a The second user terminal device 110-2 can receive user input requesting to replay a cooking course that they want to watch again (S705-1).

[0185] The service bridge server 100 can establish a communication connection with the second user terminal device 110-2 via the communication interface 210, and receive signals from the second user terminal device 110-2 requesting image and audio data for a cooking class (S710-1). Furthermore, when switching cooking stages by establishing a communication connection with the second user terminal device 110-2 via the communication interface 210, the service bridge server 100 can receive shared data (e.g., chat data and data used for adjusting UI layout synchronization) between participants in a cooking class conducted via video call from the second user terminal device 110-2.

[0186] Upon receiving a signal requesting image and audio data for a cooking course, the service bridge server 100 can send the image and audio data for the cooking course stored in the second user terminal device 110-2 via a communication connection established through the communication interface 210 (S715-1).

[0187] Upon receiving image and audio data of a cooking lesson from the service bridge server 100, the second user terminal device 110-2 can replay the image and audio of the cooking lesson (S720-1).

[0188] When the second user terminal device 110-2 replays the images and audio of the cooking course, the second user terminal device 110-2 can display a UI (S725-1) on a portion of the display, including information about at least one cooking stage required to cook the food and the cooking equipment required for each cooking stage.

[0189] The second user terminal device 110-2 can receive user input (S730-1) for controlling the first cooking operation of the first cooking device used in the food cooking stage through the UI displayed on the screen.

[0190] However, the second user terminal device 110-2 is not limited to this, and can receive user input through a touch-type user interface or a button-type user interface.

[0191] Upon receiving user input for controlling a first cooking operation of a first cooking device, the second user terminal device 110-2 can send a signal requesting the first cooking operation of the first cooking device to the service bridge server 100 (S735-1). Upon receiving the signal requesting the first cooking operation of the first cooking device, the service bridge server 100 can send a signal requesting a list of cooking devices owned by the user to the smart device server 140 via communication interface 210 to establish a communication connection with the smart device server 140 (S740-1).

[0192] Here, for reference Figure 7b The second user terminal device 110-2 can be connected to the smart device server 140. In this case, a signal requesting a list of cooking devices owned by the user can be directly sent from the second user terminal device 110-2 to the smart device server 140 (S735-2), and a list of cooking devices owned by the user can be directly sent from the smart device server 140 to the second user terminal device 110-2 (S740-2).

[0193] The service bridge server 100 can receive a list of cooking devices owned by the user by establishing a communication connection with the smart device server 140 via the communication interface 210 (S745-1).

[0194] The service bridge server 100 can identify whether a user has a first cooking device based on a list of cooking devices owned by the user (S750-1).

[0195] The subsequent operations for processor 230 are the same as those mentioned above. Figures 4a to 5d The operations described are the same.

[0196] Figure 8 This is a flowchart illustrating the operation of an electronic device 200 according to other embodiments of the present disclosure.

[0197] While providing food cooking images to the user terminal device, the electronic device 200 can receive a signal from the user terminal device requesting a first cooking operation of the first cooking device for cooking food (S810).

[0198] Upon receiving the signal, the electronic device 200 can identify whether the user has the first cooking device based on a list of cooking devices owned by the user (S820).

[0199] If the electronic device 200 detects that the user does not have the first cooking device, it can send a signal to an external device to perform a second cooking operation that can replace the first cooking operation of the first cooking device (S830). On the other hand, if the electronic device 200 detects that the user has the first cooking device, it can send a control command to the first cooking device to control the first cooking device.

[0200] Specifically, if it is detected that the user does not have the first cooking equipment, the electronic device 200 can send cooking information to the user terminal device about the method of cooking food without using the first cooking equipment.

[0201] Furthermore, if it is detected that the user does not have the first cooking device, the electronic device 200 can obtain information about a second cooking device that can perform a second cooking operation that can replace the first cooking device, based on information about the first cooking device and the first cooking operation.

[0202] Having obtained information about a second cooking device, the electronic device 200 can identify whether the user has a second cooking device based on a list of cooking devices.

[0203] When the electronic device 200 detects that the user has a second cooking device, it can send control commands to the second cooking device to control the second cooking device.

[0204] If the electronic device 200 detects that the user has a second cooking device, it can receive user input regarding whether to control the second cooking device.

[0205] Upon receiving user input, the electronic device 200 can send control commands to the second cooking device for controlling the second cooking device.

[0206] The electronic device 200 can send information about the second cooking device and the second cooking operation to the user terminal device to provide information about the second cooking device and the second cooking operation to the user terminal device.

[0207] If information about the second cooking device is unavailable or if it is determined that the user does not possess the second cooking device, the electronic device 200 may send cooking information to the user terminal device regarding a method of cooking food without using the first cooking device.

[0208] This method may include and be provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)) or through an app store (e.g., the Play Store). TM Online distribution (e.g., downloading or uploading) or direct distribution between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) may be stored or made available at least temporarily in a machine-readable storage medium (e.g., a manufacturer's server storage, an app store's server storage, or a relay server storage).

[0209] Although embodiments have been shown and described above, the disclosed embodiments are not limited to the specific embodiments described above, and various modifications can be made by those skilled in the art to which the disclosed embodiments pertain without departing from the scope and spirit of the embodiments disclosed in the appended claims. These modifications should also be understood to fall within the scope of the disclosed embodiments.

Claims

1. An electronic device comprising: The communication interface is configured to establish communication connections with external devices. Memory, storing at least one instruction; as well as At least one processor, connected to the memory and configured to execute the at least one instruction. Wherein, the at least one instruction includes instructions for the following operations: While providing food cooking images to the user terminal device, the system also receives a signal from the user terminal device requesting a first cooking operation from a first cooking device for cooking food. In response to receiving a signal requesting the first cooking operation, the system identifies whether the user possesses the first cooking device based on a list of cooking devices the user owns, and... In response to the detection that the user does not have the first cooking device, a signal is sent to the external device to perform a second cooking operation, which can replace the first cooking operation of the first cooking device.

2. The electronic device according to claim 1, wherein, The at least one instruction further includes instructions for: in response to recognizing that the user has the first cooking device, sending control instructions to the first cooking device for controlling the first cooking device.

3. The electronic device according to claim 1, wherein, The at least one instruction further includes instructions for: in response to recognizing that the user does not have the first cooking device, sending cooking information to the user terminal device about a method of cooking food without using the first cooking device.

4. The electronic device according to claim 1, wherein, The at least one instruction further includes: In response to the detection that the user does not possess the first cooking device, based on information about the first cooking device and information about the first cooking operation, an attempt is made to obtain information about a second cooking device capable of performing the second cooking operation, which can substitute for the first cooking operation performed by the first cooking device. In response to obtaining information about the second cooking device, the system identifies whether the user possesses the second cooking device based on a list of cooking devices owned by the user, and In response to the recognition that the user has the second cooking device, a control command for controlling the second cooking device is sent to the second cooking device.

5. The electronic device according to claim 1, wherein, The at least one instruction further includes instructions for the following operations: In response to the detection that the user does not possess the first cooking device, information about a second cooking device capable of performing the second cooking operation is obtained based on information about the first cooking device and information about the first cooking operation, wherein the second cooking operation can replace the first cooking operation of the first cooking device. In response to obtaining information about the second cooking device, the system identifies whether the user possesses the second cooking device based on a list of cooking devices owned by the user. In response to recognizing that the user has the second cooking device, receive user input regarding whether to control the second cooking device, and In response to receiving user input for controlling the second cooking device, a control command for controlling the second cooking device is sent to the second cooking device.

6. The electronic device according to claim 4, wherein, The at least one instruction further includes instructions for the following operation: sending information about the second cooking device and information about the second cooking operation to the user terminal device, so as to provide the user with information about the second cooking device and information about the second cooking operation.

7. The electronic device according to claim 4, wherein, The at least one instruction further includes instructions for: in response to (i) recognizing that the user does not have the second cooking device or (ii) being unable to obtain information about the second cooking device, sending cooking information about a method of cooking food without using the cooking device to the user terminal device.

8. The electronic device according to claim 1, wherein, The at least one instruction further includes instructions for the following operations: Receive a request for the food cooking image from the user terminal device, and In response to receiving a request for the food cooking image, the system sends data of the food cooking image to the user terminal device to provide the food cooking image to the user.

9. The electronic device according to claim 1, in, The food cooking images are provided via video calls between multiple users, including the user in question, and The food cooking image includes information about at least one stage of the cooking process.

10. A method for controlling an electronic device, the method comprising: While providing food cooking images to the user terminal device, the system receives a signal from the user terminal device requesting a first cooking operation from a first cooking device for cooking food. In response to receiving a signal requesting the first cooking operation, the system identifies whether the user possesses the first cooking device based on a list of cooking devices the user has. as well as In response to the detection that the user does not have the first cooking device, a signal is sent to an external device to perform a second cooking operation, which can replace the first cooking operation of the first cooking device.

11. The control method according to claim 10, wherein, Sending the signal includes: in response to recognizing that the user has the first cooking device, sending a control command to the first cooking device for controlling the first cooking device.

12. The control method according to claim 10, wherein, Sending the signal includes: in response to recognizing that the user does not have the first cooking device, sending cooking information to the user terminal device about a method of cooking food without using the first cooking device.

13. The control method according to claim 10, wherein, Sending the signal includes: In response to the detection that the user does not have the first cooking device, based on information about the first cooking device and information about the first cooking operation, an attempt is made to obtain information about a second cooking device capable of performing the second cooking operation, which can replace the first cooking operation of the first cooking device; In response to obtaining information about the second cooking device, the user is identified as having the second cooking device based on a list of cooking devices owned by the user; and In response to the recognition that the user has the second cooking device, a control command for controlling the second cooking device is sent to the second cooking device.

14. The control method according to claim 10, wherein, Sending the signal includes: In response to the detection that the user does not have the first cooking device, based on information about the first cooking device and information about the first cooking operation, an attempt is made to obtain information about a second cooking device capable of performing the second cooking operation, which can replace the first cooking operation of the first cooking device; In response to obtaining information about the second cooking device, the user is identified as having the second cooking device based on a list of cooking devices owned by the user; In response to recognizing that the user has the second cooking device, receive user input regarding whether to control the second cooking device; and In response to receiving user input for controlling the second cooking device, a control command for controlling the second cooking device is sent to the second cooking device.

15. The control method according to claim 13, further comprising: The system sends information about the second cooking device and information about the second cooking operation to the user terminal device to provide the user with the information about the second cooking device and information about the second cooking operation.

Images