Electronic device and control method therefor

Abstract

Disclosed is an electronic device. The electronic device comprises a communication circuit, a memory for storing instructions, and at least one processor, wherein the at least one processor: identifies, on the basis of acquiring information about the intent of a user to be performed by using a plurality of robots, a plurality of capabilities for performing a plurality of tasks corresponding to the intent; identifies one or more robots having the plurality of identified capabilities among the plurality of robots on the basis of the capability of each of the plurality of robots; acquires standard format data including information about a task to be performed by each of the one or more robots in order that the one or more robots using pieces of data of different formats perform the plurality of tasks; and transmits the standard format data to the one or more robots via the communication circuit.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device for controlling a robot and a method for controlling the same.

[0002] Multiple robots can cooperate to perform specific tasks. In this case, each robot can execute an action by receiving information about the task from an electronic device. In various fields such as logistics, manufacturing, exploration, and the military, multiple robots can cooperate to maximize work efficiency and automation.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0004] An electronic device according to one embodiment may include at least one processor comprising a memory for storing instructions and a processing circuitry. For example, when the instructions are executed individually or collectively by the at least one processor, the electronic device may identify a plurality of capabilities for performing a plurality of tasks corresponding to a user's intent to perform using a robot based on acquiring information about the user's intent to perform the task using the robot, identify at least one robot among the plurality of robots having the identified plurality of capabilities based on the capabilities of each of the plurality of robots, acquire data in a standard format containing information about the task to be performed by each of the at least one robot using data of a different format, and transmit the data in the standard format to the at least one robot through the communication circuitry in order to enable the at least one robot using data of a different format to perform the plurality of tasks.

[0005] A control method for a device according to one embodiment may include: a step of identifying a plurality of functions for performing a plurality of tasks corresponding to a user's intention to perform using a robot based on obtaining information about the user's intention to perform the task using the robot; a step of identifying at least one robot having the identified plurality of functions among the plurality of robots based on the function of each of the plurality of robots; a step of obtaining data in a standard format including information about a task to be performed by each of the at least one robot in order to enable the at least one robot using data in a different format to perform the plurality of tasks; and a step of transmitting the data in the standard format to the at least one robot.

[0006] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0007] FIG. 1 is a drawing for explaining a system in which an electronic device controls robots according to one embodiment.

[0008] FIG. 2 is a block diagram of an exemplary electronic device according to one embodiment.

[0009] FIG. 3 is a flowchart illustrating an example of an operation in which an electronic device performs a user's intention through a plurality of robots according to one embodiment.

[0010] FIG. 4 is a diagram illustrating an example of an intention, a task for the intention, and a function of the intention stored in an intention database according to one embodiment.

[0011] FIG. 5 is a diagram illustrating an example of an operation for identifying multiple functions to perform multiple tasks based on information about a user's intention, according to one embodiment.

[0012] FIG. 6 is a drawing illustrating an example of a robot profile according to one embodiment.

[0013] FIG. 7 is a drawing illustrating an example of a function list according to one embodiment.

[0014] FIG. 8 is a drawing illustrating an example of a plurality of robot profiles according to one embodiment.

[0015] FIG. 9 is a diagram illustrating an example of an operation in which an electronic device identifies a robot among a plurality of robots to perform a task based on the function of each of the plurality of robots, according to one embodiment.

[0016] FIG. 10 is a diagram illustrating an example of an operation in which an electronic device identifies a robot among a plurality of robots to perform a task based on the function of each of the plurality of robots, according to one embodiment.

[0017] FIG. 11 is a drawing for illustrating an example of a standard format according to one embodiment.

[0018] FIG. 12 is a drawing for illustrating an example of data in a standard format according to one embodiment.

[0019] FIG. 13 is a diagram illustrating an example of data in a format used by a robot according to one embodiment.

[0020] FIG. 14 is a drawing for explaining a module that constitutes a system for controlling robots according to one embodiment.

[0021] The present disclosure will be described in detail below with reference to the attached drawings.

[0022] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this disclosure is not limited to the devices described above.

[0023] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0024] Throughout the specification, singular expressions include plural expressions unless the context clearly indicates otherwise. Wherever a part of the specification states that it "includes" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0025] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0026] FIG. 1 is a drawing for explaining a system in which an electronic device controls robots according to one embodiment.

[0027] Referring to FIG. 1, a system for controlling robots (11, 12, 13) may include at least one of an electronic device (100) and robots (11, 12, 13). For example, an environment for performing a user's intent in a workspace may be implemented using the system. The number of robots (or devices) shown in FIG. 1 is an example and is not limited thereto.

[0028] According to one embodiment, the electronic device (100) can operate the robots (10, 11, 12) in cooperation with one another or individually to perform a user's intention. In the present disclosure, a user's intention may mean a goal that the robots (10, 11, 12) are to perform. A user's intention may be input by a user through an input interface (e.g., touch screen, keyboard, etc.) of the electronic device (100) or received from an external electronic device through a communication circuit. A user's intention may include a goal that the user intends to perform using the system, such as logistics transport or coffee brewing.

[0029] A user's intention may include at least one task. An electronic device (100) may convert a user's intention into at least one task. In the present disclosure, a task may refer to an action performed by a robot to carry out a user's intention. For example, let us assume that a user's intention is to move logistics from point A to point B. At least one task may include a first task (e.g., moving to point A), a second task (e.g., loading logistics), a third task (e.g., moving to point B), and a fourth task (e.g., unloading logistics).

[0030] According to one embodiment, an electronic device (100) can transmit data containing information about a task to robots (10, 11, 12). The robots (10, 11, 12) can receive information about the task and perform an action corresponding to the task. The electronic device (100) can be implemented as various computing devices such as an edge controller, a workstation, a cloud, a data drive, or a data station. The electronic device (100) can be implemented as one or more servers that are physically or logically separated based on functions, detailed configurations of functions, or data, and can transmit and receive data and process the transmitted and received data through communication between each server.

[0031] According to one embodiment, the robots (10, 11, 12) may be robots that are placed (or located) in a workspace. The workspace may include a space such as a factory, a kitchen logistics center, or a cafe. The robots (10, 11, 12) may perform tasks to fulfill the user's intentions. The robots (10, 11, 12) may include robots for fulfilling the user's intentions, such as, for example, mobile robots, coffee brewing robots, welding robots, packaging robots, drones, or industrial robots. These robots are merely examples, and in addition to the robots mentioned above, other robots or robots that can be connected to an electronic device (100) to perform the operations described below may be included in the robots (10, 11, 12) according to one embodiment.

[0032] According to one embodiment, robots that do not have the capability for network communication for direct connection with the electronic device (100) can be connected to the electronic device (100) through a hub device. For example, the hub device communicates with the electronic device (100) using wired communication and / or wireless communication, and robots that do not have the capability for network communication for direct connection with the electronic device (100) can communicate using wired communication and / or wireless communication. For example, the hub device can communicate with robots that do not have the capability for network communication for direct connection with the electronic device (100) through a short-range wireless network such as Bluetooth, BLE (Bluetooth Low Energy), Wi-Fi, Zigbee, or Z-Wave.

[0033] According to one embodiment, the electronic device (100) can communicate with robots (10, 11, 12) through a network. For example, the electronic device (100) can transmit data to the robots (10, 11, 12) through a network and receive data from the robots (10, 11, 12).

[0034] For example, robots (10, 11, 12) can be connected via a network. The network may include at least one of a wide area network (WAN), such as the internet, a local area network (LAN), and a short-range wireless network formed around an access point (AP).

[0035] The robots (10, 11, 12) can be connected to a network. The network may include a network for remote communication, such as the Internet or a computer network (e.g., LAN or WAN). Additionally, the network may include a cellular network. A connection relay can connect the robots (10, 11, 12) or a hub device to the network to which the electronic device (100) is connected.

[0036] FIG. 2 is a block diagram of an exemplary electronic device according to one embodiment.

[0037] The electronic device (100) of FIG. 1 may correspond to the electronic device (100) of FIG. 2. The electronic device (100) of FIG. 2 may include the electronic device (100) of FIG. 1. Referring to FIG. 2, the electronic device (100) may include at least one processor (110) (hereinafter referred to as processor (110)), at least one memory (120) (hereinafter referred to as memory (120)), at least one communication circuit (130) (hereinafter referred to as communication circuit (130)), and at least one display (240) (hereinafter referred to as display (240)).

[0038] The components illustrated in FIG. 2 are merely exemplary. For example, the electronic device (100) may include other components (e.g., power management integrated circuitry (PMIC), antenna and / or input / output interface). For example, some components may be omitted from the electronic device (100). For example, some components may be integrated into a single component.

[0039] A processor (110) can control the overall operation of an electronic device (100). Specifically, the processor (110) can control the overall operation of the electronic device (100) by being connected to each component of the electronic device (100). The processor (110) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. The processor (110) can control one or any combination of other components of the electronic device (100) and can perform operations or data processing related to communication. The processor (110) can execute one or more programs or instructions stored in the memory (120) of the electronic device (100). For example, the processor (110) can perform the method according to one embodiment of the present disclosure by executing one or more instructions stored in memory (120).

[0040] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0041] The processor (110) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When the processor (110) is implemented as a multicore processor, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one embodiment of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one embodiment of the present disclosure.

[0042] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0043] The memory (120) can store data necessary for various embodiments. Depending on the purpose of data storage, the memory (120) may be implemented in the form of a memory embedded in the electronic device (100) or in the form of a memory that can be attached to and detached from the electronic device (100). For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in a memory that can be attached to and detached from the electronic device (100). Meanwhile, the memory embedded in the electronic device (100) may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (one-time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash, etc.), hard drive, or solid state drive (SSD). Additionally, the memory that is detachable from the electronic device (100) may be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory connectable to a USB port (e.g., USB memory), etc. there is.

[0044] Instructions may be stored in the memory (120). The processor (110) may perform the operation of the electronic device (100) according to various embodiments of the present disclosure by executing the instructions stored in the memory (120) individually or collectively. Additionally, programs and data for operating the electronic device (100) may be stored in the memory (120). For example, the memory (120) may store one or more software applications, such as operating system (or system) software applications, firmware software applications, driver software applications, plugin (e.g., add-in, add-on, and / or applet) software applications, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (110). For example, memory (120) can store instructions that can be called by an API (application programming interface). For example, memory (120) can store instructions within a library.

[0045] In the above-described embodiment, various data is described as being stored in the external memory (120) of the processor (110), but at least some of the above-described data may be stored in the internal memory of the processor (110) according to at least one implementation example of the electronic device (100) or the processor (110).

[0046] In the embodiments of the present disclosure, a processor may mean a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto.

[0047] The electronic device (100) can communicate with an external device (e.g., a server device and / or an external device) through a communication circuit (130). The processor (110) can receive various data or information from an external device connected through the communication circuit (130) and can transmit various data or information to the external device.

[0048] The communication circuit (130) can communicate with an external device through a nearby access point (AP). The access point (AP) can connect the local area network (LAN) to which the electronic device (100) is connected to a wide area network (WAN) to which the external device is connected. The electronic device (100) can be connected to the external device through the network (WAN). Additionally, the communication circuit (130) can perform device-to-device (D2D) communication with the external device. For example, the communication circuit (130) can communicate with the external device over short distances without using an access point.

[0049] The communication circuit (130) can communicate with an external device using various types of communication methods. For example, the communication circuit (130) may include a LAN communication module such as an Ethernet module. The communication circuit (130) may include wireless communication modules such as Wi-Fi, Wi-Fi Direct, Bluetooth, BLE (Bluetooth Low Energy), Zigbee, NFC, Z-Wave, and infrared communication. The communication circuit (130) may include cellular communication modules such as 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), and 5G. The communication circuit (130) may include communication modules such as HDMI (High-Definition Multimedia Interface) and USB (Universal Serial Bus).

[0050] FIG. 3 is a flowchart illustrating an example of an operation in which an electronic device performs a user's intention through a plurality of robots according to one embodiment.

[0051] The processor (110) of the electronic device (100) can perform at least one of the operations of FIG. 3. When the instructions stored in the memory (120) of the electronic device (100) are executed by the processor (110) of the electronic device (100), the electronic device (100) can perform the operations of FIG. 3.

[0052] In operation 310, according to one embodiment, the electronic device (100) can obtain information about the user's intention to perform using a robot. For example, the electronic device (100) can receive information about the user's intention from the user through an input interface or through a communication circuit (130).

[0053] According to one embodiment, a user's intention may include a name of the intention and a plurality of parameters corresponding to the intention. The plurality of parameters may include types of data required to perform the intention. For example, if the user's intention is an action of transporting a box, the user's intention may include a name of the intention (e.g., transporting a box) and a plurality of parameters (e.g., automatic loading / or unloading method, weight, origin, destination).

[0054] According to one embodiment, information regarding a user's intention may include the name of the intention the user intends to perform and the values ​​of a plurality of parameters. For example, if the intention the user intends to perform is to transport a box, the information regarding the user's intention may include the name of the intention (e.g., transport box) and the values ​​for a plurality of parameters (e.g., loading / or unloading method: automatic, weight: 10 kg, origin: A, destination: B).

[0055] In operation 320, according to one embodiment, the electronic device (100) can identify a plurality of capabilities for performing a plurality of tasks corresponding to an intention. Capabilities may include functions that a robot can provide. A plurality of capabilities may include, for example, a movement function, an automatic loading function, an automatic unloading function, a coffee brewing function, a portioning function, etc. These robot capabilities are merely examples, and in addition to the aforementioned functions, a plurality of capabilities may include various functions such as a stair climbing function, a welding function, etc., depending on the information regarding functions stored in the intention database.

[0056] According to one embodiment, the electronic device (100) can identify a plurality of functions for performing a plurality of tasks corresponding to an intention based on information about the user's intention.

[0057] For example, the electronic device (100) can identify a user's intention stored in an intention database based on the name of the intention the user intends to perform. The intention database may be stored in the memory (120) of the electronic device (100). The intention database may include information for a plurality of intentions, a plurality of parameters corresponding to the intention, a plurality of task templates corresponding to the intention, and a plurality of function templates corresponding to the plurality of task templates.

[0058] For example, the electronic device (100) can identify multiple tasks corresponding to an identified intention based on the values ​​of the parameters. The electronic device (100) can identify a function corresponding to each task based on the values ​​of the parameters. The electronic device (100) can identify a function corresponding to each task based on mapping information for multiple tasks corresponding to the intention and a function corresponding to each of the multiple tasks. The mapping information for multiple tasks corresponding to the intention and a function corresponding to each of the multiple tasks can be stored in an intention database.

[0059] Information stored in the intent database may be stored at the time of manufacturing or initial use, or may be generated based on user input. Additionally, information stored in the intent database may be updated periodically or as needed.

[0060] The operation of the intention database and electronic device (100) identifying multiple functions for performing multiple tasks based on information about the user's intention is described in detail in FIGS. 4 and FIGS. 5.

[0061] In operation 330, according to one embodiment, the electronic device (100) can identify at least one robot having identified multiple functions among a plurality of robots (e.g., robots (10, 11, 12) of FIG. 1) based on the function of each of the plurality of robots. The at least one robot identified by the electronic device (100) may include a robot for performing a task corresponding to a user's intention. The identified multiple functions may include functions corresponding to a plurality of tasks for performing a user's intention.

[0062] According to one embodiment, the electronic device (100) can identify a robot capable of performing a plurality of identified functions among a plurality of robots based on information stored in a function database. The function database may be stored in the memory (120) of the electronic device (100). The function database may include information about a robot profile that includes the name of the robot, the type of the robot, and information about the functions of the robot.

[0063] A robot profile may refer to a data item for an electronic device (100) to identify a robot and define the functions of the robot. The electronic device (100) can register and control the robot to the electronic device (100) using the robot profile. For example, the robot profile may include at least one of the robot's name, robot type, ID (identifier), IP (internet protocol) address, and functions. Meanwhile, a description of the robot profile is explained in detail in FIG. 6.

[0064] According to one embodiment, an electronic device (100) can identify at least one robot having a plurality of functions based on a function database. The plurality of functions (hereinafter referred to as a plurality of functions corresponding to an intention) may include functions corresponding to a plurality of tasks for performing a user's intention. For example, the electronic device (100) can identify a robot that includes at least one of the plurality of functions corresponding to an intention by comparing the functions of each of the plurality of robots with the plurality of functions corresponding to the intention.

[0065] According to one embodiment, if it is identified that a single robot can perform all multiple functions corresponding to an intention, the electronic device (100) can identify the single robot as a robot for performing a task. For example, the electronic device (100) can identify that a single robot can perform all multiple functions corresponding to an intention when the functions of the single robot include all multiple functions corresponding to an intention.

[0066] For example, let us assume a case where multiple functions corresponding to an intention include a first function (e.g., movement function), a second function (e.g., loading function), and a third function (e.g., unloading function), and a first robot includes the first function, the second function, the third function, and a fourth function (e.g., coffee brewing function), a second robot includes the fourth function, and a third robot includes the first function. The electronic device (100) can identify a robot capable of performing all of the multiple functions corresponding to an intention (e.g., first function, second function, and third function) based on the functions of each of the multiple robots. For example, the electronic device (100) can identify the first robot as a robot for performing a task because the functions of the first robot (e.g., first function, second function, and third function, first function, second function, third function, and fourth function) include all of the multiple functions corresponding to an intention (e.g., first function, second function, and third function).

[0067] According to one embodiment, when there are multiple robots capable of performing multiple functions corresponding to an intention, the electronic device (100) can identify one of the multiple robots as a robot for performing a task.

[0068] According to one embodiment, if it is identified that a plurality of robots can perform a plurality of functions corresponding to an intention, the electronic device (100) can identify the plurality of robots as robots for performing a task.

[0069] For example, if a first robot capable of performing some of the identified multiple functions and a second robot capable of performing the remainder are identified among a plurality of robots, the electronic device (100) can identify the first robot and the second robot as robots for performing tasks.

[0070] For example, among multiple functions corresponding to an intention (e.g., a first function, a second function, and a third function), if the first function and the second function can be performed by the first robot and the third function can be performed by the second robot, the electronic device (100) can identify the first robot and the second robot as robots for performing the task.

[0071] For example, among multiple functions corresponding to an intention (e.g., first function, second function, third function, and fourth function), if the first function can be performed by the first robot, the second function can be performed by the second robot, and the third function and fourth function can be performed by the third robot, the electronic device (100) can identify the first robot, the second robot, and the third robot as robots for performing the task.

[0072] According to one embodiment, when there are multiple robots capable of performing all of the multiple functions corresponding to the intention, the electronic device (100) can identify the case where the user's intention is performed through the smallest number of robots. For example, if among the multiple robots, a first number of robots and a second number of robots greater than the first number are identified as capable of performing the identified multiple functions, the electronic device (100) can identify that the first number of robots performs the multiple tasks. That is, the electronic device (100) can identify the robot corresponding to the case where the user's intention is performed through the smallest number of robots as the robot for performing the task.

[0073] For example, let us assume that there are cases where multiple functions corresponding to an intention are all performed, such as a first case (e.g., a case where multiple functions corresponding to an intention are all performed through the first robot and the second robot) and a second case (e.g., a case where multiple functions corresponding to an intention are all performed through the first robot, the second robot, and the third robot). The electronic device (100) can identify the case where the user's intention is performed through the smallest number of robots (e.g., the first case). The electronic device (100) can identify the robots corresponding to the first case (e.g., the first robot and the second robot) as robots for performing a task.

[0074] In operation 340, according to one embodiment, the electronic device (100) can acquire data in a standard format containing information about a task to be performed by each of at least one robot in order to enable at least one robot using data of a different format to perform a plurality of tasks.

[0075] In the present disclosure, a format may refer to a method of structuring data. That is, a format may refer to rules defined to enable a robot to interpret and process data. Data may include information about a task. The format may vary depending on the robot's hardware configuration, control method, or manufacturer.

[0076] According to one embodiment, a robot can perform a task using data of a specific format. Data of a specific format may refer to data converted into a format used by a specific robot.

[0077] According to one embodiment, the electronic device (100) can acquire data in a standard format. The standard format may refer to common rules defined so that a plurality of robots can interpret and process the data. The electronic device (100) can acquire data in a standard format based on information regarding a task to be performed by each of at least one robot.

[0078] In operation 350, according to one embodiment, the electronic device (100) can transmit data in a standard format to at least one robot through a communication circuit (130). The at least one robot may include a robot for performing a task.

[0079] According to one embodiment, a robot that receives data in a standard format can acquire data in a format used by each robot based on the data in the standard format. The robot can perform a task using the converted data. The description of the data in the standard format and the data in the format used by the robot is explained in detail in FIGS. 11 to 13.

[0080] FIG. 4 is a diagram illustrating an example of an intention, a task for the intention, and a function of the intention stored in an intention database according to one embodiment.

[0081] Referring to FIG. 4, according to one embodiment, an electronic device (100) can store intentions, a plurality of tasks, and a plurality of functions in an intention database.

[0082] According to one embodiment, the electronic device (100) may store information (410) regarding a user's intention (e.g., carrying a box) and a plurality of parameters (e.g., automatic, weight, src, dest) corresponding to the user's intention. The plurality of parameters may include information regarding whether automatic loading is performed (e.g., automatic), the weight of the loaded item (e.g., weight), the starting point (e.g., src), and the destination (e.g., dest).

[0083] According to one embodiment, the electronic device (100) may store task templates (420) corresponding to each of a plurality of user intentions in an intention database. For example, the electronic device (100) may create a task by inserting parameter values ​​for a user's intention into a placeholder of the task template (420). The electronic device (100) may obtain parameter values ​​based on information regarding a user's intention. A placeholder may be a location in the task template where parameter values ​​are inserted. A placeholder to which a parameter value is mapped may be designated for each parameter value. For example, the electronic device (100) may create a plurality of tasks by inserting parameter values ​​into placeholders.

[0084] According to one embodiment, the electronic device (100) may store information about a plurality of function templates (430) corresponding to a plurality of task templates in an intention database. The electronic device (100) may create a function by inserting parameter values ​​for the user's intention into placeholders of the function templates (430).

[0085] For example, the electronic device (100) may store information in an intention database regarding a function for performing a first task (e.g., a point-moving task) (e.g., a moving function), a function for performing a second task (e.g., a loading task) (e.g., a loading function), a function for performing a third task (e.g., a point-moving task) (e.g., a moving function), and a function for performing a fourth task (e.g., a loading task) (e.g., a loading function).

[0086] Meanwhile, the user's intent, task template, and function template illustrated in FIG. 4 are merely examples and are not limited to the examples described above. For example, the user's intent (e.g., brewing coffee, climbing stairs), the task template, and the function template corresponding to said intent can be generated or updated based on the user's input.

[0087] FIG. 5 is a diagram illustrating an example of an operation for identifying multiple functions to perform multiple tasks based on information about a user's intention, according to one embodiment.

[0088] Referring to FIG. 5, according to one embodiment, an electronic device (100) can obtain information (510) regarding the name of the intention (e.g., carrying a box) and the values ​​of parameters for the intention (e.g., automatic: automatic, weight: 10kg, src: A, dest: B) based on information regarding the user's intention.

[0089] According to one embodiment, the electronic device (100) can obtain a plurality of tasks and a plurality of functions for each of the plurality of tasks by inserting values ​​of parameters into places of a task template and a function template.

[0090] For example, an electronic device (100) can obtain information (520) regarding a first task (e.g., moving to point A) and a function corresponding to the first task (e.g., a moving function), a second task (e.g., automatic loading) and a function corresponding to the second task (e.g., an automatic loading function (10kg)), a third task (e.g., moving to point B) and a function corresponding to the third task (e.g., a moving function), a fourth task (e.g., automatic unloading) and a function corresponding to the fourth task (e.g., an automatic unloading function (10kg)).

[0091] FIG. 6 is a drawing illustrating an example of a robot profile according to one embodiment.

[0092] Referring to FIG. 6, the robot profile (620) may include at least one of the following information regarding the name of the robot (610), the type of the robot, an ID (identifier), an IP (internet protocol) address, and a function. The type of the robot may be for classifying the robot according to its role or function. The ID of the robot may include an identifier for identifying a specific robot. The IP of the robot may include information regarding the IP address of the robot connected to the network.

[0093] According to one embodiment, the electronic device (100) can receive information from a user regarding the name of the robot (e.g., the fifth robot), the type of the robot (e.g., a transport robot), and the functions of the robot (e.g., a movement function, an automatic loading function (10kg), an automatic unloading function (10kg)).

[0094] According to one embodiment, the electronic device (100) may store a list of functions in memory (120). When the electronic device (100) receives user input for selecting some of the functions included in the list of functions, it may identify the selected functions as the functions of the robot. A description of the robot function list is explained in detail in FIG. 7.

[0095] The electronic device (100) can store information received from a user in a function database included in the memory (120). However, it is not limited to this, and the electronic device (100) can receive information about a robot profile from an external electronic device through a communication circuit (130).

[0096] FIG. 7 is a drawing illustrating an example of a function list according to one embodiment.

[0097] Referring to FIG. 7, the electronic device (100) can store a function list (710) in memory (120). The function list (710) may include a plurality of function items (e.g., movement function item, automatic loading function item, automatic unloading function item, stair climbing function item, coffee brewing function item, dispensing function or vision function item).

[0098] When registering a robot profile, the user can select functions (720) that the robot can perform (e.g., movement function item, automatic loading function item, automatic unloading function item) from among multiple function items included in the function list (710). The electronic device (100) can register the selected functions (720) in the robot profile.

[0099] Meanwhile, when a user selects functions that a robot can perform from a list of functions stored in memory (120), the electronic device (100) registers the selected functions in the robot profile, thereby allowing the robot's functions to be registered conveniently without the need to input information about the robot's functions every time the robot profile is registered.

[0100] FIG. 8 is a drawing illustrating an example of a plurality of robot profiles according to one embodiment.

[0101] Referring to FIG. 8, the electronic device (100) can store information (810) for a plurality of robot profiles in a functional database.

[0102] For example, the electronic device (100) may store information about a first robot profile including the name of the first robot (820-1) (e.g., first robot), the type of the robot (e.g., transport robot), information about the ID, IP address, and functions (e.g., movement function, automatic loading function (3kg), automatic unloading function (3kg)).

[0103] For example, the electronic device (100) may store information about a second robot profile including the name of the second robot (820-2) (e.g., second robot), the type of the robot (e.g., transport robot), information about the ID, IP address, and functions (e.g., movement function, automatic loading function (2kg), automatic unloading function (2kg), stair climbing function).

[0104] For example, the electronic device (100) may store information about a first robot profile including the name of the third robot (820-3) (e.g., third robot), the type of robot (e.g., transport robot), information about the ID, IP address, and functions (e.g., movement function, transport function (15kg)).

[0105] For example, the electronic device (100) may store information about a fourth robot profile including the name of the fourth robot (820-4) (e.g., fourth robot), the type of robot (e.g., subdivision robot), information about the ID, IP address, and functions (e.g., movement function, vision function, subdivision function).

[0106] For example, the electronic device (100) may store information about a fifth robot profile including the name of the fifth robot (820-5) (e.g., fifth robot), the type of robot (e.g., transport robot), information about the ID, IP address, and functions (e.g., movement function, automatic loading function (10kg), automatic unloading function (10kg)).

[0107] For example, the electronic device (100) may store information about the sixth robot profile including the name of the sixth robot (820-6) (e.g., the sixth robot), the type of the robot (e.g., a coffee brewing robot), information about the ID, the IP address, and the function (e.g., a coffee brewing function).

[0108] Meanwhile, the robot profile illustrated in FIG. 8 is an example, and the present disclosure is not limited thereto.

[0109] FIG. 9 is a diagram illustrating an example of an operation in which an electronic device identifies a robot among a plurality of robots to perform a task based on the function of each of the plurality of robots, according to one embodiment.

[0110] Referring to FIG. 9, the electronic device (100) can identify multiple functions (910) for performing multiple tasks (e.g., movement function, automatic loading function (10kg), automatic unloading function (10kg)). Since the method for identifying multiple functions for performing multiple tasks based on the user's intention has been described in detail in operation 320 of FIG. 3, redundant content is omitted.

[0111] According to one embodiment, the electronic device (100) can identify a robot for performing a task based on a function database. For example, the electronic device (100) can identify a robot (930) (e.g., a fifth robot) using a plurality of robot profiles (920) stored in a function database.

[0112] For example, the electronic device (100) can compare the functions of each of the multiple robots with the multiple functions corresponding to the intention to identify a robot (930) that includes all of the multiple functions corresponding to the intention (e.g., movement function, automatic loading function (10kg), automatic unloading function (10kg)) for the robot.

[0113] According to one embodiment, when an electronic device (100) identifies a robot (930) capable of performing multiple functions among a plurality of robots, it can acquire data in a standard format containing information on a plurality of tasks to be performed by the robot (930). The electronic device (100) can transmit the data in the standard format to the robot (930) through a communication circuit (130).

[0114] FIG. 10 is a diagram illustrating an example of an operation in which an electronic device identifies a robot among a plurality of robots to perform a task based on the function of each of the plurality of robots, according to one embodiment.

[0115] Referring to FIG. 10, the electronic device (100) can identify multiple functions (1010) (e.g., moving function, dispensing function, coffee extraction function) for performing multiple tasks.

[0116] According to one embodiment, if it is identified that a plurality of robots can perform a plurality of functions corresponding to an intention, the electronic device (100) can identify the plurality of robots as robots for performing a task.

[0117] According to one embodiment, the electronic device (100) can identify a robot for performing a task based on a function database. For example, the electronic device (100) can identify a robot for performing a task (e.g., a fourth robot (1030-1) and a sixth robot (1030-2)) using a plurality of robot profiles (1020) stored in a function database.

[0118] According to one embodiment, when a robot (1030-1, 1030-2) capable of performing a plurality of functions among a plurality of robots is identified, the electronic device (100) can obtain data in a standard format containing information on a plurality of tasks to be performed by the robot (1030-1, 1030-2). The electronic device (100) can transmit the data in the standard format to the robot (1030-1, 1030-2) through a communication circuit (130).

[0119] FIG. 11 is a drawing for illustrating an example of a standard format according to one embodiment.

[0120] Referring to FIG. 11, the standard format (1110) may include the name of the intention, the place where the intention is performed, the priority of the intention, and information about the task (1120, 1130).

[0121] The place where the intention is executed may refer to information about the space where the robot executing the intention is located. The priority of the intention may refer to information about the order of operations of the intentions when the robot receives multiple intentions. Information about the task (1120, 1130) may include information about the name of the task, the item of the task, event information, condition of the task, and action.

[0122] The task object may include information regarding the work item (e.g., a box), a description of the work item, and the weight of the work item. Event information may include information regarding a description of the task action, the timing of the task action, and the type of task action (e.g., immediate execution, time-based execution). Work conditions may include information regarding a description of the work condition (e.g., no condition) and the type of condition (e.g., no condition, found, docked, undocking). Information regarding the action may include a description of the action and information regarding the type of action (e.g., movement, unloading, loading, etc.).

[0123] FIG. 12 is a drawing for illustrating an example of data in a standard format according to one embodiment.

[0124] Referring to FIG. 12, according to one embodiment, an electronic device (100) can obtain data in a standard format based on information about the user's intention.

[0125] For example, the electronic device (100) can obtain the name of the intention that the user intends to perform using the robot and the values ​​of parameters for the intention based on information about the user's intention. The electronic device (100) can obtain information about a plurality of tasks corresponding to the intention based on the parameter values.

[0126] For example, the electronic device (100) can obtain at least one of the name of the user's intention (e.g., move box), the name of the task (e.g., move point A), information about the target of the task (e.g., box, 10kg), event information (e.g., 12:13 action, immediate action), work conditions (e.g., no conditions), and information about the action (e.g., move) based on information about the user's intention. The electronic device (100) can obtain data in a standard format based on information about the user's intention. The electronic device (100) can transmit data in a standard format to at least one robot through a communication circuit (130).

[0127] FIG. 13 is a diagram illustrating an example of data in a format used by a robot according to one embodiment.

[0128] As described above, the format used by the robot may vary depending on the hardware configuration, control method, or manufacturer of the robot. According to one embodiment, the robot can acquire data in the format used by each robot based on data in the standard format received from the electronic device (100). That is, the robot can convert data in the standard format into data in the format used by the robot.

[0129] According to one embodiment, a robot can parse data in a standard format received from an electronic device (100). The robot can extract information about a task from the data in the standard format. Based on the extracted information, the robot can generate data in a format used by the robot. The robot can perform a task using the data in the format used by the robot.

[0130] Meanwhile, the format illustrated in FIG. 13 is an example of a format used in a robot, and the format used in a robot is not limited to this. The format used in a robot may vary from robot to robot.

[0131] FIG. 14 is a drawing for explaining a module that constitutes a system for controlling robots according to one embodiment.

[0132] Referring to FIG. 14, the electronic device (100) may include a capability management system (1410), an intent management system (1420), and a task-facing interface.

[0133] According to one embodiment, the electronic device (100) can register and manage robot profiles through a function management system (1410). For example, the electronic device (100) can store information about the robot's name, robot type, and robot function in a function database based on user input. The electronic device can identify at least one robot having identified multiple functions among multiple robots based on the function of each of the multiple robots through the function management system (1410).

[0134] According to one embodiment, an electronic device (100) can register and manage a user's intention, a plurality of tasks, and functions corresponding to the plurality of tasks through an intention management system (1420). For example, the electronic device (100) can store an intention, a plurality of tasks, and a plurality of functions in an intention database based on user input. The electronic device (100) can identify an intention, a plurality of tasks corresponding to the intention, and a plurality of functions for performing the plurality of tasks based on information regarding the user's intention through the intention management system (1420).

[0135] According to one embodiment, the electronic device (100) may generate data in a standard format containing information about a task to be performed by each of at least one robot in order to enable at least one robot to perform a plurality of tasks through a task interface (1430). The electronic device (100) may transmit the data in the standard format to at least one robot through a communication circuit (130).

[0136] According to one embodiment, at least one robot (1450) (hereinafter referred to as robot (1450)) can receive data in a standard format from an electronic device (100). The robot (1450) can convert the data in the standard format into a format used by the robot (1450). The robot (1450) can perform a task using the acquired data.

[0137] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs.

[0138] An electronic device according to one embodiment as described above may include at least one processor comprising a memory for storing instructions and a processing circuitry.

[0139] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may identify a plurality of capabilities for performing a plurality of tasks corresponding to the intent based on acquiring information about the user's intent to perform using the robot, identify at least one robot among the plurality of robots having the identified plurality of capabilities based on the capabilities of each of the plurality of robots, acquire data in a standard format containing information about the tasks to be performed by each of the at least one robot using data of a different format, and transmit the data in the standard format to the at least one robot through the communication circuit in order to enable the at least one robot using data of a different format to perform the plurality of tasks.

[0140] For example, each of the above at least one robot may be configured to acquire data in a format used by each robot based on data in the standard format received from the electronic device, and to perform a task using the acquired data.

[0141] For example, the memory may store an intent database that includes information for each of the multiple intents, such as the name of the intent, parameters for the intent, multiple task templates corresponding to the intent, and multiple function templates corresponding to the multiple task templates.

[0142] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may obtain the name of the intention that the user intends to perform using the robot and the values ​​of parameters for the intention based on information regarding the user's intention, obtain a plurality of task templates corresponding to the intention and a plurality of function templates corresponding to the plurality of task templates from the intention database based on the obtained name of the intention, and fill the placeholders of the obtained plurality of task templates and the placeholders of the obtained plurality of function templates with the values ​​of the obtained parameters to identify a plurality of tasks corresponding to the intention and a plurality of functions for performing the plurality of tasks.

[0143] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may receive information regarding the name of the robot, the type of the robot, and the function of the robot from the user for each of the plurality of robots, and store a robot profile including the information regarding the name of the robot, the type of the robot, and the function of the robot in a function database included in the memory.

[0144] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may identify at least one robot corresponding to at least one robot profile having the identified plurality of functions among the plurality of robots based on the function database.

[0145] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may acquire data in a standard format containing information about the plurality of tasks to be performed by the robot when a robot capable of performing the identified plurality of functions among the plurality of robots is identified, and transmit the data in the standard format to the robot through the communication circuit.

[0146] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may acquire a first data in a standard format containing information on some tasks to be performed by the first robot and a second data in a standard format containing information on the remaining tasks to be performed by the second robot when a first robot capable of performing some of the identified multiple functions and a second robot capable of performing the remainder are identified among the plurality of robots, and transmit the first data in the standard format to the first robot through the communication circuit and transmit the second data in the standard format to the second robot through the communication circuit.

[0147] For example, when the above instructions are executed individually or collectively by the at least one processor, if the electronic device identifies that a first number of robots and a second number of robots greater than the first number of robots among the plurality of robots can perform the identified plurality of functions, it identifies that the first number of robots performs the plurality of tasks, obtains data in a standard format containing information about the plurality of tasks to be performed by the first number of robots, and transmits the data in the standard format to the first number of robots through the communication circuit.

[0148] A control method for a device according to one embodiment may include: a step of identifying a plurality of capabilities for performing a plurality of tasks corresponding to a user's intent to perform using a robot based on obtaining information about the intent of the user to perform the task using the robot; a step of identifying at least one robot among the plurality of robots having the identified plurality of capabilities based on the capabilities of each of the plurality of robots; a step of obtaining data in a standard format containing information about a task to be performed by each of the at least one robot in order to enable the at least one robot using data in a different format to perform the plurality of tasks; and a step of transmitting the data in the standard format to the at least one robot.

[0149] For example, each of the above at least one robot may be configured to acquire data in a format used by each robot based on data in the standard format received from the electronic device, and to perform a task using the acquired data.

[0150] 136 For example, the electronic device may include a memory that stores an intention database containing information for a plurality of intentions, the name of the intention, parameters for the intention, a plurality of task templates corresponding to the intention, and a plurality of function templates corresponding to the plurality of task templates.

[0151] For example, the step of identifying multiple functions for performing multiple tasks corresponding to the above intention may include: a step of obtaining the name of the intention that the user intends to perform using the robot and the values ​​of parameters for the intention based on information regarding the user's intention; a step of obtaining multiple task templates corresponding to the intention and multiple function templates corresponding to the multiple task templates from the intention database based on the obtained name of the intention; and a step of filling the placeholders of the obtained multiple task templates and the placeholders of the obtained multiple function templates with the values ​​of the obtained parameters to identify multiple tasks corresponding to the intention and multiple functions for performing the multiple tasks.

[0152] For example, the control method may include the step of receiving information from a user regarding the name of the robot, the type of the robot, and the function of the robot for each of the plurality of robots, and the step of storing a robot profile including the information regarding the name of the robot, the type of the robot, and the function of the robot in a function database included in the memory of the electronic device.

[0153] For example, the step of identifying at least one robot having the identified plurality of functions may include the step of identifying at least one robot corresponding to the profile of at least one robot having the identified plurality of functions among the plurality of robots based on the function database.

[0154] For example, the step of transmitting data in the standard format to at least one robot may include, when a robot capable of performing the identified plurality of functions among the plurality of robots is identified, the step of obtaining data in the standard format containing information on the plurality of tasks to be performed by the robot and the step of transmitting the data in the standard format to the robot.

[0155] For example, the step of transmitting data of the standard format to at least one robot may include, when a first robot capable of performing some of the identified multiple functions and a second robot capable of performing the remainder are identified among the plurality of robots, the step of obtaining first data of the standard format containing information on some tasks to be performed by the first robot and second data of the standard format containing information on the remainder tasks to be performed by the second robot, and the step of transmitting the first data of the standard format to the first robot through the communication circuit and transmitting the second data of the standard format to the second robot.

[0156] For example, the step of transmitting data in the standard format to at least one robot may include, when it is identified that a first number of robots and a second number of robots greater than the first number among the plurality of robots can perform the identified plurality of functions, a step of identifying that the first number of robots performs the plurality of tasks; a step of obtaining data in the standard format containing information about the plurality of tasks to be performed by the first number of robots; and a step of transmitting data in the standard format to the first number of robots.

[0157] Although various embodiments have been described above, each embodiment is not necessarily implemented individually, and may be combined with at least one other embodiment, either wholly or partially, to be implemented together in a single product.

[0158] Meanwhile, embodiments of the present disclosure may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules executed by a computer. A computer-readable medium may be any available medium accessible by a computer and includes both volatile and non-volatile media, and both removable and non-removable media. Additionally, a computer-readable medium may include computer storage media and communication media. Computer storage media include both volatile and non-volatile, removable and non-removable media implemented by any method or technique for storing information, such as computer-readable instructions, data structures, program modules, or other data. Communication media may typically include other data of modulated data signals, such as computer-readable instructions, data structures, or program modules.

[0159] Additionally, computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory storage media' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, 'non-transitory storage media' may include a buffer in which data is stored temporarily.

[0160] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0161] The foregoing description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0162] The scope of the present disclosure is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present disclosure.

Claims

1. In an electronic device, Communication circuit; Memory for storing instructions; and at least one processor including processing circuitry; and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on obtaining information regarding the user's intent to perform using the robot, multiple capabilities for performing multiple tasks corresponding to the said intent are identified, and Identify at least one robot having the identified multiple functions among the multiple robots based on the function of each of the multiple robots, and In order to enable at least one robot using data of different formats to perform the plurality of tasks, data of a standard format containing information on the task to be performed by each of the at least one robots is obtained, and An electronic device that transmits data in the standard format to at least one robot through the communication circuit.

2. In Paragraph 1, Each of the above-mentioned at least one robot is, An electronic device configured to acquire data in a format used by each robot based on data in a standard format received from the electronic device, and to perform a task using the acquired data.

3. In Paragraph 1, The above memory is, An intention database is stored that includes information for each of the multiple intentions, such as the name of the intention, parameters for the said intention, multiple task templates corresponding to the said intention, and multiple function templates corresponding to the said task templates. When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on information regarding the user's intention, the name of the intention that the user intends to perform using the robot and the values ​​of the parameters for the intention are obtained, and Based on the name of the aforementioned acquired intention, a plurality of task templates corresponding to the intention and a plurality of function templates corresponding to the plurality of task templates are obtained from the aforementioned intention database, and An electronic device that identifies a plurality of tasks corresponding to the intent and a plurality of functions for performing the plurality of tasks by filling placeholders of a plurality of task templates and placeholders of a plurality of function templates obtained with the values ​​of the parameters obtained above.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Information regarding the name of the robot, the type of the robot, and the function of the robot is received from the user for each of the aforementioned multiple robots, and An electronic device that stores a robot profile containing information about the name of the robot, the type of the robot, and the function of the robot in a function database included in the memory.

5. In Paragraph 4, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that identifies at least one robot corresponding to at least one robot profile having the identified plurality of functions among the plurality of robots based on the above function database.

6. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When a robot capable of performing the identified plurality of functions among the plurality of robots is identified, data in a standard format containing information on the plurality of tasks to be performed by the robot is obtained, and An electronic device that transmits data in the above standard format to the robot through the above communication circuit.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When a first robot capable of performing some of the identified multiple functions and a second robot capable of performing the remainder are identified among the plurality of robots, a first data in a standard format containing information on some tasks to be performed by the first robot and a second data in a standard format containing information on the remainder tasks to be performed by the second robot are obtained. An electronic device that transmits first data of the above standard format to the first robot through the communication circuit and transmits second data of the above standard format to the second robot through the communication circuit.

8. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If it is identified that a first number of robots and a second number of robots greater than the first number among the plurality of robots can perform the identified plurality of functions, the first number of robots is identified as performing the plurality of tasks, and Acquire data in a standard format containing information on the plurality of tasks to be performed by the first number of robots, and An electronic device that transmits data of the above standard format to the first number of robots through the above communication circuit.

9. In a method for controlling an electronic device, A step of identifying multiple capabilities for performing multiple tasks corresponding to said intent, based on obtaining information regarding a user's intent to perform using a robot; A step of identifying at least one robot having the identified multiple functions among the multiple robots based on the function of each of the multiple robots; In order for at least one robot using data of different formats to perform the plurality of tasks, a step of obtaining data in a standard format including information on a task to be performed by each of the at least one robot; and A control method comprising the step of transmitting data of the above standard format to at least one robot.

10. In Paragraph 9, Each of the above-mentioned at least one robot is, A control method configured to acquire data in a format used by each robot based on data in a standard format received from the electronic device, and to perform a task using the acquired data.

11. In Paragraph 9, The above electronic device is, It includes a memory that stores an intent database for each of the multiple intents, the name of the intent, parameters for the intent, multiple task templates corresponding to the intent, and multiple function templates corresponding to the multiple task templates. The step of identifying multiple functions for performing multiple tasks corresponding to the above intention is, A step of obtaining the name of the intention that the user intends to perform using the robot and the values ​​of parameters for the intention based on information regarding the user's intention; A step of obtaining a plurality of task templates corresponding to the intent and a plurality of function templates corresponding to the plurality of task templates from the intent database based on the name of the intent obtained above; and A control method comprising the step of identifying a plurality of tasks corresponding to the intent and a plurality of functions for performing the plurality of tasks by filling placeholders of a plurality of task templates obtained and placeholders of a plurality of function templates obtained with the values ​​of the parameters obtained above.

12. In Paragraph 9, The above control method is, A step of receiving information from a user regarding the name of the robot, the type of the robot, and the function of the robot for each of the plurality of robots; and A control method comprising the step of storing a robot profile containing information about the name of the robot, the type of the robot, and the function of the robot in a function database included in the memory of the electronic device.

13. In Paragraph 12, The step of identifying at least one robot having the aforementioned identified plurality of functions is: A control method comprising: a step of identifying at least one robot corresponding to at least one robot profile having the identified plurality of functions among the plurality of robots based on the above function database.

14. In Paragraph 9, The step of transmitting data in the above standard format to the above at least one robot is, When a robot capable of performing the identified plurality of functions among the plurality of robots is identified, a step of obtaining data in a standard format containing information on the plurality of tasks to be performed by the robot; and A control method comprising the step of transmitting data of the above standard format to the robot.

15. In Paragraph 9, The step of transmitting data in the above standard format to the above at least one robot is, When a first robot capable of performing some of the identified multiple functions and a second robot capable of performing the remainder are identified among the plurality of robots, a step of obtaining first data in a standard format containing information on some tasks to be performed by the first robot and second data in a standard format containing information on the remainder tasks to be performed by the second robot; and A control method comprising the step of transmitting first data of the above standard format to the first robot and transmitting second data of the above standard format to the second robot.

Images