Electronic device and control method therefor

Abstract

Disclosed is an electronic device. One or more processors, when instructions are individually or collectively executed, cause the electronic device to: receive, from a server via a communication circuit, mapping information to which at least one item carried by each of a plurality of robots is mapped; when a user input for selecting one item among a plurality of items is received, identify at least one robot corresponding to the selected item among the plurality of robots on the basis of the mapping information; and transmit a signal for calling the identified robot to the identified robot via the communication circuit.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a method for controlling the same.

[0002] Recently, various types of robots are being utilized in spaces with high volumes of logistics and transportation tasks, such as factories, warehouses, and construction sites. Generally, the types of robots capable of transporting goods vary depending on the type, size, shape, and weight of the items.

[0003] In this case, the operator must select one of various types of robots to transport the goods. However, at this stage, it may be difficult for the operator to determine which type of robot to call in order to transport the goods to be shipped.

[0004] An electronic device according to one or more embodiments of the present disclosure comprises one or more processors including a communication circuit, a memory for storing instructions, and a processing circuitry.

[0005] According to one or more embodiments, when the instructions are executed individually or collectively, the electronic device receives mapping information from a server via the communication circuit in which at least one item carried by each of the plurality of robots is mapped, and when a user input selecting one of the plurality of items is received, identifies at least one robot among the plurality of robots corresponding to the selected item based on the mapping information, and transmits a signal to call the identified robot via the communication circuit to the identified robot.

[0006] According to one or more embodiments, the mapping information is information in which an item capable of being transported by each of the plurality of robots is mapped to each of the plurality of robots based on item information of each of the plurality of items and the type of the plurality of robots, and the item information includes at least one of the type, size, or weight of the item.

[0007] According to one or more embodiments, when the instructions are executed individually or collectively by one or more processors, the electronic device receives the updated mapping information from the server when the mapping information is updated as at least one of a new item and a new robot is registered on the server.

[0008] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device sets a priority for the plurality of robots when a plurality of robots are mapped to the selected item, transmits a signal to call a first robot among the plurality of robots through the communication circuit according to the priority, and if no response signal to the call signal is received from the first robot, transmits a signal to call a second robot among the plurality of robots through the communication circuit according to the priority.

[0009] According to one or more embodiments, when the instructions are executed individually or collectively by one or more processors, the electronic device transmits information about the selected item to the server through the communication circuit when a user input selecting one of the plurality of items is received.

[0010] According to one or more embodiments, the plurality of robots included in the mapping information include a robot manufactured by the same manufacturer as the electronic device and a robot manufactured by a different manufacturer from the electronic device, and when the instructions are executed individually or collectively by the one or more processors, the electronic device identifies first API (Application Programming Interface) information that communicates with a robot manufactured by the same manufacturer as the electronic device, converts second API information identified from a robot manufactured by a different manufacturer from the electronic device based on the first API information, and calls a robot manufactured by a different manufacturer from the electronic device based on the mapping information and the converted second API information.

[0011] According to one or more embodiments, the electronic device further comprises at least one sensor, and when the instructions are executed individually or collectively by the one or more processors, the electronic device obtains article information including at least one of the type, size, or weight of an article through the at least one sensor, and calls at least one robot corresponding to the obtained article information based on the mapping information.

[0012] According to one or more embodiments, the electronic device further includes a display, and when the instructions are executed individually or collectively by the one or more processors, the electronic device displays a UI through the display for selecting one of the plurality of articles.

[0013] A control method for an electronic device according to one or more embodiments of the present disclosure includes receiving mapping information from a server in which at least one item carried by each of a plurality of robots is mapped; when a user input selecting one of the plurality of items is received, identifying at least one robot among the plurality of robots corresponding to the selected item based on the mapping information; and transmitting a signal to the identified robot to call the identified robot.

[0014] A non-transient computer-readable storage medium storing computer instructions that cause an electronic device to perform an operation when executed by a processor of an electronic device according to one or more embodiments of the present disclosure, wherein the operation comprises: receiving mapping information from a server in which at least one item carried by each of a plurality of robots is mapped; when a user input selecting one of the plurality of items is received, identifying at least one robot among the plurality of robots corresponding to the selected item based on the mapping information; and transmitting a signal to the identified robot to call the identified robot.

[0015] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0016] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0017] FIG. 3 is a block diagram illustrating the detailed configuration of an electronic device according to one or more embodiments.

[0018] FIG. 4 is a drawing for explaining mapping information of a robot for each item according to one or more embodiments.

[0019] FIG. 5 is a diagram illustrating the process of receiving updated mapping information of an electronic device according to one or more embodiments.

[0020] FIG. 6 is a diagram illustrating the priority setting process of an electronic device according to one or more embodiments.

[0021] FIG. 7 is a drawing for explaining the process of providing article information of an electronic device according to one or more embodiments.

[0022] FIG. 8 is a diagram illustrating the calling process of a robot manufactured by a different manufacturer and an electronic device according to one or more embodiments.

[0023] FIG. 9 is a diagram illustrating a robot calling process through a sensor of an electronic device according to one or more embodiments.

[0024] FIG. 10 is a drawing for explaining an article selection UI of an electronic device according to one or more embodiments.

[0025] FIG. 11 is a drawing for illustrating a robot control server according to one or more embodiments.

[0026] FIG. 12 is a drawing for explaining the operation process of an electronic device according to one or more embodiments.

[0027] The terms used in the various embodiments of this Disclosure have been selected to be as widely used and general as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been selected at the applicant's discretion, and in such cases, their meanings will be described in detail in the relevant description section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0028] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components such as parts) and do not exclude the presence of additional features.

[0029] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0030] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0031] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0032] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, terms such as “comprising” or “consisting of” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0033] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0034] In the present disclosure, the term "user" may refer to a person using an electronic device or a device used by such person.

[0035] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.

[0036] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0037] According to one embodiment, the electronic device (100) may call a material transport robot to transport a material (10). Here, the electronic device (100) may be implemented as various types of electronic devices such as a tablet PC, mobile phone, smart TV, monitor, kiosk, electronic picture frame, LFD (large format display), DID (Digital Information Display), video wall, projector display, etc. Although FIG. 1 illustrates the case where the electronic device (100) operates in a factory, the electronic device (100) may be used in various environments such as an office, inside a building, or a government office.

[0038] For example, the robot may be a transport robot for transporting goods. For instance, the robot may be implemented in various types, such as a fork-lift type, a conveyor type, or a box type. For instance, the robot may be implemented as various types, such as autonomous mobile robots (AMRs) or automated guided vehicles (AGVs).

[0039] According to one embodiment, the electronic device (100) may receive information from a user regarding a robot for transporting an item. For example, the user may measure the type, size, or weight of the item, select a robot capable of transporting the item, and then transmit information about the selected robot to the electronic device (100). Based on the received information about the robot, the electronic device (100) may call the robot for transporting the item.

[0040] In this case, the user may face the inconvenience of having to measure the type, size, or weight of the item to be transported and select a robot suitable for it every time the item is transported.

[0041] According to one embodiment, the electronic device (100) can call at least one robot based on mapping information in which at least one item carried by each of the plurality of robots is mapped. When the electronic device (100) receives user input selecting one of the plurality of items from a user, it can identify the robot corresponding to the selected item based on the mapping information.

[0042] Referring to FIG. 1, when the electronic device (100) receives user input from a user (20) regarding an item (10) to be transported among a plurality of items, it can identify a plurality of robots (30-1 to 30-3) corresponding to the item (10) to be transported based on mapping information in which at least one item transported by each of the plurality of robots is mapped.

[0043] The electronic device (100) can identify a robot (30-1) capable of performing a current task among a plurality of identified robots (30-1 to 30-3) and transmit a signal to the identified robot (30-1) to call the identified robot (30-1) through a communication circuit.

[0044] For example, instead of selecting a robot to transport the selected item, the user can call at least one robot mapped to the selected item by selecting the item.

[0045] Hereinafter, various embodiments will be described with reference to the drawings in which an electronic device (100) calls a robot based on mapping information in which at least one item carried by each of a plurality of robots is mapped.

[0046] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0047] According to FIG. 2, the electronic device (100) includes a communication circuit (110), a memory (120), and one or more processors (130). However, it is not limited thereto, and the electronic device (100) may be implemented with some components excluded or with other components included.

[0048] The communication circuit (110) may include wired or wireless input / output interfaces (or input / output terminals) according to various standards. The communication circuit (110) may be configured to communicate with various types of external devices according to various types of communication methods. The communication circuit (110) may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0049] The communication circuit (110) may include various interfaces such as HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface), Bluetooth, Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, AES / EBU (Audio Engineering Society / European Broadcasting Union), Optical, Coaxial, etc.

[0050] The memory (120) can store at least one instruction, data, program, etc. required for the operation of the electronic device (100). For example, the memory (120) can store contour highlighting processing information and position information corresponding to a selected image.

[0051] The memory (120) may be implemented in the form of a memory embedded in the electronic device (100) or in the form of a memory detachable from the electronic device (100), depending on the purpose of data storage. For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0052] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD).

[0053] The memory (120) may be implemented as a single memory that stores data generated in various operations according to the present disclosure, but is not limited thereto, and the memory (120) may be implemented to include a plurality of memories that each store different types of data or each store data generated in different stages.

[0054] One or more processors (130) control the overall operation of the electronic device (100). Specifically, one or more processors (130) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (130) may be electrically connected to the communication circuit (110) and the memory (120) to control the overall operation of the electronic device (100). One or more processors (130) may include a processing circuit and may be composed of one or more processors.

[0055] One or more processors (130) can perform the operation of an electronic device (100) according to various embodiments by executing one or more instructions stored in memory (120).

[0056] One or more processors (130) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. One or more processors (130) may control one or any combination of other components of an electronic device and may perform operations or data processing related to communication. One or more processors (130) may execute one or more programs or instructions stored in memory. For example, one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in memory.

[0057] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0058] One or more processors (130) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors (130) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure.

[0059] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0060] In the embodiments of the present disclosure, a processor may refer to a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. For convenience of explanation, one or more processors (130) will be referred to as processors (130) below.

[0061] According to one embodiment, the processor (130) can receive mapping information from a server via a communication circuit, in which at least one item carried by each of the plurality of robots is mapped.

[0062] The mapping information may be information in which items capable of being transported by each of the multiple robots are mapped to each of the multiple robots based on the item information of each of the multiple items and the types of the multiple robots. For example, since items such as items loaded on a pallet, large metal materials, and large wooden materials can be transported by a forklift-type robot, the aforementioned items can be mapped to a forklift-type robot.

[0063] According to one embodiment, when a processor (130) receives a user input selecting one of a plurality of items, it can identify at least one robot corresponding to the selected item among a plurality of robots based on mapping information. At least one robot may be mapped to each of the plurality of items. In this case, the electronic device (100) can identify at least one robot mapped to the selected item.

[0064] According to one embodiment, the processor (130) can transmit a signal to the identified robot through a communication circuit to call the identified robot.

[0065] FIG. 3 is a block diagram illustrating the detailed configuration of an electronic device according to one or more embodiments.

[0066] According to FIG. 3, the electronic device (100) includes a communication circuit (110), a memory (120), one or more processors (130), a display (140), at least one sensor (150), and a user interface (160). A detailed description of the configurations shown in FIG. 3 that overlap with the configuration shown in FIG. 2 will be omitted.

[0067] The display (140) is configured to provide a user with a UI for selecting one of a plurality of items. The display (140) may be implemented as a display including a self-emissive element or as a display including a non-emissive element and a backlight. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. The display (140) may also include a driving circuit, a backlight unit, etc., which may be implemented in the form of an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc.

[0068] At least one sensor (150) is configured to detect an item and identify item information about the item. The at least one sensor (150) may include at least one of a Lidar sensor, a depth camera, an IMU (Inertial Measurement Unit) sensor, a ToF (Time of Flight) sensor, a vision sensor, a light sensor, an RGB sensor, an image sensor, an infrared sensor, an ultrasonic sensor, a gyroscope sensor, an accelerometer sensor, and a proximity sensor.

[0069] The user interface (160) can be implemented with devices such as buttons, touchpads, mice, and keyboards, or with a touch screen capable of performing the aforementioned display functions and operation input functions.

[0070] FIG. 4 is a drawing for explaining mapping information of a robot for each item according to one or more embodiments.

[0071] According to one embodiment, the electronic device (100) can receive mapping information of a robot for each item mapped based on item information of each of a plurality of items and the type of a plurality of robots from a server.

[0072] According to one example, the article information may be information including at least one of the type, size, or weight of the article. For example, the type of the article may include multiple types, such as glass, wood, and clothing, classified according to the likelihood of breakage and the degree to which the article is affected by temperature.

[0073] According to one example, a user can register multiple items and multiple robots used within a specific space on the server. For example, in the case of a factory producing large-scale food preparation equipment, the user can register multiple items such as insulated carts, trays, dish dispensers, and three-tier carts, and multiple robots such as forklift robots, conveyor robots, and lifting robots on the server.

[0074] According to one example, the electronic device (100) can receive mapping information in which at least one item carried by each of the multiple robots is mapped based on item information of multiple items registered on the server and types of multiple robots registered on the server.

[0075] Referring to FIG. 4, the user can register multiple items (410-1 to 410-6) produced in a cooking appliance factory to the server. The user can register multiple robots (420-1 to 420-3) used in the cooking appliance factory to the server. Based on the item information of each of the multiple items (410-1 to 410-6) and the robot type of each of the multiple robots (420-1 to 420-3), the user can map each of the multiple items (410-1 to 410-6) to each of the multiple robots (420-1 to 420-3).

[0076] For example, the user can map a thermal car item (410-1) to a forklift robot (420-1). For example, the user can map a vat item (410-4) to a conveyor robot (420-3). For example, the user can map a roll container item (410-6) to a forklift robot (420-1) and a general lift robot (420-2). The plurality of items (410-1 to 410-6) and the plurality of robots (420-1 to 420-3) shown in FIG. 1 are merely examples, and mapping may also be performed based on different plurality of items and different plurality of robots.

[0077] According to one embodiment, the electronic device (100) can receive mapping information from a server in which at least one item carried by each of the plurality of robots (420-1 to 420-3) is mapped, and store it in memory (120).

[0078] FIG. 5 is a diagram illustrating the process of receiving updated mapping information of an electronic device according to one or more embodiments.

[0079] According to one embodiment, the electronic device (100) can receive updated mapping information from the server when mapping information is updated as at least one of a new item and a new robot is registered on the server.

[0080] For example, a user may register at least one of a new item and a new robot through the server. For example, a user may add a new item to an existing registered item. For example, a user may add a new robot to an existing registered robot.

[0081] According to one example, a user can update existing mapping information by mapping each of a plurality of items including a new item and each of a plurality of robots including a new robot through a server. The electronic device (100) can receive the updated mapping information from the server.

[0082] Referring to FIG. 5, a user can register a new item (510) through a server. As the new item (510) is registered, the user can update existing mapping information. For example, if the user registers a new item (510) including a thermos cart, a bowl dispenser, and a roll-in cart, at least one robot capable of transporting each item can be mapped to each item. The electronic device (100) can receive updated mapping information from the server when the mapping information is updated as the new item is registered.

[0083] FIG. 6 is a diagram illustrating the priority setting process of an electronic device according to one or more embodiments.

[0084] According to one embodiment, the electronic device (100) can set priorities for the multiple robots when multiple robots are mapped to a selected item.

[0085] Here, priority can be set based on the number of robots, robot dispatch times, or item information. For example, if there are many callable robots or if the robot dispatch time is short, the highest priority can be set to that robot.

[0086] According to one embodiment, the electronic device (100) transmits a signal to call a first robot among a plurality of robots through a communication circuit (110) according to priority, and if no response signal to the call signal is received from the first robot, it can transmit a signal to call a second robot among a plurality of robots through the communication circuit (110) according to priority.

[0087] For example, when the electronic device (100) receives a corresponding call signal from the first robot during the performance of a task, it can transmit a signal to the second robot through the communication circuit (110) to call the second robot among the plurality of robots according to priority.

[0088] For example, if the first robot is turned off and no response signal to the call signal is received from the first robot, the electronic device (100) can transmit a signal to call the second robot among the plurality of robots through the communication circuit (110) according to priority.

[0089] For example, the electronic device (100) can set priorities for each of the multiple robots when multiple robots are mapped to a selected item. For example, in the process of mapping robots by item, when multiple robots are mapped to an item, the user can directly set priorities for each of the multiple robots through a server.

[0090] Referring to FIG. 6, when a plurality of robots (620, 630) are mapped to a selected item (610), the electronic device (100) can set a priority (640, 650) for each of the plurality of robots (620, 630). The electronic device (100) can transmit a signal to the first robot (620) through the communication circuit (110) to call the first robot (620) which has a higher priority among the plurality of robots (620, 630).

[0091] If the electronic device (100) does not receive a response signal (660) to the call signal from the first robot (620), it can transmit a signal to the second robot (630) through the communication circuit (110) to call the second robot (630) which has a lower priority.

[0092] FIG. 7 is a drawing for explaining the process of providing article information of an electronic device according to one or more embodiments.

[0093] According to one embodiment, when the electronic device (100) receives a user input selecting one of a plurality of items, it can transmit information about the selected item to a server through a communication circuit (110).

[0094] Information regarding the selected item may include information regarding the type, size, weight, type of transport robot, transport route, and transport arrival time of the selected item. For example, the electronic device (100) may transmit the item selected by the user, the transport route of the item, and the transport arrival time to a server.

[0095] When a user selects one of a plurality of robots to transport an item, the item is transported through the selected robot, so the user receiving the item at the destination has difficulty identifying information regarding the type of item being transported and the time of arrival. However, when the user selects an item other than a robot and transports the item through at least one robot mapped to the selected item, the electronic device (100) transmits information corresponding to the type of the selected item and the time of arrival to a server, thereby allowing the user at the destination to easily identify information corresponding to the type of the item and the time of arrival.

[0096] Referring to FIG. 7, the electronic device (100) can transmit information (710, 720) about a selected item to a server. The electronic device (100) can transmit information (710, 720) about a selected item to a server at the time when a robot mapped to the selected item carries the selected item.

[0097] For example, the electronic device (100) can transmit information corresponding to the type of selected item, the number of items, the type of transport robot, the transport arrival time (720), and the transport route (710) through a server.

[0098] FIG. 8 is a diagram illustrating the calling process of a robot manufactured by a different manufacturer and an electronic device according to one or more embodiments.

[0099] According to one embodiment, the electronic device (100) can identify the API (Application Programming Interface) information of a robot manufactured by a different manufacturer than the electronic device (100) and call the robot manufactured by a different manufacturer than the electronic device (100).

[0100] API information may include programming information for each software included in different devices to communicate and exchange data. API information may be information including specific algorithms to enable different software to interact with each other.

[0101] According to one embodiment, a plurality of robots included in the mapping information may include a robot manufactured by the same manufacturer as the electronic device (100) and a robot manufactured by a different manufacturer than the electronic device (100).

[0102] According to one embodiment, the electronic device (100) can identify first API (Application Programming Interface) information for communicating with a robot manufactured by the same manufacturer as the electronic device (100). The first API information may be API information for the electronic device (100) and the robot manufactured by the same manufacturer as the electronic device (100) to communicate with each other. For example, when the electronic device (100) transmits a call signal to a robot manufactured by the same manufacturer as the electronic device (100), the robot manufactured by the same manufacturer as the electronic device (100) may transmit a response signal corresponding to the call signal to the electronic device (100) based on the first API information.

[0103] According to one embodiment, the electronic device (100) can convert second API information identified from a robot manufactured by a different manufacturer than the electronic device (100) based on the first API information. The second API information may be API information for the electronic device (100) and the robot manufactured by a different manufacturer than the electronic device (100) to communicate with each other.

[0104] According to one embodiment, the electronic device (100) can call a robot manufactured by a different manufacturer from the electronic device (100) based on mapping information of the robot by item and converted second API information.

[0105] Referring to FIG. 8, the electronic device (100) can receive mapping information based on a plurality of robots, including both a robot (810) from Company A and a robot (820) from Company B, which are of the same manufacturer as the electronic device (100). The electronic device (100) can identify first API information (830) that communicates with the robot (810) from Company A. The electronic device (100) can identify second API information from the robot (820) for the robot (820) to communicate with. The electronic device (100) can convert the second API information based on the first API information (830) so that the robot (820) from Company B can communicate with the electronic device (100) from Company A.

[0106] For example, if a robot of company B (820) is included in the robot mapped to the item selected by the user, the electronic device (100) can transmit a call signal to the robot of company B (820) based on the mapping information and the converted second API information.

[0107] FIG. 9 is a diagram illustrating a robot calling process through a sensor of an electronic device according to one or more embodiments.

[0108] According to one embodiment, the electronic device (100) can obtain item information including at least one of the type, size, or weight of the item through at least one sensor (150). For example, the electronic device (100) can obtain item information corresponding to the item to be transported by identifying the type, size, or shape of the item to be transported through a camera.

[0109] According to one embodiment, the electronic device (100) can call at least one robot corresponding to the acquired item information based on mapping information.

[0110] The electronic device (100) can receive user input regarding items to be transported from the user. The electronic device (100) can identify an item selected by the user among a plurality of items based on the user input. However, the electronic device (100) can directly identify the type, size, or weight of the item by directly sensing the item to be transported through at least one sensor (150).

[0111] Referring to FIG. 9, the electronic device (100) can obtain item information of an item (910) through at least one sensor (150). For example, the electronic device (100) can identify that the item to be transported is a basket through at least one sensor (150). Based on the mapping information, the electronic device (100) can call a robot (920) corresponding to the obtained item information.

[0112] FIG. 10 is a drawing for explaining an article selection UI of an electronic device according to one or more embodiments.

[0113] According to one embodiment, the electronic device (100) may display an item selection UI for selecting one of a plurality of items through a display (140). The item selection UI may include a plurality of items to be transported, a destination, and a call UI.

[0114] The user can select an item to be transported through an item selection UI displayed on the display (140) of the electronic device (100). When the electronic device (100) receives user input selecting one of a plurality of items, it can display a destination selection UI and a robot call UI through the display (140).

[0115] Referring to FIG. 10, the electronic device (100) can provide an item selection UI (1010) for selecting one of a plurality of items registered on a server through a display (140). When the electronic device (100) receives a user input (1020) for selecting one of a plurality of items, it can display a destination selection UI and a robot call UI through the display (140).

[0116] FIG. 11 is a drawing for illustrating a robot control server according to one or more embodiments.

[0117] According to one embodiment, the electronic device (100) may receive mapping information from a robot control server in which at least one item carried by each of the plurality of robots is mapped. The robot control server may be a server for managing, monitoring, and controlling the plurality of robots. The robot control server may be a server capable of collecting information corresponding to the real-time status and work status of the robots and transmitting commands to the robots.

[0118] According to one embodiment, the user may register mapping information (1120) to the robot control server (1100) via a webpage or application through an external device (1110). The user may register (1130) multiple robots to transport multiple items to the robot control server (1100). The user may register multiple items to the robot control server (1100) (1140). The user may register (1150) a mapping table that maps each of the multiple items to each of the multiple robots to the robot control server (1100).

[0119] According to one embodiment, a user can generate a robot call web page (1160) based on robots, items, and a robot mapping table for each item registered on the server through a robot control server (1100).

[0120] According to one embodiment, when the electronic device (100) receives a user input selecting one of a plurality of items, it can identify at least one robot corresponding to the selected item based on mapping information registered in the robot control server (1100).

[0121] According to one embodiment, the electronic device (100) can transmit a signal to the identified robot through the communication circuit (110) to call (1170) the identified robot.

[0122] FIG. 12 is a drawing for explaining the operation process of an electronic device according to one or more embodiments.

[0123] Referring to FIG. 12, in operation 1210, the electronic device (100) can receive mapping information from a server in which at least one item carried by each of the plurality of robots is mapped.

[0124] In operation 1220, when the electronic device (100) receives user input selecting one of a plurality of items, it can identify at least one robot corresponding to the selected item among a plurality of robots based on mapping information.

[0125] In operation 1230, the electronic device (100) can transmit a signal to the identified robot to call the identified robot.

[0126] Since the method of receiving mapping information in which at least one item transported by each of a plurality of robots is mapped, and identifying at least one robot corresponding to the selected item has been specifically explained through the embodiments described above, a description thereof will be omitted.

[0127] The control method described in FIG. 12 can be performed by an electronic device (100) having the configuration of FIG. 2 described above, but is not necessarily limited thereto and can be performed by an electronic device having various configurations.

[0128] The various embodiments described above may be implemented as individual embodiments, or at least one embodiment may be combined with one another, either wholly or partially, to be implemented together in a single device.

[0129] According to the various embodiments described above, the user can automatically call a robot mapped to an item by selecting an item to be transported, without directly selecting a robot to transport an item.

[0130] Meanwhile, the various embodiments described above may be applied to a product as embodiments alone, but at least some of their contents may be combined with other embodiments of the present disclosure to be implemented together.

[0131] The various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., computer). The machine may include an electronic device (e.g., electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory computer-readable storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0132] In addition, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided by being included in a computer program product.

[0133] Specifically, a non-transient readable storage medium or computer program product may be provided that stores computer instructions for performing operations such as receiving mapping information from a server in which at least one item carried by each of a plurality of robots is mapped, when user input selecting one of the plurality of items is received, identifying at least one robot corresponding to the selected item among the plurality of robots based on the mapping information, and transmitting a signal to the identified robot to call the identified robot.

[0134] Computer program products may be distributed in the form of device-readable storage media (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0135] In addition, computer instructions or programs for performing control methods of electronic devices according to the various embodiments described above may be stored on a non-transitory computer-readable medium. When computer instructions stored on such a non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and is readable by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of a non-transitory computer-readable medium may include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, ROMs, etc.

[0136] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In an electronic device, Communication circuit; Memory for storing instructions; and One or more processors including processing circuitry; and The above one or more processors, When the above instructions are executed individually or collectively, the electronic device, Through the above communication circuit, mapping information is received from a server in which at least one item carried by each of a plurality of robots is mapped, and When user input selecting one of the plurality of items is received, at least one robot corresponding to the selected item among the plurality of robots is identified based on the mapping information, and An electronic device that transmits a signal to call the identified robot through the communication circuit to the identified robot.

2. In Paragraph 1, The above mapping information is, Based on the item information of each of the plurality of items and the type of the plurality of robots, the item that can be transported by each of the plurality of robots is information mapped to each of the plurality of robots, and The above product information is, An electronic device comprising at least one of the type, size, or weight of an article.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that receives the updated mapping information from the server when the mapping information is updated as at least one of a new item and a new robot is registered on the server.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, If multiple robots are mapped to the selected item above, a priority is set for the multiple robots, and A signal to call the first robot among the plurality of robots according to the above priority is transmitted to the first robot through the communication circuit, and An electronic device that transmits a signal to call a second robot among a plurality of robots through the communication circuit according to the priority when a response signal to the call signal is not received from the first robot.

5. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that, upon receiving user input selecting one of the plurality of items, transmits information about the selected item to the server through the communication circuit.

6. In Paragraph 1, The plurality of robots included in the above mapping information are, It includes a robot manufactured by the same manufacturer as the electronic device and a robot manufactured by a different manufacturer than the electronic device, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Identifying first API (Application Programming Interface) information that communicates with a robot manufactured by the same manufacturer as the above electronic device, and Converting second API information identified from a robot manufactured by a different manufacturer than the electronic device above based on the first API information, and An electronic device that calls a robot manufactured by a different manufacturer from the electronic device based on the above mapping information and the above converted second API information.

7. In Paragraph 1, The above electronic device is, further including at least one sensor, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Acquiring article information including at least one of the type, size, or weight of the article through the above at least one sensor, and An electronic device that calls at least one robot corresponding to the acquired item information based on the above mapping information.

8. In Paragraph 1, The above electronic device is, Including a display; further When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that displays a UI for selecting one of the above plurality of items through the display.

9. In a method for controlling an electronic device, The operation of receiving mapping information from a server in which at least one item carried by each of a plurality of robots is mapped; When a user input selecting one of the plurality of items is received, an operation of identifying at least one robot corresponding to the selected item among the plurality of robots based on the mapping information; and A control method comprising the operation of transmitting a signal to the identified robot to call the identified robot.

10. In Paragraph 9, The above mapping information is, Based on the item information of each of the plurality of items and the type of the plurality of robots, the item that can be transported by each of the plurality of robots is information mapped to each of the plurality of robots, and The above product information is, A control method comprising at least one of the type, size, or weight of an article.

11. In Paragraph 9, A control method comprising: receiving the updated mapping information from the server when the mapping information is updated as at least one of a new item and a new robot is registered on the server.

12. In Paragraph 9, When multiple robots are mapped to the selected item, an operation to set priorities for the multiple robots; The operation of transmitting a signal to the first robot to call the first robot among the plurality of robots according to the above priority; and A control method comprising: an operation of transmitting a signal to the second robot to call the second robot among the plurality of robots according to the priority when a response signal to the call signal is not received from the first robot.

13. In Paragraph 9, A control method comprising: an operation of transmitting information about the selected item to the server when a user input selecting one of the plurality of items is received.

14. In Paragraph 9, The plurality of robots included in the above mapping information are, It includes a robot manufactured by the same manufacturer as the electronic device and a robot manufactured by a different manufacturer than the electronic device, The above control method is, An operation to identify first API (Application Programming Interface) information that communicates with a robot manufactured by the same manufacturer as the electronic device above; An operation of converting second API information identified from a robot manufactured by a different manufacturer than the electronic device based on the first API information; and A control method comprising: an operation of calling a robot manufactured by a different manufacturer from the electronic device based on the mapping information and the converted second API information.

15. A non-transient computer-readable storage medium storing computer instructions that cause said electronic device to perform an operation when executed by a processor of said electronic device, wherein said operation is, The operation of receiving mapping information from a server in which at least one item carried by each of a plurality of robots is mapped; When a user input selecting one of the plurality of items is received, an operation of identifying at least one robot corresponding to the selected item among the plurality of robots based on the mapping information; and A non-transient computer-readable storage medium comprising: an operation of transmitting a signal to the identified robot to call the identified robot.

Images