Electronic device and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes a display, a camera, a sensor, a memory configured to store location information and working information of a smart machine, and a processor configured to identify a smart machine located in a peripheral area of ​​the electronic device based on location information of the electronic device sensed by the sensor and location information of the smart machine stored in the memory, obtain working information of the identified smart machine from the memory, indicate a working area of ​​the smart machine on an image captured by the camera based on the obtained working information of the smart machine, and provide an image including the working area on the display.

Description

Technical Field

[0001] The present disclosure generally relates to an electronic device and a control method thereof, and, for example, to an electronic device including information about a smart appliance and a control method thereof. Background Art

[0002] Recently, various types of industrial robots have been developed and distributed for automated and unmanned factory production.

[0003] In particular, an articulated robot that has a joint system similar to that of a human and can be operated similarly to a human limb, and an automatic guided vehicle that conveniently transports various materials used in a production process are representative industrial robots.

[0004] The penetration and utilization of industrial robots has been increasing, however, the research and development of safety facilities for protecting users from industrial robots is somewhat insufficient. As a result, there is a problem of accidents caused by using industrial robots without proper safety facilities. In addition, setting up physical fences in dangerous areas around industrial robots may limit the control of industrial robots, which requires a lot of time and cost.

[0005] Therefore, there is a need to develop a method in which workers can easily and conveniently identify dangerous areas and safe areas around an industrial robot. Summary of the invention

[0006]

Technical issues

[0007] An aspect of an example embodiment is directed to an electronic device that recognizes a smart machine and provides a hazardous area and a control method thereof.

[0008]

Technical solution

[0009] An electronic device according to an example embodiment includes a display; a camera; a sensor; a memory configured to store location information and working information of a smart machine; and a processor configured to identify a smart machine located in a peripheral area of ​​the electronic device based on the location information of the electronic device sensed by the sensor and the location information of the smart machine stored in the memory, obtain the working information of the identified smart machine from the memory, indicate a working area of ​​the smart machine to an image captured by the camera based on the obtained working information of the smart machine, and provide an image including the working area on the display.

[0010] The processor may identify the smart machine based on the photographing direction of the electronic device and the position information of the electronic device sensed by the sensor.

[0011] The working information of the smart machine may include a working schedule of the smart machine and information about a working area required to perform operations included in the working schedule, wherein the processor can identify whether the smart machine is operating based on the working schedule of the smart machine, and if it is identified (determined) that the smart machine is operating, indicate and provide a working area corresponding to the operation of the smart machine based on the information of the working area.

[0012] The processor may provide information about the remaining time until the operation of the smart machine ends based on the work schedule when it is identified that the smart machine is operating, and provide information about the remaining time until the operation of the smart machine starts if it is identified that the smart machine is not operating.

[0013] The work information may include information on at least one of an operation of the smart machine obtained by analyzing an image of the smart machine photographed during a predetermined time, a time required for the operation, and a standby time between operations.

[0014] The electronic device may further include a projector, and the processor may control the projector to irradiate the first light beam to a working space of the smart machine based on the recognized working information of the smart machine.

[0015] The processor may control the projector to irradiate a second light beam that directs a recognizable position regarding at least one of the user's motion and voice based on distance information at which the smart machine is able to recognize at least one of the user's motion or voice.

[0016] The electronic device may further include a driving unit including a driving circuit configured to move the main body of the electronic device, wherein the processor is configured to control the driving unit so that the electronic device is located within a predetermined distance from a user of the electronic device, and in response to location information of the electronic device that changes according to control of the driving unit, identify a smart machine located in a peripheral area of ​​the electronic device.

[0017] The processor may provide a user interface for guiding a recognizable location of at least one of the user's motion and voice based on distance information at which the smart machine can recognize at least one of the user's motion and voice.

[0018] The memory may include coordinate information indicating each location of a specific space, wherein the location information of the electronic device includes information indicating the location of the electronic device set in the specific space based on the coordinate information, and wherein the location information of the smart machine includes information indicating the location of the smart machine set in the specific space based on the coordinate information.

[0019] A control method for an electronic device that stores location information and working information of an intelligent machine, comprising: sensing the location information of the electronic device; identifying an intelligent machine located in a peripheral area of ​​the electronic device based on the location information of the electronic device sensed by a sensor and the location information of the intelligent machine stored in a memory; obtaining working information of the identified intelligent machine from the memory; and indicating a working area of ​​the intelligent machine to an image taken by a camera based on the obtained working information of the intelligent machine, and displaying the image including the working area.

[0020] The identifying may include identifying the smart machine based on a shooting direction of the electronic device and location information of the electronic device sensed by a sensor.

[0021] The working information of the smart machine may include information about the working schedule of the smart machine and information about the working area required to perform operations included in the working schedule, and based on the working schedule of the smart machine, identifying whether the smart machine is operating; and wherein the display may include indicating and providing the working area corresponding to the operation of the smart machine based on the information about the working area if it is identified that the smart machine is operating.

[0022] The display may include, when it is identified that the smart machine is operating, displaying information about the remaining time until the operation of the smart machine ends based on the work schedule, and if it is identified that the smart machine is not operating, displaying information about the remaining time until the operation of the smart machine starts.

[0023] The work information may include information on at least one of an operation of the smart machine obtained by analyzing an image of the smart machine photographed during a predetermined time, a time required for the operation, and a standby time between operations.

[0024] The method may also include irradiating a first light beam to a workspace of the smart machine based on the identified work information of the smart machine.

[0025] The method may also include irradiating a second light beam that guides a recognizable position regarding at least one of the user's movement and voice based on distance information at which the smart machine can recognize at least one of the user's movement or voice.

[0026] The method may include moving a body of the electronic device so that the electronic device is located within a predetermined distance from a user of the electronic device, wherein the identifying may include identifying a smart machine located in a peripheral area of ​​the electronic device in response to location information of the electronic device that changes according to control of a driving unit.

[0027] The display may include, based on the distance information at which the smart machine can recognize at least one of the user's movement and voice, displaying a user interface UI of a recognizable position for guiding at least one of the user's movement and voice.

[0028] The electronic device may include coordinate information indicating each position of a specific space as a coordinate, wherein the position information of the electronic device includes information indicating the position of the electronic device set in the specific space based on the coordinate information, and wherein the position information of the smart machine includes information indicating the position of the smart machine set in the specific space based on the coordinate information.

[0029]

Beneficial effects

[0030] According to various exemplary embodiments as described above, the electronic device provides a virtual fence according to the operation of the smart machine, and thus has an effect of enabling the user to recognize a dangerous area. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The above and / or other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following detailed description in conjunction with the accompanying drawings, in which:

[0032] Figure 1 is a block diagram illustrating an example configuration of an electronic device according to an example embodiment;

[0033] Figure 2 is a block diagram illustrating an example configuration of an electronic device according to an example embodiment;

[0034] Figure 3 is a diagram illustrating an example work area according to an example embodiment;

[0035] Figure 4 is a diagram illustrating an example work schedule according to an example embodiment;

[0036] Figure 5 is a diagram illustrating an example method for providing a work area according to an example embodiment;

[0037] Figure 6 is a diagram illustrating an example electronic device according to another example embodiment;

[0038] Figure 7 and Figure 8 is a diagram illustrating an example electronic device according to another example embodiment;

[0039] Fig. 9 is a diagram illustrating an example of identifiable locations according to an example embodiment; and

[0040] Fig.10 is a flowchart illustrating an example control method of an electronic device according to an example embodiment. DETAILED DESCRIPTION

[0041] Certain example embodiments are described in further detail below with reference to the accompanying drawings.

[0042] The terms used in this disclosure are now widely used general terms and are selected in consideration of the functions of the present disclosure. However, these terms may vary according to the intentions of those skilled in the art, precedents, or the emergence of new technologies. In addition, in special cases, the terms may be selected arbitrarily. In this case, the meaning of the terms will be explained in the corresponding disclosure. Therefore, the terms used herein will be defined based on the meaning of the terms and the full content of the example embodiments, rather than the simple names of the terms.

[0043] Since various exemplary embodiments may have various modifications and several examples, certain embodiments will be illustrated in the drawings and described in more detail in the disclosure. However, this does not necessarily limit the scope of the embodiments to a specific embodiment form. On the contrary, modifications, equivalents and substitutes included in the concepts and technical scope of the present disclosure may be adopted. When describing an embodiment, if it is determined that a specific description of known technology obscures the subject matter of the present disclosure, the specific description may be omitted.

[0044] In this disclosure, relational terms such as first and second and the like may be used to distinguish one entity from another entity without necessarily implying any actual relationship or order between the entities.

[0045] It should be understood that the singular forms "a", "an" and "the" include plural forms, unless the context clearly dictates otherwise. The terms "comprising", "including", "configured to", etc. in the description are used to indicate the presence of features, numbers, steps, operations, elements, components or combinations thereof, and they do not exclude the possibility of combining or adding one or more features, numbers, steps, operations, elements, components or combinations thereof.

[0046] According to the embodiment, a "module" or "unit" performs at least one function or operation and can be implemented as hardware or software, or any combination of hardware and software. In addition, multiple "modules" or multiple "units" can be integrated into at least one module and can be implemented as at least one processor, except for the "module" or "unit" that should be implemented in specific hardware.

[0047] Hereinafter, certain exemplary embodiments will be described in more detail with reference to the accompanying drawings so that those skilled in the art can easily understand these embodiments. However, various exemplary embodiments can be implemented in various different configurations and are not limited to the description provided herein. Throughout the disclosure, similar reference numerals are used for similar elements.

[0048] Figure 1is a block diagram illustrating an example configuration of an electronic device according to an example embodiment.

[0049] refer to Figure 1 , the electronic device 100 includes a display 110 , a camera 120 , a sensor 130 , a memory 140 , and a processor (eg, including a processing circuit) 150 .

[0050] The electronic device 100 according to the embodiment of the present disclosure may be implemented as various devices, such as but not limited to, a user terminal device, a display device, a set-top box, a tablet personal computer, a smart phone, an e-book reader, a desktop computer, a laptop computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, etc. However, this is only an example, and the electronic device 100 may be implemented as various types of electronic devices, such as but not limited to, at least one type of wearable device of an accessory type (e.g., a watch, a ring, a bracelet, an ankle bracelet, a necklace, glasses, contact lenses, or a head mounted device (HMD)), an integrated type with fabric and / or clothing (e.g., electronic cloth), a robot including a drive unit, a projector, a server, etc.

[0051] The display 110 can display various screens. The display 110 can be implemented as various types of displays, such as but not limited to a liquid crystal display (LCD), an organic light emitting display (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP), etc. The present disclosure is not limited thereto, and can be implemented as various types of displays 110 capable of displaying a screen.

[0052] The display 110 may also be coupled to at least one of the front region, the side region, and the rear region of the electronic device 100 in the form of a flexible display.

[0053] The camera 120 may include various circuits, including a configuration for capturing still images or moving images under the control of a user. The camera 120 may capture still images at a specific point in time, but may also continuously capture still images. The camera 120 may provide the obtained image to the processor 150, and the image may be provided to the user through the display 110. The camera 120 may be implemented as a plurality of cameras, such as a front camera and a rear camera.

[0054] The sensor 130 may be implemented as any of various sensors, such as, but not limited to, a position sensor, a touch sensor, a geomagnetic sensor, a gyro sensor, an acceleration sensor, a proximity sensor, a grip sensor, etc. However, the present disclosure is not limited thereto, and the sensor 130 may be implemented by various types of sensors 130 capable of sensing the state of the electronic device 100, the surrounding environment of the electronic device 100, etc.

[0055] For example, the sensor 130 can sense the location information of the electronic device 100. As an example, the electronic device 100 can use a global positioning system GPS sensor to sense the location information of the electronic device. In addition, the sensor 130 can sense the shooting direction of the electronic device 100. In one example, the sensor 130 can sense the direction in which the back of the electronic device 100 points. The direction in which the rear surface of the electronic device 100 sensed by the sensor points and the shooting direction of the rear surface camera set in the electronic device 100 can be the same.

[0056] The memory 140 may store various data, such as an operating system (O / S) software module driving the electronic device 100 , various applications, content, location information of a smart machine, and operation information of the smart machine.

[0057] Intelligent machines may refer to, for example, but not limited to, industrial robots used in product manufacturing processes, such as factory production lines. For example, industrial robots may be implemented as articulated robots to replace the functions of human arms or hands. Industrial robots may refer to, for example, all types of robots used for various purposes (such as but not limited to assembly, processing, warehousing / shipping of items, inspection and measurement, pressing, resin processing, welding, etc.) in the industrial field. For example, industrial robots may be implemented as rectangular coordinate robots, cylindrical working robots, or polar coordinate robots. In the following, for convenience of description, intelligent machines are assumed to be industrial robots. However, this is just an example, and intelligent machines may be implemented as robots that operate in an autonomous manner by sensing the surrounding environment in real time based on sensors 130 and collecting information.

[0058] The memory 140 may store the location information and work information of the smart machine. For example, the memory 140 may include coordinate information indicating the coordinates of each location of a specific space, such as but not limited to a factory, a warehouse, a building, etc. The location information of the smart machine may be information indicating the location of the smart machine arranged in the specific space based on the coordinate information. For example, the location of the smart machine may include information represented by (x, y, z) coordinates, and the electronic device 100 may identify the location of the smart machine in the specific space based on the information.

[0059] In addition, the memory 140 may store the working information of the intelligent machine. The working information may include a work schedule and information about the working area required to perform the operations included in the working schedule of the intelligent machine. For example, the working area may refer to the size of the space. In one example, the intelligent machine may perform a first operation, and the memory 140 may store information about the size of the space required to perform the first operation in the form of (w, h). Here, w may be the width of the space required to perform the first operation, and h may be the height of the space required to perform the first operation. However, various types of information that can identify the size of the space required for the operation of the intelligent machine may be stored.

[0060] The operations performed by the smart machine can be set differently depending on the purpose of the smart machine. As a non-limiting example, the smart machine can perform operations such as grabbing, piercing dies, storing and releasing, moving, etc. A smart machine can perform different operations sequentially according to a schedule, or a smart machine can only perform one operation repeatedly according to a schedule.

[0061] A work schedule according to an example embodiment may refer to, for example, but not limited to, a list of operations to be performed by an intelligent machine in a time sequence. The intelligent machine may perform operations according to the work schedule. This will be referred to below Figure 4 Describe in more detail.

[0062] The processor 150 may include various processing circuits and may control the overall operation of the electronic device 100 .

[0063] According to example embodiments, the processor 150 may include various processing circuits, such as, but not limited to, one or more of a central processing unit (CPU), a dedicated processor, a microcontroller unit (MCU), a microprocessor (MPU), a controller, an application processor (AP), a communication processor (CP), an ARM processor, etc. The processor 150 may be implemented as a system on chip (SoC), a large-scale integrated circuit (LSI), or a field programmable gate array (FPGA) with a built-in processing algorithm.

[0064] The processor 150 according to an embodiment of the present disclosure may identify a smart machine located in the peripheral area of ​​the electronic device based on the location information of the electronic device 100 and the location information of the smart machine sensed by the sensor 130. Here, the environment area may refer to, for example, an area within a predetermined distance from the electronic device 100.

[0065] According to an example embodiment, the processor 150 may identify the location of the electronic device 100 based on the location information of the electronic device 100 sensed by the sensor 130, and identify a smart machine located within a predetermined distance from the location of the electronic device 100. The processor 150 may obtain the operation information of the identified smart machine from the memory 140. For example, the processor 150 may identify first and second smart machines located in a peripheral area (e.g., an area within a given distance of the electronic device) of the electronic device 100 among a plurality of smart machines. The processor 150 may obtain first operation information corresponding to the first smart machine and second operation information corresponding to the second smart machine.

[0066] As another example, a marker may be placed in a specific space where the electronic device 100 and the smart machine are located to identify each location in, for example, the lower or upper part of the space. For example, on the floor of a factory, a marker, an identification marker, etc. may be set for each predetermined distance, area, and compartment. The electronic device 100 may obtain the location information of the electronic device 100 and the location information of the smart machine based on the marker.

[0067] The processor 150 according to an embodiment of the present disclosure can indicate the working area of ​​the smart machine on the image captured by the camera 120 based on the obtained smart machine operation information, and provide it on the display. For example, the processor 150 can identify the area corresponding to the position of the first smart machine based on the coordinate information (x1, y1, z1) according to the position of the first smart machine in the captured image, and color the area corresponding to (w1, h1) with a specific color, and provide an image including the colored area through the display 110.

[0068] Therefore, the user can receive the working area of ​​the first smart machine as augmented reality (AR) through the electronic device 100. The area colored with a specific color on the display 110 can indicate an area where the user's access is dangerous due to the operation of the first smart machine. In the absence of a physical fence installed, a virtual safety fence can be provided to the user to prevent and / or reduce the possibility of accidents.

[0069] The processor 150 according to an embodiment of the present disclosure may identify a smart machine based on the position information of the electronic device 100 and the shooting direction of the electronic device 100. In one example, the sensor 130 may sense the moving direction of the electronic device 100, the shooting direction of the camera 120 (e.g., the rear camera), and the processor 150 may identify the smart machine based on the sensed direction.

[0070] The processor 150 may identify a plurality of smart machines located in the peripheral area of ​​the electronic device 100 based on the location information of the electronic device 100, and identify a smart machine corresponding to the shooting direction among the plurality of smart machines. For example, if the smart machine corresponding to the shooting direction of the electronic device 100 among the identified first and second smart machines is the first smart machine, the processor 140 may indicate the working area based on the working information of the first smart machine. Here, the working area may refer to, for example, the width and height (w1, h1) of the area required when the first smart machine operates.

[0071] The processor 150 according to an example embodiment of the present disclosure may identify whether the smart machine is operating based on a work schedule of the smart machine. However, in an example embodiment, in addition to the work schedule, the processor 150 may also identify whether the smart machine is performing an operation based on an image captured by the camera 120. If the smart machine is identified as operating, the processor 150 may indicate and provide a work area. The work schedule may include at least one of the operation of the smart machine, the time required for the operation, and the standby time between operations.

[0072] According to the processor 150 of an example embodiment, if it is recognized that a smart machine is operating, information on a remaining time until the operation of the smart machine ends may be provided.

[0073] According to another example embodiment, if it is recognized that the smart machine is not operating, information about the remaining time until the operation of the smart machine starts may be provided.

[0074] As a non-limiting example, it may be assumed that the smart machine is operating between time t1 and time t2. If the smart machine is identified as being in operation, the processor 150 may provide information about the remaining time until time t2 based on the work schedule. As another example, if the smart machine is identified as not being in operation, information about the remaining time until time t1 may be provided.

[0075] The processor 150 according to an exemplary embodiment of the present disclosure may obtain the working information by analyzing the image of the smart machine captured by the camera 120 at a preset time. For example, the processor 150 may analyze the image captured by the smart machine within a predetermined time to obtain at least one of the operation time of the smart machine, the time required for the operation, and the waiting time between operations, thereby obtaining the working information. However, in an exemplary embodiment, the processor 150 may obtain the working information of the smart machine according to various methods and store the obtained working information in the memory 140. Figure 4 Describe its description in more detail.

[0076] The processor 150 may update the work information of the smart machine by analyzing the image of the smart machine taken at a preset time. As a non-limiting example, according to the work schedule stored in the memory 140, the smart machine may operate between time t1 and t2, and may operate between time t3 and t4. On the other hand, according to the image taken within the predetermined time, the smart machine operates between time t2 and t3, and may operate between time t4 and t5. Therefore, the processor 150 may update the task information of the smart machine stored in the memory 140, replace it with the updated work information, and store the updated work information.

[0077] Figure 2 is a block diagram illustrating an example configuration of an electronic device according to an example embodiment.

[0078] refer to Figure 2 , the electronic device 100 includes a display 110, a camera 120, a sensor 130, a memory 140, a processor (e.g., including a processing circuit) 150, a communication unit (e.g., including a communication circuit) 160, a driving unit (e.g., including a driving circuit) 170, and a speaker 180. Figure 2 Zhongyu Figure 1 The overlapped parts of the components shown will not be repeated. Figure 2 Detailed description of the components shown.

[0079] The camera 120 may include, for example, a lens, a shutter, an aperture, a solid-state image capture device, an analog front end (AFE), a timing generator (TG), and the like. The shutter adjusts the time when light reflected from an object enters the user terminal device 100, and adjusts the amount of light incident on the lens by mechanically increasing or decreasing the size of the aperture through which the light enters. When the light reflected on the object accumulates in the photoelectric charge, the solid-state image capture device outputs an electrical signal as an image due to the photoelectric charge. The TG outputs a timing signal for reading out the pixel data of the solid-state image pickup device, and the AFE samples the electrical signal output from the solid-state image pickup device and digitizes the electrical signal.

[0080] The sensor 130 may include various sensor circuits and may be implemented as, for example but not limited to, a global positioning system GPS sensor, a touch sensor, a geomagnetic sensor, a gyro sensor, an acceleration sensor, a proximity sensor, a grip sensor, and the like.

[0081] The touch sensor may be implemented as, for example, but not limited to, an electrostatic touch sensor, a pressure-sensitive touch sensor, and the like. An electrostatic touch sensor may refer to, for example, a sensor that uses a dielectric coated on the display surface to calculate touch coordinates by sensing a tiny amount of electricity generated by the user's body when a part of the user's body touches the display surface. A pressure-sensitive touch sensor may include, for example, but not limited to, two electrode plates built into the electronic device 100. When the user touches the upper and lower plates of the touched point, the pressure-sensitive touch sensor senses current flow. In addition, various other touch sensing circuits, such as, but not limited to, infrared sensing, surface ultrasonic conduction, integrated tension measurement, piezoelectric effect, and the like, may be used to detect touch interactions.

[0082] In addition, the electronic device 100 may use various other touch sensing circuits, such as but not limited to magnetic and magnetic field sensors, light sensors, proximity sensors, etc., instead of touch sensors to determine whether a touch object (such as a finger or stylus) has contacted or is close to the touch object.

[0083] The geomagnetic sensor may refer to, for example, a sensor for sensing a rotation state and a moving direction of the electronic device 100. The gyro sensor may refer to, for example, a sensor for sensing a rotation angle of the electronic device 100. Both the geomagnetic sensor and the gyro sensor may be provided, but even if only one of them is provided, the user terminal device 100 can detect the rotation state.

[0084] The acceleration sensor may refer to, for example, a sensor for sensing a tilt degree of the electronic device 100 .

[0085] The proximity sensor may refer to, for example, a sensor for sensing approaching motion without directly contacting the display surface. The proximity sensor may be implemented as various types of sensors, such as, but not limited to, a high-frequency oscillation type that forms a high-frequency magnetic field and senses a current caused by a magnetic field characteristic that changes when an object is approached, a magnetic type that uses a magnet, a capacitive type that senses a capacitance that changes due to the approach of an object, etc.

[0086] The grip sensor may refer to a sensor that detects a user's grip, for example, by being provided on a rear surface, an edge, and a handle separately from a touch sensor provided on a touch screen. In addition to the touch sensor, the grip sensor may be implemented as a pressure sensor.

[0087] The memory 140 may be implemented as an internal memory included in the processor 150, such as a read-only memory ROM or a random access memory RAM, or may be implemented as a memory separate from the processor 150. In this case, depending on the purpose of data storage, the memory 140 may be implemented in the form of a memory embedded in the electronic device 100 or a removable memory in the electronic device 100. For example, in the case of data for driving the electronic device 100, it is stored in a memory embedded in the electronic device 100, and in the case of data for an extended function of the electronic device 100, the data may be stored in a memory that can be attached to or detached from the electronic device 100.

[0088] The memory embedded in the electronic device 100 can be implemented as, for example but not limited to, a non-volatile memory, a volatile memory, a hard disk drive (HDD) or a solid-state drive (SSD), a micro SD card, a USB memory, etc., an external memory (e.g., a USB memory) that can be connected to the USB port, and the like.

[0089] The processor 150 may include various processing circuits and control the overall operation of the electronic device 100 using various programs stored in the memory 140 .

[0090] For example, the processor 150 may include a RAM 151 , a ROM 152 , a main CPU 153 , a graphic processor 154 , first to nth interfaces 155 - 1 ˜ 155 - n , and a bus 156 .

[0091] The RAM 151 , the ROM 152 , the main CPU 153 , the graphic processor 154 , and the first to nth interfaces 155 - 1 ˜ 155 - n may be interconnected through a bus 156 .

[0092] The first to nth interfaces 155-1 to 155-n may be connected to the above-mentioned various components. One of the interfaces may be a network interface connected to an external device through a network.

[0093] The main CPU 153 accesses the memory 140 and performs booting using an operating system O / S stored in the memory 140. Then, various operations are performed using various programs stored in the memory 140.

[0094] The ROM 152 stores a command set for booting the system, etc. The main CPU 153 copies the operating system O / S stored in the memory 140 to the RAM 151 according to the instructions stored in the ROM 152, and executes the O / S to boot the system. When the booting is completed, the main CPU 153 copies various application programs stored in the memory 140 to the RAM 151, executes the application programs copied to the RAM 151, and performs various operations.

[0095] The graphic processor 154 generates a screen including various objects (e.g., icons, images, and texts) using an operation unit (not shown) and a rendering unit (not shown). The operation unit (not shown) calculates attribute values ​​such as coordinate values, shape, size, and color to be displayed by each object according to the layout of the screen based on the received control command. The rendering unit (not shown) generates a screen including various layouts of objects based on the attribute values ​​calculated by the operation unit (not shown). The screen generated in the rendering unit (not shown) is displayed in the display area of ​​the display 110.

[0096] The operations of the processor 150 may be performed by executing a program stored in the memory 140 .

[0097] The communicator 160 may include various communication circuits and perform communication with various types of external devices according to various types of communication methods. The communicator 160 may include various communication circuits, such as, but not limited to, one or more of a wireless chip 161, a Bluetooth chip 162, a Wi-Fi chip 163, an NFC chip 164, etc. The processor 150 communicates with several external devices and smart machines using the communicator 160.

[0098] The Wi-Fi chip 161 and the Bluetooth chip 162 communicate with each other using WiFi or Bluetooth. When using the Wi-Fi chip 161 or the Bluetooth chip 162, various connection information such as SSID and session key can be sent and received first, and various information can be sent and received using the communication information. The wireless communication chip 163 refers to a chip that performs communication according to various communication standards, such as IEEE, Zigbee, third generation (3G), third generation partnership project (3GPP), long term evolution (LTE). The NFC chip 164 refers to a chip that operates in a near field communication (NFC) mode using the 13.56 MHz band among various RF-ID bands (e.g., 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz).

[0099] The processor 150 according to an embodiment of the present disclosure can communicate with a server (not shown) to obtain the working information of the smart machine. For example, when the product name of the smart machine is input, the processor 150 receives the working information of the smart machine corresponding to the product name from the server through the communication unit 160, and stores the received working information in the memory 140. However, the present disclosure is not limited to this, and the working information of the smart machine can be obtained by any suitable means, including, for example, but not limited to, keyword searches that describe the characteristics of the smart machine. For example, of course, you can search for pick and place robots, 6-axis multi-joint robots, etc., and obtain and store working information from the search results.

[0100] As another example, the processor 150 can communicate with a smart machine set near the electronic device 100 or within a predetermined range through the Wi-Fi chip 161, the Bluetooth chip 162, the NFC chip 164, etc. to obtain at least one of the location information and working information of the smart machine.

[0101] The drive unit 170 may include various drive circuits for moving the main body of the electronic device 100. Typically, the drive unit 170 of the electronic device 100 may include a left motor and a right motor. The drive unit 170 may selectively move the left motor and the right motor so that the main body of the electronic device 100 may move forward, backward, and rotate. In addition, the drive unit 170 may include a drive wheel and a castor. The drive wheel may be connected to the left motor and the right motor so that the two drive motors may be symmetrically arranged on the left and right edges of the central area of ​​the lower part of the main body of the electronic device 100. However, it should be understood that this may include various types of drivers capable of moving the electronic device 100.

[0102] For example, the drive unit 170 may be driven under the control of the processor 150 so that the electronic device 100 is located within a predetermined distance from the user. For example, the processor 150 may detect the user and control the drive unit 170 to be located within a distance of 1 m from the sensed user. Even when the user moves, the electronic device 100 may detect the changed position of the user in real time and move to correspond to the position of the user.

[0103] According to an embodiment of the present disclosure, when the position information of the electronic device 100 changes according to the control of the driving unit 170, the electronic device 100 can identify a smart machine located in the peripheral area of ​​the electronic device 100 based on the changed position information. Considering the movement of the user, the electronic device 100 can identify the smart machine located in the peripheral area of ​​the moving user in real time and provide an indication of the working area of ​​the identified smart machine.

[0104] The projector (not shown) can, for example, irradiate a light beam to the workspace of the smart machine based on the work information of the identified smart machine. For example, in addition to providing an indication of the work area on the captured image, the electronic device 100 can also irradiate a light beam to the workspace of the identified smart machine and allow the user to identify the work area.

[0105] In one example, the projector can illuminate a first light beam with a specific color in the workspace of the smart machine. In order to enable the user to intuitively identify the work area and prevent and / or reduce accidents, the projector can illuminate the workspace with a red light beam.

[0106] The projector according to an example embodiment of the present disclosure may irradiate a second light beam that guides a recognizable position about at least one of the user's motion and the user's voice based on distance information for recognizing at least one of the user's motion and the user's voice by the smart machine. For example, the smart machine may recognize at least one of the user's motion and voice, and the electronic device 100 may include information about the minimum distance required for the smart machine to recognize the motion and voice without failure. The electronic device 100 may irradiate a second light beam that guides a recognizable position to a user who wants to control the smart machine using at least one of the motion and voice based on the information about the minimum distance. For example, a green light beam may be illuminated to distinguish it from the working area of ​​the smart machine.

[0107] A projector according to an example embodiment of the present disclosure may include a display panel (not shown) receiving a signal and displaying the signal, a lamp (not shown) irradiating light to the display panel, and a projection lens (not shown) adjusting a focus of a light beam passing through the display panel.

[0108] The display panel may be a transparent or translucent liquid crystal LCD panel, the lamp may be a light emitting diode LED, and the projection lens may include different combinations of lens assemblies capable of focusing adjustment. The projector according to an embodiment may receive a signal from the processor 150 and display it on the display panel. The lamp may irradiate light to the display panel and use a projection lens to focus an image beam passing through the display panel to display the working area to the user. However, this is only an example, and the projector may be implemented by various types of projectors, and the light beam may irradiate the area corresponding to the working area. For example, the projector may be implemented as a detachable projector.

[0109] In addition, the projector according to example embodiments may include a hologram device (not shown), and may provide a hologram to a workspace of the smart machine based on a signal received from the processor 150 .

[0110] The speaker 180 may refer to, for example, a component for outputting various audio data, various notification sounds, voice messages, etc. For example, if the electronic device 100 senses a user and the user is identified as being located in the working area of ​​the smart machine according to the detection result, the speaker 180 may output a notification. However, this is just an example, and if the sensed user is identified as being within a predetermined distance in the working area, the processor 150 may control the speaker 180 to output an alarm sound.

[0111] The input unit (not shown) may include various input circuits, such as but not limited to a touch panel, a pen sensor, a key, a microphone, etc., to receive various inputs. The touch panel may be configured by combining the display 110 and a touch sensor (not shown), and the touch sensor may use, for example but not limited to, at least one of an electrostatic type, a pressure-sensitive type, an infrared type, an ultrasonic type, etc. The touch panel may not only have a display function, but may also include a function of detecting a touch input position and a touch area and a touch input pressure, and may include a function of detecting not only a real touch but also a near touch. The pen sensor may be implemented as a part of the touch panel, or may include a separate identification page. The key may include a physical button, an optical key, or a keypad. The microphone may include at least one of an internal microphone and / or an external microphone.

[0112] The input unit may receive the location information and working information of the smart machine according to the user input. For example, if the user manually inputs the location information of the smart machine, the input unit may transmit the input information to the processor 150. In addition, when the user inputs the working information of the smart machine through the input unit, the processor 150 may store the input working information in the memory 140.

[0113] Hereinafter, the operation of the electronic device 100 will be described in more detail with reference to various drawings.

[0114] Figure 3 is a diagram illustrating an example work area according to an example embodiment.

[0115] like Figure 3 As shown, the electronic device 100 can be implemented as a user terminal device. The electronic device 100 can obtain the location information of the electronic device 100 through the sensor 130.

[0116] Based on the location information of the electronic device 100 and the smart machine, the electronic device 100 may identify the smart machine located in the peripheral area of ​​the electronic device 100. For example, the first to third machines 200, 300, and 400 may be identified.

[0117] The electronic device 100 may obtain the operation information of each of the identified first to third smart machines 200, 300, and 400. The electronic device 100 may identify whether each of the first to third smart machines 200, 300, and 400 is operating based on the obtained operation information. For example, if the second and third smart machines 300 and 400 are identified as being in operation, the requested work area may be obtained according to the operation of the second and third smart machines 300 and 400.

[0118] The electronic device 100 according to an exemplary embodiment of the present disclosure may provide an indication of a working area of ​​a smart machine to an image captured by the camera 120. Here, the image captured by the camera 120 may be a pre-stored image, or may be an image received by the camera 120 in real time.

[0119] The electronic device 100 according to an embodiment of the present disclosure may identify a smart machine based on the position information of the electronic device 100 and the shooting direction of the electronic device 100. For example, if the first to third smart machines 200, 300, and 400 are included in an image received in real time via the camera 120 according to the shooting direction of the electronic device 100, based on the working information of the first to third smart machines 200, 300, and 400, the working areas of the first to third smart machines 200, 300, and 400 may be indicated and displayed.

[0120] Here, the configuration for indicating the working area may refer to, for example, shading processing and color processing so that the working area is separated from the rest of the area in the image. For example, the area corresponding to the working area of ​​the second smart machine 300 may be colored and displayed in red. The electronic device 100 may inform the user that the area colored in red is a dangerous area.

[0121] According to another embodiment of the present disclosure, the danger zone may be changed according to the user's setting. As an example, the electronic device 100 may provide a UI for setting the security level. If the highest level is set at the security level divided into upper, middle, and lower levels, a 1-2m area may be added to the working area 20 of the smart machine to indicate the danger zone (see, for example, Fig. 9 ). The electronic device 100 can not only consider the working area of ​​the smart machine, but also indicate the dangerous area by considering the safety level. 1-2m is just an example and is not limited thereto, and it goes without saying that it can be variously changed according to the purpose.

[0122] The electronic device 100 may also indicate and provide information about non-operating smart machines to the image. For example, if the first smart machine 200 is identified as not operating, the electronic device 100 may make the peripheral area of ​​the first smart machine 200 or the area corresponding to the working area according to the operation of the first smart machine 200 green so that the area is separated from other areas. The electronic device 100 may make the user realize that the green area is a safe area.

[0123] Figure 4 is a diagram illustrating an example work schedule according to an example embodiment.

[0124] refer to Figure 4 , the electronic device 100 may include work information of the smart machine, and the work information may include information about a work schedule of the smart machine and a work area required to perform operations included in the work schedule.

[0125] Here, the work schedule may refer to, for example, a list of operations according to the time of the smart machine. Figure 4 As shown, according to the work schedule, the first intelligent machine 200 performs an operation between time t and time t1, and performs a corresponding operation when an area (w, h) is required at a position (x, y, z). In addition, the second intelligent machine 300 is in a standby state without performing an operation from time t2 to t4, and may require an area (w, h) at a position (x, y, z) from time t4 to t5 to perform a required operation.

[0126] The electronic device 100 may be configured to perform a plurality of operations based on a work schedule of each of a plurality of smart machines and information about a work area required to perform the operations included in the work schedule, and may identify a work area (or space) required to perform the operations.

[0127] For example, the first to third smart machines 200, 300, and 400 may be arranged in a factory, and the electronic device 100 may include the working information of each of the first to third smart machines 200, 300, and 400. When each of the first to third smart machines 200, 300, and 400 works at tx based on the working information, the electronic device 100 may recognize a required working area. Here, since the working area is an area where the smart machine is operated, it may refer to, for example, a dangerous area where the user's access is limited.

[0128] Figure 5 is a diagram illustrating an example method for providing a work area according to an example embodiment.

[0129] Reference Figure 5, the working information of the smart machine can be manually or automatically input. The manual input method according to the exemplary embodiment may include generating and storing the working information of the smart machine based on the input data based on whether the smart machine is fixed, the maximum / minimum output torque of the smart machine, the maximum / minimum speed of the smart machine, the operation type (grab, pierce, release, move, touch, etc.), and the time required for each operation. At the same time, this is just an example, and it is not necessary that all data are input, and the electronic device 100 can generate a work schedule based on the input data and the data received from the server.

[0130] The automatic input method according to another embodiment of the present disclosure may be a method for receiving and storing the working information of the smart machine from the server. For example, when the product name of the smart machine is input, the operation information corresponding to the product name may be received. However, the present disclosure is not limited thereto. In another embodiment, when an image captured by the smart machine through the camera 120 within a predetermined time or longer is received, the electronic device 100 may analyze the image to generate working information. Working information may be generated by analyzing the image and obtaining at least one of the operation of the smart machine, the time required for the operation, and the waiting time between the operations.

[0131] Figure 6 is a diagram illustrating an example electronic device according to another example embodiment.

[0132] refer to Figure 6 In addition to indicating and providing the working area to the captured image, the electronic device 100 can provide additional information.

[0133] As a non-limiting example, if the smart machine is identified as operable based on the work schedule, the electronic device 100 may provide information on the remaining time until the operation ends on the captured image. Figure 6 As shown, when the operation is terminated, a “time to safe” indicating the remaining time until the dangerous area becomes a safe area may be displayed.

[0134] In addition, if the electronic device 100 is identified as not in operation, the electronic device 100 may provide information on the remaining time until the operation of the smart machine starts. Figure 6 As shown, a “time to critical” indicating the remaining time until a safe area becomes a dangerous area may be displayed at the start of an operation.

[0135] When receiving a user input to display information, the electronic device 100 according to an embodiment of the present disclosure can display information about the operation. For example, if information about the remaining time until the smart machine starts the operation according to the user input is touched, the electronic device 100 can display a description of the operation, an area (or space) required for the smart machine to perform the operation, etc.

[0136] Figure 7 and Figure 8 is a diagram illustrating an example electronic device according to another example embodiment.

[0137] refer to Figure 7 The electronic device 100 includes a driving unit 170 and can be implemented in a form capable of moving itself by controlling the driving unit 170. The electronic device 100 can sense a user and can control the driving unit 170 to position the electronic device 100 within a predetermined distance from the sensed user.

[0138] When the position of the electronic device 100 changes with the control of the driving unit 170, the electronic device 100 can identify the smart machines located in the peripheral area by reflecting the changed position in real time. In one example, if the electronic device 100 moves from a first position to a second position, and the smart machines located in the peripheral area of ​​the electronic device 100 change from the first smart machine 200 to the second and third smart machines 300, 400, the electronic device 100 can obtain the working information of the second and third smart machines 300, 400.

[0139] The electronic device 100 may display an image indicating the working areas of the second and third smart machines 300 , 400 .

[0140] The electronic device 100 according to the embodiment of the present disclosure can use a projector to irradiate a light beam to a work space according to work information. Figure 7 As shown, the electronic device 100 includes a beam projector function, and based on the position information and work information of the first to third intelligent machines 200, 300, 400 in the peripheral area of ​​the electronic device 100, and can indicate the working area (or dangerous area) by irradiating a beam to the working space.

[0141] refer to Figure 8 , the electronic device 100 may include a beam projector disposed in a ceiling of a specific space. The beam projector may illuminate a beam indicating a working space of the smart machine.

[0142] like Figure 8As shown, the first to third beam projectors 100-1, 100-2, and 100-3 may be arranged to correspond to the first to third smart machines 200, 300, and 400, respectively. However, the present disclosure is not limited thereto, and one beam projector may irradiate a plurality of beams to irradiate the beams to the workspace of each of the plurality of smart machines. The first to third beam projectors 100-1, 100-2, and 100-3 may be connected to perform communication between the first to third beam projectors 100-1, 100-2, and 100-3, and may be wirelessly connected or wiredly connected to the main body of the electronic device 100 as a component of the electronic device 100.

[0143] Fig. 9 is a diagram illustrating an example of a recognizable location according to an example embodiment.

[0144] The smart machine according to an exemplary embodiment of the present disclosure may be controlled based on the user's biometric information (eg, motion recognition, voice recognition, etc.). For example, if a "power off" voice command is received, the smart machine may be turned off.

[0145] The electronic device 100 according to the example embodiment may include information about the maximum distance between the smart machine and the user, which the smart machine needs to easily recognize the user's motion and voice. Here, the maximum separation distance may refer to, for example, a situation in which the smart machine cannot correctly recognize the user's motion, voice, etc. at the maximum separation distance of the smart machine. For example, if the distance to the smart machine exceeds 5 meters, the smart machine may not easily recognize the user's motion, voice, etc., and the error rate of the smart machine may increase. The electronic device 100 may indicate information about the maximum separation distance.

[0146] In one example, if the electronic device 100 is implemented as a user terminal device, the work area 20 of the second smart machine 300 is indicated to an image taken by a camera, and a recognizable position 30 regarding at least one of motion and voice may be indicated and provided.

[0147] As another example, when the electronic device 100 is implemented as a projector, the projector may irradiate a first light beam to the work space along the work area 20 of the second smart machine 300, and irradiate a second light beam using the space according to the identifiable position 30. Based on the irradiated first and second light beams, the user may recognize that the area irradiated by the first light beam is a dangerous area, and the area irradiated by the second light beam is an area where the user should be located.

[0148] Fig.10 is a flowchart illustrating an example control method of an electronic device according to an example embodiment.

[0149] The electronic device storing the location information and operation information of the smart machine according to an embodiment of the present disclosure detects the location information (eg, location and direction information) of the electronic device ( S1010 ).

[0150] A smart appliance located in a peripheral area of ​​the electronic device is identified based on the location information of the electronic device and the location information of the smart appliance (S1020).

[0151] The operating information of the identified intelligent machine is obtained (S1030).

[0152] Based on the obtained operation information of the smart machine, an operation area of ​​the smart machine is indicated on the image captured by the camera, and the operation area is displayed ( S1040 ).

[0153] The operation of identifying S1020 may include identifying a smart machine based on a photographing direction of the electronic device detected using position information of the electronic device and the sensor.

[0154] According to an example embodiment, the working information of the smart machine may include information about a working area required to perform operations included in a working schedule of the smart machine, and the method may include identifying whether the smart machine is operating based on the working schedule of the smart machine, and displaying (S1040) includes indicating and providing a working area corresponding to the operation of the smart machine based on the information of the working area if it is identified that the smart machine is operating.

[0155] In this case, if the smart machine is identified as being in operation, the display (S1040) may display information about the remaining time until the operation of the smart machine ends based on the work schedule, and if it is identified that the smart machine is not operating, information about the remaining time until the smart machine starts operating may be displayed.

[0156] Furthermore, the work information may include at least one of an operation of the smart machine obtained by analyzing an image captured by the smart machine within a predetermined time, a time required for the operation, and a standby time between operations.

[0157] The control method according to example embodiments may include irradiating a first light beam to a work space of the smart machine based on the recognized work information of the smart machine.

[0158] The method may also include an operation of irradiating a second light beam to a recognizable position guiding at least one of the user's motion and voice based on distance information at which the smart machine can recognize at least one of the user's motion and voice.

[0159] The control method according to the embodiment may further include moving the main body of the electronic device so that the electronic device is located within a predetermined distance from a user of the electronic device, and the identification step (S1020) includes, when the location information changes, identifying a smart machine located in the peripheral area of ​​the electronic device based on the changed location information.

[0160] In addition, the display S1040 may display a UI of a recognizable location that guides at least one of the motion and voice of the user based on the distance information, wherein the smart machine may recognize at least one of the motion and voice of the user from the recognizable location.

[0161] According to an embodiment, the electronic device may include coordinate information indicating the coordinates of each position of a specific space, and the coordinate information of the electronic device includes information indicating the coordinates of the position of the electronic device arranged in the specific space based on the coordinate information, and the position information of the smart machine may be information indicating the position of the smart machine arranged in the specific space based on the coordinate information.

[0162] The various exemplary embodiments described above may be embodied in a non-transitory recording medium, which may be read by a computer or similar device using software, hardware, or any combination thereof. In some cases, the exemplary embodiments described herein may be implemented by a processor itself. According to software implementation, embodiments such as the processes and functions described herein may be implemented in separate software modules. Each software module may perform one or more functions and operations described herein.

[0163] Meanwhile, computer instructions for executing the processing operations according to the various exemplary embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When executed by a processor, the computer instructions stored in such a non-transitory computer-readable medium may cause a specific device to execute the processing operations according to the various exemplary embodiments described above.

[0164] Non-transitory computer-readable media may refer to, for example, a medium that stores data semi-permanently and can be read by a device. Examples of non-transitory computer-readable media may include, for example but not limited to, compact disks (CDs), digital versatile disks (DVDs), hard disks, Blu-ray disks, universal serial buses (USBs), memory cards, ROMs, etc.

[0165] The foregoing exemplary embodiments and advantages are merely examples and should not be construed as limitations. The present disclosure may be easily applied to other types of devices. In addition, the description of the exemplary embodiments is intended to be illustrative rather than limiting the scope of the claims, and many substitutions, modifications, and variations will be apparent to those skilled in the art.

Claims

1. An electronic device, comprising: monitor; camera; sensor; a memory configured to store location information and work information of a smart machine, wherein the work information of the smart machine includes a work schedule of the smart machine and information about a work area required to perform operations included in the work schedule; and The processor is configured as: Based on the location information of the electronic device sensed by the sensor and the location information of the smart machine stored in the memory, identifying the smart machine located in the peripheral area of ​​the electronic device, Obtaining the working information of the identified intelligent machine from the memory, and identifying whether the smart machine is operating based on a work schedule of the smart machine, Based on the obtained working information of the smart machine, indicating the working area of ​​the smart machine on the image captured by the camera, Based on recognizing that the smart machine is operating, providing an image including the work area and information about a remaining time until the operation of the smart machine ends on the display based on the work schedule, providing information about a remaining time until operation of the smart machine starts based on recognizing that the smart machine is not operating, wherein the work information includes information on at least one of: operations of the smart machine obtained by analyzing images of the smart machine captured during a predetermined time, time required for the operations, and standby time between operations, The electronic device further comprises: Projector, wherein the processor is configured to control the projector to irradiate a first light beam to a workspace of the smart machine based on the recognized work information of the smart machine, and to control the projector to irradiate a second light beam, the second light beam directing a recognizable position regarding at least one of a motion or a voice of the user based on distance information at which the smart machine can recognize at least one of the motion or the voice of the user, wherein the color of the first light beam is different from the color of the second light beam so as to distinguish the workspace from the identifiable location, The processor is configured to provide a user interface UI of a recognizable location for guiding at least one of the user's movement and voice based on distance information at which the smart machine can recognize at least one of the user's movement and voice. 2 . The electronic device according to claim 1 , wherein the processor is configured to identify the smart machine based on a shooting direction of the electronic device sensed by the sensor and location information of the electronic device.

3. The electronic device according to claim 1, further comprising: a driving unit including a driving circuit configured to move a main body of the electronic device, wherein the processor is configured to: controlling the drive unit to position the electronic device within a predetermined distance from a user of the electronic device, and In response to the position information of the electronic device changed according to the control of the driving unit, a smart machine located in a peripheral area of ​​the electronic device is identified.

4. The electronic device according to claim 1, wherein the memory is configured to include coordinate information indicating each position of the specific space, in, The location information of the electronic device includes information indicating a location of the electronic device disposed in the specific space based on the coordinate information, and The location information of the smart machine includes information indicating the location of the smart machine set in the specific space based on the coordinate information.

5. A method for controlling an electronic device that stores location information and working information of an intelligent machine, the method comprising: sensing location information of the electronic device; Based on the location information of the electronic device sensed by the sensor and the location information of the smart machine stored in the memory, identifying the smart machine located in the peripheral area of ​​the electronic device; The working information of the identified intelligent machine is obtained from the memory, wherein: The operation information of the smart machine includes an operation schedule of the smart machine and information about an operation area required to perform operations included in the operation schedule; identifying whether the smart machine is operating based on a work schedule of the smart machine; as well as Based on the obtained working information of the smart machine, indicating a working area of ​​the smart machine in an image captured by a camera, and displaying an image including the working area, The display includes indicating and providing a working area corresponding to the operation of the smart machine based on the information about the working area based on the recognition that the smart machine is operating, wherein the display includes: when it is recognized that the smart machine is operating, displaying information about the remaining time until the operation of the smart machine ends based on the work schedule, and based on recognition that the smart machine is not operating, displaying information about the remaining time until the operation of the smart machine starts, wherein the work information includes information on at least one of: operations of the smart machine obtained by analyzing images of the smart machine captured during a predetermined time, time required for the operations, and standby time between operations, The control method further comprises: Using a projector, irradiating a first light beam to a workspace of the smart machine based on the identified work information of the smart machine; and irradiating a second light beam using the projector, the second light beam guiding a recognizable position with respect to at least one of the motion and voice of the user based on distance information at which the smart machine can recognize at least one of the motion or voice of the user, wherein the color of the first light beam is different from the color of the second light beam so as to distinguish the workspace from the identifiable location, The processor is configured to provide a user interface UI of a recognizable location for guiding at least one of the user's movement and voice based on distance information at which the smart machine can recognize at least one of the user's movement and voice. 6 . The method according to claim 5 , wherein the identifying comprises identifying the smart machine based on a shooting direction of the electronic device sensed by the sensor and location information of the electronic device.

Images