Electronic device and control method therefor

Abstract

Provided are an electronic device and a control method therefor. The electronic device comprises: at least one sensor; a driving unit; a memory for storing at least one instruction; and a processor connected to the at least one sensor, the driving unit, and the memory, and controlling the electronic device. The processor executes the at least one instruction to, when lifting of the electronic device is detected while the electronic device operates in a first driving state on the basis of a first map of an area in which the electronic device is located, obtain information about a height at which the electronic device is placed after being lifted on the basis of a sensing value obtained from the at least one sensor. When the height at which the electronic device is placed after being lifted is within a preset first range, the processor operates in a second driving state in which the speed of the electronic device is limited to less than a first value. Also, the present disclosure relates to an artificial intelligence (AI) system using a machine learning algorithm, and an application thereof.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof that identify a driving state according to a position of a space in which the electronic device is placed when lifting of the electronic device is detected.

[0002] An artificial intelligence system is a computer system that implements human-level intelligence. It is a system in which the machine learns and makes judgments on its own, and its recognition rate improves with use.

[0003] Artificial intelligence technology consists of machine learning (deep learning) technology that uses algorithms that classify / learn the characteristics of input data on their own, and element technologies that use machine learning algorithms to simulate the cognitive and judgment functions of the human brain.

[0004] The element technologies may include, for example, at least one of linguistic understanding technology that recognizes human language / characters, visual understanding technology that recognizes objects as if they were human vision, inference / prediction technology that judges information and logically infers and predicts, knowledge representation technology that processes human experience information into knowledge data, and motion control technology that controls autonomous driving of vehicles and the movement of robots. In particular, visual understanding is a technology that recognizes and processes objects as if they were human vision, and includes object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and image enhancement. In addition, inference prediction is a technology that judges information and logically infers and predicts, and includes knowledge / probability-based inference, optimization prediction, preference-based planning, and recommendation.

[0005] Meanwhile, electronic devices that move within specific spaces (e.g., homes, restaurants, etc.) and perform various functions are being developed. For example, various electronic devices, such as mobile projectors, robot vacuum cleaners, serving robots, and guide robots, move within specific spaces and perform various functions.

[0006] These electronic devices can use various sensors to recognize their current location. Furthermore, if the electronic device is lifted from a first location and then placed in a second location, the electronic device can re-detect its surroundings and re-detect its current location.

[0007] However, if the electronic device is lifted from a first location and then placed in a second location, the electronic device (100) only detects the current second location and cannot determine whether it has moved within the same floor, been placed on furniture such as a table, or moved to a different floor. This can lead to problems such as the electronic device falling from the furniture or moving based on a different map.

[0008] According to one embodiment of the present disclosure, an electronic device includes: at least one sensor; a driving unit; a memory storing at least one instruction; and a processor connected to the at least one sensor, the driving unit, and the memory and controlling the electronic device, wherein the processor executes the at least one instruction to, when lifting of the electronic device is detected while the electronic device is operating in a first driving state based on a first map of an area in which the electronic device is located, obtain information on a height at which the electronic device is placed after being lifted based on a sensing value obtained from the at least one sensor, and, when the height at which the electronic device is placed after being lifted is within a first preset range, operate in a second driving state that limits a speed of the electronic device to less than a first value.

[0009] The processor obtains first information about a location to which the electronic device has moved based on a sensing value obtained from the at least one sensor while the electronic device is being moved after being lifted, and when the electronic device is placed, the processor can identify a location to which the electronic device has moved based on the obtained first information.

[0010] The at least one sensor includes an IMU sensor and a floor detection sensor, and the processor, when operating in the second driving state, identifies whether a map for a space where the electronic device is placed is stored based on information about a location to which the electronic device has moved, and if information about the map is not stored, generates a second map for a space where the electronic device is placed based on sensing values ​​acquired through the IMU sensor and the floor detection sensor while the electronic device is moved through the space where the electronic device is placed.

[0011] The processor can store information about the second map generated based on information about the location to which the electronic device has moved by matching it to the first map.

[0012] The processor can control the driving unit to move at a speed less than the first value only within a space where the electronic device is placed based on information about the second map while operating in the second driving state.

[0013] A projection unit is further included, and the processor can control the projection unit to project a screen using a single-focus projector in a space where the electronic device is placed while operating in the second driving state.

[0014] The processor may operate in a third driving state in which the electronic device moves based on a third map corresponding to the height at which the electronic device is placed after being lifted among a plurality of maps of the area stored by the electronic device, if the height at which the electronic device is placed after being lifted is within a second range higher than the first range.

[0015] If the processor determines that information about the third map among the plurality of maps of the area is not stored, the processor can generate a third map for the space where the electronic device is placed based on sensing values ​​acquired while the electronic device is moved through the space where the electronic device is placed.

[0016] The processor can input the sensing values ​​obtained from the at least one sensor into a learned neural network model to obtain information on the driving state according to the height at which the electronic device is placed after being lifted.

[0017] Meanwhile, according to one embodiment of the present disclosure, a control method of an electronic device includes: a step of operating in a first driving state in which the electronic device moves based on a first map of an area in which the electronic device is located; a step of obtaining information on a height at which the electronic device is placed after being lifted based on a sensing value obtained from at least one sensor when lifting of the electronic device is detected while the electronic device is operating in the first driving state; and a step of operating in a second driving state in which a speed of the electronic device is limited to less than a first value when the height at which the electronic device is placed after being lifted is within a first preset range.

[0018] The method may include: a step of obtaining first information about a location to which the electronic device has been moved based on a sensing value obtained from at least one sensor while the electronic device is being moved after being lifted; and a step of identifying a location to which the electronic device has been moved based on the obtained first information when the electronic device is placed.

[0019] The at least one sensor may include an IMU sensor and a floor detection sensor, and the control method may include, when operating in the second driving state, a step of identifying whether a map for a space in which the electronic device is placed is stored based on information about a location to which the electronic device has moved; and, if information about the map is not stored, a step of generating a second map for a space in which the electronic device is placed based on sensing values ​​acquired through the IMU sensor and the floor detection sensor while the electronic device is moved through the space in which it is placed.

[0020] The step of storing information about the second map generated based on information about the location to which the electronic device has moved by matching it to the first map may be included.

[0021] It may include a step of moving at a speed lower than the first value only within a space where the electronic device is placed based on information about the second map while operating in the second driving state.

[0022] It may include a step of projecting a screen using a single-focus projector in a space where the electronic device is placed while operating in the second driving state.

[0023] If the height of the electronic device after being lifted is within a second range higher than the first range, the electronic device may be operated in a third driving state based on a third map corresponding to the height of the electronic device after being lifted among a plurality of maps of the area stored by the electronic device.

[0024] If it is determined that information on the third map among the plurality of maps of the above area is not stored, the method may include a step of generating a third map for the space where the electronic device is placed based on sensing values ​​acquired while the electronic device is moved through the space where the electronic device is placed.

[0025] It may include a step of inputting the sensing value obtained from at least one sensor into a learned neural network model to obtain information on the driving state according to the height at which the electronic device is placed after being lifted.

[0026] Meanwhile, in accordance with one embodiment of the present disclosure, a non-transitory computer-readable medium storing a program for executing a control method of an electronic device includes: operating in a first driving state in which the electronic device moves based on a first map of an area in which the electronic device is located; obtaining information on a height at which the electronic device is placed after being lifted based on a sensing value obtained from at least one sensor when lifting of the electronic device is detected while the electronic device is operating in the first driving state; and operating in a second driving state in which a speed of the electronic device is limited to less than a first value when the height at which the electronic device is placed after being lifted is within a first preset range.

[0027] FIG. 1 is a block diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure;

[0028] FIG. 2 is a flowchart illustrating a method for determining a driving state of an electronic device according to one embodiment of the present disclosure;

[0029] FIG. 3 is a flowchart illustrating a method for controlling the operation of an electronic device while operating in a second driving state according to one embodiment of the present disclosure;

[0030] FIGS. 4A and 4B are drawings for explaining a method of controlling the operation of an electronic device while operating in a second driving state according to one embodiment of the present disclosure;

[0031] FIG. 5 is a flowchart illustrating a method for controlling the operation of an electronic device while operating in a third driving state according to one embodiment of the present disclosure;

[0032] FIG. 6 is a drawing for explaining a first map and a third map according to one embodiment of the present disclosure;

[0033] FIG. 7 is a flowchart illustrating a method for determining a driving state of an electronic device using a learned neural network model according to one embodiment of the present disclosure;

[0034] FIG. 8 is a diagram illustrating a neural network model learned to determine a driving state of an electronic device according to one embodiment of the present disclosure;

[0035] FIG. 9 is a block diagram illustrating in detail the configuration of an electronic device according to one embodiment of the present disclosure, and

[0036] FIG. 10 is a perspective view illustrating the appearance of an electronic device according to one embodiment of the present disclosure.

[0037] The present embodiments may be modified and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0038] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0039] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0040] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0041] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0042] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0043] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0044] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0045] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0046] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0047] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0048] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0049] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0050]

[0051] FIG. 1 is a block diagram briefly illustrating the configuration of an electronic device according to an embodiment of the present disclosure. As illustrated in FIG. 1, the electronic device (100) includes a memory (113), a driving unit (120), at least one sensor (121), and a processor (111). Meanwhile, the configuration illustrated in FIG. 1 is merely an example of various embodiments, and some components may be omitted and new components may be added. Meanwhile, the electronic device (100) according to an embodiment of the present disclosure may be a mobile projector that projects an image, but is not limited thereto, and may be implemented as various electronic devices such as a robot vacuum cleaner, a serving robot, a guide robot, etc.

[0052] The memory (113) may store an operating system (OS) for controlling the overall operation of the components of the electronic device (100) and instructions or data related to the components of the electronic device (100). In particular, the memory (113) may include a plurality of modules for operating in different driving states (or driving modes) depending on the height (of the space) at which the electronic device is placed after being lifted. In particular, when the electronic device is powered on or a function for operating in different driving states depending on the height at which the electronic device is placed after being lifted is executed, the electronic device (100) may load data for various modules stored in the non-volatile memory to perform various operations into the volatile memory. Here, loading means an operation of loading and storing data stored in the non-volatile memory into the volatile memory so that the processor (111) can access it.

[0053] In particular, the memory (113) can store information about a map of an area (e.g., a house, a restaurant, an airport, etc.) where the electronic device (100) is located. At this time, the map can include a picture that represents the state of an indoor space (or an object space) on a plane by reducing it by a certain ratio. According to embodiments of the present disclosure, the map can include a picture that represents the plane structure of the area where the electronic device (100) is located by reducing it by a certain ratio and representing it with a predetermined symbol. For example, the map can include a picture that represents the plane structure with lines. However, the present invention is not limited thereto, and the map can also include the locations of major objects within the area. In addition, the map can be a two-dimensional map, but this is only one embodiment, and can be a three-dimensional map.

[0054] According to an embodiment of the present disclosure, the memory (113) may store information regarding a plurality of maps of an area. The plurality of maps may be stored by being mapped to the height at which the electronic device (100) is placed. For example, the plurality of maps may include a map for a first-floor space, a map for a second-floor space, a map for a space containing furniture (e.g., a table) included in the area where the electronic device (100) is located, etc. In this case, the maps may include information regarding objects placed within the space.

[0055] In addition, the memory (113) can store data for various neural network models. For example, the memory (113) can store a neural network model for determining a driving state by inputting a sensing value obtained from at least one sensor (121). As another example, the memory (113) can store a neural network model for detecting lifting of the electronic device (100) by inputting a sensing value obtained from at least one sensor (121). However, this is only one embodiment, and it is obvious that the learned neural network model can be stored in an external device (e.g., an external server, etc.).

[0056] The driving unit (120) can generate physical force and transmit it to a driving unit (e.g., a wheel) included in the electronic device (100). In particular, the driving unit (120) can move to a target position under the control of the processor (110). In particular, the driving unit (120) can control the movement of the electronic device (100) at a limited speed depending on the driving state. For example, when operating in a second driving state (e.g., when the electronic device (100) is placed on a table), the driving unit (120) can move by limiting the speed of the electronic device (100) to less than a first value.

[0057] At least one sensor (121) can obtain various information about the status of the electronic device (100) or the surrounding environment of the electronic device (100). In particular, at least one sensor (121) may include an IMU (Inertial Measurement Unit) sensor. The IMU sensor is a sensor for detecting the movement of the electronic device (100) and may be implemented as a 6-axis sensor or a 9-axis sensor. In this case, the IMU sensor may include at least one of a geomagnetic sensor, an acceleration sensor, and a gyro sensor. In addition, at least one sensor (121) may include a ToF (Time Of Flight) sensor. A LIDAR sensor can obtain a sensing value for obtaining information about the distance to the object by projecting a light beam to an object and detecting the light reflected by the object. However, as described above, using a LIDAR sensor to obtain information about the distance to the object is merely one embodiment, and information about the distance to the object may be obtained using various sensors such as a depth sensor. In particular, the processor (121) can generate a map of an indoor space based on sensing values ​​(or sensing information) acquired through an IMU sensor and a lidar sensor. In addition, at least one sensor (121) may include a floor detection sensor for preventing the electronic device (100) from falling, such as a distance measurement sensor (e.g., a ToF sensor, etc.) facing the floor. In addition, at least one sensor (121) may include a sensor provided on a wheel of the electronic device (100), etc., for detecting lifting of the electronic device (100).

[0058] The processor (111) can control the electronic device (100) according to at least one instruction stored in the memory (113).

[0059] In particular, the processor (111) may include one or more processors. Specifically, the one or more processors may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors may control one or any combination of other components of the electronic device (100) and perform operations related to communication or data processing. The one or more processors may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory.

[0060] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one processor or by a plurality of processors. That is, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-only processor). For example, the electronic device (100) may perform an operation of generating a map or an operation of controlling the driving of the electronic device using the general-purpose processor, and may perform an operation of determining a driving state of the electronic device through a neural network model using the artificial intelligence-only processor.

[0061] One or more processors may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include internal processor memory, such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0062] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among a plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0063] In one or more embodiments of the present disclosure, when lifting of the electronic device (100) is detected while the electronic device (100) is operating in a first driving state in which the electronic device (100) moves based on a first map of an area in which the electronic device (100) is located by executing at least one instruction stored in the memory (113), the processor (111) obtains information about a height at which the electronic device (100) is placed after being lifted based on a sensed value sensed from at least one sensor (121). If the height at which the electronic device (100) is placed after being lifted is within a first preset range, the processor (111) operates in a second driving state that limits the speed of the electronic device (100) to less than the first value.

[0064] In one embodiment, the processor (111) may obtain first information about a location to which the electronic device has moved based on sensing values ​​obtained from at least one sensor while the electronic device is being moved after being lifted. When the electronic device (100) is placed, the processor (111) may identify the location to which the electronic device (100) has moved based on the first information.

[0065] In one embodiment, when operating in the second driving state, the processor (111) can identify whether a map for the space where the electronic device (100) is placed is stored based on information about the location to which the electronic device (100) has moved. If information about the map is not stored, the processor (111) can generate a second map for the space where the electronic device (100) is placed based on sensing values ​​acquired through the IMU sensor and the floor detection sensor while the electronic device (100) is moved through the space where it is placed.

[0066] In one embodiment, the processor (111) may store information about a second map generated based on information about a location to which the electronic device (100) has moved, matching the second map with the first map.

[0067] In one embodiment, the processor (111) may control the driving unit (120) to move at a speed less than the first value only within the space in which the electronic device (100) is placed based on information about the second map while operating in the second driving state.

[0068] In one embodiment, the processor (111) may project a screen using a single-focus projector in a space where the electronic device is placed while operating in the second driving state.

[0069] In one embodiment, if the height at which the electronic device (100) is placed after being lifted is within a second range that is higher than the first range, the processor (111) may identify a third map corresponding to the height at which the electronic device (100) is placed after being lifted among a plurality of maps of an area stored by the electronic device (100). The electronic device (100) may operate in a third driving state in which the electronic device (100) moves based on the third map.

[0070] In one embodiment, if it is determined that information for a third map among the plurality of maps of the area is not stored, the processor (111) may generate and store a third map for the space where the electronic device (100) is placed based on sensing values ​​acquired while the electronic device moves through the space where the electronic device is placed.

[0071] In one embodiment, the processor (111) can input sensing values ​​obtained from at least one sensor (121) into a learned neural network model to obtain information on the driving state according to the height at which the electronic device (100) is placed after being lifted.

[0072]

[0073] Hereinafter, the present disclosure will be described in more detail with reference to the drawings. FIG. 2 is a flowchart illustrating a method for determining a driving state of an electronic device according to one embodiment of the present disclosure.

[0074] First, the electronic device (100) can operate in a first driving state (S210). At this time, the first driving state is a state in which the vehicle drives in an indoor space based on a first map. While driving in the first driving state, the electronic device (100) can drive in an indoor space corresponding to the first map without any speed restrictions.

[0075] The electronic device (100) can obtain a sensing value through at least one sensor (121) (S220). For example, while operating in the first driving state, the electronic device (100) can obtain a sensing value through a 9-axis IMU sensor, can obtain a sensing value through a lidar sensor, and can obtain a sensing value through a sensor for detecting lifting of the electronic device (100). However, this is only one embodiment, and the electronic device (100) can obtain an image through a camera.

[0076] The electronic device (100) can identify whether lifting of the electronic device (100) has been detected (S230). At this time, lifting of the electronic device (100) may mean that the electronic device (100) (or the wheels of the electronic device (100)) falls from the floor surface of the indoor space where the electronic device (100) moves. Specifically, the electronic device (100) can identify whether lifting of the electronic device (100) has been detected based on the sensing value acquired in step S220. In one embodiment, the electronic device (100) can identify whether lifting of the electronic device (100) has been detected based on the sensing value acquired in step S220 or a change in an image. In one embodiment, the electronic device (100) can input the sensing value acquired in step S220 into a trained neural network model (e.g., a lifting detection model) to identify whether lifting of the electronic device (100) has been detected.

[0077] If it is determined that lifting of the electronic device (100) is not detected (S230-N), the electronic device (100) can maintain the first driving state (S295).

[0078] If it is identified that lifting of the electronic device (100) is detected (S230-Y), the electronic device (100) can identify (or estimate) the location of the electronic device (100) (S240). Specifically, if movement of the electronic device (100) is detected after lifting is detected, the electronic device (100) can identify the location of the electronic device (100) through dead reckoning. That is, the electronic device (100) can obtain the moving direction and moving speed of the electronic device (100) based on the sensing values ​​obtained from at least one sensor (121), and can estimate the location to which the electronic device (100) has moved from the starting location where lifting of the electronic device (100) was detected based on the obtained moving direction and moving speed. At this time, the electronic device (100) can obtain information on the moved location on the Z-axis (height) as well as the moved location on the X and Y axes of the first map.

[0079] The electronic device (100) can detect the placement of the electronic device (100) (S250). At this time, the placement of the electronic device (100) may mean that the electronic device (100) (or the wheel of the electronic device (100)) touches the floor surface of a specific space. In one embodiment, if it is determined that the sensing value obtained from at least one sensor (121) does not change for a threshold period of time, the electronic device (100) can detect the placement of the electronic device (100). In one embodiment, the electronic device (100) can input the sensing value obtained from at least one sensor (121) into a learned neural network model to detect the placement of the electronic device (100).

[0080] The electronic device (100) can identify whether the height at which the electronic device (100) is placed has changed (S260). At this time, the electronic device (100) can identify whether the height at which the electronic device (100) is placed has changed based on the sensing value obtained after lifting the electronic device (100). In one embodiment, the electronic device (100) can input the sensing value obtained after lifting the electronic device (100) into a trained neural network model to identify whether the height at which the electronic device (100) is placed has changed.

[0081] If it is determined that the height at which the electronic device (100) is placed does not change (S260-N), the electronic device (100) can maintain the first driving state (S295). That is, if it is determined that the electronic device (100) is placed in the same space as the existing space, the electronic device (100) can move in the indoor space while maintaining the first driving state, which is the existing driving state. In one embodiment, if a height change less than a threshold value (e.g., 1 cm) is detected, the electronic device (100) can determine that the height at which the electronic device (100) is placed does not change.

[0082] If it is determined that the height at which the electronic device (100) is placed is changing (S260-Y), the electronic device (100) can determine whether the height at which the electronic device (100) is placed is within a first range (S270). At this time, the first range is a range in which the floor of the space in which the electronic device (100) moves does not change, and may be, for example, 1 cm or more and less than 2 m, but is not limited thereto.

[0083] If it is identified as being within the first range (S270-Y), the electronic device (100) may operate in a second driving state (S280). At this time, the second driving state may be a state in which the electronic device (100) drives in a space (particularly, furniture such as a table or desk) in which it is located at a limited speed less than a first value (e.g., a speed value of the existing first driving state). At this time, the second driving state may be called a table driving state, etc. At this time, the electronic device (100) may drive in a limited speed based on a second map (or mini-map) corresponding to the space (e.g., a table) in which the electronic device (100) is located while operating in the second driving state. The electronic device (100) may limit the movement range based on sensing values ​​acquired through a floor detection sensor and an IMU sensor while operating in the second driving state. At this time, the electronic device (100) can determine a projection surface for projecting a screen with a limited movement range by using at least one of an IMU sensor, a lidar sensor, and a camera.

[0084] If it is identified as being outside the first range (S270-N), the electronic device (100) can operate in a third driving state. At this time, the third driving state is a state in which the electronic device (100) drives in an indoor space based on a second map that is different from the first map. The electronic device (100) can drive in an indoor space corresponding to the second map without speed restrictions while driving in the second driving state. That is, if the height at which the electronic device (100) is placed after being lifted is identified as being within a second range (e.g., 2 m or more and less than 3 m) higher than the first range, the electronic device (100) can identify that the floor on which the electronic device (100) is located has changed and can move the electronic device (100) based on the second map corresponding to the floor on which the electronic device (100) is located. Meanwhile, the first range and the second range can be set differently depending on the floor height of the house in which the electronic device (100) is located or a user input.

[0085] Meanwhile, in the above-described embodiment, when the house where the electronic device (100) is located is on the second floor, it is described that it operates in the first to third driving states. However, this is only one example. If the house where the electronic device (100) is located is on the third floor or higher, the number of driving states may be changed to correspond to the number of floors of the house where the electronic device (100) is located. For example, if the house where the electronic device (100) is located is on the third floor, the electronic device (100) may operate in the first to fourth driving states.

[0086] In addition, in the above-described embodiment, the second driving state is described regardless of the type of furniture on which the electronic device (100) is placed. However, this is merely an example, and a plurality of second driving states may be included depending on the type (or height) of the furniture on which the electronic device (100) is placed. For example, when the electronic device (100) is placed on a table, the electronic device (100) may operate in the 2-1 driving state (or the 1st table driving state), and when the electronic device (100) is placed on a desk, the electronic device (100) may operate in the 2-2 driving state (or the 2nd table driving state). At this time, when the driving state is distinguished depending on the type (or height) of the furniture on which the electronic device (100) is placed, the electronic device (100) may control the projection unit with different settings according to the distinguished driving state to project a screen onto the projection surface.

[0087] In addition, in the above-described embodiment, the electronic device (100) obtains information about the lifting of the electronic device (100) and the height at which the electronic device (100) is placed by using the sensing value obtained through the 9-axis IMU sensor, but this is only one embodiment, and the electronic device (100) can obtain information about the lifting of the electronic device (100) and the height of the space at which the electronic device (100) is placed by using the sensing value obtained through the ToF sensor or the image captured through the camera.

[0088] FIG. 3 is a flowchart illustrating a method for controlling the operation of an electronic device while operating in a second driving state according to one embodiment of the present disclosure.

[0089] The electronic device (100) can detect the placement of the electronic device (100) (S310). Specifically, if it is determined that the sensing value obtained from at least one sensor (121) does not change for a threshold period of time after the electronic device (100) is lifted, the electronic device (100) can detect the placement of the electronic device (100). Alternatively, the electronic device (100) can input the sensing value obtained from at least one sensor (121) into a trained neural network model to detect the placement of the electronic device (100) after it has been lifted.

[0090] At this time, the electronic device (100) can be placed on the table (410) as shown in FIG. 4a after the electronic device (100) is lifted.

[0091] The electronic device (100) can be identified as operating in a second driving state (S320). Specifically, as described in FIG. 2, if the height of the space in which the electronic device (100) is placed is identified as being within a first range, the electronic device (100) can be identified as operating in a second driving state in which the electronic device (100) travels in the space in which it is located at a limited speed less than the first value.

[0092] The electronic device (100) can recognize the current location of the electronic device (100) based on the identified location (S330). Specifically, the electronic device (100) can identify the moved location of the electronic device (100) through the estimated navigation as described in step S240 of FIG. 2 after being lifted. Then, when the placement of the electronic device (100) is detected, the electronic device (100) can re-recognize the current location based on an image acquired through a camera or a sensing value acquired through at least one sensor (121) based on the identified location.

[0093] The electronic device (100) can identify whether a second map for the space where the electronic device (100) is placed has been pre-stored based on the current location of the electronic device (100) (S340). Specifically, a first map for moving the electronic device (100) may store at least one second map for at least one object (e.g., a desk, a table, a dining table, etc.) included in the first map. The electronic device (100) can identify an object corresponding to the current location based on the recognized current location of the electronic device (100). The electronic device (100) can identify whether a second map for the space where the electronic device (100) is placed has been pre-stored based on whether a second map corresponding to the identified object has been stored. For example, if the current location of the electronic device (100) is (x1, y1) in the living room, the electronic device (100) can identify whether an object is located at (x1.y1) in the living room, and if the object is identified as being located, the electronic device (100) can identify whether a second map corresponding to the object located at (x1, y1) in the living room is stored, thereby identifying whether a second map for the space where the electronic device (100) is placed is already stored.

[0094] If it is identified that a second map for the space where the electronic device (100) is placed is pre-stored (S340-Y), the electronic device (100) can move at a speed lower than the first value only within the space where the electronic device (100) is placed based on the identified second map (S370). That is, the electronic device (100) can move at a limited range of speeds only on the table (410) based on the identified second map.

[0095] If it is determined that a second map for the space where the electronic device (100) is placed is not previously stored (S340-N), the electronic device (100) can generate a second map for the space where the electronic device (100) is placed based on the sensing values ​​acquired while the electronic device (100) is moved through the space where the electronic device (100) is placed (S350). That is, the electronic device (100) can determine that the space is an area where movement is impossible based on the sensing values ​​acquired through the IMU sensor and the floor detection sensor while the electronic device (100) is moved through the space where the electronic device (100) is placed, or if an obstacle is located, and can obtain information about the boundary surface. In addition, the electronic device (100) can obtain information about the size, shape, and movable range of the space where the electronic device (100) is placed (i.e., the table (410)) based on the information about the boundary surface. In addition, the electronic device (100) can generate a second map of the space in which the electronic device (100) is placed based on information about the size, shape, and movable range of the space in which the electronic device (100) is placed. At this time, the second map may be called a table map or a mini map.

[0096] The electronic device (100) can match and store information about the second map to the first map (S360). Specifically, the electronic device (100) can identify information about the location to which the electronic device (100) has moved within the first map based on sensing values ​​acquired while moving within the space where the electronic device (100) is placed. The electronic device (100) can match and store information about the second map to the first map based on information about the location to which the electronic device (100) has moved. For example, if the information about the location to which the electronic device (100) has moved is within the first area of ​​the kitchen in the first map, the electronic device (100) can store the second map (420) related to the table (410) within the first area of ​​the kitchen in the first map (430), as illustrated in FIG. 4B. At this time, the electronic device (100) can identify information about the type of space (e.g., table) in which the electronic device (100) is placed and store it on the first map (430) together with the second map (420). Meanwhile, in FIG. 4b, the first map (430) is described as a three-dimensional map, but this is only one example, and it is obvious that it can be implemented as a two-dimensional map.

[0097] The electronic device (100) can move at a speed lower than the first value only within the space where the electronic device (100) is placed based on the generated second map (S370). That is, the electronic device (100) can move at a limited range of speeds only on the table (410) based on the identified second map.

[0098] While the electronic device (100) is operating in the second driving state, the electronic device (100) can project a screen using a short-focus projector in the space where the electronic device (100) is placed. That is, if the space where the electronic device (100) is placed (i.e., the table (410)) is located within a preset value from the projection surface, the electronic device (100) can project a screen using a short-focus projector in the space where the electronic device (100) is placed in order to project a screen from a close position. However, if the space where the electronic device (100) is placed (i.e., the table (410)) is located outside the preset value from the projection surface, the electronic device (100) can project a screen using a general projector in the space where the electronic device (100) is placed.

[0099] Meanwhile, it has been described that the electronic device (100) creates a second map for the space where the electronic device (100) is placed and stores it on the first map, but this is only one example, and it is obvious that the electronic device (100) can store only information about the size and location of the space where the electronic device (100) is placed on the first map.

[0100] FIG. 5 is a flowchart illustrating a method for controlling the operation of an electronic device while operating in a third driving state according to one embodiment of the present disclosure.

[0101] The electronic device (100) can detect the placement of the electronic device (100) (S510). At this time, the electronic device (100) can be placed on another floor (e.g., a floor higher than the floor operating in the first driving state) after the electronic device (100) is lifted.

[0102] The electronic device (100) can be identified as operating in a third driving state (S520). Specifically, as described in FIG. 2, if the height of the space where the electronic device (100) is placed is identified as being within a second range greater than the first range, the electronic device (100) can be identified as operating in a third driving state in which the electronic device (100) moves based on a third map different from the first map. For example, as illustrated on the left side of FIG. 6, if the electronic device (100) is identified as being placed on a second floor while operating in a first driving state in which the electronic device (100) moves based on a first map (610) corresponding to the first floor, the electronic device (100) can be identified as operating in a third driving state in which the electronic device (100) moves based on a third map (620) corresponding to the second floor, as illustrated on the right side of FIG. 6.

[0103] The electronic device (100) can identify whether a third map corresponding to the height of the space where the electronic device (100) is placed is pre-stored (S530). Specifically, the electronic device (100) can store a map corresponding to each of a plurality of floors included in a house where the electronic device (100) is located. The electronic device (100) can identify the floor of the space where the electronic device (100) is placed based on the height of the space where the electronic device (100) is placed. The electronic device (100) can identify whether a third map corresponding to the floor of the space where the electronic device (100) is placed is pre-stored. For example, if the floor of the space where the electronic device (100) is placed after being lifted while previously operating on the first floor is the second floor, the electronic device (100) can identify whether a third map corresponding to the second floor is pre-stored.

[0104] If it is identified that a third map corresponding to the height of the space where the electronic device (100) is placed is pre-stored (S530-Y), the electronic device (100) can move based on the identified third map (S550). That is, the electronic device (100) can move based on the third map corresponding to the floor on which the electronic device (100) is located. For example, the electronic device (100) can move based on the third map corresponding to the second floor, which is the floor on which the electronic device (100) is located.

[0105] If it is determined that a third map corresponding to the height of the space where the electronic device (100) is placed is not previously stored (S530-N), the electronic device (100) may generate a third map for the space where the electronic device (100) is placed based on the sensing values ​​acquired while moving through the space where the electronic device (100) is placed (S540). Specifically, the electronic device (100) may generate the third map for the space where the electronic device (100) is placed based on the sensing values ​​acquired through at least one sensor (121) while moving through the space where the electronic device (100) is placed. At this time, when a user command for generating the third map is input, the electronic device (100) may generate the third map for the space where the electronic device (100) is placed based on the sensing values ​​acquired through at least one sensor (121) while moving through the space where the electronic device (100) is placed.

[0106] The electronic device (100) can move based on the generated third map (S550). That is, the electronic device (100) can move based on the newly generated third map corresponding to the floor on which the electronic device (100) is located.

[0107] Meanwhile, in the above-described embodiment, the driving state is determined based on the height of the space in which the electronic device (100) is placed. However, this is merely an example, and the driving state of the electronic device (100) can be determined using a learned neural network model. Hereinafter, a method for determining the driving state of an electronic device using a learned neural network model will be described with reference to FIG. 7.

[0108] First, the electronic device (100) can operate in a first driving state (S710). The first driving state is a state in which the vehicle drives in an indoor space based on a first map. While driving in the first driving state, the electronic device (100) can drive in an indoor space corresponding to the first map without any speed restrictions.

[0109] The electronic device (100) can obtain a sensing value through at least one sensor (121) (S220). In one embodiment, while operating in the first driving state, the electronic device (100) can obtain a sensing value through a 9-axis IMU sensor, can obtain a sensing value through a lidar sensor, and can obtain a sensing value through a sensor for detecting lifting of the electronic device (100). In another embodiment, the electronic device (100) can obtain an image through a camera.

[0110] The electronic device (100) can input sensing values ​​into a learned neural network model (S230). At this time, the neural network model may be a model learned to determine a driving state corresponding to the height at which the electronic device (100) is located by inputting sensing values ​​acquired through at least one sensor (121) or camera. In one embodiment, the neural network model (800) may include an input layer (810), a hidden layer (820), and an output layer (830), as illustrated in FIG. 8. At this time, the input layer (810) may receive sensing values ​​of an acceleration sensor (Acc), an angular velocity sensor (Ang), and a geomagnetic sensor (Mag) as information on the x, y, and z axes, respectively, and transmit them in parallel to the parallel neural network model. At this time, the sensing values ​​acquired from multiple sensors may transmit sensing values ​​according to continuous time as well as sensing values ​​for one time axis to the parallel neural network model, thereby increasing classification accuracy. The hidden layer (820) can combine intermediate feature values ​​acquired through neurons trained in parallel for each sensing value into a single feature value and pass it to the output layer to derive a result value (or final feature value). Through this, it is possible to individually learn the part that each sensing value contributes to the result value. The output layer (830) is a step for reducing the number of neurons to derive a single result value (information on the driving status), and can apply various activation functions to each.

[0111] The electronic device (100) can obtain information about the driving state from the neural network model (S740). For example, the electronic device (100) can input the sensing values ​​obtained while the electronic device (100) is being moved after being lifted into the neural network model to identify information about the driving state corresponding to the space where the electronic device (100) is placed. For example, if the electronic device (100) is placed on the floor of an existing floor, the electronic device (100) can identify information about the first driving state through the neural network model. If the electronic device (100) is placed on furniture (e.g., a table) on the existing floor, the electronic device (100) can identify information about the second driving state through the neural network model. If the electronic device (100) is placed on the floor of a new floor, the electronic device (100) can identify information about the third driving state through the neural network model.

[0112] The electronic device (100) can operate (or move) based on the acquired driving state information (S750). That is, when operating in the first driving state, the electronic device (100) can move without a speed limitation based on the first map, when operating in the second driving state, the electronic device (100) can move at a speed limitation based on the second map (or table map), and when operating in the third driving state, the electronic device (100) can move without a speed limitation based on the third map.

[0113] FIG. 9 is a block diagram illustrating in detail the configuration of an electronic device according to an embodiment of the present disclosure. Referring to FIG. 2, the electronic device (100) may include at least one of a processor (111), a projection unit (112), a memory (113), a communication interface (114), a manipulation interface (115), an input / output interface (116), a speaker (117), a microphone (118), a power supply unit (119), a driving unit (120), or a sensor (121). Meanwhile, the configuration illustrated in FIG. 9 is merely an example of various embodiments, and some configurations may be omitted and new configurations may be added. Meanwhile, the contents already described in FIG. 1 are omitted.

[0114] The projection unit (112) is a component that projects an image to the outside. According to various embodiments of the present disclosure, the projection unit (112) can be implemented in various projection methods (e.g., CRT (cathode-ray tube) method, LCD (Liquid Crystal Display) method, DLP (Digital Light Processing) method, laser method, etc.). For example, the CRT method has the same principle as a CRT monitor. The CRT method magnifies the image with a lens in front of the cathode-ray tube (CRT) and displays the image on the screen. Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of a three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0115] Another example is the LCD method, which displays images by passing light from a light source through liquid crystals. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into red, green, and blue by a dichroic mirror (a mirror that reflects only a specific color of light and transmits all others). After passing through the liquid crystals, the light can be refocused into a single point.

[0116] Another example is the DLP method, which displays images using a DMD (Digital Micromirror Device) chip. The DLP projection unit may include a light source, a color wheel, a DMD chip, a projection lens, etc. Light output from the light source can be colored as it passes through the rotating color wheel. The light passing through the color wheel is input to the DMD chip. The DMD chip contains numerous micromirrors and reflects the light input to the DMD chip. The projection lens can play a role in magnifying the light reflected from the DMD chip to the size of the image.

[0117] Another example is a laser system that uses a Diode Pumped Solid State (DPSS) laser and a galvanometer. A multi-color laser uses three DPSS lasers, one for each RGB color, with their optical axes overlapped by a special mirror. The galvanometer includes a mirror and a high-power motor that moves the mirror at high speeds. For example, the galvanometer can rotate the mirror at up to 40 kHz / sec. The galvanometer is mounted according to the scan direction, but since projectors typically scan in a planar manner, the galvanometer can also be positioned separately along the x and y axes.

[0118] Meanwhile, the projection unit (112) may include various types of light sources. For example, the projection unit (112) may include at least one light source among a lamp, an LED, and a laser.

[0119] The projection unit (112) can output images in a 4:3 screen ratio, a 5:4 screen ratio, or a 16:9 wide screen ratio depending on the purpose of the electronic device (100) or the user's settings, and can output images in various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the screen ratio.

[0120] Meanwhile, the projection unit (112) can perform various functions for adjusting the output image under the control of the processor (111). For example, the projection unit (112) can perform functions such as zoom, keystone, quick corner (4 corner) keystone, and lens shift.

[0121] Specifically, the projection unit (112) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, the zoom function can be performed depending on the distance from the screen. At this time, the zoom function may include a hardware method that adjusts the screen size by moving the lens and a software method that adjusts the screen size by cropping the image, etc. Meanwhile, when the zoom function is performed, the focus of the image needs to be adjusted. For example, the method of adjusting the focus includes a manual focus method, an electric focus method, etc. The manual focus method refers to a method of focusing manually, and the electric focus method refers to a method of automatically focusing using a motor built into the projector when the zoom function is performed. When performing the zoom function, the projection unit (112) may provide a digital zoom function through software, and may provide an optical zoom function that performs the zoom function by moving the lens through the driving unit (120).

[0122] In addition, the projection unit (112) can perform a keystone correction function. If the height is not right for front projection, the screen may be distorted upwards or downwards. The keystone correction function refers to a function that corrects a distorted screen. For example, if distortion occurs in the left and right directions of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up and down directions, it can be corrected using vertical keystone. The quick corner (4 corner) keystone correction function is a function that corrects the screen when the center area of ​​the screen is normal but the corner areas are not balanced. The lens shift function is a function that moves the screen as it is when the screen is off the screen.

[0123] Meanwhile, the projection unit (112) can automatically analyze the surrounding environment and projection environment without user input to provide zoom / keystone / focus functions. Specifically, the projection unit (112) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected by a sensor (depth camera, distance sensor, infrared sensor, light sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0124] In addition, the projection unit (112) can provide a lighting function using a light source. In particular, the projection unit (112) can provide a lighting function by outputting a light source using an LED. According to various embodiments, the projection unit (112) can include one LED, and according to other embodiments, the electronic device (100) can include a plurality of LEDs. Meanwhile, the projection unit (112) can output a light source using a surface-emitting LED according to an implementation example. Here, the surface-emitting LED can mean an LED having a structure in which an optical sheet is arranged on the upper side of the LED so that the light source is evenly distributed and output. Specifically, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0125] Meanwhile, the projection unit (112) may provide the user with a dimming function for adjusting the intensity of the light source. Specifically, when a user input for adjusting the intensity of the light source is received from the user through the operation interface (115) (e.g., a touch display button or dial), the projection unit (112) may control the LED to output the intensity of the light source corresponding to the received user input.

[0126] Additionally, the projection unit (112) can provide a dimming function based on content analyzed by the processor (111) without user input. Specifically, the projection unit (112) can control the LED to output the intensity of the light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0127] Meanwhile, the projection unit (112) can control the color temperature under the control of the processor (111). Here, the processor (111) can control the color temperature based on the content. Specifically, when the content is identified to be output, the processor (111) can obtain frame-by-frame color information of the content whose output has been determined. Then, the processor (111) can control the color temperature based on the obtained frame-by-frame color information. Here, the processor (111) can obtain at least one main color of the frame based on the frame-by-frame color information. Then, the processor (111) can adjust the color temperature based on the obtained at least one main color. For example, the color temperature that the processor (111) can adjust can be classified into a warm type or a cold type. Here, it is assumed that a frame to be output (hereinafter, referred to as an output frame) includes a scene in which a fire has occurred. The processor (111) can identify (or obtain) that the main color is red based on the color information included in the current output frame. In addition, the processor (111) can identify a color temperature corresponding to the identified primary color (red). Here, the color temperature corresponding to red may be a warm type. Meanwhile, the processor (111) may utilize an artificial intelligence model to obtain color information or a primary color of the frame. According to various embodiments, the artificial intelligence model may be stored in the electronic device (100) (e.g., memory (113)). According to another embodiment, the artificial intelligence model may be stored in an external server capable of communicating with the electronic device (100).

[0128] Additionally, the projection unit (112) may include a light source for implementing a short-focus projector.

[0129] The memory (113) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in the processor (111), or may be implemented as a separate memory from the processor (111). In this case, the memory (113) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding the functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0130] Meanwhile, in the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)), and in the case of memory that can be detachably attached to the electronic device (100), it may be implemented as a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. there is.

[0131] The memory (113) may store at least one instruction regarding the electronic device (100). In addition, the memory (113) may store an O / S (Operating System) for driving the electronic device (100). In addition, the memory (113) may store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. In addition, the memory (113) may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

[0132] Specifically, various software modules for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (113), and the processor (111) may control the operation of the electronic device (100) by executing various software modules stored in the memory (113). That is, the memory (113) is accessed by the processor (111), and data reading / recording / modifying / deleting / updating, etc. may be performed by the processor (111).

[0133] Meanwhile, in the present disclosure, the term memory (113) may be used to mean a storage unit, a ROM (not shown), a RAM (not shown) in a processor (111), or a memory card (not shown) (e.g., a micro SD card, a memory stick) mounted on an electronic device (100).

[0134] The communication interface (114) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication interface (114) may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0135] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0136] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, various connection information, such as the service set identifier (SSID) and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received.

[0137] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which lies between visible light and millimeter waves.

[0138] In addition to the above-described communication method, other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0139] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a paired cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0140] When a neural network model is stored in an external server (or external device), the communication interface (114) can transmit sensing values ​​acquired through at least one sensor (121) to the external server (or external device) and receive information on the driving status from the external server (or external device).

[0141] The manipulation interface (115) may include various types of input devices. For example, the manipulation interface (115) may include a physical button. In this case, the physical button may include a function key, a directional key (e.g., a four-way key), or a dial button. According to various embodiments, the physical button may be implemented as multiple keys. According to another embodiment, the physical button may be implemented as one key. Here, when the physical button is implemented as one key, the electronic device (100) may receive a user input in which one key is pressed for a threshold time or longer. When a user input in which one key is pressed for a threshold time or longer is received, the processor (111) may perform a function corresponding to the user input. For example, the processor (111) may provide a lighting function based on the user input.

[0142] Additionally, the manipulation interface (115) can receive user input using a non-contact method. When receiving user input using a contact method, physical force must be transmitted to the electronic device (100). Therefore, a method for controlling the electronic device (100) regardless of physical force may be required. Specifically, the manipulation interface (115) can receive user gestures and perform operations corresponding to the received user gestures. Here, the manipulation interface (115) can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0143] Additionally, the manipulation interface (115) can receive user input using a touch method. For example, the manipulation interface (115) can receive user input via a touch sensor. According to various embodiments, the touch method can be implemented in a non-contact manner. For example, the touch sensor can determine whether the user's body has approached within a threshold distance. Here, the touch sensor can identify user input even when the user does not touch the touch sensor. Meanwhile, according to another implementation example, the touch sensor can identify user input when the user touches the touch sensor.

[0144] Meanwhile, the electronic device (100) can receive user input in various ways other than the above-described operation interface (115). In various embodiments, the electronic device (100) can receive user input through an external remote control device. Here, the external remote control device can be a remote control device corresponding to the electronic device (100) (e.g., a dedicated control device of the electronic device (100)) or a user's portable communication device (e.g., a smartphone or a wearable device). Here, the user's portable communication device can store an application for controlling the electronic device (100). The portable communication device can obtain user input through the stored application and transmit the obtained user input to the electronic device (100). The electronic device (100) can receive user input from the portable communication device and perform an operation corresponding to the user's control command.

[0145] Meanwhile, the electronic device (100) can receive user input using voice recognition. According to various embodiments, the electronic device (100) can receive the user's voice through a microphone included in the electronic device (100). According to other embodiments, the electronic device (100) can receive the user's voice from a microphone or an external device. Specifically, the external device can acquire the user's voice through the microphone of the external device and transmit the acquired user's voice to the electronic device (100). The user's voice transmitted from the external device can be audio data or digital data converted from audio data (e.g., audio data converted into a frequency domain, etc.). Here, the electronic device (100) can perform an operation corresponding to the received user's voice. Specifically, the electronic device (100) can receive audio data corresponding to the user's voice through the microphone. In addition, the electronic device (100) can convert the received audio data into digital data. And, the electronic device (100) can convert the converted digital data into text data using the STT (Speech To Text) function. According to various embodiments, the STT (Speech To Text) function can be performed directly in the electronic device (100), and according to other embodiments, the STT (Speech To Text) function can be performed in an external server. The electronic device (100) can transmit digital data to an external server. The external server can convert the digital data into text data and obtain control command data based on the converted text data. The external server can transmit the control command data (which may also include text data) to the electronic device (100). The electronic device (100) can perform an operation corresponding to the user's voice based on the obtained control command data.

[0146] Meanwhile, the electronic device (100) may provide a voice recognition function using a single assistant (or artificial intelligence assistant, e.g., Bixby™), but this is merely an example of various embodiments, and the voice recognition function may be provided using multiple assistants. In this case, the electronic device (100) may provide the voice recognition function by selecting one of the multiple assistants based on a trigger word corresponding to the assistant or a specific key present on the remote control.

[0147] Meanwhile, the electronic device (100) may receive user input using screen interaction. Screen interaction may refer to a function of identifying whether a predetermined event occurs through an image projected by the electronic device (100) on the screen (or projection surface) and acquiring user input based on the predetermined event. Here, the predetermined event may refer to an event in which a predetermined object is identified at a specific location (e.g., a location where a UI for receiving user input is projected). Here, the predetermined object may include at least one of a part of the user's body (e.g., a finger), a pointer, or a laser point. If the predetermined object is identified at a location corresponding to the projected UI, the electronic device (100) may identify that a user input for selecting the projected UI has been received. For example, the electronic device (100) may project a guide image to display the UI on the screen. In addition, the electronic device (100) may identify whether the user selects the projected UI. Specifically, if a predetermined event is identified at a location of a projected UI, the electronic device (100) can identify that the user has selected the projected UI. Here, the projected UI may include at least one item. Here, the electronic device (100) can perform spatial analysis to identify whether the predetermined event is at the location of the projected UI. Here, the electronic device (100) can perform spatial analysis through a sensor (e.g., an image sensor, an infrared sensor, a depth camera, a distance sensor, etc.). By performing spatial analysis, the electronic device (100) can identify whether the predetermined event occurs at a specific location (a location where the UI is projected). In addition, if it is identified that the predetermined event occurs at a specific location (a location where the UI is projected), the electronic device (100) can identify that a user input for selecting a UI corresponding to the specific location has been received.

[0148] In particular, the operation interface (115) can receive a user command to create a second map or a third map.

[0149] The input / output interface (116) is configured to input / output at least one of an audio signal and an image signal. The input / output interface (116) can receive at least one of an audio signal and an image signal from an external device, and can output a control command to the external device.

[0150] Depending on the implementation example, the input / output interface (116) may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0151] Meanwhile, in various embodiments of the present disclosure, the input / output interface (116) may be implemented as at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (Dsubminiature), and DVI (Digital Visual Interface). According to various embodiments, the wired input / output interface may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0152] Additionally, the electronic device (100) may receive data via a wired input / output interface, but this is merely an example of various embodiments, and may also receive power via the wired input / output interface. For example, the electronic device (100) may receive power from an external battery via a USB C-type or from an outlet via a power adapter. As another example, the electronic device (100) may receive power from an external device (e.g., a laptop or monitor) via a DP.

[0153] Meanwhile, the audio signal may be implemented to be input through a wired input / output interface, and the image signal may be implemented to be input through a wireless input / output interface (or communication interface). Alternatively, the audio signal may be implemented to be input through a wireless input / output interface (or communication interface), and the image signal may be implemented to be input through a wired input / output interface.

[0154] The speaker (117) is a component that outputs an audio signal. In particular, the speaker (117) may include an audio output mixer, an audio signal processor, and an audio output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to various embodiments, the audio output module may include a plurality of speakers, and in this case, the audio output module may be arranged inside the main body, and sound emitted by covering at least a portion of the diaphragm of the audio output module may pass through a waveguide and be transmitted to the outside of the main body. The audio output module may include a plurality of audio output units, and the plurality of audio output units may be arranged symmetrically on the exterior of the main body, thereby radiating sound in all directions, that is, in a 360-degree omnidirectional manner.

[0155] The microphone (118) is a component for receiving a user's voice or other sounds and converting them into audio data. The microphone (118) can receive the user's voice in an activated state. For example, the microphone (118) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (118) can include various components such as a microphone for collecting the user's voice in analog form, an amplifier circuit for amplifying the collected user's voice, an A / D conversion circuit for sampling the amplified user's voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0156] The power supply unit (119) can receive power from an external source and supply power to various components of the electronic device (100). The power supply unit (119) according to various embodiments of the present disclosure can receive power through various methods. In various embodiments, the power supply unit (119) can receive power using a connector. In addition, the power supply unit (119) can receive power using a 220 V DC power cord. However, the present invention is not limited thereto, and the electronic device (100) can receive power using a USB power cord or receive power using a wireless charging method.

[0157] In addition, the power supply unit (119) can be supplied with power using an internal battery or an external battery. The power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through the internal battery. For example, the power supply unit (119) can charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and can be supplied with power through the charged internal battery. In addition, the power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through an external battery. For example, when the electronic device (100) is connected to the external battery through various wired communication methods such as a USB power cord, a USB C-Type power cord, and a socket home, the power supply unit (119) can be supplied with power through the external battery. That is, the power supply unit (119) can be supplied with power directly from the external battery, or can charge the internal battery through the external battery and be supplied with power from the charged internal battery.

[0158] The power supply unit (119) according to the present disclosure can receive power using at least one of the multiple power supply methods described above.

[0159] Meanwhile, with respect to power consumption, the electronic device (100) may have a power consumption value (e.g., 43 W) or lower due to socket shape and other standards. In this case, the electronic device (100) may vary its power consumption to reduce power consumption when using a battery. That is, the electronic device (100) may vary its power consumption based on the power supply method, power usage, etc.

[0160] The driving unit (120) can drive at least one hardware component included in the electronic device (100). The driving unit (120) can generate a physical force and transmit it to at least one hardware component included in the electronic device (100).

[0161] Here, the driving unit (120) can generate driving power for movement of the hardware configuration included in the electronic device (100) (e.g., movement of the electronic device (100)) or rotation of the configuration (e.g., rotation of the projection lens).

[0162] The driving unit (120) can adjust the projection direction (or projection angle) of the projection unit (122). In addition, the driving unit (120) can move the position of the electronic device (100). Here, the driving unit (120) can control the moving member (109) to move the electronic device (100). For example, the driving unit (120) can control the moving member (109) using a motor and wheels.

[0163] At least one sensor (121) may include various types of sensors. Specifically, at least one sensor (121) may include at least one of a tilt sensor for sensing the tilt of the electronic device (100) and an image sensor for capturing an image. Here, the tilt sensor may be an acceleration sensor or a gyro sensor, and the image sensor may mean a camera or a depth camera. Meanwhile, the tilt sensor may be described as a motion sensor. In addition, the sensor (121) may include various sensors other than the tilt sensor or the image sensor. For example, the sensor (121) may include an illuminance sensor and a distance sensor. The distance sensor may be a ToF (Time of Flight). In addition, the sensor (121) may include a lidar sensor.

[0164] Meanwhile, the electronic device (100) can control the lighting function by linking with an external device. Specifically, the electronic device (100) can receive lighting information from the external device. Here, the lighting information can include at least one of brightness information or color temperature information set in the external device. Here, the external device can mean a device connected to the same network as the electronic device (100) (e.g., an IoT device included in the same home / work network) or a device that is not in the same network as the electronic device (100) but can communicate with the electronic device (100) (e.g., a remote control server). For example, assume that an external lighting device (IoT device) included in the same network as the electronic device (100) is outputting red light at a brightness of 50. The external lighting device (IoT device) can directly or indirectly transmit lighting information (e.g., information indicating that it is outputting red light at a brightness of 50) to the electronic device (100). Here, the electronic device (100) can control the output of the light source based on lighting information received from an external lighting device. For example, if the lighting information received from the external lighting device includes information for outputting red light at a brightness of 50, the electronic device (100) can output red light at a brightness of 50.

[0165] Meanwhile, the electronic device (100) can control the lighting function based on biometric information. Specifically, the processor (111) can obtain the user's biometric information. Here, the biometric information can include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. Here, the biometric information can include various types of information in addition to the information described above. For example, the electronic device (100) can include a sensor for measuring biometric information. The processor (111) can obtain the user's biometric information through the sensor and control the output of the light source based on the obtained biometric information. As another example, the processor (111) can receive the biometric information from an external device through the input / output interface (116). Here, the external device can refer to the user's portable communication device (e.g., a smartphone or a wearable device). The processor (111) can obtain the user's biometric information from the external device and control the output of the light source based on the obtained biometric information. Meanwhile, according to an implementation example, the electronic device (100) can identify whether the user is sleeping, and if the user is identified as sleeping (or preparing to sleep), the processor (111) can control the output of the light source based on the user's biometric information.

[0166] Meanwhile, the electronic device (100) according to various embodiments of the present disclosure can provide various smart functions.

[0167] Specifically, the electronic device (100) is connected to a portable terminal device for controlling the electronic device (100), and a screen output from the electronic device (100) can be controlled through user input input from the portable terminal device. As an example, the portable terminal device can be implemented as a smartphone including a touch display, and the electronic device (100) receives screen data provided by the portable terminal device from the portable terminal device and outputs it, and a screen output from the electronic device (100) can be controlled according to user input input from the portable terminal device.

[0168] The electronic device (100) can share content or music provided by the mobile terminal device by connecting to the mobile terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC.

[0169] In addition, the mobile terminal device and the electronic device (100) can be connected in various connection methods. In various embodiments, the mobile terminal device can search for the electronic device (100) to perform a wireless connection, or the electronic device (100) can search for the mobile terminal device to perform a wireless connection. In addition, the electronic device (100) can output content provided by the mobile terminal device.

[0170] In various embodiments, when a mobile terminal device is placed near an electronic device (100) while specific content or music is being output from the mobile terminal device, and a preset gesture is detected through the display of the mobile terminal device (e.g., motion tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0171] In various embodiments, when the mobile terminal device is outputting specific content or music and the mobile terminal device comes closer to the electronic device (100) to a preset distance or less (e.g., non-contact tap view) or the mobile terminal device comes into contact with the electronic device (100) twice at a short interval (e.g., contact tap view), the electronic device (100) can output the content or music being output by the mobile terminal device.

[0172] In the above-described embodiment, it has been described that the same screen as the screen provided by the mobile terminal device is provided by the electronic device (100), but the present disclosure is not limited thereto. That is, when a connection is established between the mobile terminal device and the electronic device (100), the mobile terminal device may output a first screen provided by the mobile terminal device, and the electronic device (100) may output a second screen provided by the mobile terminal device that is different from the first screen. For example, the first screen may be a screen provided by a first application installed on the mobile terminal device, and the second screen may be a screen provided by a second application installed on the mobile terminal device. For example, the first screen and the second screen may be different screens provided by a single application installed on the mobile terminal device. In addition, for example, the first screen may be a screen including a remote control-type UI for controlling the second screen.

[0173] An electronic device (100) according to the present disclosure can output a standby screen. For example, if the electronic device (100) is not connected to an external device or if no input is received from the external device for a preset period of time, the electronic device (100) can output a standby screen. Conditions for the electronic device (100) to output a standby screen are not limited to the examples described above, and the standby screen can be output under various conditions.

[0174] The electronic device (100) may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device (100) may extract only the shape of a specific object from data received from an external device, acquire an amorphous object, and output a standby screen including the acquired amorphous object.

[0175] Meanwhile, the electronic device (100) may further include a display (not shown).

[0176] The display (not shown) may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, a PDP (Plasma Display Panel), etc. The display (not shown) may also include a driving circuit, a backlight unit, etc., which may be implemented as a type of a-si TFT (amorphous silicon thin film transistor), LTPS (low temperature poly silicon) TFT, OTFT (organic TFT), etc. Meanwhile, the display (not shown) may be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display (three-dimensional dispaly), etc. In addition, according to various embodiments of the present disclosure, the display (not shown) may include not only a display panel that outputs an image, but also a bezel that houses the display panel. In particular, according to various embodiments of the present disclosure, the bezel may include a touch sensor (not shown) for detecting user interaction.

[0177] Meanwhile, the electronic device (100) may further include a shutter unit (not shown).

[0178] The shutter portion (not shown) may include at least one of a shutter, a fixing member, a rail, or a body.

[0179] Here, the shutter can block the light output from the projection unit (112). Here, the fixing member can fix the position of the shutter. Here, the rail can be a path for moving the shutter and the fixing member. Here, the body can be a configuration including the shutter and the fixing member.

[0180] The processor (111) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machines (ARM) processor, or may be defined by the relevant term. In addition, the processor (111) may be implemented as a system on chip (SoC) or large scale integration (LSI) having a built-in processing algorithm, or may be implemented in the form of a field programmable gate array (FPGA). In addition, the processor (111) may perform various functions by executing computer executable instructions stored in the memory (113).

[0181] In particular, the processor (111) can control the operation of the electronic device (100) by executing at least one command stored in the memory (113).

[0182] FIG. 10 is a perspective view illustrating an exterior of an electronic device according to an embodiment of the present disclosure. Referring to the embodiment (1010) of FIG. 10, the electronic device (100) may include a movable member (109). The movable member (109) may refer to a member for moving from a first position to a second position in a space where the electronic device (100) is placed. The electronic device (100) may control the movable member (109) so that the electronic device (100) moves using a force generated by the driving unit (120). At this time, the movable member (109) may include a motor or wheels. The embodiment (1020) of FIG. 3 is a view of the electronic device (100) of the embodiment (1010) viewed from a different direction.

[0183]

[0184] Meanwhile, the methods according to various embodiments of the present disclosure may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0185] The methods according to various embodiments of the present disclosure may be implemented as software including commands stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call commands stored in the storage medium and operate according to the called commands, and may include an electronic device (e.g., a TV) according to the disclosed embodiments.

[0186] Meanwhile, a device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0187] When the above instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0188] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, At least one sensor; drive unit; memory for storing at least one instruction; and A processor connected to at least one sensor, the driving unit and the memory, and controlling the electronic device; The above processor, by executing at least one instruction, When lifting of the electronic device is detected while the electronic device is operating in a first driving state based on a first map of an area where the electronic device is located, information about the height at which the electronic device is placed after being lifted is obtained based on a sensing value obtained from the at least one sensor, An electronic device that operates in a second driving state that limits the speed of the electronic device to less than a first value when the height at which the electronic device is placed after being lifted is within a preset first range.

2. In paragraph 1, The above processor, While the electronic device is being moved after being lifted, first information about the position to which the electronic device has been moved is obtained based on the sensing value obtained from the at least one sensor, An electronic device that identifies the location to which the electronic device has been moved based on the acquired first information when the electronic device is placed.

3. In paragraph 2, The at least one sensor includes an IMU sensor and a floor detection sensor, The above processor, When operating in the second driving state, it identifies whether a map of the space where the electronic device is placed is stored based on information about the location to which the electronic device has moved, An electronic device that generates a second map of a space in which the electronic device is placed based on sensing values ​​acquired through the IMU sensor and the floor detection sensor while the electronic device is moved through the space in which it is placed, if information about the above map is not stored.

4. In paragraph 3, The above processor, An electronic device that matches and stores information about the second map generated based on information about the location to which the electronic device has moved to the first map.

5. In paragraph 3, The above processor, An electronic device that controls the driving unit to move at a speed lower than the first value only within a space in which the electronic device is placed based on information about the second map while operating in the second driving state.

6. In paragraph 3, It further includes a projection section; The above processor, An electronic device that controls the projection unit to project a screen using a single-focus projector in a space where the electronic device is placed while operating in the second driving state.

7. In paragraph 1, The above processor, An electronic device that operates in a third driving state in which the electronic device moves based on a third map corresponding to the height at which the electronic device is placed after being lifted among a plurality of maps of the area stored by the electronic device, when the height at which the electronic device is placed after being lifted is within a second range higher than the first range.

8. In paragraph 7, The above processor, An electronic device that generates a third map for a space in which the electronic device is placed based on sensing values ​​acquired while moving through the space in which the electronic device is placed, if it is determined that information on the third map among the plurality of maps of the above area is not stored.

9. In paragraph 1, The above processor, An electronic device that inputs sensing values ​​obtained from at least one sensor into a learned neural network model to obtain information on a driving state according to the height at which the electronic device is placed after being lifted.

10. In a method for controlling an electronic device, A step of operating in a first driving state in which the electronic device moves based on a first map of an area in which the electronic device is located; A step of obtaining information about a height at which the electronic device is placed after being lifted based on a sensing value obtained from at least one sensor when lifting of the electronic device is detected while the electronic device is operating in a first driving state; and A control method comprising: a step of operating in a second driving state that limits the speed of the electronic device to less than a first value when the height at which the electronic device is placed after being lifted is within a preset first range; 11. In paragraph 10, A step of obtaining first information about a position to which the electronic device has been moved based on a sensing value obtained from at least one sensor while the electronic device is being moved after being lifted; A control method comprising: a step of identifying a location to which the electronic device has been moved based on the acquired first information when the electronic device is placed; 12. In paragraph 11, The at least one sensor includes an IMU sensor and a floor detection sensor, The above control method is, When operating in the second driving state, a step of identifying whether a map for the space where the electronic device is placed is stored based on information about the location to which the electronic device has moved; and A control method comprising: a step of generating a second map for a space where the electronic device is placed based on sensing values ​​acquired through the IMU sensor and the floor detection sensor while the electronic device moves through the space where it is placed, if information about the map is not stored; 13. In paragraph 12, A control method comprising: a step of matching and storing information about the second map generated based on information about the location to which the electronic device has moved to the first map.

14. In paragraph 12, A control method comprising: a step of moving at a speed lower than the first value only within a space in which the electronic device is placed based on information about the second map while operating in the second driving state; 15. In paragraph 12, A control method comprising: a step of projecting a screen using a single-focus projector in a space where the electronic device is placed while operating in the second driving state;

Images