Electronic device and control method therefor

Abstract

This electronic device comprises: a sensor; a driving unit including circuitry; a memory for storing instructions; and at least one processor including processing circuitry, wherein the at least one processor collectively or individually executes the instructions so as to instruct the electronic device to identify a projection surface corresponding to image projection when an event corresponding to the image projection is generated, and control the driving unit to move to an optimal projection position obtained on the basis of the projection distance to the projection surface, a projection angle corresponding to the image projection on the projection surface, and a movement distance.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device and a method for controlling the same capable of identifying an optimal projection position and projecting an image on the identified optimal projection position.

[0002] With the recent advancements in electronic and optical technologies, various types of projectors are being utilized. A projector is defined as an electronic device that projects light onto a projection surface (or screen) to form an image. Furthermore, mobile electronic devices incorporating projectors (e.g., robots) are currently being developed. These mobile devices move within specific spaces (e.g., homes, restaurants, airports, etc.) and utilize projectors to provide users with diverse information.

[0003] Conventional fixed electronic devices include a keystone correction function that adjusts the screen based on the projection direction to display a flat image to the user. However, if there is an obstacle within the projection range of the electronic device that interferes with viewing, there is the inconvenience of having to manually adjust the position and direction of the device to find the optimal projection surface free of obstacles.

[0004] Recently, mobile electronic devices have been developing to address these issues. These devices include functions to move the main body or change the projection angle, allowing for changes to the projection surface or the projection position of the electronic device. Therefore, there is a need to explore methods to identify optimal / improved projection positions using mobile electronic devices.

[0005] According to one embodiment of the present disclosure, an electronic device comprises: a sensor; a driving unit including a circuit; a memory for storing instructions; and at least one processor including a processing circuit; wherein the at least one processor executes the instructions collectively or individually so that when an event corresponding to an image projection occurs, the electronic device identifies a projection surface corresponding to an image projection and controls the driving unit to move to a projection position obtained based on a projection distance to the projection surface, a projection angle corresponding to an image projection on the projection surface, and a distance traveled.

[0006] At least one processor may collectively or individually enable the electronic device to acquire a score corresponding to a plurality of candidate positions based on the projection distance, the projection angle, and the movement distance for each of the plurality of candidate positions acquired based on the current position, and to acquire a projection position based on the acquired score.

[0007] At least one processor may collectively or individually enable the electronic device to obtain a first score, which is the highest score, corresponding to the projection distance if the projection distance from the candidate position to the projection surface is within a first range, and to obtain a score corresponding to the projection distance that is lower than the first score if the projection distance from the candidate position to the projection surface is further than the first range.

[0008] At least one processor may collectively or individually enable the electronic device to obtain a second score, which is the highest score, corresponding to the projection angle when the projection angle corresponding to the image projection from the candidate position to the projection surface is less than a first value, and to obtain a score corresponding to the projection angle that is lower than the second score when the projection angle corresponding to the image projection from the candidate position to the projection surface is greater than the first value.

[0009] At least one processor may collectively or individually enable the electronic device to obtain a third score, which is the highest score corresponding to the distance traveled, if the distance traveled to the candidate position is less than a second value, and to obtain a score for the distance traveled that is lower than the third score if the distance traveled to the candidate position is greater than the second value.

[0010] At least one processor may collectively or individually enable the electronic device to obtain a projection angle for projecting the image onto the projection surface by avoiding the obstacle based on the current projection angle, the angle of view, the size of the obstacle, and the projection distance to the projection surface, if an obstacle is present near the projection surface.

[0011] At least one processor may collectively or individually enable the electronic device to obtain a travel distance for projecting the image from the front of the projection surface by avoiding the obstacle based on the current projection angle, the field of view, the size of the obstacle, and the projection distance to the projection surface, if an obstacle is present near the projection surface.

[0012] At least one processor may collectively or individually enable the electronic device to identify whether there is an obstacle within the range for projecting an image onto the projection surface around the projection position after the electronic device has moved to the projection position.

[0013] At least one processor may collectively or individually control the electronic device to project an image onto the projection surface at the projection position if no obstacle exists within the range, and to acquire one of a plurality of candidate positions around the projection position based on the projection distance, the projection angle, and the movement distance if an obstacle exists within the range.

[0014] It further includes a projection unit; and at least one processor can collectively or individually enable the electronic device to move to the projection position and then project an image through the projection unit.

[0015] A control method for an electronic device according to one embodiment of the present disclosure comprises: a step of identifying a projection surface corresponding to an image projection when an event corresponding to an image projection occurs; and a step of moving to a projection position obtained based on a projection distance to the projection surface, a projection angle corresponding to an image projection on the projection surface, and a distance traveled.

[0016] The above moving step may include: a step of obtaining a score corresponding to a plurality of candidate positions based on the projection distance, the projection angle, and the movement distance for each of the plurality of candidate positions obtained based on the current position; and a step of obtaining a projection position based on the obtained score.

[0017] The step of obtaining the above score involves obtaining a first score, which is the highest score, with a score corresponding to the projection distance if the projection distance from the candidate position to the projection surface is within a first range, and obtaining a score corresponding to the projection distance that is lower than the first score if the projection distance from the candidate position to the projection surface is further than the first range.

[0018] The step of obtaining the above score involves obtaining a second score, which is the highest score, with the projection angle corresponding to the projection angle if the projection angle corresponding to the image projection from the candidate position to the projection surface is less than a first value, and obtaining a score corresponding to the projection angle that is lower than the second score if the projection angle corresponding to the image projection from the candidate position to the projection surface is greater than the first value.

[0019] The step of obtaining the above score involves obtaining a third score, which is the highest score corresponding to the distance traveled, if the distance traveled to the candidate position is less than the second value, and obtaining a score for the distance traveled that is lower than the third score if the distance traveled to the candidate position is greater than the second value.

[0020] The above moving step may include, if an obstacle exists near the projection surface, a step of obtaining a projection angle for projecting the image onto the projection surface by avoiding the obstacle based on the current projection angle, the angle of view, the size of the obstacle, and the projection distance to the projection surface.

[0021] The above moving step includes: a step of, if an obstacle exists near the projection surface, obtaining a moving distance to project the image from the front of the projection surface by avoiding the obstacle based on the current projection angle, the field of view, the size of the obstacle, and the projection distance to the projection surface.

[0022] The above control method may include the step of moving to the projection position and then identifying whether there is an obstacle within the range for projecting an image onto the projection surface around the projection position.

[0023] The above control method projects an image onto the projection surface at the projection position if no obstacle exists within the range, and if an obstacle exists within the range, it can obtain one of a plurality of candidate positions around the projection position based on the projection distance, the projection angle, and the movement distance.

[0024] In a non-transient computer-readable medium storing instructions that cause the electronic device to perform a method of controlling the electronic device when executed individually and / or collectively by one or more processors (including processing circuits) of the electronic device, the method comprises: a step of identifying a projection plane corresponding to an image projection when an event corresponding to an image projection occurs; and a step of moving to a projection position obtained based on a projection distance to the projection plane, a projection angle corresponding to an image projection on the projection plane, and a distance traveled.

[0025] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the detailed description below with reference to the accompanying drawings.

[0026] FIG. 1 is a drawing illustrating an electronic device for projecting an image at an optimal projection position according to various embodiments of the present disclosure.

[0027] FIG. 2 is a block diagram showing the configuration of an electronic device according to various embodiments of the present disclosure,

[0028] FIGS. 3a and 3b are perspective views illustrating the external appearance of an electronic device according to various embodiments of the present disclosure.

[0029] FIG. 4 is a drawing for explaining a method of rotating an electronic device to adjust the projection angle of the electronic device according to various embodiments of the present disclosure.

[0030] FIG. 5 is a drawing for illustrating a method of moving an electronic device to adjust the projection position of the electronic device according to various embodiments of the present disclosure.

[0031] FIG. 6 is a flowchart illustrating an embodiment in which an electronic device identifies an optimal projection position and projects an image according to various embodiments of the present disclosure.

[0032] FIG. 7a is a drawing for explaining the characteristics of an image projected onto a projection surface according to a projection distance, according to various embodiments of the present disclosure.

[0033] FIG. 7b is a drawing for explaining the characteristics of an image projected onto a projection plane according to a projection angle, according to various embodiments of the present disclosure.

[0034] FIG. 8 is a graph showing scores for projection distance, projection angle and travel distance according to various embodiments of the present disclosure,

[0035] FIG. 9 is a drawing for illustrating a method for identifying an optimal projection position according to projection distance, projection angle and travel distance, according to various embodiments of the present disclosure.

[0036] FIGS. 10, 11 and 12 are drawings for illustrating an embodiment of adjusting a projection angle to avoid an obstacle according to various embodiments of the present disclosure,

[0037] FIG. 13 is a drawing for illustrating an embodiment in which an electronic device moves to avoid an obstacle, according to various embodiments of the present disclosure.

[0038] FIG. 14 is a drawing for explaining an embodiment of adjusting the projection angle and travel distance of an electronic device when the travel distance is limited due to an obstacle, according to various embodiments of the present disclosure.

[0039] FIG. 15 is a drawing illustrating image projection results according to a conventional method and various embodiments of the present disclosure, and,

[0040] FIG. 16 is a flowchart illustrating an embodiment of identifying an optimal projection position and projecting an image according to various embodiments of the present disclosure.

[0041] Various embodiments may be subject to various modifications and may have various forms; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of specific embodiments and should be understood to include various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In relation to the description of the drawings, similar reference numerals may be used for similar components.

[0042] In describing the present disclosure, if it is determined that a detailed description of related known functions or configurations could unnecessarily obscure the essence of the present disclosure, such detailed description is omitted.

[0043] The following embodiments may be modified in various different forms, and the scope of the technical concept of the present disclosure is not limited to the following embodiments.

[0044] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of the rights of this disclosure. The singular expression includes the plural expression unless the context clearly indicates otherwise.

[0045] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components such as parts) and do not exclude the presence of additional features.

[0046] In the present disclosure, expressions such as “A or B,” “at least one of A or / and B,” or “one or more of A or / and B” may include all possible combinations of items listed together. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” may refer to cases including (1) at least one A, (2) at least one B, or (3) both at least one A and at least one B.

[0047] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0048] Where it is stated that a certain component (e.g., a first component) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., a second component), it should be understood that the said certain component may be directly connected to the said other component or connected through another component (e.g., a third component).

[0049] When it is stated that a certain component (e.g., a first component) is "directly connected" or "directly coupled" to another component (e.g., a second component), it may be understood that no other component (e.g., a third component) exists between said certain component and said other component.

[0050] As used in this disclosure, the expression “configured to” may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware.

[0051] In some situations, the expression “device configured to do something” may mean that the device is “capable of doing something” in conjunction with other devices or components. For example, the phrase “processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing the said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or application processor) capable of performing said operations by executing one or more software programs stored in a memory device.

[0052] In the embodiments, a 'module' or 'part' performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module and implemented by at least one processor, except for a 'module' or 'part' that needs to be implemented in specific hardware.

[0053] In the embodiments, "state" may be replaced with terms such as "situation," "mode," etc. For example, "wall projection state" may be replaced with "wall projection situation," "wall projection mode," etc.

[0054] Meanwhile, the various elements and areas in the drawings are depicted schematically. Accordingly, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0055] FIG. 1 is a drawing illustrating an electronic device for projecting an image at an optimal projection position according to various embodiments of the present disclosure. An electronic device (100) according to one embodiment of the present disclosure may be implemented as a mobile projector as shown in FIG. 1, but this is merely one embodiment and may be implemented as various mobile electronic devices such as a robot.

[0056] For example, according to one embodiment of the present disclosure, an electronic device (100) may include a projector for projecting an image. In this case, the projector is a device that projects an image onto a screen, wall, or floor through light. The projector can process an input image signal and project the processed image signal by magnifying it through a light source and a lens system.

[0057] For example, a projector may include a long-focus projection lens and an ultra-short-focus projection lens. The projector can project an image to a location far from a wall or a screen installed on the wall using the long-focus projection lens. Additionally, the projector can project an image to a location close to a wall or the floor using the ultra-short-focus projection lens.

[0058] According to one embodiment of the present disclosure, an electronic device (100) can identify an optimal projection position and project an image on the optimal projection position. For example, the electronic device (100) can identify an image projection surface (10) (or referred to as "projection surface") based on a first obstacle (20-1) and a second obstacle (20-2), and can identify an optimal projection position for projecting an image onto the identified projection surface (10). For example, the electronic device (100) can identify the optimal projection position of the electronic device (100) based on the projection distance between the image projection surface (10) and the electronic device (100) (or referred to as "projection distance to the projection surface"), the projection angle at which the electronic device (100) projects an image onto the image projection surface (10) (or referred to as "projection angle corresponding to image projection onto the projection surface"), and the distance traveled by the electronic device (100). For example, the electronic device (100) can identify a plurality of candidate locations based on the current location of the electronic device (100). Then, the electronic device (100) can identify scores for the plurality of candidate locations based on the projection distance, projection angle, and movement distance for each of the identified plurality of candidate locations. The electronic device (100) can identify the candidate location with the highest identified score as the optimal projection location.

[0059] And, the electronic device (100) can move to an optimal projection position and project an image toward the image projection surface (10). Here, if the projection angle at the optimal projection position is greater than or equal to a critical angle, the electronic device (100) performs keystone correction on the image so that the image appears straight and projects the image with the keystone correction performed.

[0060] FIG. 2 is a block diagram showing the configuration of an electronic device (100) according to various embodiments of the present disclosure. Referring to FIG. 2, the electronic device (100) may include at least one of a processor (111) (e.g., including a processing circuit), a projection unit (112), a memory (113), a communication interface (114) (e.g., including a communication circuit), an operation interface (115), an input / output interface (116), a speaker (117), a microphone (118), a power supply unit (119), a driving unit (120), and / or a sensor (121). The configuration shown in FIG. 2 is merely an example of various embodiments, and some configurations may be omitted, and new configurations may be added.

[0061] The projection unit (112) is configured to project an image outward. According to various embodiments of the present disclosure, the projection unit (112) can be implemented using various projection methods (e.g., cathode-ray tube (CRT) method, liquid crystal display (LCD) method, digital light processing (DLP) method, laser method, etc.). For example, the CRT method is basically the same principle as a CRT monitor. The CRT method magnifies the image using a lens in front of the cathode-ray tube (CRT) to display the image on a screen. Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of the three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0062] As another example, the LCD method displays an image by transmitting light from a light source through a liquid crystal. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into Red, Green, and Blue by a dichroic mirror (a mirror that reflects only specific colors of light and allows the rest to pass through), then passes through the liquid crystal, and finally converges back into one place.

[0063] As another example, the DLP method is a technique that displays images using a DMD (Digital Micromirror Device) chip. The projection unit of the DLP method may include a light source, a color wheel, a DMD chip, and a projection lens. Light emitted from the light source can acquire color as it passes through a rotating color wheel. The light passing through the color wheel is input into the DMD chip. The DMD chip contains numerous micro-mirrors and reflects the light input into it. The projection lens performs the function of magnifying the light reflected from the DMD chip to the size of an image.

[0064] As another example, the laser method includes DPSS (Diode Pumped Solid State) lasers and galvanometers. Lasers that output various colors utilize a laser formed by installing three DPSS lasers for each RGB color and superimposing their optical axes using special mirrors. The galvanometer includes mirrors and high-output motors to move the mirrors at high speeds. For example, a galvanometer can rotate the mirror at a maximum speed of 40 KHz / sec. The galvanometer is mounted according to the scanning direction; since projectors generally perform planar scanning, the galvanometer can also be positioned along the x and y axes.

[0065] The projection unit (112) may include various types of light sources. For example, the projection unit (112) may include at least one light source among a lamp, an LED, and a laser.

[0066] The projection unit (112) can output images with a 4:3 aspect ratio, a 5:4 aspect ratio, or a 16:9 wide aspect ratio depending on the use of the electronic device (100) or the user's settings, and can output images with various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the aspect ratio.

[0067] The projection unit (112) can perform various functions to adjust the output image under the control of the processor (111). For example, the projection unit (112) can perform functions such as zoom, keystone, quick corner (4-corner) keystone, lens shift, etc.

[0068] For example, the projection unit (112) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, a zoom function can be performed depending on the distance from the screen. For example, the zoom function may include a hardware method that adjusts the screen size by moving a lens and a software method that adjusts the screen size by cropping the image. Meanwhile, when the zoom function is performed, the focus of the image needs to be adjusted. For example, the focus adjustment method includes a manual focus method and an electric method. For example, the manual focus method refers to a method of manually focusing, and for example, the electric method refers to a method of automatically focusing using a motor built into the projector when the zoom function is performed. When performing the zoom function, the projection unit (112) may provide a digital zoom function through software and may provide an optical zoom function that performs the zoom function by moving the lens through a rotating part.

[0069] The projection unit (112) can perform a keystone correction function. If the height is not correct for front projection, the screen may be distorted upward or downward. The keystone correction function refers to a function that corrects the distorted screen. For example, if distortion occurs in the left-right direction of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up-down direction, it can be corrected using vertical keystone. The quick corner (4 corner) keystone correction function is a function that corrects the screen when the central area of ​​the screen is normal but the corner areas are unbalanced. The lens shift function is a function that moves the screen as is when the screen goes off the screen.

[0070] Meanwhile, the projection unit (112) can automatically analyze the surrounding environment and projection environment without user input to provide zoom / keystone / focus functions. For example, the projection unit (112) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected through sensors (depth camera, distance sensor, infrared sensor, illuminance sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0071] Additionally, the projection unit (112) can provide a lighting function using a light source. In particular, the projection unit (112) can provide a lighting function by outputting a light source using an LED. According to various embodiments, the projection unit (112) may include a single LED, and according to other embodiments, the electronic device (100) may include a plurality of LEDs. According to an implementation example, the projection unit (112) may output a light source using a surface-emitting LED. Here, a surface-emitting LED may refer to an LED having a structure in which an optical sheet is placed on the upper side of the LED so that the light source is evenly distributed and output. Specifically, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0072] The projection unit (112) can provide a dimming function to the user to adjust the intensity of the light source. For example, when an input (e.g., user input) to adjust the intensity of the light source is received from the user through the operation interface (115) (e.g., a touch display button or a dial), the projection unit (112) can control the LED to output the intensity of the light source corresponding to the received user input.

[0073] The projection unit (112) can provide a dimming function based on content analyzed by the processor (111) without user input. For example, the projection unit (112) can control an LED to output the intensity of a light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0074] The projection unit (112) can control the color temperature by the control of the processor (111). The processor (111) includes various processing circuits and can control the color temperature based on the content. When the content is identified as being output, the processor (111) can obtain frame-by-frame color information of the content determined to be output. The processor (111) can control the color temperature based on the obtained frame-by-frame color information. Here, the processor (111) can obtain at least one main color of the frame based on the frame-by-frame color information. The processor (111) can adjust the color temperature based on at least one obtained main color. For example, the color temperature that the processor (111) can adjust can be classified as a warm type or a cold type. It is assumed that the frame to be output (hereinafter output frame) contains a scene where a fire has occurred. The processor (111) can identify (or obtain) that the main color is red based on the color information contained in the current output frame. And, the processor (111) can identify a color temperature corresponding to the identified primary color (red). Here, the color temperature corresponding to red may be a warm type. The processor (111) may use an artificial intelligence model to obtain color information of the frame or the primary color. According to various embodiments, the artificial intelligence model may be stored in an electronic device (100) (e.g., memory (113)). According to an embodiment, the artificial intelligence model may be stored in an external server capable of communicating with the electronic device (100).

[0075] The projection unit (112) may include a long-focus projection lens and an ultra-short-focus projection lens. The long-focus projection lens is a lens capable of projecting a large screen from a long distance, and can project an image from a position ranging from several meters to tens of meters away. The ultra-short-focus projection lens is a lens capable of projecting a large screen from a very short distance, and can project an image from a position ranging from several tens of centimeters away.

[0076] The projection unit (112) may further include a switching unit that includes a circuit capable of switching (or changing, tilting) between a long-focus projection lens and an ultra-short-focus projection lens. That is, the projector (112) can switch between a long-focus projection lens and an ultra-short-focus projection lens using the switching unit under the control of the processor (111).

[0077] The memory (113) may be implemented as internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) or RAM included in the processor (111), or as memory separate from the processor (111). In this case, the memory (113) may be implemented as a memory embedded in the electronic device (100) or as a memory that can be attached to the electronic device (100) depending on the purpose of data storage. For example, data for operating the electronic device (100) may be stored in memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in memory that can be attached to the electronic device (100).

[0078] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that is detachable from the electronic device (100), it may be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory that can be connected to a USB port (e.g., USB memory).

[0079] Memory (113) may store at least one instruction regarding the electronic device (100). Additionally, an operating system (O / S) for operating the electronic device (100) may be stored in memory (113). Furthermore, various software programs or applications for operating the electronic device (100) may be stored in memory (113) according to various embodiments of the present disclosure. Additionally, memory (113) may include semiconductor memory such as flash memory or magnetic storage media such as a hard disk.

[0080] For example, various software modules for operating an electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (113), and the processor (111) may control the operation of the electronic device (100) by executing the various software modules stored in the memory (113). That is, the memory (113) is accessed by the processor (111), and reading / writing / modifying / deleting / updating of data by the processor (111) may be performed.

[0081] For example, the memory (113) may store information about a map of the house where the electronic device (100) is located. In this case, the map may include a drawing that reduces the planar structure of the house by a certain ratio and represents it using agreed-upon symbols. For example, the map may include a drawing that represents the planar structure of the house with lines. However, it is not limited thereto, and the map may also include the locations of major objects inside the house.

[0082] A map according to one embodiment of the present disclosure may be a two-dimensional map, but this is merely one embodiment and may be a three-dimensional map.

[0083] In the present disclosure, the term memory (113) may be used to include a storage unit, a ROM (not shown), a RAM (not shown) within a processor (111), or a memory card (not shown) (e.g., a micro SD card, a memory stick) mounted in an electronic device (100).

[0084] The communication interface (114) is a configuration comprising various communication circuits configured to communicate with various types of external devices according to various types of communication methods. The communication interface (114) may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0085] A wireless communication module may be a module that communicates wirelessly with an external device. For example, a wireless communication module may include at least one module among a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0086] Wi-Fi modules and Bluetooth modules can perform communication using Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi module or a Bluetooth module, various connection information, such as the SSID (service set identifier) ​​and session key, is transmitted and received first; after establishing a communication connection using this information, various types of information can be transmitted and received.

[0087] The infrared communication module includes various circuits and performs communication according to infrared communication (IrDA, Infrared Data Association) technology, which uses infrared rays located between visible light and millimeter waves to wirelessly transmit data over short distances.

[0088] Other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation), in addition to the communication method described above.

[0089] A wired communication module may be a module that communicates with an external device via a wire. For example, a wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0090] The communication interface (114) can communicate with an external device (200). The communication interface (114) can receive information about the external device (200) from the external device (200) (e.g., information about the current location of the external device (200), information about the device equipped in the external device (200), etc.). The communication interface (114) can transmit path information to the external device (200) and can transmit information about the multi-projector system.

[0091] The operation interface (115) may include various types of input devices. For example, the operation interface (115) may include a physical button. In this case, the physical button may include a function key, a directional key (e.g., a four-way key), or a dial button. Depending on various embodiments, the physical button may be implemented as a plurality of keys. Depending on an embodiment, the physical button may be implemented as a single key. When the physical button is implemented as a single key, the electronic device (100) may receive user input in which one key is pressed for a threshold time or longer. When user input in which one key is pressed for a threshold time or longer is received, the processor (111) may perform a function corresponding to the user input. For example, the processor (111) may provide a lighting function based on the user input.

[0092] The operation interface (115) can receive user input using a non-contact method. When receiving user input through a contact method, physical force must be transmitted to the electronic device (100). Therefore, a method for controlling the electronic device (100) regardless of physical force may be required. Specifically, the operation interface (115) can receive user gestures and perform actions corresponding to the received user gestures. Here, the operation interface (115) can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0093] The operation interface (115) can receive user input using a touch method. For example, the operation interface (115) can receive user input through a touch sensor. Depending on various embodiments, the touch method may be implemented in a non-contact manner. For example, the touch sensor may determine whether the user's body has approached within a threshold distance. Here, the touch sensor may identify user input even when the user does not touch the touch sensor. Meanwhile, according to other embodiments, the touch sensor may identify user input when the user touches the touch sensor.

[0094] The electronic device (100) can receive input in various ways other than the operation interface (115) described above. In various embodiments, the electronic device (100) can receive user input through an external remote control device. Here, the external remote control device may be a remote control device corresponding to the electronic device (100) (e.g., a dedicated control device of the electronic device (100)) or a user's portable communication device (e.g., a smartphone or a wearable device). Here, the user's portable communication device may store an application for controlling the electronic device (100). The portable communication device may acquire user input through the stored application and transmit the acquired user input to the electronic device (100). The electronic device (100) can receive user input from the portable communication device and perform an operation corresponding to the user's control command.

[0095] The electronic device (100) can receive user input using voice recognition. According to various embodiments, the electronic device (100) can receive user voice through a microphone included in the electronic device (100). According to embodiments, the electronic device (100) can receive user voice from a microphone or an external device. For example, the external device can acquire user voice through the microphone of the external device and transmit the acquired user voice to the electronic device (100). The user voice transmitted from the external device may be audio data or digital data converted from audio data (e.g., audio data converted into the frequency domain). The electronic device (100) can perform an operation corresponding to the received user voice. For example, the electronic device (100) can receive audio data corresponding to the user voice through the microphone. And, the electronic device (100) can convert the received audio data into digital data. Additionally, the electronic device (100) can convert the converted digital data into text data using a Speech To Text (STT) function. Depending on various embodiments, the Speech To Text (STT) function may be performed directly by the electronic device (100), and depending on the embodiment, the Speech To Text (STT) function may be performed by an external server. The electronic device (100) can transmit the digital data to an external server. The external server can convert the digital data into text data and obtain control command data based on the converted text data. The external server can transmit the control command data (which may also include text data) to the electronic device (100). The electronic device (100) can perform an action corresponding to the user's voice based on the obtained control command data.

[0096] The electronic device (100) may provide a voice recognition function using one assistant (or an artificial intelligence assistant, e.g., Bixby™), but this is merely one of various embodiments and may provide a voice recognition function through multiple assistants. At this time, the electronic device (100) may provide a voice recognition function by selecting one of the multiple assistants based on a trigger word corresponding to the assistant or a specific key on the remote control.

[0097] The electronic device (100) can receive user input using screen interaction. Screen interaction may represent, for example, a function of identifying whether a predetermined (or specific) event occurs through an image projected by the electronic device (100) onto a screen (or projection surface), and acquiring user input based on the predetermined event. The predetermined event may represent, for example, an event in which a predetermined object is identified at a specific location (for example, a location where a UI for receiving user input is projected). The predetermined object may include at least one of a part of the user's body (for example, a finger), a pointer, or a laser pointer. When the electronic device (100) identifies a predetermined object at a location corresponding to the projected UI, it may identify that user input for selecting the projected UI has been received. For example, the electronic device (100) may project a guide image to display the UI on the screen. And, the electronic device (100) may identify whether the user selects the projected UI. For example, the electronic device (100) can identify that a user has selected the projected UI if a predetermined event is identified at the location of the projected UI. The projected UI may include at least one item. Here, the electronic device (100) can perform spatial analysis to identify whether a predetermined event is at the location of the projected UI. The electronic device (100) can perform spatial analysis through a sensor (e.g., image sensor, infrared sensor, depth camera, distance sensor, etc.). By performing spatial analysis, the electronic device (100) can identify whether a predetermined event occurs at a specific location (the location where the UI is projected). If it is identified that a predetermined event occurs at a specific location (the location where the UI is projected), the electronic device (100) can identify that user input for selecting the UI corresponding to the specific location has been received.

[0098] For example, the operation interface (115) can receive a user command to operate a multi-projection function. In one embodiment, a touch / jog icon for inputting a user command may be provided through a display. And, when a touch / jog icon is selected through a touch display or the like among the operation interfaces (115), the electronic device (100) can receive a user command (e.g., a user command to operate a multi-projection function).

[0099] The input / output interface (116) may include various circuits for inputting and outputting at least one of an audio signal and an image signal. The input / output interface (116) may receive at least one of the audio and image signals from an external device and may output control commands to the external device.

[0100] Depending on the implementation example, the input / output interface (116) may be implemented as an interface that inputs and outputs only audio signals and an interface that inputs and outputs only image signals, or as a single interface that inputs and outputs both audio signals and image signals.

[0101] In various embodiments of the present disclosure, the input / output interface (116) may be implemented as at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). According to various embodiments, the wired input / output interface may be implemented as an interface that inputs and outputs only audio signals and an interface that inputs and outputs only image signals, or as a single interface that inputs and outputs both audio signals and image signals.

[0102] The electronic device (100) can receive data through a wired input / output interface, but this is merely one embodiment, and it can also receive power through a wired input / output interface. For example, the electronic device (100) can receive power from an external battery via a USB C-type or from an outlet via a power adapter. As another example, the electronic device (100) can receive power from an external device (e.g., a laptop or a monitor) via DP.

[0103] Audio signals can be implemented to be received through a wired input / output interface, and image signals can be implemented to be received through a wireless input / output interface (or communication interface). Audio signals can be implemented to be received through a wireless input / output interface (or communication interface), and image signals can be implemented to be received through a wired input / output interface.

[0104] The speaker (117) is configured to output an audio signal. In particular, the speaker (117) may include an audio output mixer, an audio signal processor, and an audio output module. The audio output mixer may synthesize multiple audio signals to be output into at least one audio signal. For example, the audio output mixer may synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from an external source) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to various embodiments, the audio output module may include multiple speakers, in which case the audio output module may be placed inside the main body, and the sound radiated by covering at least a part of the diaphragm of the audio output module may pass through a waveguide and be transmitted to the outside of the main body. The audio output module may include multiple audio output units, and by symmetrically arranging the multiple audio output units on the exterior of the main body, sound may be radiated in all directions, that is, in all 360 degrees.

[0105] The microphone (118) is a component for receiving user voice or other sounds and converting them into audio data. The microphone (118) can receive the user's voice when active. For example, the microphone (118) may be formed integrally on the upper side, front side, or side side of the electronic device (100). The microphone (118) may include various components such as a microphone for collecting analog user voice, an amplifier circuit for amplifying the collected user voice, an A / D conversion circuit for sampling the amplified user voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0106] The power supply unit (119) can receive power from an external source and supply power to various components of the electronic device (100). The power supply unit (119) according to various embodiments of the present disclosure can receive power through various methods. In various embodiments, the power supply unit (119) can receive power using a connector. In addition, the power supply unit (119) can receive power using a 220V DC power cord. However, it is not limited thereto, and the electronic device (100) can receive power using a USB power cord or a wireless charging method.

[0107] The power supply unit (119) may receive power using an internal battery or an external battery. In various embodiments of the present disclosure, the power supply unit (119) may receive power through an internal battery. For example, the power supply unit (119) may charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and receive power through the charged internal battery. In addition, in various embodiments of the present disclosure, the power supply unit (119) may receive power through an external battery. For example, when the electronic device (100) and the external battery are connected through various wired communication methods such as a USB power cord, a USB C-Type power cord, or a socket, the power supply unit (119) may receive power through the external battery. That is, the power supply unit (119) may receive power directly from the external battery, or charge the internal battery through the external battery and receive power from the charged internal battery.

[0108] The power supply unit (119) according to the present disclosure can receive power using at least one of the plurality of power supply methods described above.

[0109] Regarding power consumption, the electronic device (100) may have a power consumption of less than or equal to a preset value (e.g., 43W) due to reasons such as the socket type and other standards. At this time, the electronic device (100) may vary the power consumption to reduce power consumption when using a battery. That is, the electronic device (100) may vary the power consumption based on the power supply method and power usage.

[0110] The driving unit (120) includes various circuits and can drive at least one hardware configuration included in the electronic device (100). The driving unit (120) can generate physical force and transmit it to at least one hardware configuration included in the electronic device (100). Here, the driving unit (120) can generate driving power for a movement operation of the hardware configuration included in the electronic device (100) (e.g., movement of the electronic device (100)).

[0111] For example, the driving unit (120) can move the position of the electronic device (100). Here, the driving unit (120) can control the moving member (109) to move the electronic device (100). For example, the driving unit (120) can control the moving member (109) using a motor and a wheel. According to the present disclosure, the driving unit (120) may be referred to by various terms such as a driving unit, a driving unit, a moving unit, etc.

[0112] The sensor (121) may include at least one sensor. For example, the sensor (121) may include at least one of a tilt sensor that senses the tilt of the electronic device (100) and an image sensor that captures an image. Here, the tilt sensor may be an accelerometer or a gyroscope, and the image sensor may represent, for example, a camera or a depth camera. The tilt sensor may be described as a motion sensor. Additionally, the sensor (121) may include various sensors other than the tilt sensor or the image sensor. For example, the sensor (121) may include an illuminance sensor or a distance sensor. The distance sensor may be a Time of Flight (ToF). Additionally, the sensor (121) may include a LiDAR sensor.

[0113] For example, the sensor (121) can obtain a sensing value to obtain information about whether an external device (200) is located within the detection range using at least one sensor. Additionally, the sensor (121) can obtain obstacle information within the detection range using at least one sensor.

[0114] The electronic device (100) can control lighting functions by linking with an external device. For example, the electronic device (100) can receive lighting information from an external device. Here, the lighting information may include at least one of brightness information or color temperature information set by the external device. The external device may refer to a device connected to the same network as the electronic device (100) (e.g., an IoT device included in the same home / company network) or a device that is not on the same network as the electronic device (100) but can communicate with the electronic device (100) (e.g., a remote control server). For example, assume that an external lighting device (IoT device) included in the same network as the electronic device (100) is outputting red light at a brightness of 50. The external lighting device (IoT device) can transmit lighting information (e.g., information indicating that it is outputting red light at a brightness of 50) to the electronic device (100) directly or indirectly. The electronic device (100) can control the output of the light source based on the lighting information received from the external lighting device. For example, if the lighting information received from an external lighting device includes information that outputs red light at a brightness of 50, the electronic device (100) can output red light at a brightness of 50.

[0115] The electronic device (100) can control a lighting function based on biometric information. For example, the processor (111) can acquire biometric information of a user. The biometric information may include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. Here, the biometric information may include various information in addition to the information described above. As an example, the electronic device (100) may include a sensor for measuring biometric information. The processor (111) can acquire the user's biometric information through the sensor and control the output of a light source based on the acquired biometric information. As another example, the processor (111) can receive biometric information from an external device through an input / output interface (116). Here, the external device may refer to the user's portable communication device (e.g., a smartphone or a wearable device). The processor (111) can acquire the user's biometric information from the external device and control the output of a light source based on the acquired biometric information. Meanwhile, according to an embodiment, the electronic device (100) can identify whether the user is sleeping, and if the user is identified as being asleep (or preparing to sleep), the processor (111) can control the output of the light source based on the user's biometric information.

[0116] An electronic device (100) according to various embodiments of the present disclosure can provide various smart functions.

[0117] For example, the electronic device (100) is connected to a mobile terminal device for controlling the electronic device (100), and the screen output from the electronic device (100) can be controlled through user input received from the mobile terminal device. As an example, the mobile terminal device may be implemented as a smartphone including a touch display, and the electronic device (100) receives and outputs screen data provided by the mobile terminal device from the mobile terminal device, and the screen output from the electronic device (100) can be controlled according to user input received from the mobile terminal device.

[0118] The electronic device (100) can connect with a mobile terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC, and share content or music provided by the mobile terminal device.

[0119] A mobile terminal device and an electronic device (100) can be connected in various connection methods. In various embodiments, a wireless connection can be established by searching for the electronic device (100) from the mobile terminal device, or a wireless connection can be established by searching for the mobile terminal device from the electronic device (100). Additionally, the electronic device (100) can output content provided by the mobile terminal device.

[0120] In various embodiments, when a specific content or music is being output from a mobile terminal device, the mobile terminal device is placed near an electronic device (100), and a preset gesture is detected through the display of the mobile terminal device (e.g., motion tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0121] In various embodiments, when specific content or music is being output from a mobile terminal device, if the mobile terminal device comes closer to the electronic device (100) at a distance less than a preset distance (e.g., non-contact tap view) or if the mobile terminal device comes into contact with the electronic device (100) twice at short intervals (e.g., contact tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0122] In various embodiments, it has been described that a screen identical to the screen provided by the mobile terminal device is provided by the electronic device (100), but the present disclosure is not limited thereto. For example, when a connection is established between the mobile terminal device and the electronic device (100), a first screen provided by the mobile terminal device may be output at the mobile terminal device, and a second screen provided by the mobile terminal device that is different from the first screen may be output at the electronic device (100). For example, the first screen may be a screen provided by a first application installed on the mobile terminal device, and the second screen may be a screen provided by a second application installed on the mobile terminal device. For example, the first screen and the second screen may be different screens provided by a single application installed on the mobile terminal device. In addition, for example, the first screen may be a screen that includes a UI in the form of a remote control for controlling the second screen.

[0123] The electronic device (100) according to the present disclosure may output a standby screen. For example, the electronic device (100) may output a standby screen when the electronic device (100) is not connected to an external device or when there is no input received from an external device for a preset period of time. The conditions for the electronic device (100) to output a standby screen are not limited to the above-described examples, and a standby screen may be output under various conditions.

[0124] The electronic device (100) may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device (100) may obtain an unstructured object by extracting only the shape of a specific object from data received from an external device, and may output a standby screen including the obtained unstructured object.

[0125] The electronic device (100) may further include a display (not shown).

[0126] The display (not shown) can be implemented as various types of displays, such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, or a PDP (Plasma Display Panel). The display (not shown) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT (amorphous silicon thin film transistor), an LTPS (low temperature poly silicon) TFT, or an OTFT (organic TFT). Meanwhile, the display (not shown) can be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, or a three-dimensional display. Furthermore, according to various embodiments of the present disclosure, the display (not shown) may include not only a display panel that outputs an image but also a bezel that houses the display panel. In particular, according to various embodiments of the present disclosure, the bezel may include a touch sensor (not shown) for detecting user interaction.

[0127] The electronic device (100) may further include a shutter part (not shown).

[0128] The shutter section (not shown) may include at least one of a shutter, a fixed member, a rail, or a body.

[0129] The shutter can block light output from the projection unit (112). Here, the fixed member can fix the position of the shutter. Here, the rail may be a path for moving the shutter and the fixed member. Here, the body may be a configuration including the shutter and the fixed member.

[0130] The processor (111) may be implemented as a digital signal processor (DSP), microprocessor, or time controller (TCON) that processes digital signals. However, it is not limited thereto, and may include or be defined by one or more of a central processing unit (CPU), microcontroller unit (MCU), micro processing unit (MPU), controller, application processor (AP), graphics-processing unit (GPU), communication processor (CP), or ARM (advanced reduced instruction set computer (RISC) machines) processor. Additionally, the processor (111) may be implemented as a System on Chip (SoC) or large scale integration (LSI) with built-in processing algorithms, or may be implemented in the form of a Field Programmable Gate Array (FPGA). Furthermore, the processor (111) can perform various functions by executing computer executable instructions stored in memory (113). Therefore, the processor (111) can perform various processing It may include circuits and / or multiple processors. For example, as used in the present disclosure and claims, the term "processor" may include various processing circuits comprising one or more processors, and one or more of these one or more processors may be configured to perform various functions together, either individually or collectively.Where the expressions “a processor,” “at least one processor,” and “one or more processors” in this disclosure are described as being configured to perform various functions, such expressions may include, by example and without limitation, cases where one processor performs some of the listed functions and another processor performs the remaining functions, as well as cases where a single processor performs all functions. Additionally, one or more processors may be a combination of multiple processors that perform various functions in a distributed manner. One or more processors may execute program instructions to perform or achieve various functions.

[0131] For example, the processor (111) executes at least one instruction stored in memory (113) so that when an event corresponding to image projection occurs, it identifies a projection surface corresponding to image projection and controls the drive unit (120) to move to an optimal projection position obtained based on the projection distance to the projection surface, the projection angle corresponding to image projection on the projection surface, and the distance traveled.

[0132] In various embodiments, the processor (111) can obtain a score corresponding to a plurality of candidate positions based on a projection distance, projection angle, and movement distance for each of a plurality of candidate positions obtained based on the current position, and obtain an optimal projection position based on the obtained score.

[0133] In various embodiments, the processor (111) can obtain a first score, which is the highest score, with a score corresponding to the projection distance if the projection distance from the candidate position to the projection surface is within a first range, and can obtain a score corresponding to a projection distance lower than the first score if the projection distance from the candidate position to the projection surface is further than the first range.

[0134] In various embodiments, the processor (111) can obtain a second score, which is the highest score, with a projection angle corresponding to the projection angle when the projection angle corresponding to the projection from the candidate position to the projection surface is less than a first value, and can obtain a score corresponding to a projection angle lower than the second score when the projection angle corresponding to the projection from the candidate position to the projection surface is greater than the first value.

[0135] In various embodiments, the processor (111) can obtain a third score, which is the highest score, with a score corresponding to the distance traveled when the distance traveled to the candidate location is less than the second value, and can obtain a score for a distance traveled lower than the third score when the distance traveled to the candidate location is greater than the second value.

[0136] In various embodiments, if an obstacle exists near the projection surface, the processor (111) can obtain a projection angle to project an image onto the projection surface by avoiding the obstacle based on the current projection angle, the angle of view, the size of the obstacle, and the projection distance to the projection surface.

[0137] In various embodiments, if an obstacle exists near the projection surface, the processor (111) can obtain a distance to project an image from the front of the projection surface by avoiding the obstacle based on the current projection angle, the angle of view, the size of the obstacle, and the projection distance to the projection surface.

[0138] In various embodiments, the processor (111) can move to the optimal projection position and then identify whether there is an obstacle within the range for projecting an image onto a projection surface around the optimal projection position.

[0139] In various embodiments, the processor (111) controls the projection of an image onto the projection surface at an optimal projection position if no obstacle exists within the range, and if an obstacle exists within the range, it can obtain one of a plurality of candidate positions around the optimal projection position based on the projection distance, projection angle, and travel distance.

[0140] In various embodiments, the processor (111) can move to an optimal projection position and then project an image through the projection unit (112).

[0141] FIGS. 3a and 3b are perspective views illustrating the external appearance of an electronic device (100) according to various embodiments of the present disclosure. As shown in FIG. 3a, the electronic device (100) may include a sensor (121) and a projection unit (112) in a head area. The head area refers to an area located at the top of the electronic device (100) and may be referred to by various terms such as top area, top area, sensing area, projection area, etc. Furthermore, the head area of ​​the electronic device (100) may be rotated to adjust the projection angle or to sense information about the surroundings of the electronic device (100). At this time, the head area of ​​the electronic device (100) may be rotated by a rotation unit (310) as shown in FIG. 3. In various embodiments, as shown in FIG. 4(a), the head area of ​​the electronic device (100) may perform a yaw rotation rotating in the left and right directions. Additionally, as shown in FIG. 4(b), the head region of the electronic device (100) can perform pitch rotation in the up-and-down direction. Additionally, as shown in FIG. 4(c), the head region of the electronic device (100) can perform roll rotation in the clockwise / counterclockwise direction. However, as shown in FIG. 4, the head region of the electronic device (100) can rotate in all three axes, but this is merely one embodiment, and it is obvious that it can rotate in only some of the three axes.

[0142] Additionally, a driving unit (120) may be included in the lower region of the electronic device (100). The driving unit (120) can move the electronic device (100) by driving a moving member (i.e., a wheel). For example, as shown in FIG. 5, the electronic device (100) can be moved by a distance d from point (a) to point (d) relative to the image projection plane through the driving unit (120).

[0143] For example, the electronic device (100) can adjust the projection angle of the electronic device (100) through the rotating part (310) and adjust the projection position of the electronic device (100) through the driving part (120).

[0144] FIG. 3b is a drawing illustrating the external appearance of an electronic device according to one embodiment of the present disclosure. Referring to the embodiment of FIG. 3, the electronic device (100) may include a moving member (109). The moving member (109) may, for example, represent a member for moving from a first position to a second position in a space where the electronic device (100) is placed. The electronic device (100) may control the moving member (109) to move the electronic device (100) using a force generated by a driving unit (120). At this time, the moving member (109) may include a motor or a wheel. Additionally, as shown in FIG. 3b, the electronic device (100) may include a projection unit (112) on a part of the main body.

[0145] FIG. 6 is a flowchart illustrating an embodiment in which an electronic device identifies an optimal projection position and projects an image according to various embodiments of the present disclosure.

[0146] The electronic device (100) detects an event for video projection (S610). The event for video projection may be an event where a user inputs a video projection command, but is not limited thereto, and may be various events such as an event reaching a preset time or an event where a user approaches the electronic device (100).

[0147] The electronic device (100) can identify an image projection surface for projecting an image (S620). The image projection surface is an area for the electronic device (100) to project an image, and may be, for example, a wall, but this is merely one embodiment, it may be a floor or a screen of a preset color (e.g., white). For example, the electronic device (100) can obtain information about the location of the electronic device (100) and surrounding obstacles by scanning the area around the electronic device (100) using a sensor (121). The electronic device (100) can identify an image projection surface for projecting an image based on the location of the electronic device (100), information about surrounding obstacles, and pre-stored map data. In various embodiments, the electronic device (100) can identify the wall surface closest to the location where the electronic device (100) is located as the image projection surface. In various embodiments, the electronic device (100) can identify a wall surface where no obstacles exist at the location where the electronic device (100) is located as the image projection surface. In various embodiments, the electronic device (100) can identify the screen located closest to the electronic device (100) as the image projection surface. This is merely one embodiment, and it is obvious that the image projection surface can be identified in various ways.

[0148] The electronic device (100) can identify the optimal projection position of the electronic device (100) based on the projection distance between the image projection surface and the electronic device (100), the projection angle at which the electronic device (100) projects an image onto the image projection surface, and the movement distance of the electronic device (100) (S630).

[0149] For example, the electronic device (100) can identify a plurality of candidate locations based on the current location of the electronic device (100). In various embodiments, the electronic device (100) can identify a plurality of candidate locations located around the electronic device (100) based on map data.

[0150] The electronic device (100) can identify a score for the plurality of candidate locations based on the projection distance, projection angle, and movement distance for each of the identified plurality of candidate locations.

[0151] For example, depending on the projection distance and projection angle, the size, brightness, and resolution of the projected screen change, and depending on the travel distance, the time required to project the image and stability change. In other words, the projection distance, projection angle, and travel distance are very important factors in identifying the optimal projection position. For example, the first factor for identifying the optimal projection position is the projection distance. The projection distance refers to the distance between the electronic device (100) and the image projection surface, and is a factor that determines the size and brightness of the projected screen. For example, as shown in FIG. 7a, the first screen (710) with the shortest projection distance has a small screen size but high image brightness, whereas the second screen (720) with an intermediate projection distance has a screen size larger than the first screen (710) but may have a darker image brightness than the first screen (710). The third screen (730), which has the longest projection distance, is larger than the first screen (710) and the second screen (720), but the brightness of the image may be darker than that of the first screen (710) and the second screen (720). For example, when the projection distance is at an appropriate value that is neither too close nor too far, optimal image quality can be provided in terms of image size and brightness.

[0152] In one embodiment of the present disclosure, for each of a plurality of candidate locations, when the projection distance from the candidate location to the image projection surface is within a first range, the electronic device (100) may identify a first score for the projection distance as the highest point, and identify the first score for the projection distance as lower than the highest point as the projection distance from the candidate location to the image projection surface becomes farther than the first range. For example, as shown in the first graph (810) of FIG. 8, when the projection distance is within the first range, the first score for the projection distance is 1, which is the highest point, but as it becomes farther than the first range, the first score may become smaller. The first range may be set differently depending on the projection mode of the electronic device (100), the type of projection lens, and the type of content, etc. Alternatively, the first range may be set by the user.

[0153] The second factor for identifying the optimal projection position is the projection angle. The projection angle refers to the angle at which the electronic device (100) is rotated toward the projection plane relative to the projection plane, and the resolution and brightness of the projected screen can be determined according to the projection angle. As shown in FIG. 7b, the first screen (740) with a projection angle of 0 has a projection range that is rectangular in shape, identical to the screen, but as the projection angle increases, the projection range of the second screen (750) and the third screen (760) becomes asymmetry in the vertical and horizontal directions. In such cases, the electronic device (100) can perform keystone correction to make the projected screen appear straight again. However, as with the second screen (750) and the third screen (560), the ratio of the screen size to the projection range decreases due to keystone correction. That is, the number of pixels on the screen decreases, resulting in lower resolution and darker brightness. Therefore, the smaller the projection angle, the better the image quality can be provided in terms of resolution and brightness.

[0154] In one embodiment of the present disclosure, for each of a plurality of candidate positions, if the projection angle from the candidate position to the image projection plane is less than a first value, the electronic device (100) identifies a second score for the projection angle as the highest point, and can identify the second score for the projection angle as lower than the highest point as the projection angle from the candidate position to the image projection plane becomes greater than the first value. For example, as shown in the second graph (820) of FIG. 8, when the projection angle is less than the first value, the second score for the projection angle is 1, which is the highest point, but the second score may become smaller as it becomes greater than the first value. The first value may be a value close to 0 and may be pre-set, but this is merely one embodiment and may be set by the user.

[0155] The third factor for identifying the optimal projection position is the travel distance. The travel distance refers to the distance the electronic device (100) travels from its current position to the projection position, and can determine the time required and the stability of the electronic device (100). Specifically, the greater the travel distance, the further the electronic device (100) must travel, which increases the time required and the risk of unexpected events occurring. Therefore, a projection position that is as close as possible to the current position can be considered a better projection position. If the electronic device (100) uses wired power, the travel distance may be limited by the length of the power cable. Alternatively, the first value may be 0.

[0156] In one embodiment of the present disclosure, for each of a plurality of candidate locations, if the distance to the candidate location is less than a second value, the electronic device (100) may identify a third score for the distance to move as the highest point, and identify the third score for the distance to move as lower than the highest point as the distance to move further than the second value. For example, as in the third graph (830) of FIG. 8, when the distance to move is less than the second value, the third score for the distance to move may be 1, which is the highest point, but the third score may decrease as the distance to move further than the second value. Here, the second value may be pre-set, but this is merely one embodiment and may be set by the user. The second value may be 0.

[0157] Although the highest point in Fig. 8 is described as being 1, this is merely one example, and it is obvious that it can be implemented with other values.

[0158] And, the electronic device (100) can calculate a final score by adding the first to third scores for a plurality of candidate positions and identify the candidate position with the largest score among the calculated final scores as the optimal projection position.

[0159] FIG. 9 is a drawing for explaining a method for identifying an optimal projection position according to projection distance, projection angle and travel distance, according to various embodiments of the present disclosure.

[0160] As illustrated in FIG. 9, the electronic device (100) scans the surroundings from the current location (900) with a sensor (121) to recognize the location and distance of two obstacles and an image projection surface. Then, the electronic device (100) calculates first to third scores for each of the previously described criteria for a plurality of candidate locations in the surrounding space.

[0161] In FIG. 9, the first score according to projection distance is indicated as a square, the second score according to projection angle as a triangle, and the third score according to movement distance as a circle. That is, if located in the first area (910-1) among the squares, the first score is the highest score, and if located in the second area (910-2), the first score may be lower than the highest score. Also, if located in the first area (920-1) among the triangles, the second score is the highest score, and if located in the second area (920-2), the second score may be lower than the highest score. If located in the first area (930-1) among the circles, the third score is the highest score, and if located in the second area (930-2), the third score may be lower than the highest score. Among multiple candidate locations, a candidate location located in an area where the regions with high scores from the first to third overlap can be identified as the optimal projection location. For example, the electronic device (100) can identify the first point (905) as the optimal projection position.

[0162] The electronic device (100) can move to an optimal projection position (S640). The electronic device (100) can project an image at an identified projection angle at the optimal projection position. Here, if the projection angle is greater than a threshold value, the electronic device (100) can project the image by performing keystone correction.

[0163] Meanwhile, when projecting forward relative to the image projection surface, the electronic device (100) can provide the best projection image, but if there is an obstacle in front, it must project while avoiding the obstacle. According to one embodiment of the present disclosure, the electronic device (100) uses a sensor (121) to recognize an obstacle around the image projection surface or an obstacle located at the projection position of the electronic device (100), and calculates a projection angle that can project the image by taking into account the recognized obstacle.

[0164] With reference to FIG. 10, the projection distance (r) and projection angle (α) will be explained. As shown on the left side of FIG. 10, the electronic device (100) can project an image symmetrically to the left and right around the central axis when the projection angle is 0. The dotted arrow indicates the central axis, and the solid arrow indicates the two ends of the screen. At this time, the shortest distance between the electronic device (100) projecting the image and the image projection surface is called the projection distance (r), and the angle at which the screen spreads to the left and right from the center is called the angle of view (θ). The projection distance (r) may vary depending on the environment, but the angle of view (θ) has a fixed value due to the physical characteristics of the electronic device (100). The drawing shown on the right side of FIG. 10 illustrates the electronic device (100) rotated to the right by an angle α relative to the image projection surface, so that the projection angle becomes α. The angle formed by the left edge of the projection screen and the projection plane is (θ-α), and the angle formed by the right edge of the projection screen and the projection plane is (θ+α).

[0165] According to one embodiment of the present disclosure, an electronic device (100) can calculate a projection distance (r), the size of an obstacle (d), and a current projection angle (α1) based on sensing data obtained from a Time of Flight (ToF) sensor among the sensors (121). When projecting an image as shown at the top of FIG. 11, the sensing data obtained from the ToF sensor may be as shown at the bottom of FIG. 11. For example, a total of 443 data points were detected, and each sensing data point may be represented as a point on the projection plane in three-dimensional position coordinates. The drawing shown at the top of FIG. 11 may show the sensing data as viewed from above. The electronic device (100) can determine the thickness of an obstacle (d) from the difference in the position coordinates of the sensing data. obsInformation regarding ) can be obtained. The projection distance (r) and projection angle (α) can be calculated by modeling a plane from the sensing data obtained from the ToF sensor. For example, the electronic device (100) can obtain a normal vector of the plane from the sensing data and measure the angle of the normal vector to measure the projection angle (α), and can measure the projection distance (r) from the distance between the plane and the electronic device (100).

[0166] When identifying the optimal projection position among multiple candidate positions, or when projecting an image at the optimal projection position, if there is an obstacle near the image projection surface, the electronic device (100) needs to project the image based on a new projection angle or project the image at a new projection position. This will be explained in more detail with reference to FIGS. 12 to 14.

[0167] According to various embodiments, when an obstacle is present near the image projection surface, the electronic device (100) can identify a new projection angle to project an image onto the image projection surface by avoiding the obstacle based on the current projection angle of the electronic device (100), the field of view of the electronic device (100), the size of the obstacle, and the projection distance to the image projection surface.

[0168] This will be explained with reference to FIG. 12. Specifically, in FIG. 12, the dashed arrow indicates projection at the current projection angle (α), and the solid arrow indicates the new projection angle (α obs It shows the projection at the new projection angle (α obs ) is as shown in Equation 1 below, with the current projection angle (α), field of view (θ), and obstacle size (d obs It can be calculated from ) and projection distance (r).

[0169] [Mathematical Formula 1]

[0170]

[0171] As described above, the current projection angle (α), the size of the obstacle (d obs ) and projection distance (r) can be calculated from the ToF sensor, and the angle of view (θ) is a fixed value. According to Equation 1, the electronic device (100) obtains a new projection angle (α obs ) can be calculated and (α obs By rotating the electronic device (100) by -α, the screen can be projected while automatically avoiding obstacles.

[0172] When the obstacle is small, a small rotation is sufficient to avoid the obstacle, but when the obstacle is large, too many rotation angles may be required to avoid the obstacle by rotation alone. In this case, since the score loss due to rotation may be greater than the movement of the electronic device (100), according to various embodiments of the present disclosure, the electronic device (100) can avoid the obstacle by moving rather than rotating.

[0173] According to various embodiments, when an obstacle is present near the image projection surface, the electronic device (100) can identify the distance traveled by the electronic device (100) to project an image from the front of the image projection surface by avoiding the obstacle based on the current projection angle of the electronic device (100), the field of view of the electronic device (100), the size of the obstacle, and the projection distance to the image projection surface.

[0174] This will be explained with reference to FIG. 13. For example, FIG. 13 illustrates a process for calculating a movement distance to avoid an obstacle according to various embodiments of the present disclosure. If the electronic device (100) can move parallel to the image projection plane as shown in FIG. 13, the first score according to the projection distance is maintained, so the optimal projection position can be determined only with respect to the projection angle and the movement distance. When the projection angle is fixed, the electronic device (100) has a size d obs To avoid the obstacle, d from the current position (P1) obsYou must move to the target location (P2) that is a certain distance away.

[0175] For example, for a frontal projection, one needs to rotate by (-α), but in this case, the screen position moves toward the obstacle. Therefore, if there is an obstacle, rotate by (-α) and move d from P2 to P3. rot You must move an additional amount. Additional movement distance d rot It can be calculated from the projection distance (r) and the current projection angle (α) as shown in mathematical formula 2 below.

[0176] [Mathematical Formula 2]

[0177]

[0178] Finally, the electronic device (100) has a distance (d) calculated as described above. rot The size of the obstacle (d) in ) obs The final travel distance can be calculated by adding ). Accordingly, the electronic device (100) (d obs + d rot By moving by (-α) and rotating, it becomes possible to avoid obstacles while simultaneously projecting an image forward.

[0179] The electronic device (100) may be unable to move sufficiently due to spatial constraints. This situation will be explained with reference to FIG. 14. That is, FIG. 14 is a diagram illustrating the operation in a case where the electronic device (100) is unable to move sufficiently due to spatial constraints, or where the loss due to movement is greater than the gain obtained from frontal projection. For example, the additional movement distance is d rot d' is smaller, and the projection angle after rotation can be α' greater than 0. When the additional travel distance is set to d', the process of calculating a' can be calculated by the following mathematical formula 3.

[0180] [Mathematical Formula 3]

[0181]

[0182] The process of calculating d' when the projection angle is set to a' can also be calculated by the above mathematical formula 3.

[0183] Accordingly, the rotation angle and travel distance of the electronic device (100) may be as shown in Equation 4 below.

[0184] [Mathematical Formula 4]

[0185]

[0186] According to various embodiments of the present disclosure as described above, the electronic device (100) is able to project an image with optimal size and quality while avoiding obstacles. FIG. 15 is a drawing illustrating the results of image projection according to a conventional method and one embodiment of the present disclosure.

[0187] FIG. 15 is a drawing showing an image projected by an electronic device (100) onto an image projection surface having an obstacle (e.g., a curtain) in a conventional manner and in a manner according to various embodiments of the present disclosure.

[0188] In the case of projecting an image using the first conventional method, as shown in the first figure (1510) of FIG. 15, the image is projected onto the image projection surface and an obstacle, which interferes with the user's viewing. In the case of the second conventional method, where only the projection angle is rotated to project the image while avoiding obstacles, as shown in the second figure (1520) of FIG. 15, there is a limitation in that the screen size becomes smaller or the resolution is lower due to keystone correction. However, by simultaneously adjusting the projection angle and the distance traveled to avoid obstacles, an optimal projection screen can be provided as shown in the third figure (1530) of FIG. 15.

[0189] FIG. 16 is a flowchart illustrating an embodiment of identifying an optimal projection position and projecting an image according to various embodiments of the present disclosure.

[0190] The electronic device (100) can detect an event for projecting an image (S1610). The event for projecting an image may be an event where a user inputs a command to project an image, but is not limited to this and may be various events.

[0191] The electronic device (100) can identify an image projection surface for projecting an image (S1620). For example, the electronic device (100) can identify information about the location of the electronic device (100) and obstacles by scanning the area around the electronic device (100) through a sensor (121), and can identify an image projection surface based on the location of the electronic device (100), information about obstacles, and map data.

[0192] The electronic device (100) can identify the optimal projection position of the electronic device (100) among a plurality of candidate positions (S1630). For example, the electronic device (100) can identify the optimal projection position of the electronic device (100) based on the projection distance between the image projection surface and the electronic device (100), the projection angle at which the electronic device (100) projects an image onto the image projection surface, and the movement distance of the electronic device (100), in the manner described above.

[0193] The electronic device (100) can move to an optimal projection position (S1640). For example, the electronic device (100) can identify a driving path based on map data and an optimal projection position, and move to an optimal projection position according to the identified driving path.

[0194] The electronic device (100) can scan around the optimal projection position (S1650). For example, the electronic device (100) can scan around the optimal projection position through the sensor (121) to identify information about obstacles around the optimal projection position. The detected obstacles may be obstacles that were not detected by the sensor (121) at the previous position or moving obstacles (e.g., people, pets, robot vacuums, etc.), but are not limited thereto.

[0195] The electronic device (100) can identify whether there is an obstacle within the range for projecting an image onto an image projection surface (S1660). For example, the electronic device (100) can identify whether there is an obstacle within the image projection range or within the movement path for projecting an image.

[0196] If it is identified that there are no obstacles within the range for projecting an image onto an image projection surface, the electronic device (100) can project an image toward the image projection surface at an optimal projection position (S1670).

[0197] However, if it is identified that there is an obstacle within the range for projecting an image onto the image projection surface, the electronic device (100) may perform the operation S1620 again. For example, the electronic device (100) may re-search for one of a plurality of candidate locations around the optimal projection location based on the projection distance, projection angle, and travel distance on the optimal projection location.

[0198] Meanwhile, the method according to various embodiments of the present disclosure may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0199] A method according to various embodiments of the present disclosure may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., a TV) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions.

[0200] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, a 'non-transitory storage medium' may include a buffer in which data is stored temporarily.

[0201] When the above instruction is executed by a processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or an interpreter.

[0202] Although various embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure. Furthermore, it will be understood that any embodiment described in this specification may be used in combination with other embodiments.

Claims

1. In an electronic device, Sensor; A driving unit including a circuit; Memory for storing instructions; and at least one processor including a processing circuit; comprising, At least one processor executes the instructions collectively or individually, so that the electronic device, When an event corresponding to an image projection occurs, identify the projection surface corresponding to the image projection, and An electronic device that controls the driving unit to move to a projection position obtained based on the projection distance to the projection surface, the projection angle corresponding to image projection on the projection surface, and the distance traveled.

2. In Paragraph 1, At least one processor, collectively or individually, the electronic device, A score corresponding to a plurality of candidate locations is obtained based on the projection distance, projection angle, and movement distance for each of the plurality of candidate locations obtained based on the current location, and An electronic device that obtains a projection position based on the above-mentioned acquired score.

3. In Paragraph 2, At least one processor, collectively or individually, the electronic device, If the projection distance from the candidate position to the projection surface is within the first range, the highest first score is obtained with the score corresponding to the projection distance, and An electronic device that obtains a score corresponding to the projection distance lower than the first score when the projection distance from the above candidate position to the above projection surface becomes farther than the above first range.

4. In Paragraph 2, At least one processor, collectively or individually, the electronic device, If the projection angle corresponding to image projection from the candidate position to the projection plane is less than the first value, the second score, which is the highest score, is obtained with the score corresponding to the projection angle, and An electronic device that obtains a score corresponding to the projection angle that is lower than the second score when the projection angle corresponding to the image projection from the above candidate position to the above projection plane becomes greater than the first value.

5. In Paragraph 2, At least one processor, collectively or individually, the electronic device, If the distance traveled to the candidate location is less than the second value, the third score, which is the highest score, is obtained with the score corresponding to the distance traveled, and An electronic device that, when the distance traveled to the above candidate position becomes greater than the second value, obtains a score for the distance traveled that is lower than the third score.

6. In Paragraph 1, At least one processor, collectively or individually, the electronic device, An electronic device that, if an obstacle exists near the projection surface, obtains a projection angle to project the image onto the projection surface by avoiding the obstacle based on the current projection angle, the angle of view, the size of the obstacle, and the projection distance to the projection surface.

7. In Paragraph 1, At least one processor, collectively or individually, the electronic device, An electronic device that, if an obstacle exists near the projection surface, obtains a travel distance to project the image from the front of the projection surface by avoiding the obstacle based on the current projection angle, the field of view, the size of the obstacle, and the projection distance to the projection surface.

8. In Paragraph 1, At least one processor, collectively or individually, the electronic device, An electronic device that moves to the projection position and identifies whether there is an obstacle within the range for projecting an image onto the projection surface around the projection position.

9. In Paragraph 8, At least one processor, collectively or individually, the electronic device, If no obstacle exists within the above range, control to project an image onto the projection surface at the above projection position, and An electronic device that, if an obstacle exists within the above range, obtains one of a plurality of candidate positions around the projection position based on the projection distance, the projection angle, and the movement distance.

10. In Paragraph 1, It further includes a projection section; and At least one processor, collectively or individually, the electronic device, An electronic device that moves to the above projection position and then projects an image through the above projection unit.

11. In a method for controlling an electronic device, A step of identifying a projection plane corresponding to an image projection when an event corresponding to an image projection occurs; and A control method comprising the step of moving to a projection position obtained based on the projection distance to the projection surface, the projection angle corresponding to image projection on the projection surface, and the distance traveled.

12. In Paragraph 11, The above moving step is, A step of obtaining a score corresponding to a plurality of candidate locations based on the projection distance, the projection angle, and the movement distance for each of the plurality of candidate locations obtained based on the current location; and A control method comprising the step of obtaining a projection position based on the above-mentioned acquired score.

13. In Paragraph 12, The step of obtaining the above score is, If the projection distance from the candidate position to the projection surface is within the first range, the highest first score is obtained with the score corresponding to the projection distance, and A control method for obtaining a score corresponding to the projection distance that is lower than the first score when the projection distance from the above candidate position to the above projection surface is greater than the above first range.

14. In Paragraph 12, The step of obtaining the above score is, If the projection angle corresponding to image projection from the candidate position to the projection plane is less than the first value, the second score, which is the highest score, is obtained with the score corresponding to the projection angle, and A control method for obtaining a score corresponding to the projection angle that is lower than the second score when the projection angle corresponding to the image projection from the above candidate position to the above projection plane becomes greater than the first value.

15. In Paragraph 12, The step of obtaining the above score is, If the distance traveled to the candidate location is less than the second value, the third score, which is the highest score, is obtained with the score corresponding to the distance traveled, and A control method for obtaining a score for the distance traveled that is lower than the third score when the distance traveled to the above candidate position becomes greater than the second value.

Images