Electronic device and control method thereof

Abstract

This electronic device comprises: a projection device for projecting an image; a driving device for adjusting the projection direction of the projection device; memory for storing at least one instruction; and one or more processors connected to the projection device, the driving device, and the memory to control the electronic device, wherein the one or more processors control the projection device to project an image in a first direction, and control the driving device to project the image in a direction different from the first direction when a preset event occurs.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device capable of projecting an image by changing the projection direction of a projector and a control method thereof.

[0002] Projectors, projection systems, and other display devices display images by projecting input video signals onto a screen using light emitted from a light source (e.g., an LED or lamp). These display devices are primarily used for presentations in conference rooms, projectors in theaters, and home theaters.

[0003] These projectors include projection projectors, which are positioned at a distance from the projection surface and project the image in the direction of the projection surface, and ultra-short throw projectors, which are positioned adjacent to the projection surface and project the image.

[0004] An electronic device according to one embodiment includes a projection device for projecting an image, a driving device for adjusting a projection direction of the projection device, a memory for storing at least one instruction, and one or more processors connected to the projection device, the driving device, and the memory for controlling the electronic device, wherein the one or more processors control the projection device to project an image in a first direction, and when a preset event occurs, control the driving device to project an image in a direction different from the first direction.

[0005] The electronic device further includes a camera, and the one or more processors control the camera to photograph a space surrounding the electronic device, and based on the photographed surrounding space, the projection device can obtain a plurality of projection areas on which to project an image.

[0006] The one or more processors can obtain a first projection area for a space located above the electronic device and a second projection area for a space located on the floor.

[0007] The one or more processors can obtain a second projection area in a space having a preset size on a floor surface and located between a user and the electronic device.

[0008] The one or more processors can check a wall surface in the photographed surrounding space, and if there is no obstacle among the checked walls, check an area having a preset color to obtain one or more first projection areas.

[0009] The one or more processors can control the driving device to change the projection direction of the projection device from the first projection area to the second projection area when the need for interaction with the image is confirmed.

[0010] The one or more processors can use the image captured by the camera during projection of the image to the second projection area to identify a user-selected area among the projected images, and perform an event corresponding to the identified user-selected area.

[0011] The one or more processors can control the driving device and the projection device to select the first projection area or the second projection area based on at least one of the content type and playback time corresponding to the image, and to project the image onto the selected projection area.

[0012] The one or more processors may control the driving device and the projection device so that a user interface window for receiving user settings is projected onto the second projection area when at least one of the settings of the electronic device or the playback environment of the image requires user settings.

[0013] The one or more processors can use the image captured by the camera to determine the direction pointed by the user, and acquire a space corresponding to the determined direction as a projection area.

[0014] The electronic device further includes a microphone, and the one or more processors can recognize a user voice input through the microphone and control the driving device to change the projection area based on the user voice.

[0015] The electronic device further includes a camera, and the one or more processors can control the driving device to analyze the posture of the user based on the captured image when the user is captured through the camera, and to change the projection area based on the posture of the user.

[0016]

[0017] The electronic device further includes a camera and a mobile device for moving the electronic device, and the one or more processors can control the mobile device to allow the camera to photograph an environment surrounding the electronic device, obtain a projection area on which the image is to be projected using the photographed image, and control the mobile device to move the electronic device to a position corresponding to the projection area.

[0018] The one or more processors can control the projection device to display at least one of status information and driving direction information of the electronic device in a projection area corresponding to a moving direction of the electronic device while the electronic device is moving.

[0019] A method for controlling an electronic device according to an embodiment of the present disclosure includes the steps of acquiring a plurality of projection areas, projecting an image onto a first projection area among the plurality of projection areas, and changing a projection direction so that the image is projected onto a second projection area different from the first projection area when a preset event occurs.

[0020] The above-described acquiring step may acquire a first projection area for a space located above the electronic device and a second projection area for a space located on the floor.

[0021] The above-described acquiring step may include a step of, when a captured image is input by a user, confirming the direction pointed by the user in the input image, and acquiring a space corresponding to the confirmed direction as a first projection area.

[0022] The above changing step can change the projection direction of the projection device from the first projection area to the second projection area when the need for interaction with the image is confirmed.

[0023] The above-mentioned projecting step may select a first projection area on which to project an image from among a plurality of projection areas based on at least one of a content type corresponding to the image and a playback time, and project the image on the selected first projection area.

[0024] The present control method further includes a step of analyzing the input image to confirm at least one of the user's posture and the user's gaze when a captured image is input, and the changing step may change the projection direction so as to project the image on a second projection area corresponding to the confirmed user posture and the user's gaze among the plurality of projection areas.

[0025] A non-transitory computer-readable recording medium storing a program for executing a control method of an electronic device according to an embodiment of the present disclosure, the control method comprising the steps of: obtaining a plurality of projection areas; projecting an image onto a first projection area among the plurality of projection areas; and, when a preset event occurs, changing a projection direction so that the image is projected onto a second projection area different from the first projection area.

[0026] The above and other aspects, features, and advantages of the embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings. In the accompanying drawings:

[0027] FIG. 1 is a drawing for explaining the operation of an electronic device according to an embodiment of the present disclosure;

[0028] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure;

[0029] FIG. 3 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure;

[0030] FIG. 4 is a drawing for explaining the operation of a driving device according to an embodiment of the present disclosure;

[0031] FIG. 5 is a drawing for explaining an operation of determining a projection area according to one embodiment of the present disclosure;

[0032] FIG. 6 is a drawing for explaining an operation of determining a projection area according to one embodiment of the present disclosure;

[0033] FIG. 7 is a diagram illustrating an example of a determined projection area according to one embodiment of the present disclosure;

[0034] FIG. 8 is a drawing for explaining a keystone correction method according to an embodiment of the present disclosure;

[0035] FIG. 9 is a drawing for explaining an example of an operation of determining a projection area based on a user's gesture according to one embodiment of the present disclosure;

[0036] FIG. 10 is a drawing for explaining an example of an operation of determining a projection area based on a user's gesture according to one embodiment of the present disclosure;

[0037] FIG. 11 is a drawing for explaining an operation of changing a projection area based on a user's posture according to an embodiment of the present disclosure;

[0038] FIG. 12 is a drawing for explaining an operation of determining a projection area based on the type of content according to one embodiment of the present disclosure;

[0039] FIG. 13 is a diagram illustrating an example of a change in a projection area according to a transition of content according to an embodiment of the present disclosure;

[0040] FIG. 14 is a diagram illustrating an example of a screen displayed in a projection area according to one embodiment of the present disclosure;

[0041] FIG. 15 is a drawing showing an example of a screen displayed in a projection area according to one embodiment of the present disclosure;

[0042] FIG. 16 is a drawing showing an example of a screen displayed in a projection area according to one embodiment of the present disclosure;

[0043] FIG. 17 is a diagram illustrating an example of a screen for user interaction according to one embodiment of the present disclosure, and

[0044] FIG. 18 is a flowchart for explaining a control method of an electronic device according to an embodiment of the present disclosure.

[0045] The present embodiments may be modified and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0046] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0047] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0048] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0049] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0050] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to instances where (1) at least one A is included, (2) at least one B is included, or (3) at least one A and at least one B are included.

[0051] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0052] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0053] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0054] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0055] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0056] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0057] According to various embodiments, operations performed by a module, program or other component may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0058] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0059] Meanwhile, an electronic device according to various embodiments of the present disclosure may include, for example, at least one of a smartphone, a tablet PC, a desktop PC, a laptop PC, or a wearable device. The wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., an electronic garment), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0060] In some embodiments, the electronic device may include at least one of, for example, a television, a digital video disk (DVD) player, an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™), a game console (e.g., Xbox™, PlayStation™), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame. Meanwhile, among the above-described electronic devices, a device having a display may be referred to as a display device. Meanwhile, the electronic device of the present disclosure may be a set-top box or a PC that provides images to a display device even if it does not have a display.

[0061] Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that a person having ordinary knowledge in the technical field to which the present disclosure pertains can easily implement the present disclosure.

[0062] FIG. 1 is a drawing for explaining the operation of an electronic device according to an embodiment of the present disclosure.

[0063] Referring to FIG. 1, an electronic device (100) according to an embodiment of the present disclosure can project an image from a fixed location to multiple areas (or multiple directions). For example, the electronic device (100) can project an image to a first area (10) on a wall surface within a building, as illustrated, or can also project an image in a second direction (20) located on a floor surface within a building.

[0064] For such projection, the electronic device (100) includes a driving device for adjusting the projection direction, and can change the projection direction from the first direction (10) to the second direction (20) based on a user's operation or a preset event.

[0065] Here, the projection direction refers to the direction in which the image in the form of a projection is projected, and may also be referred to as the direction in which the electronic device is looking, the projection direction, or the projection direction. For ease of explanation, the projection direction is expressed as being changed below, but it can also be expressed as being changed in the projection area. In this case, the change in the projection area does not mean a change in the screen size while maintaining the center point of the projection area, but rather a case in which the center point of the projection area is changed.

[0066] Although the illustrated example illustrates and describes that the electronic device (100) can change the projection direction from only one location, if the electronic device (100) is a mobile device, i.e., capable of movement, it can project images from various locations in various directions. This embodiment will be described later with reference to FIG. 7.

[0067] Meanwhile, if an obstacle is located in the area where the image is projected, the user viewing the image may perceive discomfort with the projected image. In this regard, the electronic device (100) can identify areas within the surrounding environment where the user does not experience discomfort while viewing the image, and project the image onto those areas based on a preset algorithm or priority among the identified areas. A specific method for identifying the projection area is described below in FIGS. 5 to 10 .

[0068] Here, the projection area refers to an area such as a wall, floor, or ceiling where the image projected by the electronic device (100) is projected. It may include not only the area where the image is displayed, but also a gray area outside the image corresponding to the image. In addition, it is sufficient if it is an area where the user can view the projected image without interference, such as an area where a screen is installed, a furniture area, or a blind area, as well as an area such as a building wall.

[0069] Meanwhile, the electronic device (100) can change the projection direction in response to various events. For example, the projection direction may be changed at the user's request, in response to content corresponding to the displayed image, based on the user's posture or gaze, or based on the need for interaction. Detailed operations of each embodiment are described in FIGS. 5 to 17.

[0070] As described above, the electronic device (100) according to the present embodiment does not project an image in a fixed projection direction, but can project an image in various directions, thereby having the effect of being able to adaptively project an image to the usage environment.

[0071] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0072] Referring to FIG. 2, the electronic device (100) may include a memory (110), a projection device (120), a driving device (130), and a processor (140).

[0073] The memory (110) can store data required for various embodiments. Depending on the purpose of data storage, the memory (110) may be implemented in the form of memory embedded in the electronic device (100) or may be implemented in the form of memory that can be attached or detached to the electronic device (100).

[0074] For example, data for driving an electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory that can be attached or detached to the electronic device (100).

[0075] Meanwhile, in the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)).

[0076] In addition, in the case of a memory that can be attached or detached to an electronic device (100), it can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), an external memory that can be connected to a USB port (e.g., USB memory), etc.

[0077] The memory (110) may include various instructions necessary for the operation of the processor (140). Here, the instructions may include instructions for identifying a projection area in the surrounding environment where projection is possible, instructions for processing changes in the projection area, instructions for keystone correction, instructions for user voice recognition or voice processing, instructions for processing images, etc.

[0078] The projection device (120) projects an image. The projection device (120) can project an image onto a projection area using a light source such as a lamp or LED. For example, the projection device (120) can project light corresponding to the image via a lens and / or mirror. Accordingly, the projected light can be formed into an image on the projection area.

[0079] Such a projection device (120) may be a super short-focus projector, a projection-type projector, or a hybrid projector capable of switching between the super short-focus and projection-type methods. For example, in the case of a hybrid projector, a plurality of lenses (e.g., a lens for super short-focus, a lens for projection) may be provided within the projection device (120), and an image may be projected using a corresponding lens in response to a change in the projection method.

[0080] The projection device (120) can adjust the amount of light projected based on the distance between projection areas and the surrounding environment. For example, if the surrounding environment is bright, the projection device (120) can project an image with a high amount of light. Alternatively, if the surrounding environment is dark, the projection device (120) can project an image with a relatively low amount of light.

[0081] In addition, the projection device (120) can project an image with a high amount of light when the projection area and the electronic device (100) are close together and the projection device (120) operates in a short-focus manner. In addition, the projection device (120) can output an image with a low amount of light when the projection device (120) operates in a relatively long distance and the projection device (120) operates in a projection manner.

[0082] This operation is an example, and the amount of light can be calculated by considering the surrounding environment, distance, area of ​​the projection area, etc., and the projection device (120) can project an image based on the calculated amount of light.

[0083] The driving device (130) can adjust the projection direction of the projection device. Such a driving device (130) can be implemented in various ways. For example, as illustrated in FIG. 1, when the projection device (120) is fixed to the body of the electronic device (100), the driving device (130) can adjust the projection direction of the projection device (120) by adjusting the direction in which the body is facing.

[0084] The driving device (130) may adjust the projection direction of the projection device (120) by changing the direction of the mirror (or lens) within the projection device (120). Alternatively, both of the above-described methods may be employed. That is, the driving device (130) may be implemented in a form that performs a certain angle change by adjusting the direction of the body, and performs an additional angle change by adjusting the direction of the mirror (or lens).

[0085] Meanwhile, although the projection device (120) and the driving device (130) are depicted as separate components in the above, if the driving device (130) changes the projection direction by adjusting the direction of the mirror (or lens) within the projection device, they may be implemented as a single device. In addition, the driving device (130) may be configured to be combined with the moving device described later in relation to FIG. 3.

[0086] One or more processors (140) control the overall operation of the electronic device (100). Specifically, one or more processors (140) may be connected to each component of the electronic device (100) (e.g., the projection device (120), the driving device (130), the memory (1100)) to control the overall operation of the electronic device (100). For example, one or more processors (140) may be electrically connected to the projection device (120) and the memory (110) to control the overall operation of the electronic device (100). The processor (140) may be composed of one or more processors.

[0087] The processor (140) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an ARM processor, or may be defined by the relevant terminology.

[0088] In addition, the processor (140) may be implemented as a SoC (System on Chip), an LSI (Large Scale Integration) with a built-in processing algorithm, or may be implemented in the form of an FPGA (Field Programmable Gate Array). In addition, the processor (140) may perform various functions by executing computer executable instructions stored in memory. Meanwhile, the processor (140) may include multiple processors (e.g., CPU + GPU, CPU + DSP).

[0089] The processor (140) identifies a projection area. Specifically, the processor (140) can acquire information about the surrounding space and, based on the acquired information, identify a projection area where an image can be projected. This information about the surrounding space may be data (or images, videos) captured using a sensor (e.g., a camera or ToF sensor) built into the electronic device (100). Alternatively, it may be an image (or data) provided by another device (e.g., a user terminal device).

[0090] At this time, the processor (140) can acquire multiple projection areas rather than a single projection area. For example, the processor (140) can identify an obstacle-free space by selecting the walls, ceiling, and floor surfaces within the space as candidate areas. Furthermore, the processor (140) can select a space that is larger than a preset size and has obstacles and a color that does not affect video viewing, such as white, as a projection area.

[0091] At this time, the processor (140) can assign priorities to each projection area. At this time, priorities can be determined by space. For example, if three projection areas are confirmed for a wall surface and two projection areas are confirmed for a floor surface, the processor (140) can determine priorities within the three projection areas on the wall surface and determine priorities within the two projection areas on the floor surface.

[0092] The reason for determining different priorities for each space is that, for specific reasons, images may be projected onto walls or floors. Alternatively, implementation can prioritize the entire projection area and utilize the projection area with the highest priority among the required spaces (e.g., walls or floors).

[0093] While the above description only defines the projection area on the floor and walls, it is possible to determine the projection area on the ceiling as well. Furthermore, while the above description describes detecting the projection area when projection of an image is required, the operation of searching for the projection area for a specific space may have already been performed.

[0094] And the processor (140) detects the occurrence of a preset event. For example, the processor (140) can detect whether an event requiring a change in projection direction has occurred, such as receiving a control command (or voice command) from a user requesting a change in the projection area, or displaying content requiring user interaction.

[0095] And, when a preset event occurs, the processor (140) can control the driving device (130) to project an image in a direction different from the first direction. For example, when an event requiring a change in the projection direction occurs while projecting an image in the first direction (e.g., the first projection area), the processor (140) can control the driving device (130) to change the projection direction to the second direction.

[0096] Meanwhile, in FIG. 2, the electronic device (100) is illustrated and described as changing the projection direction of the projection device (120) using the driving device (130), but the electronic device (100) may also be implemented in a form in which it has a plurality of projection devices capable of projecting in different directions, and one of the plurality of projection devices performs the projection operation without using a separate driving device.

[0097] Meanwhile, although the area for the floor surface is described as being determined through spatial search in the above, the empty floor space between the user and the electronic device can be used as the second projection area without a separate search.

[0098] Although only a simple configuration of the electronic device (100) has been illustrated and described above, the electronic device (100) may also include other configurations in addition to the configuration described above. This will be described below with reference to FIG. 3.

[0099] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0100] The electronic device (100) may include a memory (110), a projection device (120), a driving device (130), a processor (140), a sensor (150), a moving device (160), a speaker (170), and a microphone (180).

[0101] The memory (110), projection device (120), driving device (130), and processor (140) have been previously described in FIG. 2. Hereinafter, descriptions of the same operations will be omitted and only the added operations will be described.

[0102] The sensor (150) is a sensor for recognizing the surrounding environment of the electronic device. For example, the sensor (150) may include a first camera (151), a second camera (153), and a ToF sensor (155).

[0103] The first camera (151) is positioned at the front of the electronic device (100) and can capture an image of an area located at the front of the electronic device (100). At this time, the first camera (151) is positioned adjacent to the projection device (120) and can capture an image in the same direction as the projection direction.

[0104] Accordingly, the image captured by the first camera (151) can be used to check whether the projection device (120) is normally projecting onto the projection area or to determine the projection area.

[0105] Additionally, the image captured by the first camera (151) can be used to detect the position or movement of an object (or person) within the projection area. For example, since the electronic device (100) projects an image with a high amount of light, if the user directly looks at the light projected by the projection device (120), it may affect their eyesight.

[0106] Accordingly, the processor (140) can detect whether a person is located within the projection area where the image is projected based on the image captured by the first camera (151) or the image or sensor value input from an additional sensor (e.g., a PIR sensor). If a person is detected in the projection area, the processor (140) can control the projection device (120) to stop the projection operation.

[0107] Additionally, the image captured by the first camera (151) can be used to confirm the driving or moving direction of the electronic device (100). Specifically, the processor (140) can check the presence of obstacles or obstacles within the moving direction in the image captured by the first camera (151), and can use this to control the operation of the mobile device.

[0108] The second camera (153) is located on the rear of the electronic device (100) and can capture images of an area located on the rear of the electronic device. At this time, the second camera (153) is located on the opposite side of the projection area of ​​the projection device (120) and can capture images of a user viewing the image.

[0109] Accordingly, the image captured by the second camera (153) can be used to analyze the user's posture and the user's line of sight. For example, when projecting an image on a wall, the processor (140) can analyze the image captured by the second camera (153) to determine whether the user's posture or line of sight is uncomfortable for looking at the projection area, and can change the projection area to match the current user's posture or line of sight. For example, when projecting an image on a wall, if the user's posture is lying down, the processor (140) can decide to switch to the projection area located on the ceiling. At this time, the processor (140) can change the projection area immediately in this situation, or can confirm with the user whether it is okay to make the change and then proceed with the change.

[0110] Additionally, the image captured by the second camera (153) can be used to determine whether a person, such as a user, approaches the area where the image is displayed. For example, the processor (140) can use the image captured by the second camera (153) to determine whether a person approaches the front, side, or projection area of ​​the electronic device (100). If such an approach is confirmed, the processor (140) can activate a risk detection operation (i.e., an operation for detecting the position or movement of an object (or person) within the projection area).

[0111] Additionally, the video captured by the first camera (151) or the video captured by the second camera (153) can also be used to detect the user's gesture. For example, if the user points to a specific area and utters a voice command such as "Display the video in that direction," the processor (140) can identify the direction the user is pointing through the video captured by the first camera (151) or the second camera (153) and set the area corresponding to the identified direction as the projection area. The corresponding operation is described in more detail in FIG. 9.

[0112] In addition, when a user's gesture for selecting a specific area (or pointing to a specific selected area among the areas where the image is projected) is captured by the first camera (151) or the second camera (153) while projecting an image that requires interaction, the processor (150) can recognize the user's gesture using the captured image and execute an event corresponding to the recognized gesture. For example, the above-described gesture may include a gesture for specifying a projection direction of the image, a gesture for specifying a projection area, a gesture for selecting a specific area within the projected image, etc.

[0113] The ToF sensor (155) is a three-dimensional sensor that recognizes the three-dimensionality or spatial information of an object by calculating the distance it takes for light emitted from an object via an infrared wavelength to bounce back. Using such a ToF sensor, the distance between walls and floors can be more accurately determined. The output signal from such a ToF sensor (155) can be used to determine the projection area. Meanwhile, the processor (140) can determine the projection area by comprehensively using signal values ​​(or images) provided from the first camera (151) and the ToF sensor (155).

[0114] Meanwhile, although the illustrated example includes multiple cameras, only one camera may be included in the implementation, and the ToF sensor may also be omitted. In addition to the above-described cameras and ToF sensors, various sensors may be additionally used, such as a distance sensor (e.g., radar (Radar, Radio Detection And Ranging), lidar (LiDAR, Light Detection and Ranging), IR sensor, ultrasonic sensor, etc.), depth camera, geomagnetic sensor), human body detection sensor, fall detection sensor, PIR (Pyro-electric InfraRed) sensor, gyro sensor for detecting angular velocity, encoder for determining the moving speed of the electronic device, etc. In addition, three or more cameras may be used instead of two cameras.

[0115] The moving device (160) is a component for moving the electronic device (100). To this end, the moving device (160) includes a motor, wheels, etc., and can move the electronic device (100) through the movement of the wheels. Meanwhile, during implementation, a catapult, etc. may be used instead of the wheels, and when the electronic device (100) is implemented as a drone, etc., a propeller may be used instead of the wheels.

[0116] In the process of determining the projection area, the processor (140) can control the moving device (160) to rotate or move the electronic device (100) so that the entire space around the electronic device (100) is scanned.

[0117] When the processor (140) determines to project an image on a specific projection area among a plurality of projection areas, the processor (140) can control the moving device (160) to position the electronic device (100) at the best or possible position for projecting an image on the determined projection area.

[0118] The processor (140) can control the moving device (160) to move the electronic device (100) not only for the reasons described above, but also when movement is required for various operations. For example, when the electronic device (100) can perform the function of a robot vacuum cleaner capable of performing cleaning, the processor (140) can determine a cleaning path and control the moving device (160) to move the electronic device (100) along the determined cleaning path.

[0119] And the processor (140) can control the projection device (120) and the driving device (130) to display an emoticon (or sign, symbol, image, thumbnail), etc. corresponding to the movement direction of the electronic device (100) in an area corresponding to the movement direction of the electronic device (100) while the electronic device (100) is moving.

[0120] The speaker (170) can output sound. Specifically, the speaker (170) may be a component that outputs various audio data corresponding to content, as well as various notification sounds or voice messages. In addition, the speaker (170) may also output result information corresponding to the voice recognition operation described below.

[0121] Meanwhile, in the above description, a speaker is mounted on the electronic device (100) and the electronic device (100) directly outputs sound. However, when implemented, the processor (150) may transmit the output sound information through communication with another adjacent speaker device (or an electronic device capable of sound output), thereby allowing the other speaker device to output sound.

[0122] Meanwhile, if the user sets the speaker (170) to mute, which stops its use, the processor (140) can deactivate the operation of the speaker (170). In addition, if a notification is required for the user in this mute state, the processor (140) can control the projection device (120) and the driving device (130) to display a message corresponding to the notification on the floor. In this case, the displayed user interface window may be a user interface window that simply displays information, or may be a user interface window that requires a user's selection, i.e., interaction.

[0123] If a user interface window requiring a user selection is displayed, the electronic device (100) can confirm the user's selection based on an image (or signal) input from a sensor (150). The processor (140) can then perform an event corresponding to the user's selection.

[0124] The microphone (180) can receive the user's voice when activated. For example, the microphone (180) can be formed integrally on the upper side, front side, side side, etc. of the electronic device (100). The microphone (180) can include various components such as a microphone that collects the user's voice in analog form, an amplifier circuit that amplifies the collected user's voice, an A / D conversion circuit that samples the amplified user's voice and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.

[0125] When a user's voice is input through this microphone (180), the processor (140) can confirm the content of the user's voice and perform an action corresponding to the content of the voice.

[0126] For example, when a voice command to change the projection direction is input through the above-described microphone (180), the processor (140) can control the driving device (130) to project an image in a projection direction corresponding to the input voice command. Meanwhile, if it is difficult to project in the projection direction requested by the user from the current location, the processor (140) can control the moving device (160) to move to a position where projection can be performed in the corresponding projection area.

[0127] Meanwhile, although the above description has been made as projecting an image corresponding to the content while viewing the content, the processor (140) can perform a projection operation to display specific information in various cases, not just the above-described cases. For example, when a user sets the electronic device (100) to silent mode, when it is necessary to notify that the battery of the electronic device (100) is below a certain level and needs to be charged, or that the volume is set to silent, the projection device (120) can be controlled to display information or a user interface window for receiving user selection input in various cases. Examples of various user interface windows that the electronic device (100) can display will be described below with reference to FIGS. 14 to 17.

[0128] Meanwhile, while FIG. 3 illustrates an electronic device including various additional components, some of the illustrated components may be implemented in an omitted form. Furthermore, although not illustrated, other components (e.g., a communication device for communicating with other devices, a suction device, etc.) may be further included.

[0129] FIG. 4 is a drawing for explaining the operation of a driving device according to one embodiment of the present disclosure.

[0130] Referring to FIG. 4, the electronic device (100) can project an image onto a wall located in front. For example, the driving device (130) can adjust the position of the body of the electronic device (100) so that the direction in which the lens (121) of the projection device (120) faces a predetermined projection area.

[0131] If it is necessary to change the projection direction to a floor surface rather than a wall surface, the driving device (130) can adjust the position of the body of the electronic device (100) so that the viewing direction of the lens (121) of the projection device (120) faces the floor direction.

[0132] Meanwhile, if the electronic device (100) is a hybrid projection device capable of changing the projection method, i.e., if switching between a short-focus method and a projection method is possible, the electronic device (100) can control the projection device (120) to operate in the projection method when projecting an image onto a wall. In addition, the electronic device (100) can control the projection device (120) to operate in the ultra-short-focus method when projecting an image onto a floor.

[0133] Meanwhile, in the illustrated example, an example of changing the projection direction of the projection device (120) by changing the direction of the body of the electronic device (100) is illustrated and described, but as described above, the projection direction of the projection device can also be changed by changing the direction of the lens or mirror within the projection device (120). In addition, the projection direction can also be changed by adjusting the direction in which the body of the electronic device (100) faces and the direction in which the mirror (or lens) faces together.

[0134] FIG. 5 is a drawing for explaining an operation of determining a projection area according to one embodiment of the present disclosure.

[0135] Referring to FIG. 5, when the operation of the electronic device (100) is initiated, a procedure for acquiring a projection area may be performed (510).

[0136] For example, if a voice call such as “Come here with the electronic device!” is made, the electronic device (100) can recognize the call through voice recognition and move around the user.

[0137] In this state, if the user gives a voice command such as “Show me content A!”, the electronic device (100) may proceed with a procedure to obtain a projection area to display content A.

[0138] Meanwhile, if it is necessary to display an image to the user before determining the projection area, the electronic device (100) may project the image on the floor between the user and the electronic device (100). For example, if it is necessary to display a guidance message asking whether it is okay to proceed with searching for the projection area, the electronic device (100) may display a guidance message on the floor.

[0139] And, when a confirmation command is input from a user, the electronic device (100) can proceed with a procedure for acquiring the projection area described above. Here, the confirmation command can be input by voice, or can be performed through a user interface window such as that illustrated in FIG. 17, which will be described later.

[0140] In addition, in cases other than the above-described cases, when only simple content (or guidance message) needs to be displayed, the electronic device (100) can display the necessary information (or content) on the floor surface without performing a scanning operation to obtain a projection area.

[0141] When the procedure for acquiring a projection area is performed, a scan of the space surrounding the electronic device (100) may be performed (511). For example, the space where the user is located may be scanned using a camera and / or a ToF sensor provided in the electronic device (100). Alternatively, the implementation may be implemented in a form where the user scans the space using his or her user terminal device, rather than a sensor provided in the electronic device (100), and the scanned information (e.g., an image) is provided to the electronic device (100).

[0142] Once the scan of the space surrounding the electronic device is complete, detection of a suitable space for image projection can be performed (S513). For example, the surrounding walls can be recognized, and areas of the wall free of obstacles and with a specific color, such as a plain pattern, can be detected. Additionally, areas within the area with an area greater than a certain size can be detected.

[0143] When an area where an image can be projected is detected by the above-described operation (515), the electronic device (100) moves to a position suitable for projection in the area and can display content in the area (520).

[0144] Meanwhile, although the illustrated example describes the operations of spatial scanning and optimal surface detection as separate operations, spatial scanning and optimal surface detection can be performed in parallel during implementation.

[0145] Furthermore, while FIG. 6 describes scanning a projection area in response to a user's content playback request, the detection of the projection area may have already been performed during implementation. For example, a user may have a history of projecting to a specific projection area in their room, and a history of scanning the room for that projection. In such a case, the electronic device (100) may store information about the space (e.g., room information) and information about the projection area available in the space.

[0146] In this way, when information about the projection area is stored, the electronic device (100) can proceed with only a procedure to check whether the pre-stored projection area is available in response to a user's content playback request, and then proceed with projection on the corresponding projection area.

[0147] Meanwhile, the operation in the case where a space satisfying the conditions described above cannot be found in the above-described process is described below with reference to FIG. 6.

[0148] FIG. 6 is a drawing for explaining an operation of determining a projection area according to one embodiment of the present disclosure.

[0149] First, the electronic device scans the space (610). The above-described operation has been previously described in FIG. 5, and a redundant description will be omitted.

[0150] If there is an area suitable for projecting an image within the space (620_Y), the electronic device can be moved to a position suitable for projecting an image in the determined projection area as described above (641).

[0151] And the electronic device (100) can adjust the projection direction to project on the corresponding area (643). And, keystone correction can be performed to display content on the corresponding projection area, and an image can be projected (645). A specific method of keystone correction is described with reference to FIG. 8. Meanwhile, if the electronic device (100) is a hybrid type projection device that can utilize both a single-focus method and a projection method, the light source can be switched to the projection method.

[0152] In addition, if there is a history of projection already performed on the above-described area, the electronic device (100) can store keystone correction result information on the above-described area and perform an image projection operation without a separate keystone correction operation using the pre-stored correction result information.

[0153] For such an operation, the electronic device (100) can store information on a projection area that can be projected for each space (i.e., coordinate information of the projection area, position information of the electronic device for projecting on the corresponding coordinates), and can store keystone correction information for each position.

[0154] If a suitable projection area cannot be found (620-N), the electronic device (100) decides to project the image onto the floor surface and can project the image onto the floor surface (630).

[0155] Specifically, the electronic device (100) can determine the user's location (631). For this operation, the electronic device (100) can search for the user's location using images captured by a camera, or search for the user's location based on the direction of the user's call input through multiple microphones.

[0156] The electronic device (100) can then move to a position adjacent to the user (633). At this time, the position may be in the front direction of the user, and may be a position where the distance between the user and the electronic device (100) is maintained at a preset distance. Specifically, as described below, in that an image will be projected into the space between the user and the electronic device, the electronic device can move to a position suitable for projecting an image into a specific space (i.e., projection area) in front of the user in the front direction of the user.

[0157] And the electronic device (100) can adjust the projection direction of the projection device so that an image can be projected onto the floor (635). For example, if the projection device is a hybrid type that can utilize both a single-focus method and a projection method, the light source can be switched to a single-focus method.

[0158] And the electronic device (100) can project an image onto the floor surface (637).

[0159] FIG. 7 is a drawing illustrating an example of a determined projection area according to one embodiment of the present disclosure.

[0160] Referring to FIG. 7, after scanning the space where the user is located, the electronic device (100) can determine a first projection area (710) on a wall located in front of the user. Specifically, a room space typically has four walls, and as illustrated, a space where a window or a door is located may not be suitable for projecting an image. Accordingly, the electronic device (100) can determine an area larger than a preset size among the wall spaces without obstacles, such as doors or windows, as the projection area.

[0161] And the electronic device (100) can determine a second projection area (720) in an area adjacent to the user among the floor surfaces. Meanwhile, in the illustrated example, the second projection area (720) is depicted as being located in the direction of the wall, but as described in FIG. 6, the second projection area may also be a space between the user and the electronic device (100).

[0162] Meanwhile, although the above illustrates that the electronic device (100) determines the projection area using a directly captured image, the electronic device (100) may also determine the projection area through linkage with another device.

[0163] For example, when a user takes a picture of his or her space with his or her smartphone, the electronic device (100) can receive and use information about the space. At this time, the electronic device (100) can receive and use a video (or image) from the user terminal device, or can receive and use coordinate values ​​provided from the user terminal device (i.e., the user terminal device determines the optimal projection area and notifies only the result of the determination).

[0164] Additionally, images captured by a robot vacuum cleaner, rather than a user terminal device, can be used. In this case, the electronic device (100) can also receive map information used by the robot vacuum cleaner.

[0165] Meanwhile, in the above, it is illustrated that the space is determined as a projection area on multiple walls, ceilings, etc. that make up a room, but even if it is not a wall, a flat surface with a preset size, such as an area where a screen is installed or the side of a piece of furniture with a flat surface, can be determined.

[0166] FIG. 8 is a drawing for explaining a keystone correction method according to one embodiment of the present disclosure.

[0167] Referring to Figure 8, there are four coordinate systems in image geometry: world coordinate system, camera coordinate system, normal coordinate system, and pixel coordinate system. Here, the world coordinate system and camera coordinate system are three-dimensional coordinate systems, and the normal coordinate system and pixel coordinate system are 2D coordinate systems.

[0168] The World Coordinate System (WCS) is a coordinate system used as a reference when expressing the position of an object. The World Coordinate System is a coordinate system that can be arbitrarily selected and used. For example, one corner of space can be taken as the origin, the direction toward one wall can be set as the X-axis, the direction toward the other wall can be set as the Y-axis, and the direction facing the sky can be set as the Z-axis. A point in the World Coordinate System can be expressed as P(X, Y, Z).

[0169] The camera coordinate system is a coordinate system based on the camera. The camera coordinate system takes the camera's focus (the center of the lens) as the origin, the camera's front optical axis direction as the Z-axis, the direction downwards from the camera as the Y-axis, and the direction to the right as the X-axis. A point in the camera coordinate system can be expressed as Pc(Xc, Yc, Zc).

[0170] The Pixel Image Coordinate System (PICS) is also known as the Image Coordinate System. The PCS is a coordinate system for images seen with the naked eye, with the upper left corner of the image as the origin, the right direction as the increasing x-axis, and the downward direction as the increasing y-axis. The plane determined by the x-axis and y-axis of the PCS is called the image plane.

[0171] Geometrically, a point P = (X, Y, Z) in 3D space is a point p on the image plane that passes through the focus of the camera (or the focus of the lens). img =(x,y) is projected onto point P and point p img All 3D points on the ray connecting p imgis projected onto . Therefore, from 3D point P to p img can be determined uniquely, but conversely, the image pixel p img Finding P from is impossible without additional information. The unit of the pixel coordinate system is pixel, and p img It can be expressed as =(x,y).

[0172] In this way, when the plane of a projection device that projects an image and the projection area where the image is projected are not perpendicular to each other, even if the projection device (120) projects a rectangular image, the image projected on the projection area may not be rectangular but may have a trapezoidal shape. Keystone correction is a method for correcting the image being displayed in a trapezoidal shape for the above-described reason, and can correct the projected image to have a shape opposite to the trapezoidal shape described above by using the calculation method for the above-described reason.

[0173] FIG. 9 is a drawing for explaining an example of an operation for determining a projection area based on a user's gesture according to one embodiment of the present disclosure.

[0174] Referring to Fig. 9, a user is pointing at a specific point (911) on a wall using his / her hand. The electronic device (100) can analyze the image captured by the camera to confirm the point (911) that the user is pointing at.

[0175] For example, when a user inputs a voice command such as “project there” and points to a specific area with his / her hand, the electronic device (100) controls the camera to capture an image to confirm the direction in which the user’s hand is pointing, and can use the captured image to confirm the point (911) that the user is pointing to.

[0176] The electronic device (100) can determine the area with the largest area centered on the identified point (911) as the projection area.

[0177] Meanwhile, in the illustrated example, the projection area is determined with the identified point as the center point, but if a point that is somewhat distant from the point can be used as a projection area with a larger area, the projection area may be determined with the distant point as the center point.

[0178] While the illustrated example shows the user pointing their hand at a wall, the above-described motion can also be performed on the floor when implemented. Furthermore, in this case, the direction pointed by the user's foot, rather than their hand, can be utilized.

[0179] FIG. 10 is a drawing for explaining an example of an operation for determining a projection area based on a user's gesture according to one embodiment of the present disclosure.

[0180] Referring to FIG. 10, when a user drags a specific space on a wall with a voice command such as “project to this space,” the electronic device (100) can check the direction in which the user’s hand moves and determine the space dragged by the user as a projection area.

[0181] Meanwhile, while the illustrated example describes determining the projection area based on the space the user drags, the implementation may not use the user's projection area as is, but rather modify it. For example, the center point of the space the user drags could be identified, and the area with the largest area centered around the identified center point could be determined as the projection area.

[0182] Meanwhile, in the above, a gesture in which a user drags a specific space to determine a projection area is illustrated and described. However, when implemented, in addition to the dragging method, if the user points two fingers at two specific spaces, the tips of the two fingers may be identified as the two ends of the projection area, and the space between the two fingers may be determined as the projection area.

[0183] FIG. 11 is a drawing for explaining an operation of changing a projection area based on a user's posture according to one embodiment of the present disclosure.

[0184] Referring to FIG. 11, the electronic device (100) can track the user's posture and gaze during projection of an image in a first projection direction (1110).

[0185] For example, a second camera (153) that captures the user's direction can be used to capture the image (1113) and confirm the user's posture and / or gaze (1111). If a change in the user's posture or gaze is detected as a result of the confirmation, the electronic device (100) can inquire of the user as to whether to proceed with a change in the projection direction (1115).

[0186] As a result of the inquiry, if the user confirms the change, the electronic device (100) can determine a projection area suitable for the current user's posture (1117).

[0187] The electronic device (100) can then perform projection onto the determined projection area (1120). For example, as illustrated, if a movement, such as a user lying down, is detected during the initial projection of the image onto the wall, the electronic device (100) can change the projection direction to the ceiling area and project the image through the aforementioned operation.

[0188] FIG. 12 is a diagram for explaining an operation of determining a projection area based on the type of content according to one embodiment of the present disclosure.

[0189] Referring to Figure 12, when a content playback command is received from a user (1205), the type of content selected by the user can be confirmed (1210). For example, the content can be checked to determine whether it is a movie-like type, its playback time, and whether it requires long-term viewing or only short-term viewing.

[0190] If the verification result determines that the content requires long-term viewing (1215), the projection area can be searched for on the wall space of the space where the user is located (1220). Alternatively, the projection area can be searched for on the ceiling space.

[0191] Meanwhile, if there is a history of exploration of the projection area for the space in question, a projection area located on a wall or ceiling among the projection areas detected in advance for the space in question can be selected.

[0192] And, the movement and projection direction adjustment of the electronic device (100) for performing projection on the searched projection area are performed (1225), and an image corresponding to the content can be projected on the searched projection area (1230).

[0193] If the verification result determines that the content requires short viewing (1240), the user's location can be confirmed and the floor around the user can be explored based on the user's location (1245).

[0194] And, the movement and projection direction adjustment of the electronic device (100) for performing projection on the searched projection area are performed (1250), and an image corresponding to the content can be projected on the searched projection area (1255).

[0195] FIG. 13 is a diagram illustrating an example of a change in a projection area due to a change in content according to an embodiment of the present disclosure.

[0196] Referring to Figure 13, it shows a case where a user is watching content such as a movie and then switches to a screen that requires user selection, such as the home screen of an electronic device or a web page.

[0197] For example, when displaying a screen (1311) related to content (1310), if the user changes the displayed content, the screen (1321) corresponding to the changed content may be switched (1320). Meanwhile, after the switch, the electronic device may project the screen (1331) onto a floor surface located near the user (1330) to facilitate the user's interaction with the changed content.

[0198] Meanwhile, in the illustrated example, the projection direction is changed after the content is changed, but it is also possible to change the projection direction in advance in response to the user's content change command during implementation and then switch the screen displayed thereafter.

[0199] FIG. 14 is a drawing illustrating an example of a screen displayed in a projection area according to one embodiment of the present disclosure.

[0200] Specifically, FIG. 14 is a diagram illustrating an example of displaying status information of an electronic device. Referring to FIG. 14, the first screen (1410) includes information indicating the sound status of the electronic device (100).

[0201] The second screen (1420) includes information indicating the battery status of the electronic device. This information may be displayed when the device is in silent mode and cannot output audible guidance messages, or simultaneously with the display of audible guidance messages.

[0202] Meanwhile, in the illustrated example, only one piece of information is displayed on one screen, but when implemented, it is possible to display multiple pieces of information (for example, battery status and volume status) on one screen.

[0203] In this way, various status information of the electronic device is projected and displayed on the electronic device, so that the user can more easily understand the status of the electronic device.

[0204] FIG. 15 is a drawing illustrating an example of a screen displayed in a projection area according to one embodiment of the present disclosure.

[0205] Specifically, FIG. 15 is a drawing showing an example of a screen indicating the direction of movement during movement of an electronic device.

[0206] The electronic device (100) displays the movement direction of the electronic device in an area corresponding to the front of the movement direction (or driving direction) while moving, so that the user can more intuitively check the movement pattern (or movement direction) of the electronic device.

[0207] As shown, when an electronic device has a circular or disk shape that makes it difficult to distinguish between the front and back, etc., it is difficult for a user to intuitively know the front or moving direction of the electronic device.

[0208] Accordingly, the electronic device of the present disclosure displays the driving direction as shown on the floor surface corresponding to the moving direction while moving, thereby allowing the user to more intuitively know the moving direction of the electronic device.

[0209] Meanwhile, although the illustrated example only shows the direction of movement, the expected arrival area can be displayed during implementation. For example, if the projection direction is being moved as described above, the electronic device can display a symbol (e.g., a symbol such as an x ​​or o) indicating the final arrival area, and the projection direction of the projection device can be adjusted to continuously maintain the corresponding arrival area during movement.

[0210] Such symbols may be referred to as emoticons, images, thumbnails, etc., and may also display information in the form of text rather than symbols.

[0211] FIG. 16 is a drawing illustrating an example of a screen displayed in a projection area according to one embodiment of the present disclosure.

[0212] Referring to FIG. 16, the electronic device (100) can display a screen (1610, 1620) containing various emoticons or images. In this way, the electronic device (100) can display various emotional elements to increase the sense of connection with the user.

[0213] Such display actions may be displayed based on the user's operations and actions, or may be displayed based on an algorithm provided by the manufacturer.

[0214] FIG. 17 is a diagram illustrating an example of a screen for user interaction according to one embodiment of the present disclosure.

[0215] Specifically, referring to FIG. 17, examples of various screens (1710, 1720, 1730) requiring user interaction are illustrated. For example, the screens illustrated in FIG. 17 are examples of screens that may be displayed when a user has set a silent mode, etc., but at a time when a user selection is required.

[0216] The first screen (1710) includes a first selection area and a second selection area. The user can select one of the two selection areas displayed on the screen. For example, if a power-off command is input by voice from the user, the electronic device (100) may display the first screen (1710) asking whether to proceed with the power-off. If "Yes" is selected on the first screen (1710), the image projection operation may be terminated.

[0217] Meanwhile, when implemented, the first screen (1710) may be displayed not only at the time of power-off but also at the time when various selections are required, and a screen may be displayed for selecting one of three or more selections, not just two selections.

[0218] The second screen (1720) also includes a first selection area and a second selection area. In the illustrated example, it also includes information about what each selection area relates to. In other words, the first screen includes multiple selection areas and information about what each selection area relates to.

[0219] The third screen (1730) includes a bar-shaped selection area. For example, the third screen may be displayed to receive user input for setting the volume of an electronic device. The user can check the current volume status of the electronic device through the displayed screen, and the user can set the volume using the bar-shaped selection area on the displayed screen.

[0220] Meanwhile, in the illustrated example, a screen related to volume adjustment is displayed, but when implemented, the above-described form can also be applied to settings such as screen brightness.

[0221] Meanwhile, the various screens illustrated in Fig. 17 can be displayed in a projection area located on the floor surface adjacent to the user. Since the screen is projected onto the area adjacent to the user, the user can interact with the screen without moving significantly.

[0222] Meanwhile, if the distance between the user and the electronic device is a certain distance, a cursor can be displayed on the screen described above, and the cursor can be moved relatively in response to the movement of a part of the user's body (e.g., the tip of a finger), thereby allowing a specific area on the screen to be selected.

[0223] FIG. 18 is a flowchart for explaining a control method of an electronic device according to an embodiment of the present disclosure.

[0224] Referring to FIG. 18, a projection area is acquired (S1810). For example, the electronic device may use an internal camera to capture a space surrounding the electronic device, and based on the captured surrounding space, acquire a projection area on which the projection device will project an image. At this time, the projection area may include a first projection area for a space located above the electronic device, and a second projection area for a space located on the floor. Here, the first projection area may be a wall or ceiling area in a space such as a room.

[0225] Additionally, the aforementioned projection area can be acquired through user interaction. For example, as described in FIG. 9 or FIG. 10 , if a user points to a specific space or makes a gesture designating a specific area within a specific space, the space corresponding to the gesture can be determined as the projection area.

[0226] An image is projected onto a first projection area among the acquired projection areas (S1820). For example, if there are multiple projection areas, priorities may be assigned to each projection area, and a projection area on which an image is to be projected may be determined based on the determined priorities. At this time, the electronic device may determine the projection area by considering the type of content corresponding to the image to be projected, the playback time, etc. For example, if a user selects playback of content such as a long-playing movie, an area among the multiple projection areas that the user is comfortable viewing may be determined as the first projection area.

[0227] And when a preset event occurs, the projection direction is changed so that the image is projected on a second projection area different from the first projection area (S1830). For example, when a screen requiring selection of a specific area is displayed during image display through the first projection area, such as a wall, or when a screen requiring control of settings or operations of the electronic device is displayed, the electronic device can change the projection direction of the projection device. Alternatively, the projection direction can be changed in the case of a user's voice command (e.g., a command to change the projection direction, a command to change content, and a case where interaction with the changed content is required).

[0228] Furthermore, while the aforementioned preset events can operate based on user voice commands, the electronic device can also actively change the projection direction. For example, the electronic device can detect the user's posture or gaze, identify a projection area more suitable for the identified posture and gaze, and then change the projection direction to the identified projection area. Meanwhile, when implementing the device, if a change in the projection area is necessary, the projection area can be changed immediately. Alternatively, the user can request a change and change the projection direction based on the result of the inquiry.

[0229] As described above, the electronic device according to the present disclosure can change the projection area in an appropriate projection direction in various situations, so that the user can view content more easily.

[0230] Meanwhile, the methods according to at least some of the various embodiments of the present disclosure described above may be implemented in the form of an application that can be installed on an existing electronic device.

[0231] Additionally, the methods according to at least some of the various embodiments of the present disclosure described above can be implemented with only a software upgrade or a hardware upgrade for an existing electronic device.

[0232] Additionally, the methods according to at least some of the various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic devices.

[0233] Meanwhile, according to one embodiment of the present disclosure, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The machine is a device that can call instructions stored from the storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the 'non-transitory storage medium' only means that it is a tangible device and does not include a signal (e.g., an electromagnetic wave), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is temporarily stored in the storage medium. No. For example, a 'non-transitory storage medium' may include a buffer in which data is temporarily stored. According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones).In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0234] Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device (e.g., an electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored in the storage medium and operating according to the called instructions.

[0235] When the above-described instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by utilizing other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0236] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, A projection device that projects images; A driving device for adjusting the projection direction of the above projector; memory for storing at least one instruction; and comprising one or more processors connected to the projection device, the driving device, and the memory to control the electronic device; One or more of the above processors, An electronic device that controls the projection device to project an image in a first direction, and controls the driving device to project an image in a direction different from the first direction when a preset event occurs.

2. In paragraph 1, Including cameras; One or more of the above processors, Controlling the camera to photograph the space surrounding the electronic device, An electronic device that obtains a plurality of projection areas on which the projection device will project an image based on the photographed surrounding space.

3. In paragraph 2, One or more of the above processors, An electronic device that obtains a first projection area for a space located above the electronic device and a second projection area for a space located on a floor surface.

4. In paragraph 3, One or more of the above processors, An electronic device having a preset size on a floor surface and obtaining a second projection area in a space having a preset size on a floor surface located between a user and the electronic device.

5. In paragraph 3, One or more of the above processors, Check the wall surface in the surrounding space photographed above, An electronic device that obtains one or more first projection areas by checking an area having a preset color if there is no obstacle among the identified wall surfaces.

6. In paragraph 3, One or more of the above processors, An electronic device that controls the driving device so that the projection direction of the projection device is changed from the first projection area to the second projection area when the need for interaction with the above image is confirmed.

7. In paragraph 5, One or more of the above processors, Using the image captured by the camera during the projection of the image to the second projection area, the user-selected area among the projected images is confirmed, An electronic device that performs an event corresponding to the user selection area identified above.

8. In paragraph 3, One or more of the above processors, An electronic device that selects the first projection area or the second projection area based on at least one of the content type and playback time corresponding to the image, and controls the driving device and the projection device to project the image onto the selected projection area.

9. In paragraph 3, One or more of the above processors, An electronic device that controls the driving device and the projection device so that a user interface window for receiving user settings is projected onto a second projection area when at least one of the settings of the electronic device or the playback environment of the image requires user settings.

10. In paragraph 2, One or more of the above processors, An electronic device that uses images captured by the above camera to identify the direction pointed by the user and acquires a space corresponding to the identified direction as a projection area.

11. In paragraph 1, Including Mike; One or more of the above processors, An electronic device that recognizes a user's voice input through the microphone and controls the driving device to change the projection area based on the user's voice.

12. In paragraph 1, Including cameras; One or more of the above processors, When a user is captured through the above camera, the user's posture is analyzed based on the captured image, An electronic device that controls the driving device to change the projection area based on the posture of the user.

13. In paragraph 1, camera; and Further comprising a moving device for moving the electronic device; One or more of the above processors, Controlling the mobile device so that the camera photographs the environment surrounding the electronic device; Using the above-described captured image, a projection area on which the image will be projected is obtained, An electronic device that controls the moving device so that the electronic device moves to a position corresponding to the projection area.

14. In a method for controlling an electronic device, Step of obtaining multiple projection areas; A step of projecting an image onto a first projection area among the plurality of projection areas; and A control method comprising: a step of changing the projection direction so that an image is projected on a second projection area different from the first projection area when a preset event occurs; 15. In a non-transitory computer-readable recording medium storing a program for executing a method of controlling an electronic device, The above control method is, Step of obtaining multiple projection areas; A step of projecting an image onto a first projection area among the plurality of projection areas; and A computer-readable recording medium comprising: a step of changing the projection direction so that an image is projected on a second projection area different from the first projection area when a preset event occurs;

Images