Electronic device and method for controlling same

Abstract

This electronic device comprises: a sensor; a projection device that projects a projection image; a moving device that includes at least one actuator and moves the electronic device; a memory that stores at least one instruction; and at least one processor that executes the at least one instruction, wherein the instructions, when executed by the at least one processor, may instruct the electronic device to: obtain location information and direction information of a user on the basis of a sensed value of the sensor; identify a projection area on the basis of the location information and the direction information; identify an image projection position of the electronic device on the basis of an image projection distance and an image projection angle with respect to the projection area; and control the moving device to move to the image projection position.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device for projecting an image by identifying a more specific image projection position and a control method thereof.

[0002] A projector is an electronic device that displays images by projecting the input image signal onto a screen using light emitted from a light source (e.g., a light-emitting diode (LED) or lamp).

[0003] Recently, mobile projectors have become commercially available, allowing users to project images onto their desired projection area by positioning the projector in the optimal projection position and then projecting the image.

[0004] An electronic device according to at least one embodiment of the present disclosure includes a sensor, a projection device for projecting a projection image, at least one actuator, a moving device for moving the electronic device, a memory for storing at least one instruction, and at least one processor for executing the at least one instruction, wherein when executed by at least one processor, the at least one instruction causes the electronic device to obtain location information and direction information of a user based on a sensing value of the sensor, identify a projection area based on the location information and the direction information, identify an image projection position of the electronic device based on an image projection distance and an image projection angle with respect to the projection area, and control the moving device to move to the image projection position.

[0005] The memory stores information about the space around the user, and when executed by the at least one processor, the at least one instruction may cause the electronic device to generate a cost map including a plurality of costs and a plurality of grids corresponding to each of the plurality of costs based on the information about the image projection distance, the image projection angle, and the space around the user, and to identify, among the plurality of grids, a location corresponding to a grid including the smallest cost among the plurality of costs as the image projection location.

[0006] The electronic device according to claim 1, wherein when executed by the at least one processor, the at least one instruction causes the electronic device to generate a first layer including a first cost that decreases from a grid among the plurality of grids including a first difference between the image projection distance and a preset distance to a grid among the plurality of grids including a second difference between the image projection distance and the preset distance, generate a second layer including a second cost that decreases from a grid among the plurality of grids including a third difference between the angles between the image projection angle and the preset angle to a grid among the plurality of grids including a fourth difference between the image projection angle and the preset angle, and generate the cost map by assigning weights to each of the first layer and the second layer, wherein the second difference is greater than the first difference, and the fourth difference is greater than the third difference.

[0007] The memory stores preferred location information corresponding to the user's status, and when executed by the at least one processor, the at least one instruction may cause the electronic device to obtain the user's status information based on the sensing value of the sensor, identify a plurality of candidate locations where the image projection angle for the projection area is within a preset angle range and the image projection distance is within a preset distance range, and identify the image projection location among the plurality of candidate locations based on the user's status information and the preferred location information.

[0008] The sensor comprises a camera, and the at least one instruction, when executed by the at least one processor, causes the electronic device to control the moving device to move to the image projection location when the user's feedback regarding movement to the image projection location is obtained through the camera.

[0009] When executed by the at least one processor, the at least one instruction may cause the electronic device to, when the image projection position is changed, compare the image quality of the projected image at the position before the change with the image quality of the projected image at the position after the change to provide information about the change in the image quality of the projected image.

[0010] The electronic device further comprises a microphone, and the at least one instruction, when executed by the at least one processor, may cause the electronic device to control the moving device to move to the image projection location when feedback from the user regarding movement to the image projection location is obtained through the microphone.

[0011] When executed by the at least one processor, the at least one instruction may cause the electronic device to, when negative feedback from the user regarding movement to the image projection position is obtained, update the plurality of costs of the cost map, identify a smallest cost among the plurality of costs included in the updated cost map, and change the image projection position to a position corresponding to a grid including the smallest cost in the updated cost map.

[0012] When executed by at least one processor, the at least one instruction enables the electronic device to identify the projection area based on the type and playback time of content corresponding to the projection image.

[0013] The sensor includes a camera, and when executed by the at least one processor, the at least one instruction causes the electronic device to control the camera to photograph a surrounding space of the user, and to obtain information about a plurality of projectible areas within the surrounding space based on the photographed surrounding space.

[0014] A method for controlling an electronic device according to at least one embodiment of the present disclosure comprises the steps of: obtaining location information and direction information of a user based on a sensing value of a sensor; identifying a projection area based on the location information and the direction information; identifying an image projection position of the electronic device based on an image projection distance and an image projection angle with respect to the projection area; and moving to the image projection position.

[0015] The step of identifying the image projection position may include the step of generating a cost map including a plurality of cost points and a plurality of grids corresponding to each of the plurality of cost points based on information about the image projection distance, the image projection angle, and the space around the user, and the step of identifying a position corresponding to a grid including the smallest cost among the plurality of cost points as the image projection position among the plurality of grids.

[0016] The step of generating the cost map includes the steps of generating a first layer including a first cost that decreases from a grid including a first difference between the image projection distance and a preset distance among the plurality of grids to a grid including a second difference between the image projection distance and the preset distance among the plurality of grids, generating a second layer including a second cost that decreases from a grid including a third difference between the angle between the image projection angle and the preset angle among the plurality of grids to a grid including a fourth difference between the image projection angle and the preset angle among the plurality of grids, and generating the cost map by assigning weights to each of the first layer and the second layer, wherein the second difference is greater than the first difference, and the fourth difference is greater than the third difference.

[0017] The step of identifying the image projection position may include a step of obtaining status information of the user based on a sensing value of the sensor, a step of identifying a plurality of candidate positions in which the image projection angle for the projection area is within a preset angle range and the image projection distance is within a preset distance range, and a step of identifying the image projection position based on the status information of the user and preferred location information corresponding to the status of the user.

[0018] A non-transitory computer-readable recording medium storing computer instructions that, when executed by a processor of an electronic device according to at least one embodiment of the present disclosure, cause the electronic device to perform an operation, the operation includes a step of obtaining location information and direction information of a user based on a sensing value of a sensor, a step of identifying a projection area based on the location information and the direction information, a step of identifying an image projection position of the electronic device based on an image projection distance and an image projection angle with respect to the projection area, and a step of moving to the image projection position.

[0019] FIG. 1 is a diagram illustrating the operation of an electronic device according to one or more embodiments of the present disclosure.

[0020] FIG. 2 is a drawing for explaining the configuration of an electronic device according to one or more embodiments of the present disclosure.

[0021] FIG. 3 is a block diagram illustrating a configuration of an electronic device according to one or more embodiments of the present disclosure.

[0022] FIG. 4A and FIG. 4B are diagrams for explaining a method for identifying an image projection area of ​​an electronic device according to one or more embodiments of the present disclosure.

[0023] FIG. 5 is a diagram illustrating a method for generating a cost map of an electronic device according to one or more embodiments of the present disclosure.

[0024] FIG. 6 is a diagram illustrating a method for generating a cost map based on multiple layers of an electronic device according to one or more embodiments of the present disclosure.

[0025] FIG. 7A is a diagram illustrating an operation method based on feedback from a user of an electronic device according to one or more embodiments of the present disclosure.

[0026] FIG. 7b is a diagram illustrating an operation method based on feedback from a user of an electronic device according to one or more embodiments of the present disclosure.

[0027] FIG. 8A is a diagram illustrating a method for providing information on a change in image quality of an electronic device according to one or more embodiments of the present disclosure.

[0028] FIG. 8b is a diagram illustrating a method for providing information on a change in image quality of an electronic device according to one or more embodiments of the present disclosure.

[0029] FIG. 9 is a flowchart illustrating a method of moving an electronic device to an image projection position according to one or more embodiments of the present disclosure.

[0030] FIG. 10 is a flowchart illustrating a method for identifying an image projection position of an electronic device according to one or more embodiments of the present disclosure.

[0031] FIG. 11 is a flowchart illustrating an operation for user feedback of an electronic device according to one or more embodiments of the present disclosure.

[0032] The present embodiments may be modified and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0033] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0034] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0035] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0036] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0037] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to instances where (1) at least one A is included, (2) at least one B is included, or (3) at least one A and at least one B are included.

[0038] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0039] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0040] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0041] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0042] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0043] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0044] According to various embodiments, operations performed by a module, program or other component may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0045] The various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacings drawn in the attached drawings.

[0046] An electronic device according to various embodiments of the present disclosure may include, for example, at least one of a smartphone, a tablet PC, a desktop PC, a laptop PC, or a wearable device. The wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., an electronic garment), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0047] In some embodiments, the electronic device may include at least one of, for example, a television, a digital video disk (DVD) player, an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™), a game console (e.g., Xbox™, PlayStation™), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame. Meanwhile, among the above-described electronic devices, a device having a display may be referred to as a display device. Meanwhile, the electronic device of the present disclosure may be a set-top box or a PC that provides images to a display device even if it does not have a display.

[0048] Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that a person having ordinary knowledge in the technical field to which the present disclosure pertains can easily implement the present disclosure.

[0049] FIG. 1 is a diagram illustrating the operation of an electronic device according to one or more embodiments of the present disclosure.

[0050] According to FIG. 1, the electronic device (100) can identify a projection area (210, 220) based on the user's location information and direction information.

[0051] Here, "user location information" refers to various pieces of information regarding the user's location identified by the electronic device (100). For example, the user's location information may include two-dimensional or three-dimensional coordinate values. In this case, the user's location information may be expressed as specific coordinate values ​​in a two-dimensional or three-dimensional coordinate system with an arbitrary point within the building as the origin.

[0052] Here, "user orientation information" refers to various pieces of information regarding the user's orientation identified by the electronic device (100). For example, the user's orientation information may include angular information regarding the orientation of the user's body, including the user's upper body or face. In this case, the user's orientation information may be determined as the angle at which the user's body orientation is rotated around an arbitrary axis. In another example, the user's orientation information may also include vector information regarding the user's body orientation.

[0053] According to one embodiment, if the user's location information corresponds to information that the user is located opposite the wall, and the user's direction information corresponds to the direction of the wall, the electronic device (100) can identify the first projection area (210) as the projection area.

[0054] According to another embodiment, if the user's location information corresponds to information that the user is located opposite the wall and the user's direction information corresponds to the floor direction, the electronic device (100) can identify the second projection area (220) as the projection area.

[0055] The electronic device (100) of the present disclosure can store information on a plurality of projectible areas existing within a space. Here, the "projectible area" refers to an area on which the electronic device (100) can project an image. For example, the projectible area may include a wall, a floor, or a ceiling existing within the space. According to another example, the projectible area may include an area where a screen is installed, a furniture area, a blind area, or the like, which can provide a user with an uninterrupted image. In addition, the "information on a plurality of projectible areas" may include information on the location of each of the plurality of projectible areas, the flatness of each of the plurality of projectible areas, the color of each of the plurality of projectible areas, etc.

[0056] The electronic device (100) of the present disclosure can capture images of the user's surrounding space to obtain information on multiple projectable areas. Specifically, if the electronic device (100) includes a camera, the camera can be controlled to capture images of the user's surrounding space, and information on multiple projectable areas within the surrounding space can be obtained based on the captured images.

[0057] According to one embodiment, when an image output command is obtained from a user, the electronic device (100) may identify a projection area based on information on a plurality of projectible areas pre-stored in the electronic device (100), the user's location information, and the user's direction information. According to another embodiment, when an image output command is obtained from a user, the electronic device (100) may scan the space around the user to obtain information on a plurality of projectible areas, and then identify the projection area.

[0058] Although Figure 1 depicts the projection area in the form of a rectangle, this is only one example, and the projection area can of course be implemented in various shapes such as a circle, a parallelogram, or a rhombus.

[0059] Although the above description only explains that information on multiple projectible areas can be acquired using a camera, this is only one example, and it is of course possible to acquire information on multiple projectible areas based on various sensors such as a lidar (light detection and ranging) sensor and a ToF (time of flight) sensor. In addition, the electronic device (100) can also acquire information on multiple projectible areas from an external electronic device such as a robot vacuum cleaner, a robot, etc.

[0060] As described above, the electronic device (100) determines the optimal projection area based on the user's position, direction, etc., thereby reducing the inconvenience of the user having to change his or her position or direction to view the image. In addition, the electronic device (100) may determine the optimal image projection area based on information about a plurality of projectible areas, thereby providing the user with a high-quality image. In the description of FIGS. 2 and 3 described below, the operation of the electronic device (100) will be specifically described along with a description of the configuration of the electronic device (100).

[0061] FIG. 2 is a drawing for explaining the configuration of an electronic device according to one or more embodiments of the present disclosure.

[0062] According to FIG. 2, an electronic device (100) of a movable form is illustrated. The illustrated form is merely an example, and may have a different shape than the illustrated form.

[0063] The electronic device (100) may include a projection device (120) on the front. As shown in FIG. 2, the projection device (120) is positioned on the front of the electronic device (100), but this is only one example, and the projection device (120) may be positioned in various locations, such as the rear or top of the electronic device (100).

[0064] As illustrated in FIG. 2, the projection device (120) is a projector type that projects and displays an image. Accordingly, the electronic device (100) can project an image onto a projection area to provide the image to the user.

[0065] Hereinafter, the description is made assuming that the projection device (120) projects an image in a projector format. However, when implemented, the projection device (120) may be implemented as a configuration (e.g., LCD, OLED, micro LED, etc.) that displays an image on a specific surface of the electronic device rather than in a projector format. Meanwhile, in the illustrated example, one projection device (120) is depicted as being arranged on the front of the electronic device (100). However, when implemented, the electronic device (100) may have multiple projection devices arranged on it.

[0066] The electronic device (100) may include a moving device (130) at the lower end. The moving device (130) is a component for moving the electronic device (100). To this end, the moving device (130) includes an actuator such as a motor, wheels, etc., and can move the electronic device (100) through the movement of the wheels. The moving device (130) may be implemented in various forms, and examples of how the moving device (130) may be implemented in various forms will be described in detail in the description of FIG. 3 described below.

[0067] The form of the electronic device illustrated is merely an example and may be implemented in various forms. The specific configuration of the electronic device (100) will be described later with reference to FIG. 3.

[0068] FIG. 3 is a block diagram illustrating a configuration of an electronic device according to one or more embodiments of the present disclosure.

[0069] According to FIG. 3, the electronic device (100) may include a sensor (110), a projection device (120), a moving device (130), a memory (140), and at least one processor (150).

[0070] The sensor (110) can detect the user and the user's surrounding space. For example, the sensor (110) may include a camera, a ToF sensor, a lidar sensor, etc.

[0071] According to one embodiment, when the sensor (110) includes a camera, at least one processor (150) can control the camera to capture an image of a space. Based on the image of the space acquired through the camera, at least one processor (150) can acquire information such as the user's location information, direction information, information regarding a plurality of projectible areas existing in the space, and information regarding various objects such as obstacles existing in the space.

[0072] According to one embodiment, when the sensor (110) includes a ToF sensor, at least one processor (150) can control the ToF sensor to obtain distance information about space and various objects. Based on the distance information obtained through the ToF sensor, the at least one processor (150) can obtain information about the user's location, direction information, information about a plurality of projectible areas existing in space, information about various objects such as obstacles existing in space, etc.

[0073] According to one embodiment, when the sensor (110) includes a lidar sensor, at least one processor (150) can control the lidar sensor to obtain distance information about space and various objects. Based on the distance information obtained through the lidar sensor, the at least one processor (150) can obtain information about the user's location, direction information, information about a plurality of projectible areas existing in space, information about various objects such as obstacles existing in space, etc.

[0074] In the above description, only the case where the sensor (110) includes a camera, a ToF sensor, and a lidar sensor is described, but it is of course possible for the sensor (110) to include all of the camera, the ToF sensor, and the lidar sensor, or at least one of the camera, the ToF sensor, and the lidar sensor.

[0075] The projection device (120) is a device for projecting an image. The projection device (120) can project an image onto a projection area using a light source such as a lamp or LED. For example, the projection device (120) can project light corresponding to the image via a lens and / or mirror. Accordingly, the projected light can be formed into an image on the projection area.

[0076] Such a projection device (120) may be a super short-focus projector, a projection-type projector, or a hybrid projector capable of switching between the super short-focus and projection-type methods. For example, in the case of a hybrid projector, a plurality of lenses (e.g., a lens for super short-focus, a lens for projection) may be provided within the projection device (120), and an image may be projected using a corresponding lens in response to a change in the projection method.

[0077] The projection device (120) can adjust the amount of light projected based on the distance between projection areas and the surrounding environment. For example, if the surrounding environment is bright, the projection device (120) can project an image with a high amount of light. Alternatively, if the surrounding environment is dark, the projection device (120) can project an image with a relatively low amount of light.

[0078] In addition, the projection device (120) can project an image with a high amount of light when the projection area and the electronic device (100) are close together and the projection device (120) operates in a short-focus manner. In addition, the projection device (120) can output an image with a low amount of light when the projection device (120) operates in a relatively long distance and the projection device (120) operates in a projection manner.

[0079] This operation is an example, and the amount of light can be calculated by considering the surrounding environment, distance, area of ​​the projection area, etc., and the projection device (120) can project an image based on the calculated amount of light.

[0080] The moving device (130) is a configuration for moving the electronic device (100).

[0081] As shown in FIG. 2, the moving device (130) is depicted as a wheel, but it may be implemented in the form of a cat filter, and when the electronic device (100) is implemented as a drone or the like, the moving device (130) may also be implemented as a propeller or the like.

[0082] Although the illustrated example shows the electronic device (100) as having a direct moving device (130), the moving device (130) may be a separate device. For example, the electronic device (100) may be combined with a moving device such as a robot vacuum cleaner, and may be mounted on the robot vacuum cleaner to control the movement of the robot vacuum cleaner and operate.

[0083] Meanwhile, the moving device (130) can adjust the projection direction of the electronic device (100). For example, the direction in which the projection device (120) looks can be adjusted by adjusting the body position of the electronic device (100) as shown in FIG. 2, or the projection shape can be adjusted by adjusting the position of the lens or mirror within the projection device (120).

[0084] Here, the projection direction refers to the direction in which the image in the form of a projection is projected, and may also be referred to as the direction in which the electronic device (100) is facing, the projection direction, the projection direction, etc. In the following, for the sake of ease of explanation, the projection direction is expressed as being changed, but it may also be expressed as being changed in the projection area. In this case, the change in the projection area does not mean a change in the screen size while maintaining the center point of the projection area, but rather a case in which the center point of the projection area is changed.

[0085] The memory (140) can store data necessary for implementing various embodiments of the electronic device (100) according to one or more embodiments of the present disclosure. Depending on the purpose of data storage, the memory (140) may be implemented in the form of memory embedded in the electronic device (100) or may be implemented in the form of memory that can be attached or detached to the electronic device (100).

[0086] For example, data for driving an electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory that can be attached or detached to the electronic device (100).

[0087] Meanwhile, in the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)).

[0088] In addition, in the case of a memory that can be attached or detached to an electronic device (100), it can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), an external memory that can be connected to a USB port (e.g., USB memory), etc.

[0089] The memory (140) can store various instructions necessary for the operation of at least one processor (150). Here, the instructions may include instructions for identifying a projection area in the surrounding environment where projection is possible, instructions for processing changes in the projection area, instructions for keystone correction, instructions for user voice recognition or voice processing, instructions for projecting an image, etc.

[0090] The memory (140) can store map information. Here, the map information is information about the space where the electronic device (100) is located, and may be information about a space divided into multiple areas. For example, if the electronic device (100) is located in a home, the map information may be generated based on a floor plan of the home. This map information may be generated directly by the electronic device (100), or may be received and utilized as generated by another electronic device (e.g., a robot vacuum cleaner).

[0091] The memory (140) can store information on a plurality of projectible areas, and the memory (140) can store information on changes in image quality according to changes in the image projection distance and image projection angle.

[0092] In the present disclosure, the term “image projection distance” may refer to the distance from a projection device (120) to a projection area. For example, the image projection distance may include the distance from the position of a light source included in the projection device (120) to the center point of the projection area.

[0093] In the present disclosure, the term "image projection angle" may refer to the angle formed by a straight line connecting the projection device (120) to the center point of the projection area and the projection area (projection surface). For example, if the projection area is a plane, the angle may include the angle formed by a straight line connecting the position of a light source included in the projection device (120) to the center point of the projection area and the plane including the projection area.

[0094] In one embodiment, it is assumed that the projection device (120) is a projection-type projector. In this case, if the image projection distance is very large, the image may become blurry. Furthermore, if the image projection angle is close to 0 degrees, the probability of distortion in the projected image may increase. In such a case, the projection device (120) cannot help but provide an image with a relatively low image quality.

[0095] Accordingly, the electronic device (100) can store information on changes in image quality according to changes in the image projection distance and image projection angle in the memory (140) in order to provide a high-quality image to the user. In this case, the electronic device (100) can store the image quality in the memory (140) by digitizing the value from 0 to 100. For example, when the image projection distance is 3 m, the information that the image quality value is 50, and when the image projection distance is 5 m, the information that the image quality value is 70, can be stored in the memory (140). As another example, when the image projection angle is 10 degrees, the information that the image quality value is 10, and when the image projection angle is 70 degrees, the information that the image quality value is 50, can be stored in the memory (140).

[0096] The above description only explains that the image quality value can be quantified as a value from 0 to 100. However, it is of course true that the image quality value can be calculated as a value in a variety of ranges, such as a value from 0 to 100 or a value from 0 to 1, based on the average brightness value of the image, the contrast value, the variance of the brightness value of the image, the standard deviation of the brightness value of the image, and the resolution.

[0097] In the above description, only the case where the projection device (120) is a projection-type projector has been described, but even if the projection device (120) is an ultra-short-focus type projector or a hybrid type projector, information on changes in image quality according to changes in image projection distance and image projection angle can be stored.

[0098] At least one processor (150) controls the overall operation of the electronic device (100) by executing at least one instruction stored in the memory (140). Specifically, at least one processor (150) may be connected to each component of the electronic device (100) (e.g., the projection device (120), the moving device (130), and the memory (140)) to control the overall operation of the electronic device (100). For example, at least one processor (150) may be electrically connected to the projection device (120) and the memory (140) to control the overall operation of the electronic device (100).

[0099] At least one processor (150) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an ARM processor, or may be defined by the terms thereof.

[0100] In addition, at least one processor (150) may be implemented as a SoC (System on Chip), LSI (Large Scale Integration) having a built-in processing algorithm, or may be implemented in the form of an FPGA (Field Programmable Gate Array). In addition, at least one processor (150) may perform various functions by executing computer executable instructions stored in a memory. Meanwhile, at least one processor (150) may include multiple processors (e.g., CPU + GPU, CPU + DSP). Hereinafter, for the convenience of explanation, at least one processor (150) will be collectively referred to as a processor (150).

[0101] The processor (150) can obtain location information and direction information of the user based on the sensing values ​​of the sensor (110). For example, if the sensor (110) includes a camera and a lidar sensor, the processor (150) can detect the location and direction of the user based on the sensing values ​​of the camera and the lidar sensor.

[0102] The processor (150) can identify a projection area based on the user's location information and the user's direction information. As described above, the memory (140) stores information on a plurality of projectible areas, and the processor (150) can identify one projectible area among the plurality of projectible areas based on the user's location information and direction information.

[0103] According to another embodiment, the processor (150) may identify the projection area based on the type of content corresponding to the image and the playback time. Specifically, when the processor (150) receives an image output command from the user, the processor (150) may identify the type of content corresponding to the image selected by the user, the playback time, etc. For example, the processor may identify whether the content is a sports game, a movie, a cooking video, etc., and may determine whether the content requires long-term viewing or only short-term viewing by checking whether the content has a playback time of 10 minutes or 1 hour.

[0104] If the content is a sports game, the processor (150) can identify a single, large projection area among multiple projection areas within the space. Furthermore, if the content is a cooking video, the processor (150) can identify a small projection area within the kitchen among multiple projection areas, as the user is likely to watch the video while cooking.

[0105] If the processor (150) determines that the content has a long playback time and thus requires long-term viewing, it may search for projection areas on a wall or ceiling among multiple projection-capable areas. Furthermore, if the processor (150) determines that the content has a short playback time and thus requires short-term viewing, it may search for projection areas on the floor or furniture around the user.

[0106] As described above, the processor (150) can identify a projection area based on various methods. The detailed operation of identifying a projection area will be described in detail in the description of FIGS. 4a and 4b below.

[0107] The processor (150) can identify the image projection position based on the image projection distance and image projection angle for the projection area.

[0108] As described above, the memory (140) stores information on changes in image quality according to changes in the image projection distance and the image projection angle, and the processor (150) can identify a position where an image with the maximum image quality can be projected for an identified projection area based on the information on changes in image quality as an image projection position.

[0109] According to one embodiment, the memory (140) may store preferred location information corresponding to the user's status. In this case, the processor (150) may obtain the user's status information based on the sensing value of the sensor (110), and identify the image projection location based on the image projection angle, the image projection distance, the user's status information, and the preferred location information corresponding to the user's status.

[0110] Here, the preferred location information corresponding to the user's status may include information on the distance from the user and the direction from the user, which are defined for each of the user's multiple statuses. For example, if the user's status is a state of watching TV, the memory (140) may store information indicating that the memory (140) is positioned at a distance of approximately 4 meters from the user and positioned to the user's right so as not to interfere with the user's TV viewing. As another example, if the user's status is a state of movement, the memory (140) may store information indicating that the memory (140) is positioned at a distance of '1 meter or more and 2 meters or less' from the user and positioned in a direction perpendicular to the user's movement direction.

[0111] According to one embodiment, the processor (150) may identify a plurality of candidate locations where the image projection angle for the identified projection area is within a preset angle range and the image projection distance is within a preset distance range, and may identify an image projection location among the plurality of candidate locations based on the user's status information and preferred location information corresponding to the user's status.

[0112] Here, the preset angle range refers to the range of image projection angles at which the projection device (120) can project relatively high-quality images, and the preset distance range refers to the range of image projection distances at which the projection device (120) can project relatively high-quality images. According to one embodiment, the preset angle range and the preset distance range may be determined based on information about changes in image quality according to changes in the image projection angle and distance, and may be directly set by the manufacturer or the user. In addition, it goes without saying that the preset angle range and the preset distance range may be set to various values ​​depending on the projection method and performance of the projection device (120).

[0113] When the user's status information corresponds to the TV viewing status, the processor (150) can identify, based on the preferred location information, a location that is approximately 4 m away from the user and is located to the right of the user among the identified multiple candidate locations as the image projection location.

[0114] Among multiple candidate locations, there may not be a candidate location that is approximately 4 meters from the user and located to the user's right. In this case, a cost map can be generated to identify the optimal image projection location. The method for generating a cost map will be described in detail in the descriptions of FIGS. 5 and 6 below.

[0115] As described above, the processor (150) can identify an image projection location by considering the image projection distance, image projection angle, and even the user's condition, and can provide a high-quality image at a location preferred by the user.

[0116] In the following drawings 4a and 4b, a specific method for the electronic device (100) to identify a projection area will be described.

[0117] FIGS. 4A and 4B are diagrams illustrating a method for identifying an image projection area of ​​an electronic device according to one or more embodiments of the present disclosure.

[0118] According to FIG. 4a, when a user is lying on a bed and looking at the ceiling, the electronic device (100) can identify the ceiling area (420) among a plurality of projectible areas (410, 420, 430) as a projection area.

[0119] The electronic device (100) can identify, based on the sensing value of the sensor (110), that the user's location information corresponds to the bed and that the user's direction information corresponds to the ceiling direction. The electronic device (100) can search multiple projectible areas (410, 420, 430) and identify one area among the multiple projectible areas (410, 420, 430) that best corresponds to the user's location information and direction information. In this case, the electronic device (100) can identify the projection area corresponding to the user's location and direction as the ceiling area (420).

[0120] According to one embodiment, the electronic device (100) may identify that the user's location information corresponds to the bed based on the sensing value of the sensor (110), but that the user's direction information corresponds to the floor. In this case, the electronic device (100) may also identify the floor area (410) as the projection area.

[0121] According to FIG. 4b, when a user is sitting on a sofa in a living room, the electronic device (100) can identify a first floor area (440) among a plurality of projectible areas (440, 450, 460, 470) as a projection area.

[0122] The electronic device (100) can identify, based on the sensing value of the sensor (110), that the user's location information corresponds to the sofa and that the user's direction information corresponds to the center floor direction. The electronic device (100) can search multiple projectible areas (440, 450, 460, 470) and identify one area that best corresponds to the user's location information and direction information among the multiple projectible areas (440, 450, 460, 470). In this case, the electronic device (100) can identify the projection area corresponding to the user's location and direction as the first floor area (440).

[0123] According to one embodiment, the electronic device (100) may identify that the user's location information corresponds to the sofa based on the sensing value of the sensor (110), but the user's direction information corresponds to the right floor direction. In this case, the electronic device (100) may also identify the second floor area (450) as the projection area.

[0124] Although the above description describes that the electronic device (100) can identify only one area as a projection area, it may also identify more than one area as a candidate projection area.

[0125] Although the above description explains that the electronic device (100) can identify the projection area based on the user's location information and direction information, this is merely an example, and it is of course possible to identify the projection area based on the user's status information. For example, if the electronic device (100) determines that the user's status information corresponds to a cooking state, the electronic device (100) can search for a projectible area existing within the space where cooking is taking place and identify the projection area.

[0126] As described above, when the electronic device (100) identifies a projection area based on various pieces of information, it identifies an image projection position for projecting an image onto the identified projection area. The specific operation for identifying the image projection position will be described in detail in the description of FIGS. 5 and 6 below.

[0127] FIG. 5 is a diagram illustrating a method for generating a cost map of an electronic device according to one or more embodiments of the present disclosure.

[0128] According to FIG. 5, the electronic device (100) can generate a cost map (500) including a plurality of costs and a grid corresponding to each of the plurality of costs.

[0129] In the present disclosure, a "cost map" may refer to a map generated by dividing a space in which an electronic device (100) can move into a plurality of grids and assigning a cost to each of the plurality of grids. For example, the cost map may be implemented as a map in which the electronic device (100) divides a space into 5 x 5 grids and assigns a cost from 10 to -10 to each of the 25 grids.

[0130] The cost map may be referred to by various expressions that represent the same or similar concepts. For example, it may be referred to by various expressions such as "cost grid map," "," "cost graph," "cost graph," "cost chart," "cost matrix," "cost comparison map," "cost chart," "cost analysis map," "cost analysis matrix," and "cost comparison map." However, for convenience of explanation, it will be referred to collectively as "cost map" in this disclosure.

[0131] The electronic device (100) can obtain information about the space around the user based on the sensing value of the sensor (110), or obtain information about the space around the user from an external device (e.g., a robot vacuum cleaner) and store the information about the space around the user in the memory (140).

[0132] Here, information about the space around the user may include map information about the space around the user, information about obstacles, information about movement time, etc.

[0133] The electronic device (100) can generate a cost map (500) including a plurality of costs and a grid corresponding to each of the plurality of costs based on information about the image projection distance, the image projection angle, and the space around the user.

[0134] According to one embodiment, the electronic device (100) may, based on map information about the space surrounding the user, visualize the space surrounding the user as a map divided into a plurality of grids having the same area. Furthermore, the electronic device (100) may generate a cost map (500) by assigning a cost to each of the plurality of grids included in the map visualizing the space surrounding the user.

[0135] The electronic device (100) can calculate the image projection distance and image projection angle from the location corresponding to each of the plurality of grids to the identified projection area, respectively, to determine the cost to be allocated to each of the plurality of grids.

[0136] According to one embodiment, the electronic device (100) may assign a cost to grids having a smaller difference between the image projection distance calculated at a location corresponding to each of the plurality of grids and the preset distance, starting from grids having a larger difference. As another example, the electronic device (100) may assign a cost to grids having a smaller difference between the image projection angle calculated at a location corresponding to each of the plurality of grids and the preset angle, starting from grids having a larger difference.

[0137] Here, the preset distance may refer to a distance value at which the projection device (120) can project a high-quality image. In addition, the preset angle may refer to an angle value at which the projection device (120) can project a high-quality image. It goes without saying that the preset angle range and the preset distance range may be set to various values ​​depending on the projection method and performance of the projection device (120). For example, if the projection device (120) is an ultra-short-throw projector, the preset distance may be 50 cm and the preset angle may be 20 degrees, whereas if the projection device (120) is a projection-type projector, the preset distance may be 4 m and the preset angle may be 90 degrees.

[0138] The electronic device (100) may also use information about the space around the user to determine the cost to be allocated to each of the plurality of grids.

[0139] According to one embodiment, the electronic device (100) may calculate the number and size of obstacles present around a location corresponding to each of a plurality of grids based on information about obstacles within a space. The electronic device (100) may assign a decreasing cost to a grid in order from a grid with a smaller number of obstacles to a grid with a larger number of obstacles. As another example, the electronic device (100) may assign a decreasing cost to a grid in order from a grid with a smaller size of obstacles to a grid with a larger size of obstacles.

[0140] The electronic device (100) may also use information about travel time to determine the cost to be allocated to each of the plurality of grids.

[0141] According to one embodiment, the electronic device (100) may calculate the time required to move to a location corresponding to each of a plurality of grids based on information about movement times. The electronic device (100) may assign a lower cost in order from grids with shorter movement times to grids with longer movement times.

[0142] According to another embodiment, the electronic device (100) may assign a cost to each of a plurality of grids based on various information and methods, such as assigning a small cost to a grid corresponding to a location where a steep slope or a ledge exists, and assigning a large cost to a grid corresponding to a location where a flat floor surface exists, based on map information about the surrounding space.

[0143] The electronic device (100) can generate a cost map (500) by assigning a cost to each of a plurality of grids through various methods as described above, identify the smallest cost among the plurality of costs, and identify a location corresponding to the grid including the smallest cost as an image projection location. Once the image projection location is identified, the electronic device (100) can control the moving device (130) to move to the image projection location.

[0144] As illustrated in FIG. 5, the smallest cost in the cost map (500) generated by the electronic device (100) is '-1.5', and the moving device (130) can be controlled to move to a position corresponding to a grid including a cost of '-1.5'.

[0145] Although FIG. 5 illustrates a cost map in a 7 x 7 grid form, this is only one example, and it is obvious that cost maps can be created in various forms, such as 8 x 8 or 3 x 3 grid forms. In addition, it is obvious that the electronic device (100) can create a cost map by dividing space into various grid forms, such as circles and triangles, in addition to a grid form.

[0146] In addition, although in the above description, the electronic device (100) identified the position corresponding to the grid including the smallest cost as the image projection position, it is of course also possible to identify the position corresponding to the grid including the highest cost as the image projection position. In the case where the electronic device (100) identifies the position corresponding to the grid including the highest cost as the image projection position, the cost may be assigned in a direction opposite to the above-described method. For example, the electronic device (100) may assign a greater cost in order from the grid having a smaller difference between the image projection distance and the preset distance to the grid having a larger difference.

[0147] As described above, the electronic device (100) can determine costs based on various pieces of information. The electronic device (100) can generate a cost map by assigning weights to the costs determined based on various pieces of information, as described in detail in connection with FIG. 6.

[0148] FIG. 6 is a diagram illustrating a method for generating a cost map based on multiple layers of an electronic device according to one or more embodiments of the present disclosure.

[0149] According to FIG. 6, the electronic device (100) can generate a cost map (620) by assigning weights to each of n layers (610-1, ..., 610-n). In this description, for convenience of explanation, the cost included in the first layer (610-1) is referred to as the first cost, the cost included in the second layer is referred to as the second cost, and the cost included in the n-th layer (610-n) is referred to as the n-th cost. In addition, the weight assigned to the first layer (610-1) is referred to as the first weight, the weight assigned to the second layer is referred to as the second weight, and the weight assigned to the n-th layer (610-n) is referred to as the n-th weight.

[0150] According to one embodiment, the electronic device (100) may generate a cost map (620) by assigning weights to each of two layers generated based on the image projection distance and the image projection angle. In this case, the electronic device (100) may generate a first layer (610-1) in which the first cost is reduced from one of the plurality of grids in which the difference between the image projection distance and the preset distance is small to one of the plurality of grids in which the difference between the image projection distance and the preset distance is large. In addition, the electronic device (100) may generate a second layer in which the second cost is reduced from one of the plurality of grids in which the difference between the image projection angle and the preset angle is small to one of the plurality of grids in which the difference between the image projection angle and the preset angle is large.

[0151] The electronic device (100) can multiply the first cost by a first weight and multiply the second cost by a second weight. The electronic device (100) can generate a cost map (620) by adding the first cost multiplied by the first weight and the second cost multiplied by the second weight.

[0152] Here, the first weight and the second weight may have the same value, or may have different values. For example, if the projection direction of the projection device (120) is fixed, the image projection angle cannot but have a fixed value, so the second layer generated based on the image projection angle has a more important meaning, and thus the second weight may have a larger value than the first weight. As another example, if the user wants to be provided with a large image, the image projection distance must be long, and thus the first layer may have a more important meaning than the second layer. In this case, the first weight may have a larger value than the second weight.

[0153] As described above, the electronic device (100) can generate a cost map suitable for the situation by assigning different weight sizes depending on various situations such as the purpose of image projection and the type of projection device (120).

[0154] According to one embodiment, the electronic device (100) may generate layers with decreasing costs in order from grids with a smaller number of obstacles in the surrounding area to grids with a larger number of obstacles, based on information about obstacles in the space. Furthermore, the electronic device (100) may also generate layers with decreasing costs in order from grids with smaller obstacle sizes in the surrounding area to grids with larger obstacle sizes.

[0155] According to another embodiment, the electronic device (100) can calculate the time required to move to a location corresponding to each of a plurality of grids based on information about the movement time, and can create layers that assign a smaller cost in order from the grid with the smaller movement time to the grid with the larger movement time.

[0156] According to another embodiment, the electronic device (100) may generate a layer that assigns a small cost to a grid corresponding to a location where a steep slope or a ledge exists, and assigns a large cost to a grid corresponding to a location where a flat floor surface exists, based on map information about the surrounding space.

[0157] In another embodiment, the electronic device (100) may generate layers based on the user's status information and preferred location information corresponding to the user's status. In other words, the electronic device (100) may assign a lower cost to grids corresponding to locations closer to the user's preferred location and to grids corresponding to locations further away, based on the user's status information and preferred location information corresponding to the user's status.

[0158] Specifically, if the user's status identified by the electronic device (100) corresponds to a TV watching status, and the preferred location information corresponding to the TV watching status corresponds to a 'location 4 m away to the right from the user', the electronic device (100) can create a layer in which the grid corresponding to the 'location 4 m away to the right from the user' is given the smallest cost, and the grid is given a larger cost the farther away it is from the 'location 4 m away to the right from the user'.

[0159] The above-described layer creation method is only one example, and the electronic device (100) can of course create multiple layers based on various information and methods.

[0160] The electronic device (100) can generate a plurality of layers (610-1, ..., 610-n) based on various information as described above, and can generate a final cost map (620) by multiplying a weight by a cost included in each of the plurality of layers and adding all of the costs multiplied by the weights.

[0161] According to one embodiment, if the electronic device (100) determines that the cost of a layer generated based on the user's status information and the preferred location information corresponding to the user's status is the most important value, the weight assigned to the corresponding cost may be determined to be the largest value.

[0162] The electronic device (100) can identify an image projection position based on the final cost map (620). As illustrated in FIG. 6, if '-2.3' is the smallest cost, the electronic device (100) can identify a position corresponding to a grid including a cost of '-2.3' as an image projection position.

[0163] In the above description, it is only explained that the electronic device (100) can identify a position corresponding to the grid including the smallest cost as an image projection position, but this is only one example, and the electronic device (100) can identify one image projection position and move to the identified image projection position even when the number of grids including the smallest cost is plural.

[0164] In a cost map generated by an electronic device (100), let's assume that '-2.3' is the smallest cost and there are multiple grids containing a cost of '-2.3'. According to one embodiment, the electronic device (100) can identify a location corresponding to a grid closest to the user's location among the multiple grids as an image projection location.

[0165] According to another embodiment, the electronic device (100) may randomly select one grid from among a plurality of grids including the smallest cost and identify a location corresponding to the selected grid as an image projection location. According to another embodiment, the electronic device (100) may select a grid corresponding to a location closest to the identified projection area and identify a location corresponding to the selected grid as an image projection location.

[0166] The electronic device (100) can identify the projection position based on the plurality of costs included in the final cost map (620) as described above. However, the plurality of costs included in the final cost map (620) can be changed by the user's feedback, and the specific operation of changing the image projection position of the electronic device (100) by the user's feedback will be described in detail in the description of FIGS. 7A and 7B below.

[0167] FIG. 7A and FIG. 7B are diagrams illustrating an operation method based on feedback from a user of an electronic device according to one or more embodiments of the present disclosure.

[0168] According to FIG. 7a, the electronic device (100) can change the image projection position from the first position (710) to the second position (720) based on the user's feedback.

[0169] According to one embodiment, the electronic device (100) can obtain user feedback regarding movement to an image projection position. If the sensor (110) includes a camera, the electronic device (100) can obtain user feedback based on an image captured by the camera. If the electronic device (100) includes a microphone, the electronic device (100) can obtain user feedback through the microphone.

[0170] The electronic device (100) can control the moving device (130) to move to the image projection position when positive feedback from the user is obtained regarding movement to the image projection position, and can change the image projection position when negative feedback from the user is obtained regarding movement to the image projection position.

[0171] Here, user feedback may include the user's voice, gestures, etc. For example, the user's feedback may include the user's voice saying "More to the left" or "Not that way." Additionally, the user's feedback may include the user's hand gesture pointing to the left or indicating "OK."

[0172] According to one embodiment, when negative feedback from the user regarding movement to the image projection position is obtained, the electronic device (100) can update the cost of the cost map, identify the smallest cost among the plurality of costs included in the updated cost map, and change the image projection position to a position corresponding to the grid including the smallest cost.

[0173] Specifically, when the electronic device (100) controls the moving device (130) to move to the first location (710) by identifying the first location (710) as an image projection location, and a negative feedback from the user such as “a little further to the left” is obtained, the electronic device (100) can update the cost of the cost map by reducing the cost of the portion corresponding to the left of the first location in the cost map. The electronic device (100) can change the second location (720) corresponding to the grid including the smallest cost in the updated cost map to the image projection location.

[0174] According to FIG. 7b, the electronic device (100) can change the image projection position from the first position (710) to the third position (730) based on the user's feedback.

[0175] Specifically, when the electronic device (100) controls the moving device (130) to identify the first location (710) as an image projection location and move to the first location, if a negative feedback from the user such as “not that way” is obtained, the electronic device (100) can update the cost of the cost map by increasing the cost of the grid corresponding to the first location in the cost map. The electronic device (100) can change the third location (730) corresponding to the grid including the smallest cost in the updated cost map to the image projection location.

[0176] As described above, the electronic device (100) can obtain user feedback through a camera. In this case, the electronic device (100) can obtain user feedback using image recognition technology for the captured image.

[0177] As described above, the electronic device (100) can obtain user feedback through a microphone. In this case, the electronic device (100) can obtain user voice feedback using STT technology and / or NLP technology.

[0178] As described above, the electronic device (100) can identify an appropriate image projection location by reflecting the user's feedback on the cost map. If the image projection location changes based on the user's feedback, the image quality may also change. In this case, the electronic device (100) can provide the user with information regarding the change in image quality, as described in detail in FIGS. 8A and 8B .

[0179] FIGS. 8A and 8B are diagrams illustrating a method for providing information on a change in image quality of an electronic device according to one or more embodiments of the present disclosure.

[0180] According to FIG. 8a, when the image projection position is changed based on the user's feedback and the size of the projected image is changed, the electronic device (100) can provide the user with information about the change in the size of the projected image.

[0181] According to one embodiment, when the image projection position is changed, the electronic device (100) can provide information on the change in the image quality of the projected image by comparing the image quality of the projected image at the position before the change (810) and the image quality of the projected image at the position after the change (820).

[0182] Specifically, if the image projection position changes based on user feedback, the projection area may also change. In this case, the size of the projection area (830) before the change and the size of the projection area (840) after the change may differ, and the size of the image projected by the electronic device (100) may also change. Since the user may not want the image size to change, the electronic device (100) may output a voice message indicating to the user, "The screen size will be reduced at the changed position."

[0183] In Fig. 8a, only the case where the size of the projected image is reduced based on a change in the image projection position is described, but it is of course possible to provide the user with information about the change in size even when the size of the projected image is increased.

[0184] According to FIG. 8b, the electronic device (100) can provide the user with information about the change in image quality when the image projection position is changed based on the user's feedback and the image quality of the projected image may be degraded.

[0185] In one embodiment, only the image projection position of the electronic device (100) may be changed based on user feedback, and the projection area may not be changed. In this case, the image projection angle and image projection distance at the position (810) before the change may be different from the image projection angle and image projection distance at the position (820) after the change.

[0186] Specifically, a change in the image projection position may result in a smaller image projection angle, increasing the likelihood of distortion in the projected image. In this case, the electronic device (100) may output a voice message to the user stating, "Image quality may deteriorate at the changed position" or "Distortion in the projected image may occur."

[0187] Although FIGS. 8a and 8b only illustrate that the electronic device (100) outputs an audio signal to provide the user with information about changes in image quality, this is only one example, and the electronic device (100) can of course provide the user with information about changes in image quality by projecting an image about changes in image quality or transmitting information about changes in image quality to an external device such as a display device.

[0188] As described above, when the image projection position of the electronic device (100) is changed based on the user's feedback, the electronic device (100) can provide the user with information about the position after the change and the projection image after the change, and thus the user can obtain information about the changed image projection position and can also provide feedback again about the change in the image projection position of the electronic device (100).

[0189] FIG. 9 is a flowchart illustrating a method of moving an electronic device to an image projection position according to one or more embodiments of the present disclosure.

[0190] According to FIG. 9, the electronic device (100) can obtain the user's location information and direction information based on the sensing value of the sensor (S910).

[0191] Next, the electronic device (100) can identify a projection area based on the location information and direction information (S920). At this time, the electronic device (100) can also identify the projection area based on information about a plurality of projectible areas. The electronic device (100) can capture a photograph of the user's surrounding space and, based on the captured surrounding space, obtain information about a plurality of projectible areas within the surrounding space.

[0192] Next, the electronic device (100) can identify an image projection position based on the image projection distance and the image projection angle for the projection area (S930). At this time, the electronic device (100) can generate a cost map including a plurality of costs and grids corresponding to each of the plurality of costs based on information about the image projection distance, the image projection angle, and the space around the user, identify the smallest cost among the plurality of costs, and identify a position corresponding to the grid including the smallest cost as an image projection position.

[0193] At this time, the electronic device (100) may generate a first layer including a first cost that decreases from one of a plurality of grids having a small difference between the image projection distance and the preset distance to one of a plurality of grids having a large difference between the image projection distance and the preset distance, generate a second layer including a second cost that decreases from one of a plurality of grids having a small difference between the image projection angle and the preset angle to one of a plurality of grids having a large difference between the image projection angle and the preset angle, and generate a cost map by assigning weights to each of the first layer and the second layer.

[0194] Next, the electronic device (100) can move to the identified image projection location (S940).

[0195] As described above, the control method of the electronic device (100) according to one embodiment of the present disclosure can provide convenience to the user and provide high-quality images, as the electronic device (100) can directly identify the image projection position based on various information such as the user's location information, direction information, image projection distance, and image projection angle, without the user having to directly determine the image projection position, and can move to the identified image projection position.

[0196] FIG. 10 is a flowchart illustrating a method for identifying an image projection position of an electronic device according to one or more embodiments of the present disclosure.

[0197] According to FIG. 10, the electronic device (100) can identify a projection area based on position information and direction information (S1010).

[0198] Next, the electronic device (100) can obtain user status information based on the sensing value of the sensor (S1020). According to one embodiment, the electronic device (100) can obtain information that the user is in a TV viewing state.

[0199] Next, the electronic device (100) can identify a plurality of candidate locations where the image projection angle for the identified projection area is within a preset angle range and the image projection distance is within a preset distance range (S1030). According to one embodiment, the electronic device (100) can identify a plurality of candidate locations where the image projection angle is between 50 degrees and 90 degrees and the image projection distance is between 2 m and 4 m.

[0200] Next, the electronic device (100) can identify an image projection location based on the user's status information and the preferred location information corresponding to the user's status (S1040). According to one embodiment, if the user's status corresponds to a TV viewing status, the electronic device (100) can identify, based on the preferred location information corresponding to the TV viewing status, a location located to the right of the user and approximately 4 m from the user among the identified multiple candidate locations as an image projection location.

[0201] As described above, the control method of the electronic device (100) according to an embodiment of the present disclosure can identify an image projection location corresponding to the user's status based on the user's status information and the preferred location information corresponding to the user's status, and can project an image at the user's preferred location without the user inputting a command for moving the location. In addition, the electronic device (100) can obtain feedback on the image projection location from the user, and can change the image projection location based on the obtained feedback. A method for changing the image projection location will be described in detail in the description of FIG. 11 described below.

[0202] FIG. 11 is a flowchart illustrating an operation for user feedback of an electronic device according to one or more embodiments of the present disclosure.

[0203] According to FIG. 11, the electronic device (100) can obtain user feedback regarding movement to the image projection position (S1110). At this time, the user feedback can be obtained through a microphone or a camera.

[0204] Next, the electronic device (100) can identify whether the user's feedback is positive (S1120). According to one embodiment, if the electronic device (100) acquires the user's voice saying "Not there" through the microphone, the electronic device (100) can identify the user's feedback as negative feedback. According to one embodiment, if the electronic device (100) acquires the user's voice saying "More to the left" through the microphone, the electronic device (100) can identify the user's feedback as negative feedback. According to one embodiment, if the electronic device (100) acquires the user's gesture saying "ok" through the camera, the electronic device (100) can identify the user's feedback as positive feedback.

[0205] Next, if the user's feedback is identified as negative (S1120:N), the electronic device (100) may change the image projection position (S1130). According to one embodiment, the electronic device (100) may update the cost of the cost map, identify the smallest cost among the multiple costs included in the updated cost map, and change the image projection position to a position corresponding to the grid including the smallest cost.

[0206] Next, the electronic device (100) can compare the image quality of the projection image at the position before the change with the image quality of the projection image at the position after the change to provide information on the change in image quality (S1140). According to one embodiment, the electronic device (100) can provide information on the change in the size of the projection image and can also provide information on the occurrence of distortion in the projection image.

[0207] If the electronic device (100) is identified as positive in the user's feedback (S1120:Y), it can move to the image projection position (S1150).

[0208] The various methods described in FIGS. 9 to 11 can be performed by an electronic device having the configuration shown in FIG. 3, but are not necessarily limited thereto, and can be performed by electronic devices having various configurations.

[0209] In FIGS. 9 to 11, the order of all steps is mapped for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0210] As described above, the electronic device according to the present disclosure can identify an appropriate image projection position in various situations and move to the image projection position, so that a user can view a high-quality image without having to move directly or change the position of the image projection device.

[0211] The methods according to at least some of the various embodiments of the present disclosure described above can be implemented in the form of an application installable on an existing electronic device.

[0212] Additionally, the methods according to at least some of the various embodiments of the present disclosure described above can be implemented with only a software upgrade or a hardware upgrade for an existing electronic device.

[0213] Additionally, the methods according to at least some of the various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic devices.

[0214] According to one embodiment of the present disclosure, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The machine is a device that can call instructions stored from the storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, a 'non-transitory storage medium' only means that it is a tangible device and does not include a signal (e.g., an electromagnetic wave), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is temporarily stored in the storage medium. For example, a 'non-transitory storage medium' may include a buffer in which data is temporarily stored. According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones).In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0215] Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device (e.g., an electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored in the storage medium and operating according to the called instructions.

[0216] When the above-described instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by utilizing other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0217] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various applications are possible by a person having ordinary skill in the art to which the present disclosure pertains without departing from the scope claimed in the claims, and such applications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, sensor; A projection device that projects a projection image; A moving device comprising at least one actuator for moving the electronic device; memory that stores at least one instruction; and At least one processor comprising at least one instruction for executing said at least one instruction, wherein when executed by said at least one processor, said at least one instruction causes said electronic device to: Obtain the user's location information and direction information based on the sensing values ​​of the above sensor, Identifying the projection area based on the above location information and the above direction information, Identifying the image projection position of the electronic device based on the image projection distance and image projection angle for the above projection area, An electronic device that controls the moving device to move to the image projection position.

2. In paragraph 1, The above memory stores information about the space around the user, When executed by at least one processor, said at least one instruction causes said electronic device to: Generating a cost map including a plurality of costs and a plurality of grids corresponding to each of the plurality of costs based on information about the image projection distance, the image projection angle, and the surrounding space, An electronic device that identifies, among the plurality of grids, a position corresponding to a grid including the smallest cost among the plurality of costs as the image projection position.

3. In paragraph 2, When executed by at least one processor, said at least one instruction causes said electronic device to: Generating a first layer including a first cost that decreases from a grid including a first difference between the image projection distance and the preset distance among the plurality of grids to a grid including a second difference between the image projection distance and the preset distance among the plurality of grids, Generating two layers including a second cost that decreases from a grid including a third difference between the angles between the image projection angle and the preset angle among the plurality of grids to a grid including a fourth difference between the image projection angle and the preset angle among the plurality of grids, Create the cost map by assigning weights to each of the first layer and the second layer, The above second difference is greater than the above first difference, An electronic device wherein the fourth difference is greater than the third difference.

4. In paragraph 1, The above memory stores preferred location information corresponding to the user's status, When executed by at least one processor, said at least one instruction causes said electronic device to: Obtaining the user's status information based on the sensing value of the above sensor, Identifying a plurality of candidate locations where the image projection angle for the projection area is within a preset angle range and the image projection distance is within a preset distance range, An electronic device that identifies the image projection location among the plurality of candidate locations based on the user's status information and the preferred location information.

5. In paragraph 1, The above sensor includes a camera, When executed by at least one processor, said at least one instruction causes said electronic device to: When the user's feedback on movement to the image projection position is obtained through the camera, the moving device is controlled to move to the image projection position. Electronic devices.

6. In paragraph 5, When executed by at least one processor, said at least one instruction causes said electronic device to: An electronic device that provides information on changes in the image quality of a projected image by comparing the image quality of a projected image at a position before the change and the image quality of a projected image at a position after the change when the above-mentioned image projection position is changed.

7. In paragraph 1, including a microphone; When executed by at least one processor, said at least one instruction causes said electronic device to: An electronic device that controls the moving device to move to the image projection position when the user's feedback regarding movement to the image projection position is obtained through the microphone.

8. In paragraph 2, When executed by at least one processor, said at least one instruction causes said electronic device to: When the user's negative feedback regarding the movement to the image projection position is obtained, the plurality of costs of the cost map are updated, An electronic device that identifies the smallest cost among a plurality of costs included in the updated cost map and changes the image projection position to a position corresponding to a grid including the smallest cost in the updated cost map.

9. In paragraph 1, When executed by at least one processor, said at least one instruction causes said electronic device to: An electronic device that identifies the projection area based on the type and playback time of the content corresponding to the projection image.

10. In paragraph 1, The above sensor includes a camera, When executed by at least one processor, said at least one instruction causes said electronic device to: Control the camera to capture the surrounding space of the user, An electronic device that obtains information about a plurality of projectible areas within the surrounding space based on the photographed surrounding space.

11. In a method for controlling an electronic device, A step of obtaining user location information and direction information based on the sensing values ​​of the sensor; A step of identifying a projection area based on the position information and the direction information; A step of identifying an image projection position of the electronic device based on an image projection distance and an image projection angle for the projection area; and A control method comprising: a step of moving to the above image projection position; 12. In paragraph 11, The step of identifying the above image projection position is: A step of generating a cost map including a plurality of costs and a plurality of grids corresponding to each of the plurality of costs based on information about the image projection distance, the image projection angle, and the space around the user; and A control method comprising: a step of identifying, among the plurality of grids, a position corresponding to a grid including the smallest cost among the plurality of costs as the image projection position.

13. In paragraph 12, The steps for generating the above cost map are: A step of generating a first layer including a first cost that decreases from a grid including a first difference between the image projection distance and the preset distance among the plurality of grids to a grid including a second difference between the image projection distance and the preset distance among the plurality of grids; A step of generating a second layer including a second cost that decreases from a grid including a third difference between the angles between the image projection angle and the preset angle among the plurality of grids to a grid including a fourth difference between the image projection angle and the preset angle among the plurality of grids; and A step of generating the cost map by assigning weights to each of the first layer and the second layer; The above second difference is greater than the above first difference, A control method wherein the fourth difference is greater than the third difference.

14. In paragraph 11, The step of identifying the above image projection position is: A step of obtaining status information of the user based on the sensing value of the sensor; A step of identifying a plurality of candidate locations where the image projection angle for the projection area is within a preset angle range and the image projection distance is within a preset distance range; and A control method comprising: a step of identifying the image projection position based on the status information of the user and the preferred location information corresponding to the status of the user.

15. A non-transitory computer-readable recording medium storing computer instructions that, when executed by a processor of an electronic device, cause the electronic device to perform an operation, wherein the operation is: A step of obtaining user location information and direction information based on the sensing values ​​of the sensor; A step of identifying a projection area based on the position information and the direction information; A step of identifying an image projection position of the electronic device based on an image projection distance and an image projection angle for the projection area; and A non-transitory computer-readable recording medium comprising: a step of moving to the above image projection position;

Images