Electronic apparatus and control method thereof

Abstract

An electronic apparatus comprises: a sensor unit; a memory; a projection unit for outputting a light source to a projection surface; and at least one processor, wherein the at least one processor is configured to: identify a first projection position according to an environmental illuminance value based on first data obtained through the sensor unit and according to a first brightness value of the projection surface; obtain a second brightness value corresponding to the brightness of a projection image that is output by the projection unit and is at the first projection position; obtain, while the projection image is being output, a third brightness value corresponding to the brightness of a projection area, which is based on second data obtained through the sensor unit; and control the projection unit such that the projection image is output at a second projection position identified on the basis of the second brightness value and the third brightness value.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof that automatically adjusts a projection distance in consideration of a brightness level.

[0002] The position of an electronic device having a projection function that outputs an image may be changed. If the position is changed, the size or brightness of the projected image output on the projection surface may change.

[0003] If the electronic device is too close to the projection surface, the brightness will increase, but the projected image will be smaller. If the electronic device is too far from the projection surface, the projected image will be larger, but the clarity or brightness will decrease.

[0004] It is inconvenient for the user to manually determine the projection position and move the electronic device directly to an arbitrary location.

[0005] Without precise criteria for determining whether to move the projection position, it can be difficult to provide the user with an optimal experience.

[0006] The present disclosure is designed to improve the above-described problem, and an object of the present disclosure is to provide an electronic device and a control method thereof that determine a projection position before outputting a projection image, determines the projection position again after outputting the projection image, and moves to the determined projection position.

[0007] According to one embodiment, an electronic device includes a sensor unit, a memory, a projection unit that outputs a light source to a projection surface, and at least one processor, wherein the at least one processor identifies a first projection position based on an environmental illuminance value and a first brightness value of the projection surface based on first data acquired through the sensor unit, acquires a second brightness value corresponding to the brightness of a projection image output through the projection unit at the first projection position, acquires a third brightness value corresponding to the brightness of a projection area based on the second data acquired through the sensor unit while the projection image is being output, and controls the projection unit to output the projection image at the second projection position identified based on the second brightness value and the third brightness value.

[0008] The at least one processor can obtain the environmental illuminance value corresponding to the intensity of light in the surrounding environment based on the first data including illuminance data obtained through the illuminance sensor included in the sensor unit.

[0009] The at least one processor can obtain the first data including the first image obtained through the image sensor included in the sensor unit, and identify an average brightness value of a plurality of pixels of a first target area corresponding to the projection surface among a plurality of areas included in the first image as the first brightness value of the projection surface.

[0010] The memory stores a correction distance table including a plurality of correction distances, and the at least one processor can identify the first projection position based on a correction distance corresponding to the environmental illuminance value and the first brightness value among the plurality of correction distances.

[0011] The electronic device further includes a motor and a moving member, and the at least one processor supplies a force generated by the motor to the moving member to move from the current position to the first projection position.

[0012] The at least one processor can obtain an average brightness value of a plurality of pixels included in the projection image as the second brightness value.

[0013] The at least one processor may obtain the second data including the second image through an image sensor included in the sensor unit, and obtain an average brightness value of a plurality of pixels included in a second target area corresponding to the projection area where the projection image is output among a plurality of areas included in the second image as the third brightness value.

[0014] The at least one processor can identify the second projection position that is closer to the projection surface than the first projection position if the difference between the second brightness value and the third brightness value exceeds a threshold value.

[0015] The at least one processor may obtain a third distance between the user and the projection surface based on a first distance between the electronic device and the projection surface and a second distance between the electronic device and the user, obtain a measurement size of a third target area corresponding to a projection area where the projection image is output from among a plurality of areas included in the third image based on third data including a third image through an image sensor included in the sensor unit, and identify a size of a UI (User Interface) provided by the electronic device based on the third distance and the measurement size.

[0016] An electronic device in which at least one processor increases the size of the UI if the ratio of the measured size divided by the third distance is less than or equal to a threshold ratio value.

[0017] According to one embodiment, a control method of an electronic device includes the steps of identifying a first projection position based on an environmental illuminance value and a first brightness value of a projection surface based on acquired first data, acquiring a second brightness value corresponding to brightness of a projection image at the first projection position, acquiring a third brightness value corresponding to brightness of a projection area based on the acquired second data while the projection image is being output, and outputting the projection image at the identified second projection position based on the second brightness value and the third brightness value.

[0018] The above control method may further include a step of obtaining the environmental illuminance value corresponding to the light intensity of the surrounding environment based on the first data including illuminance data.

[0019] The above control method may further include a step of acquiring the first data including a first image and a step of identifying an average brightness value of a plurality of pixels of a first target area corresponding to the projection surface among a plurality of areas included in the first image as a first brightness value of the projection surface.

[0020] The electronic device stores a correction distance table including a plurality of correction distances, and the step of identifying the first projection position can identify the first projection position based on a correction distance corresponding to the environmental illuminance value and the first brightness value among the plurality of correction distances.

[0021] The electronic device may further include a motor and a moving member, and the control method may further include a step of supplying a force generated by the motor to the moving member to move from the current position to the first projection position.

[0022] The step of obtaining the second brightness value may obtain an average brightness value of a plurality of pixels included in the projection image as the second brightness value.

[0023] The step of obtaining the third brightness value may include obtaining the second data including the second image, and obtaining an average brightness value of a plurality of pixels included in a second target area corresponding to the projection area where the projection image is output among a plurality of areas included in the second image as the third brightness value.

[0024] The above control method may further include a step of identifying the second projection position that is closer to the projection surface than the first projection position, if the difference between the second brightness value and the third brightness value exceeds a threshold value.

[0025] The control method may further include a step of obtaining a third distance between the user and the projection surface based on a first distance between the electronic device and the projection surface and a second distance between the electronic device and the user, a step of obtaining a measured size of a third target area corresponding to a projection area where the projection image is output among a plurality of areas included in the third image based on third data including a third image, and a step of identifying a size of a UI (User Interface) provided by the electronic device based on the third distance and the measured size.

[0026] The above control method may further include a step of increasing the size of the UI if a ratio value obtained by dividing the measured size by the third distance is less than or equal to a threshold ratio value.

[0027] FIG. 1 is a block diagram illustrating an electronic device according to one embodiment.

[0028] FIG. 2 is a block diagram illustrating a specific configuration of the electronic device of FIG. 1, according to one embodiment.

[0029] FIG. 3 is a drawing for explaining a mobile projector according to one embodiment.

[0030] FIG. 4 is a drawing for explaining the distance between a projection surface and an electronic device according to one embodiment.

[0031] FIG. 5 is a drawing for explaining a projection surface divided into multiple areas according to one embodiment.

[0032] FIG. 6 is a diagram for explaining an operation of acquiring sensing data according to one embodiment.

[0033] FIG. 7 is a drawing for explaining an operation of outputting a projection image on a projection surface according to one embodiment.

[0034] FIG. 8 is a drawing for explaining a correction distance table according to one embodiment.

[0035] FIG. 9 is a diagram illustrating a projection position calculation module according to one embodiment.

[0036] FIG. 10 is a drawing for explaining an operation of outputting a projection image according to one embodiment.

[0037] FIG. 11 is a drawing for explaining an operation of obtaining distance information based on a projection surface (10), a user (20), and an electronic device (100), according to one embodiment.

[0038] FIG. 12 is a drawing for explaining an operation of changing the size of a UI element according to one embodiment.

[0039] FIG. 13 is a drawing for explaining a screen for changing the size of a UI element according to one embodiment.

[0040] FIG. 14 is a drawing for explaining a moving operation of an electronic device (100) according to one embodiment.

[0041] FIG. 15 is a diagram for explaining a notification for a location movement according to one embodiment.

[0042] FIG. 16 is a drawing for explaining a position movement criterion according to one embodiment.

[0043] FIG. 17 is a drawing for explaining a keystone correction function according to one embodiment.

[0044] FIG. 18 is a drawing for explaining a keystone correction function according to one embodiment.

[0045] FIG. 19 is a drawing for explaining a screen related to power information according to one embodiment.

[0046] FIG. 20 is a drawing for explaining an operation of changing a projection area according to one embodiment.

[0047] FIG. 21 is a drawing for explaining an operation of outputting a projection image using a plurality of devices according to one embodiment.

[0048] FIG. 22 is a drawing for explaining an appropriate screen size according to one embodiment.

[0049] FIG. 23 is a drawing for explaining an operation of determining a projection position using an environment before outputting a projection image, according to one embodiment.

[0050] FIG. 24 is a drawing for explaining an operation of determining a projection position using an environment after outputting a projection image, according to one embodiment.

[0051] FIG. 25 is a drawing for explaining an operation of changing the size of a UI element by considering the measured size of a projection area, according to one embodiment.

[0052] FIG. 26 is a drawing for explaining a method of controlling an electronic device according to one embodiment.

[0053] Figure 27 is a drawing for explaining an operation of changing a projection image according to distance.

[0054] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0055] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. In certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0056] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0057] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0058] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0059] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0060] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0061] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Multiple "modules" or multiple "parts" may be integrated into at least one module and implemented by at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented in specific hardware.

[0062] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0063] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0064] FIG. 1 is a block diagram illustrating an electronic device (100) according to one embodiment.

[0065] Referring to FIG. 1, the electronic device (100) may include at least one of a processor (111), a projection unit (112), a memory (113), and a sensor unit (121).

[0066] At least one processor (111) can perform overall control operations of the electronic device (100). Specifically, at least one processor (111) functions to control the overall operations of the electronic device (100). A specific description related to at least one processor (111) is described in FIG. 2.

[0067] The projection unit (112) is a configuration that projects images (projected images, contents, etc.) to the outside. A detailed description related to the projection unit (112) is described in Fig. 2.

[0068] The memory (113) can store a projection image projected through the projection unit (112). The projection image can refer to a still image as well as a continuous image (or a moving image). The projection image can refer to an image included in the content. The memory (113) can store the operating O / S.

[0069] The sensor unit (121) can obtain sensing data. The sensor unit (121) can include at least one of an illumination sensor (121-1) and an image sensor (121-2). The electronic device (100) can obtain first sensing data, second sensing data, and third sensing data in chronological order through the sensor unit (121). The electronic device (100) can obtain illumination data through the illumination sensor (121-1). The electronic device (100) can obtain first illumination data, second illumination data, and third illumination data through the illumination sensor (121-1).

[0070] The electronic device (100) can acquire a photographed image through the image sensor (121-2). The electronic device (100) can acquire a first photographed image, a second photographed image, and a third photographed image in chronological order through the image sensor (121-2).

[0071] The memory (113) can store content images. The projection unit (112) can be used to output images.

[0072] At least one processor (111) can control operations performed in the electronic device (100).

[0073] At least one processor (111) may obtain an environmental illuminance value based on first sensing data acquired through the sensor unit (121), and may obtain a first brightness value representing the brightness of a projection surface area based on the first sensing data acquired through the sensor unit (121). The first sensing data may include a plurality of sensing data. For example, the first sensing data may include first illuminance data and first shooting data. Depending on the implementation example, each data may be described as separate sensing data.

[0074] The electronic device (100) can identify (or acquire) various brightness values. The various brightness values ​​can include at least one of a first brightness value, a second brightness value, or a third brightness value.

[0075] The first brightness value may represent a brightness level corresponding to the projection surface (10) in the space where the electronic device (100) exists. At least one processor (111) may identify the projection surface (10) on which the projection image is to be output. At least one processor (111) may identify (or acquire or sense) the brightness value of the projection surface (10). At least one processor (111) may acquire a photographed image including the projection surface (10). At least one processor (111) may identify a brightness value for the projection surface (10) included in the photographed image as the first brightness value.

[0076] The second brightness value may represent the brightness value of the projection image itself. The second brightness value may represent the brightness value of the projection image itself output by the electronic device (100). At least one processor (111) may obtain a pixel value related to the projection image. At least one processor (111) may identify the brightness value of the projection image itself as the second brightness value using the pixel value related to the projection image. The second brightness value may be described as a brightness value of the projection image, a basic brightness value, or a reference brightness value.

[0077] The third brightness value may represent the brightness value of the projection surface (10) in a state where the projection image is output. At least one processor (111) may identify (or acquire or sense) the brightness value for the projection surface (10) after outputting the projection image to the projection surface (10). At least one processor (111) may acquire a photographed image including the projection surface (10) in a state where the projection image is output. The photographed image may include the projection surface (10) and the output projection image.

[0078] The first brightness value and the third brightness value can be obtained based on a captured image obtained through an image sensor (e.g., a camera).

[0079] The second brightness value may be information obtained based on pixel values ​​contained in the image data itself. No capturing operation by the image sensor may be required to obtain the second brightness value.

[0080] At least one processor (111) can determine a first projection position based on an environmental illuminance value and a first brightness value, control a projection unit (112) to output a projection image stored in a memory (113) at the first projection position, obtain a second brightness value indicating the brightness of the projection image, and after the projection image is output to the projection surface (10), obtain a third brightness value indicating the brightness of the projection area based on second sensing data acquired through the sensor unit (121), determine a second projection position based on the second brightness value and the third brightness value, and control the projection unit (112) to output the projection image at the second projection position.

[0081] At least one processor (111) can obtain first sensing data including illuminance data through an illuminance sensor (121-1) included in a sensor unit (121), and obtain an environmental illuminance value indicating the intensity of light in the surrounding environment based on the illuminance data.

[0082] Illumination data may be described as illuminance information. At least one processor (111) may obtain an environmental illuminance value representing the illuminance of the surrounding environment based on the illuminance data included in the first sensing data. The environmental illuminance value may be described as the illuminance value of the surrounding environment.

[0083] At least one processor (111) can obtain first sensing data including a first captured image through an image sensor (121-2) included in a sensor unit (121), identify a first target area representing a projection surface area corresponding to a projection surface (10) among a plurality of areas included in the first captured image, and determine an average brightness value of a plurality of pixels corresponding to the first target area as a first brightness value.

[0084] At least one processor (111) can acquire a first captured image through the image sensor (121-2). At least one processor (111) can identify a plurality of areas included in the first captured image. At least one processor (111) can identify a projection surface area representing a projection surface (10) among the plurality of areas. At least one processor (111) can identify the projection surface area as a first target area.

[0085] At least one processor (111) can obtain brightness values ​​of a plurality of pixels included in a first target area (or projection surface area). At least one processor (111) can obtain an average brightness value of a plurality of pixels included in the first target area. At least one processor (111) can determine the average brightness value of a plurality of pixels included in the first target area as a first brightness value.

[0086] The first brightness value may represent a brightness level corresponding to a projection surface (10) in a space where an electronic device (100) exists. The projection surface (10) may be included in the first captured image. The area corresponding to the projection surface (10) may be a projection surface area. At least one processor (111) may identify a projection surface area representing the projection surface (10) in the first captured image as a first target area, and may determine an average brightness value of a plurality of pixels for the first target area as the first brightness value.

[0087] At least one processor (111) can determine whether to change the position of the electronic device (100) based on the environmental illuminance value and the first brightness value. At least one processor (111) can determine the first projection position by taking into account the environmental illuminance value and the first brightness value.

[0088] According to various embodiments, at least one processor (111) may determine the first projection position using a correction distance table.

[0089] At least one processor (111) can identify a correction distance corresponding to an environmental illuminance value and a first brightness value among a plurality of correction distances, and determine a first projection position based on the correction distance.

[0090] The memory (113) may store a correction distance table including a plurality of correction distances. The correction distance table may include correction distances corresponding to environmental illuminance values ​​and brightness values ​​of a projection surface area.

[0091] The correction distance may include a distance for moving the position of the electronic device (100). At least one processor (111) may determine the first projection position based on the correction distance.

[0092] Multiple correction distances included in the correction distance table may indicate that the darker the surrounding environment, the closer the projection surface (10) should be moved.

[0093] For example, when the surrounding environment becomes dark, the compensation distance may include distance information to move closer to the projection surface (10).

[0094] For example, when the surrounding environment becomes brighter, the correction distance may include distance information to move further away from the projection surface (10) or distance information to maintain the current position.

[0095] At least one processor (111) can determine a first projection position based on the correction distance. At least one processor (111) can move to the first projection position.

[0096] A detailed description of the correction distance table is described in Fig. 8.

[0097] According to various embodiments, at least one processor (111) may determine the first projection position based on a preset event. The preset event may refer to an event in which the surrounding environment is determined to be dark or an event in which the brightness of the projection surface is determined to be dark.

[0098] For example, if the environmental illuminance value is below a first threshold value, at least one processor (111) can identify that a preset event has occurred.

[0099] For example, if the first brightness value is less than or equal to the second threshold value, at least one processor (111) can identify that a preset event has occurred.

[0100] For example, if the environmental illuminance value is less than or equal to a first threshold value and the first brightness value is less than or equal to a second threshold value, at least one processor (111) can identify that a preset event has occurred.

[0101] The electronic device (100) may further include a motor and a moving member, and at least one processor (111) may supply a force generated by the motor to the moving member to move from the current position to the first projection position.

[0102] At least one processor (111) can obtain driving force from a motor. At least one processor (111) can supply (or transmit) the driving force generated by the motor to a moving member. The moving member may include a wheel-shaped member. The moving member can rotate based on the received driving force. When the moving member rotates, the position of the electronic device (100) can be changed. At least one processor (111) can drive by rotating left and right.

[0103] At least one processor (111) can move to a first projection position. After moving to the first projection position, at least one processor (111) can output a projection image to a projection surface (10) through a projection unit (112).

[0104] At least one processor (111) can acquire a projection image.

[0105] At least one processor (111) can obtain content including a projection image. The content can include a projection image and audio data corresponding to the projection image.

[0106] For example, the content may be data stored in the memory (113) of the electronic device (100).

[0107] For example, content may be received via an external source device, such as a content provider device or a set-top box.

[0108] For example, content may be received from an external server. The external server may include a content provider server.

[0109] At least one processor (111) can obtain a projection image included in the content and output the obtained projection image to the projection surface (10) through the projection unit (112).

[0110] At least one processor (111) can obtain audio data included in the content and output the obtained audio data through a speaker (117).

[0111] At least one processor (111) can determine an average brightness value of a plurality of pixels included in the projection image as a second brightness value.

[0112] At least one processor (111) can obtain a brightness value of a projection image. The projection image can be included in image data. The image data can include a frame representing the projection image. The frame representing the projection image includes a plurality of pixels, and the frame representing the projection image can include an RGB value or a brightness value for each of the plurality of pixels.

[0113] For example, a frame representing a projection image may include RGB values ​​corresponding to each of a plurality of pixels. At least one processor (111) may obtain a brightness value corresponding to each of the plurality of pixels based on the RGB values.

[0114] For example, a frame representing a projection image may include brightness values ​​corresponding to each of a plurality of pixels.

[0115] At least one processor (111) can obtain a first value by adding up the brightness values ​​of a plurality of pixels included in a first target area. At least one processor (111) can obtain a second value by dividing the first value by the number of a plurality of pixels included in the first target area. At least one processor (111) can determine the second value as an average brightness value of the first target area. At least one processor (111) can determine the second value as a second brightness value.

[0116] The second brightness value may represent the original brightness value when the projection image is not output to the projection surface (10). The second brightness value may be described as the brightness value of the projection image, the basic brightness value, or the reference brightness value.

[0117] At least one processor (111) may obtain second sensing data including a second captured image through an image sensor (121-2) included in a sensor unit (121), identify a second target area corresponding to a projection area where a projection image is output among a plurality of areas included in the second captured image, and determine an average brightness value of a plurality of pixels corresponding to the second target area as a third brightness value.

[0118] After outputting a projection image at a first projection position, at least one processor (111) can acquire a second captured image through an image sensor (121-2). At least one processor (111) can acquire the second captured image in the direction of the projection surface (10) where the projection image is output. The second captured image can be included in the second sensing data.

[0119] At least one processor (111) can identify a projection area in the second captured image. The projection area may be an area where a projection image output on the projection surface (10) is output (or displayed). At least one processor (111) can identify a projection area in which a projection image is output in the second captured image. The projection area may be described as a second target area. At least one processor (111) can set the projection area as the second target area.

[0120] The projection surface area may represent an area corresponding to the projection surface (10) in the embodiment (710) of FIG. 7.

[0121] The projection area may represent an area where a projection image (721) is output in the embodiment (720) of FIG. 7.

[0122] At least one processor (111) can identify a plurality of pixels included in a second target area. At least one processor (111) can obtain a plurality of pixels and a brightness value corresponding to each of the plurality of pixels. At least one processor (111) can determine an average brightness value of the plurality of pixels as a third brightness value.

[0123] At least one processor (111) can obtain a third value by adding up the brightness values ​​of a plurality of pixels included in the second target area. At least one processor (111) can obtain a fourth value by dividing the third value by the number of a plurality of pixels included in the second target area.

[0124] At least one processor (111) can determine the fourth value as an average brightness value corresponding to the second target area. At least one processor (111) can determine the fourth value as a third brightness value.

[0125] According to various embodiments, the second sensing data may obtain a second environmental illuminance value in addition to the second captured image. The environmental illuminance value included in the first sensing data may be described as the first environmental illuminance value.

[0126] After the projection image is output to the projection surface (10), if a preset event is identified, at least one processor (111) can change (or update) the projection position.

[0127] A preset event may refer to an event in which the output projection image is judged to be dark. Depending on the lens settings of the projection unit (112) or the surrounding environment, the brightness of the actual output projection image may be perceived as dark. At least one processor (111) can identify whether a preset event has occurred by comparing the original brightness with the actual captured brightness.

[0128] At least one processor (111) obtains a difference value between the second brightness value and the third brightness value, and if the difference value exceeds a threshold value (third threshold value), a second projection position that is closer to the projection surface (10) than the first projection position can be determined.

[0129] If the difference between the second brightness value and the third brightness value exceeds the third threshold value, at least one processor (111) can identify that a preset event has occurred.

[0130] The second brightness value can represent the original brightness level before the projection image is output.

[0131] The third brightness value may represent brightness information displayed in the captured image after the projection image is output. The third brightness value may represent a brightness value for an area where the projection image is output. The projection image may be output to a projection area among the projection surface (10). The third brightness value may include a brightness value for an area where the projection image is output among the projection surface (10).

[0132] At least one processor (111) can obtain a difference value between the second brightness value and the third brightness value. At least one processor (111) can calculate the difference value by subtracting the third brightness value from the second brightness value. A larger positive difference value may indicate that the captured brightness is lower than the original brightness.

[0133] At least one processor (111) can compare the difference value with a third threshold value to determine whether to change the position of the electronic device (100). If the position is changed, the position determined by the at least one processor (111) can be recorded as a second projection position.

[0134] If the difference value exceeds the third threshold value, at least one processor (111) can determine a second projection position that is closer to the projection surface (10) than the first projection position. At least one processor (111) can move from the first projection position to the second projection position.

[0135] If the difference value is less than or equal to the third threshold value, at least one processor (111) can maintain the current position (first projection position).

[0136] At least one processor (111) can obtain a first distance (d10) between the electronic device (100) and the projection surface (10), obtain a second distance (d20) between the electronic device (100) and the user (20), and obtain a third distance (d30) between the user (20) and the projection surface (10) based on the first distance (d10) and the second distance (d20).

[0137] At least one processor (111) can obtain third sensing data including a third captured image through an image sensor (121-2) included in the sensor unit (121).

[0138] At least one processor (111) can identify a third target area corresponding to a projection area where a projection image is output among a plurality of areas included in the third photographed image.

[0139] At least one processor (111) can identify a measurement size of a third target area. At least one processor (111) can identify a measurement size (s10) of a projection area where a projection image is output in the third captured image.

[0140] At least one processor (111) can determine the size of a UI (User Interface) provided by the electronic device based on the third distance (d30) and the measurement size (s10).

[0141] At least one processor (111) can increase the size of the UI if the ratio of the measured size divided by the third distance is less than or equal to a threshold ratio.

[0142] The description of the first distance (d10), second distance (d20), third distance (d30), and measurement size (s10) is described in Fig. 12.

[0143] The UI provided by the electronic device (100) may include UI items, UI elements, etc.

[0144] The UI may include at least one of a settings UI, a notification UI, an advertisement UI, and other UIs.

[0145] The Settings UI may include UI related to the Settings menu.

[0146] The notification UI may include a UI that displays various notifications related to the electronic device (100).

[0147] The advertising UI may include a UI that displays advertising information provided by the electronic device (100).

[0148] The UI may include at least one of a graphical UI and a textual UI. The graphical UI may include icons, images, etc. The textual UI may include text data displayed in a preset language.

[0149] At least one processor (111) can set (or determine) the size of the UI. The UI provided by the electronic device (100) can be output to the projection surface (10) through the projection unit (112). At least one processor (111) can output the UI based on a preset size. The preset size can refer to the resolution of the UI. The size of the UI can indicate the size displayed according to the projection ratio when output from a preset distance. The size of the UI can be described as the basic size of the UI.

[0150] The smaller the measurement size (s10), the closer the electronic device (100) may be moved to the projection surface (10). At least one processor (111) may obtain a value obtained by dividing the measurement size (s10) by the third distance (d30) as a fifth value. At least one processor (111) may compare the fifth value with a fourth threshold value to determine whether to change the size of the UI.

[0151] A smaller fifth value may mean that the size of the output projection image is smaller compared to the distance between the projection surface (10) and the user (20). If the projection image is output below a certain size when the user (20) is far away from the projection surface (10), the user (20) may not be able to see the projection image accurately.

[0152] If the fifth value is less than or equal to the fourth threshold value, at least one processor (111) can change the size of the UI. At least one processor (111) can obtain a sixth value by dividing the fourth threshold value by the fifth value. At least one processor (111) can change the size of the UI based on the sixth value. At least one processor (111) can change the size of the UI by multiplying the current size of the UI by the sixth value.

[0153] For example, it is assumed that the measurement size is 80 cm and the third distance (d30) between the projection surface (10) and the user (20) is 250 cm. The fourth threshold value is assumed to be 0.4. At least one processor (111) can obtain a fifth value (0.32) by dividing the measurement size (80 cm) by the third distance (250 cm). Since the fifth value (0.32) is less than or equal to the fourth threshold value (0.4), the at least one processor (111) can change the size of the UI. The at least one processor (111) can obtain a sixth value (1.25) by dividing the fourth threshold value (0.4) by the fifth value (0.32). The at least one processor (111) can change the size of the UI based on the sixth value (1.25). The at least one processor (111) can increase (or expand) the size of the UI by 1.25 times the current size.

[0154] According to various embodiments, at least one processor (111) may change the UI size using the movement distance.

[0155] At least one processor (111) can obtain (or calculate) a movement distance between a first projection position and a second projection position.

[0156] At least one processor (111) can determine the size of a UI (User Interface) provided by the electronic device based on the third distance (d30) and the movement distance.

[0157] At least one processor (111) can increase the size of the UI if the ratio of the movement distance divided by the third distance (d30) is less than or equal to a threshold ratio.

[0158] At least one processor (111) can move from a first projection position to a second projection position. At least one processor (111) can identify the distance between the first projection position and the second projection position as a movement distance. The movement distance can be described as a fourth distance.

[0159] As the movement distance increases, the electronic device (100) may be moved closer to the projection surface (10). At least one processor (111) may obtain a value obtained by dividing the movement distance by a third distance (d30) as a fifth value. At least one processor (111) may compare the fifth value with a fourth threshold value to determine whether to change the size of the UI.

[0160] If the fifth value is less than or equal to the fourth threshold value, at least one processor (111) can change the size of the UI. At least one processor (111) can obtain a sixth value by dividing the fourth threshold value by the fifth value. At least one processor (111) can change the size of the UI based on the sixth value. At least one processor (111) can change the size of the UI by multiplying the current size of the UI by the sixth value.

[0161] For example, it is assumed that the moving distance is 80 cm and the third distance (d30) between the projection surface (10) and the user (20) is 250 cm. The fourth threshold value is assumed to be 0.4. At least one processor (111) can obtain a fifth value (0.32) by dividing the moving distance (80 cm) by the third distance (250 cm). Since the fifth value (0.32) is less than or equal to the fourth threshold value (0.4), at least one processor (111) can change the size of the UI. At least one processor (111) can obtain a sixth value (1.25) by dividing the fourth threshold value (0.4) by the fifth value (0.32). At least one processor (111) can change the size of the UI based on the sixth value (1.25). At least one processor (111) can increase (or expand) the size of the UI by 1.25 times its current size.

[0162] If the fifth value exceeds the fourth threshold, at least one processor (111) can maintain the size of the UI.

[0163] According to various embodiments, at least one processor (111) may determine whether to change the size of the UI by using a change value of the screen size instead of the movement distance. The projection ratio may be a value determined by the projection unit (112). The projection ratio may be a value obtained by dividing the size of the projection image by the projection distance. Accordingly, the change in the size of the projection image and the change in the projection distance may be proportional. At least one processor (111) may obtain the same calculation result by using a change value of the screen size instead of the movement distance when changing the size of the UI.

[0164] At least one processor (111) can obtain third sensing data including a third captured image through an image sensor (121-2) included in the sensor unit (121).

[0165] At least one processor (111) can identify a projection area on which a projection image is projected in the third captured image. At least one processor (111) can obtain a measurement size (s10) of the projection area.

[0166] At least one processor (111) can obtain a measurement size change value of the projection area.

[0167] At least one processor (111) can output a projection image at a first projection location. At least one processor (111) can acquire a second captured image at the first projection location. At least one processor (111) can identify a projection area included in the second captured image. At least one processor (111) can identify a first measured size of the projection area.

[0168] At least one processor (111) can output a projection image at a second projection location. At least one processor (111) can obtain a third captured image at the second projection location. At least one processor (111) can identify a projection area included in the third captured image. At least one processor (111) can identify a second measurement size of the projection area.

[0169] At least one processor (111) can obtain a difference value between a first measurement size and a second measurement size. The measurement size difference value can be described as a measurement size change value.

[0170] At least one processor (111) may obtain a fifth value obtained by dividing the measured size difference value by a third distance (d30). At least one processor (111) may compare the fifth value with a fourth threshold value to determine whether to change the size of the UI. The subsequent calculation operation may be identical to the calculation method using the movement distance. Duplicate explanations are omitted.

[0171] For example, it is assumed that the first measurement size is 100 cm, the second measurement size is 20 cm, and the third distance (d30) between the projection surface (10) and the user (20) is 250 cm. The fourth threshold value is assumed to be 0.4. At least one processor (111) can calculate the measurement size change value as 80 cm. At least one processor (111) can obtain a fifth value (0.32) by dividing the measurement size change value (80 cm) by the third distance (250 cm). Since the fifth value (0.32) is less than or equal to the fourth threshold value (0.4), at least one processor (111) can change the size of the UI. At least one processor (111) can obtain a sixth value (1.25) by dividing the fourth threshold value (0.4) by the fifth value (0.32). At least one processor (111) can change the size of the UI based on the sixth value (1.25). At least one processor (111) can increase (or expand) the size of the UI by 1.25 times its current size.

[0172] According to various embodiments, the electronic device (100) can compare the brightness of the projection surface and the screen brightness. The electronic device (100) can determine the user's visibility based on the brightness comparison result. The electronic device (100) can obtain battery (or power supply) status information. The electronic device (100) can determine the projection type (normal projection method, ultra-short focus method) and identify the projection distance based on at least one of the brightness comparison result and the battery status information.

[0173] According to various embodiments, the electronic device (100) may be connected to an Internet of Things (IoT) device. The IoT device may include at least one of a device having a light source output function and a device that determines the transmittance (or irradiance) of an external light source. For example, the IoT device may include a smart light bulb, a smart lighting fixture, a blind device, and the like.

[0174] The electronic device (100) can control the IoT device based on the occurrence of an event requiring brightness. The electronic device (100) can change the lighting of the IoT device if the preset criteria cannot be met even by distance movement or brightness control of the electronic device (100) itself. When the lighting of the IoT device is controlled, the brightness of the measured projection surface or the brightness of the projected image may change. The electronic device (100) can satisfy the preset criteria by controlling the IoT device. The light source intensity of the IoT device can be adjusted or the light source transmittance (or irradiance) can be repeatedly changed until the preset criteria are met. The preset criteria may include the conditions described in FIGS. 22 to 26 .

[0175] Events requiring brightness acquisition may include at least one of the following: an event where movement to the identified (or calculated) location is impossible, an event where the battery power is below a threshold, and an event where the projection shape determined at the projection location is impossible (e.g., outside the projection ratio).

[0176] FIG. 2 is a block diagram for explaining a specific configuration of the electronic device (100) of FIG. 1, according to one embodiment.

[0177] Referring to FIG. 2, the electronic device (100) may include at least one of a processor (111), a projection unit (112), a memory (113), a communication interface (114), an operation interface (115), an input / output interface (116), a speaker (117), a microphone (118), a power supply unit (119), a driving unit (120), a sensor unit (121), or a moving member (122).

[0178] The configuration illustrated in FIG. 2 is merely an example of various embodiments, and some configurations may be omitted and new configurations may be added.

[0179] The content already explained in Fig. 1 is omitted.

[0180] At least one processor (111) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes a digital signal. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machines (ARM) processor, or may be defined by the relevant terminology. At least one processor (111) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). At least one processor (111) may perform various functions by executing computer executable instructions stored in a memory (113).

[0181] The projection unit (112) is a component that projects an image to the outside. According to various embodiments of the present disclosure, the projection unit (112) can be implemented in various projection methods (e.g., CRT (cathode-ray tube) method, LCD (Liquid Crystal Display) method, DLP (Digital Light Processing) method, laser method, etc.). For example, the CRT method has the same principle as a CRT monitor. The CRT method magnifies the image with a lens in front of the cathode-ray tube (CRT) and displays the image on the screen. Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of a three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0182] Another example is the LCD method, which displays images by passing light from a light source through liquid crystals. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into red, green, and blue by a dichroic mirror (a mirror that reflects only a specific color of light and transmits all others). After passing through the liquid crystals, the light can be refocused into a single point.

[0183] Another example is the DLP method, which displays images using a DMD (Digital Micromirror Device) chip. The DLP projection unit may include a light source, a color wheel, a DMD chip, a projection lens, etc. The light output from the light source can be colored as it passes through the rotating color wheel. The light passing through the color wheel is input to the DMD chip. The DMD chip contains numerous micromirrors and reflects the light input to the DMD chip. The projection lens can play a role in magnifying the light reflected from the DMD chip to the image size.

[0184] Another example is a laser system that uses a Diode Pumped Solid State (DPSS) laser and a galvanometer. A multi-color laser uses three DPSS lasers, one for each RGB color, with their optical axes overlapped by a special mirror. The galvanometer includes a mirror and a high-power motor that moves the mirror at high speeds. For example, the galvanometer can rotate the mirror at up to 40 kHz / sec. The galvanometer is mounted according to the scan direction, but since projectors typically scan in a planar manner, the galvanometer can also be positioned separately along the x and y axes.

[0185] The projection unit (112) may include various types of light sources. For example, the projection unit (112) may include at least one light source among a lamp, an LED, and a laser.

[0186] The projection unit (112) can output images in a 4:3 screen ratio, a 5:4 screen ratio, or a 16:9 wide screen ratio depending on the purpose of the electronic device (100) or the user's settings, and can output images in various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the screen ratio.

[0187] The projection unit (112) can perform various functions for adjusting the output image under the control of at least one processor (111). For example, the projection unit (112) can perform functions such as zoom, keystone, quick corner (4 corner) keystone, and lens shift.

[0188] Specifically, the projection unit (112) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, the zoom function can be performed depending on the distance from the screen. At this time, the zoom function may include a hardware method of adjusting the screen size by moving the lens and a software method of adjusting the screen size by cropping the image, etc. When the zoom function is performed, the focus of the image needs to be adjusted. For example, the method of adjusting the focus includes a manual focus method, an electric focus method, etc. The manual focus method refers to a method of focusing manually, and the electric focus method refers to a method of automatically focusing using a motor built into the projector when the zoom function is performed. When performing the zoom function, the projection unit (112) may provide a digital zoom function through software, and may provide an optical zoom function of performing the zoom function by moving the lens through the driving unit (120).

[0189] The projection unit (112) can perform a keystone correction function. If the height is not right for front projection, the screen may be distorted upwards or downwards. The keystone correction function refers to a function that corrects a distorted screen. For example, if distortion occurs in the left and right directions of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up and down directions, it can be corrected using vertical keystone. The quick corner (4 corner) keystone correction function is a function that corrects the screen when the center area of ​​the screen is normal but the corner areas are not balanced. The lens shift function is a function that moves the screen as it is when the screen is off the screen.

[0190] The projection unit (112) can automatically analyze the surrounding environment and projection environment without user input to provide zoom / keystone / focus functions. Specifically, the projection unit (112) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected by a sensor (depth camera, distance sensor, infrared sensor, light sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0191] The projection unit (112) can provide a lighting function using a light source. In particular, the projection unit (112) can provide a lighting function by outputting a light source using an LED. According to various embodiments, the projection unit (112) can include one LED, and according to other embodiments, the electronic device (100) can include a plurality of LEDs. The projection unit (112) can output a light source using a surface-emitting LED according to an implementation example. The surface-emitting LED can refer to an LED having a structure in which an optical sheet is arranged on the upper side of the LED so that the light source is evenly distributed and output. Specifically, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0192] The projection unit (112) can provide the user with a dimming function for adjusting the intensity of the light source. Specifically, when a user input for adjusting the intensity of the light source is received from the user through the operation interface (115) (e.g., a touch display button or dial), the projection unit (112) can control the LED to output the intensity of the light source corresponding to the received user input.

[0193] The projection unit (112) can provide a dimming function based on content analyzed by at least one processor (111) without user input. Specifically, the projection unit (112) can control the LED to output the intensity of a light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0194] The projection unit (112) can control the color temperature under the control of at least one processor (111). The at least one processor (111) can control the color temperature based on the content. Specifically, when the content is identified to be output, the at least one processor (111) can obtain frame-by-frame color information of the content whose output has been determined. Then, the at least one processor (111) can control the color temperature based on the obtained frame-by-frame color information. The at least one processor (111) can obtain at least one primary color of the frame based on the frame-by-frame color information. Then, the at least one processor (111) can adjust the color temperature based on the obtained at least one primary color. For example, the color temperature that the at least one processor (111) can adjust can be classified into a warm type or a cold type. It is assumed that a frame to be output (hereinafter, referred to as an output frame) includes a scene in which a fire has occurred. At least one processor (111) can identify (or obtain) that the primary color is red based on color information included in the current output frame. In addition, at least one processor (111) can identify a color temperature corresponding to the identified primary color (red). The color temperature corresponding to red may be a warm type. At least one processor (111) can use an artificial intelligence model to obtain the color information or primary color of the frame. According to various embodiments, the artificial intelligence model can be stored in the electronic device (100) (e.g., the memory (113)). According to another embodiment, the artificial intelligence model can be stored in an external server that can communicate with the electronic device (100).

[0195] The memory (113) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in at least one processor (111), or may be implemented as a separate memory from at least one processor (111). In this case, the memory (113) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0196] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that can be attached or detached to the electronic device (100), it may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc.

[0197] The memory (113) may store at least one command regarding the electronic device (100). In addition, the memory (113) may store an O / S (Operating System) for driving the electronic device (100). The memory (113) may also store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. In addition, the memory (113) may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

[0198] Specifically, various software modules for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (113), and at least one processor (111) may control the operation of the electronic device (100) by executing various software modules stored in the memory (113). That is, the memory (113) is accessed by at least one processor (111), and data reading / recording / modifying / deleting / updating, etc. may be performed by at least one processor (111).

[0199] In the present disclosure, the term memory (113) may be used to mean a storage unit, a ROM (not shown), a RAM (not shown) in at least one processor (111), or a memory card (not shown) (e.g., a micro SD card, a memory stick) mounted on an electronic device (100).

[0200] The communication interface (114) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication interface (114) may include a wireless communication module or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.

[0201] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0202] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, various connection information, such as the service set identifier (SSID) and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received.

[0203] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which is between visible light and millimeter waves.

[0204] In addition to the above-described communication method, other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0205] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a paired cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0206] The manipulation interface (115) may include various types of input devices. For example, the manipulation interface (115) may include a physical button. In this case, the physical button may include a function key, a directional key (e.g., a four-way key), or a dial button. According to various embodiments, the physical button may be implemented as multiple keys. According to another embodiment, the physical button may be implemented as one key. When the physical button is implemented as one key, the electronic device (100) may receive a user input in which one key is pressed for a threshold time or longer. When a user input in which one key is pressed for a threshold time or longer is received, at least one processor (111) may perform a function corresponding to the user input. For example, at least one processor (111) may provide a lighting function based on the user input.

[0207] The manipulation interface (115) can receive user input using a non-contact method. When receiving user input using a contact method, physical force must be transmitted to the electronic device (100). Therefore, a method for controlling the electronic device (100) regardless of physical force may be required. Specifically, the manipulation interface (115) can receive user gestures and perform operations corresponding to the received user gestures. The manipulation interface (115) can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0208] The manipulation interface (115) can receive user input using a touch method. For example, the manipulation interface (115) can receive user input via a touch sensor. According to various embodiments, the touch method can be implemented in a non-contact manner. For example, the touch sensor can determine whether the user's body has approached within a threshold distance. The touch sensor can identify user input even when the user does not touch the touch sensor. According to another implementation example, the touch sensor can identify user input when the user touches the touch sensor.

[0209] The electronic device (100) can receive user input in various ways other than the above-described operation interface (115). In various embodiments, the electronic device (100) can receive user input through an external remote control device. The external remote control device can be a remote control device corresponding to the electronic device (100) (e.g., a dedicated control device of the electronic device (100)) or a user's portable communication device (e.g., a smartphone or wearable device). The user's portable communication device can store an application for controlling the electronic device (100). The portable communication device can obtain user input through the stored application and transmit the obtained user input to the electronic device (100). The electronic device (100) can receive user input from the portable communication device and perform an operation corresponding to the user's control command.

[0210] The electronic device (100) can receive user input using voice recognition. According to various embodiments, the electronic device (100) can receive the user's voice through a microphone included in the electronic device (100). According to other embodiments, the electronic device (100) can receive the user's voice from a microphone or an external device. Specifically, the external device can acquire the user's voice through the microphone of the external device and transmit the acquired user's voice to the electronic device (100). The user's voice transmitted from the external device can be audio data or digital data converted from audio data (e.g., audio data converted into a frequency domain, etc.). The electronic device (100) can perform an operation corresponding to the received user's voice. Specifically, the electronic device (100) can receive audio data corresponding to the user's voice through the microphone. In addition, the electronic device (100) can convert the received audio data into digital data. In addition, the electronic device (100) can convert the converted digital data into text data using the STT (Speech To Text) function. According to various embodiments, the STT (Speech To Text) function can be performed directly in the electronic device (100).

[0211] According to another embodiment, the STT (Speech To Text) function may be performed by an external server. The electronic device (100) may transmit digital data to the external server. The external server may convert the digital data into text data and obtain control command data based on the converted text data. The external server may transmit the control command data (which may also include text data) to the electronic device (100). The electronic device (100) may perform an operation corresponding to the user's voice based on the obtained control command data.

[0212] The electronic device (100) may provide a voice recognition function using a single assistant (or artificial intelligence assistant, e.g., Bixby™), but this is merely an example and the electronic device (100) may provide the voice recognition function using multiple assistants. In this case, the electronic device (100) may provide the voice recognition function by selecting one of the multiple assistants based on a trigger word corresponding to the assistant or a specific key present on the remote control.

[0213] The electronic device (100) can receive user input using screen interaction. Screen interaction may refer to a function of identifying whether a predetermined event occurs through an image projected by the electronic device (100) on the screen (or projection surface) and acquiring user input based on the predetermined event. The predetermined event may refer to an event in which a predetermined object is identified at a specific location (e.g., a location where a UI for receiving user input is projected). The predetermined object may include at least one of a part of the user's body (e.g., a finger), a pointer, or a laser point. If the predetermined object is identified at a location corresponding to the projected UI, the electronic device (100) can identify that a user input for selecting the projected UI has been received. For example, the electronic device (100) may project a guide image to display the UI on the screen. In addition, the electronic device (100) can identify whether the user selects the projected UI. Specifically, the electronic device (100) can identify that the user has selected the projected UI when a predetermined event is identified at a location of the projected UI. The projected UI can include at least one item. The electronic device (100) can perform spatial analysis to identify whether the predetermined event is at the location of the projected UI. The electronic device (100) can perform spatial analysis through a sensor (e.g., an image sensor, an infrared sensor, a depth camera, a distance sensor, etc.). By performing the spatial analysis, the electronic device (100) can identify whether the predetermined event occurs at a specific location (a location where the UI is projected). In addition, when the predetermined event is identified as occurring at a specific location (a location where the UI is projected), the electronic device (100) can identify that a user input for selecting a UI corresponding to the specific location has been received.

[0214] The input / output interface (116) is configured to input / output at least one of an audio signal and an image signal. The input / output interface (116) can receive at least one of an audio signal and an image signal from an external device, and can output a control command to the external device.

[0215] Depending on the implementation example, the input / output interface (116) may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0216] In various embodiments of the present disclosure, the input / output interface (116) may be implemented as at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (Dsubminiature), and DVI (Digital Visual Interface). According to various embodiments, the wired input / output interface may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0217] The electronic device (100) can receive data via a wired input / output interface, but this is merely an example of various embodiments, and can also receive power via the wired input / output interface. For example, the electronic device (100) can receive power from an external battery via a USB C-type or from an outlet via a power adapter. As another example, the electronic device (100) can receive power from an external device (e.g., a laptop or monitor) via a DP.

[0218] The audio signal may be implemented to be input through a wired input / output interface, and the image signal may be implemented to be input through a wireless input / output interface (or communication interface). Alternatively, the audio signal may be implemented to be input through a wireless input / output interface (or communication interface), and the image signal may be implemented to be input through a wired input / output interface.

[0219] The speaker (117) is a component that outputs an audio signal. In particular, the speaker (117) may include an audio output mixer, an audio signal processor, and an audio output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to various embodiments, the audio output module may include a plurality of speakers, and in this case, the audio output module may be arranged inside the main body, and sound emitted by covering at least a portion of the diaphragm of the audio output module may pass through a waveguide and be transmitted to the outside of the main body. The audio output module may include a plurality of audio output units, and the plurality of audio output units may be arranged symmetrically on the exterior of the main body, thereby radiating sound in all directions, that is, in a 360-degree omnidirectional manner.

[0220] The microphone (118) is a component for receiving a user's voice or other sounds and converting them into audio data. The microphone (118) can receive the user's voice in an activated state. For example, the microphone (118) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (118) can include various components such as a microphone for collecting the user's voice in analog form, an amplifier circuit for amplifying the collected user's voice, an A / D conversion circuit for sampling the amplified user's voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0221] The power supply unit (119) can receive power from an external source and supply power to various components of the electronic device (100). The power supply unit (119) according to various embodiments of the present disclosure can receive power through various methods. In various embodiments, the power supply unit (119) can receive power using a connector (130) as illustrated in FIG. 1. The power supply unit (119) can receive power using a 220 V DC power cord. However, the present invention is not limited thereto, and the electronic device (100) can receive power using a USB power cord or a wireless charging method.

[0222] The power supply unit (119) can be supplied with power using an internal battery or an external battery. The power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through the internal battery. For example, the power supply unit (119) can charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and can be supplied with power through the charged internal battery. The power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through an external battery. For example, when the electronic device (100) is connected to the external battery through various wired communication methods such as a USB power cord, a USB C-Type power cord, and a socket home, the power supply unit (119) can be supplied with power through the external battery. That is, the power supply unit (119) can be supplied with power directly from the external battery, or can charge the internal battery through the external battery and be supplied with power from the charged internal battery.

[0223] The power supply unit (119) according to the present disclosure can receive power using at least one of the multiple power supply methods described above.

[0224] With respect to power consumption, the electronic device (100) may have a power consumption value (e.g., 43 W) or lower due to socket type and other standards. In this case, the electronic device (100) may vary its power consumption to reduce power consumption when using a battery. That is, the electronic device (100) may vary its power consumption based on the power supply method, power usage, etc.

[0225] The driving unit (120) can drive at least one hardware component included in the electronic device (100). The driving unit (120) can generate a physical force and transmit it to at least one hardware component included in the electronic device (100).

[0226] The driving unit (120) can generate driving power for movement of a hardware component included in the electronic device (100) (e.g., movement of the electronic device (100)) or rotation of the component (e.g., rotation of a projection lens).

[0227] The driving unit (120) can adjust the projection direction (or projection angle) of the projection unit (112). The driving unit (120) can move the position of the electronic device (100). The driving unit (120) can control a moving member to move the electronic device (100). For example, the driving unit (120) can control the moving member using a motor.

[0228] The sensor unit (121) may include at least one sensor. Specifically, the sensor unit (121) may include at least one of a tilt sensor for sensing the tilt of the electronic device (100) and an image sensor for capturing an image. The tilt sensor may be an acceleration sensor or a gyro sensor, and the image sensor may mean a camera or a depth camera. The tilt sensor may be described as a motion sensor. The sensor unit (121) may include various sensors in addition to the tilt sensor or the image sensor. For example, the sensor unit (121) may include an illuminance sensor and a distance sensor. The distance sensor may be a ToF (Time of Flight). The sensor unit (121) may include a lidar sensor.

[0229] The electronic device (100) can control a lighting function by linking with an external device. Specifically, the electronic device (100) can receive lighting information from the external device. The lighting information can include at least one of brightness information or color temperature information set in the external device. The external device can refer to a device connected to the same network as the electronic device (100) (e.g., an IoT device included in the same home / work network) or a device that is not in the same network as the electronic device (100) but can communicate with the electronic device (100) (e.g., a remote control server). For example, assume that an external lighting device (IoT device) included in the same network as the electronic device (100) is outputting red light at a brightness of 50. The external lighting device (IoT device) can directly or indirectly transmit lighting information (e.g., information indicating that it is outputting red light at a brightness of 50) to the electronic device (100). The electronic device (100) can control the output of a light source based on the lighting information received from the external lighting device. For example, if the lighting information received from the external lighting device includes information to output red light at a brightness of 50, the electronic device (100) can output red light at a brightness of 50.

[0230] The electronic device (100) can control a lighting function based on biometric information. Specifically, at least one processor (111) can obtain the user's biometric information. The biometric information can include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. The biometric information can include various types of information in addition to the information described above. For example, the electronic device (100) can include a sensor for measuring biometric information. The at least one processor (111) can obtain the user's biometric information through the sensor and control the output of a light source based on the obtained biometric information. As another example, the at least one processor (111) can receive the biometric information from an external device through an input / output interface (116). The external device can refer to the user's portable communication device (e.g., a smartphone or a wearable device). The at least one processor (111) can obtain the user's biometric information from the external device and control the output of the light source based on the obtained biometric information. According to an implementation example, the electronic device (100) can identify whether the user is sleeping, and if the user is identified as sleeping (or preparing to sleep), at least one processor (111) can control the output of the light source based on the user's biometric information.

[0231] An electronic device (100) according to various embodiments of the present disclosure can provide various smart functions.

[0232] Specifically, the electronic device (100) is connected to a portable terminal device for controlling the electronic device (100), and a screen output from the electronic device (100) can be controlled through user input input from the portable terminal device. As an example, the portable terminal device can be implemented as a smartphone including a touch display, and the electronic device (100) receives screen data provided by the portable terminal device from the portable terminal device and outputs it, and a screen output from the electronic device (100) can be controlled according to user input input from the portable terminal device.

[0233] The electronic device (100) can share content or music provided by the mobile terminal device by connecting to the mobile terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC.

[0234] In addition, the mobile terminal device and the electronic device (100) can be connected in various connection methods. In various embodiments, the mobile terminal device can search for the electronic device (100) to perform a wireless connection, or the electronic device (100) can search for the mobile terminal device to perform a wireless connection. In addition, the electronic device (100) can output content provided by the mobile terminal device.

[0235] In various embodiments, when a mobile terminal device is placed near an electronic device (100) while specific content or music is being output from the mobile terminal device, and a preset gesture is detected through the display of the mobile terminal device (e.g., motion tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0236] In various embodiments, when the mobile terminal device is outputting specific content or music and the mobile terminal device comes closer to the electronic device (100) to a preset distance or less (e.g., non-contact tap view) or the mobile terminal device comes into contact with the electronic device (100) twice at a short interval (e.g., contact tap view), the electronic device (100) can output the content or music being output by the mobile terminal device.

[0237] In the above-described embodiment, it has been described that the same screen as the screen provided by the mobile terminal device is provided by the electronic device (100), but the present disclosure is not limited thereto. That is, when a connection is established between the mobile terminal device and the electronic device (100), the mobile terminal device may output a first screen provided by the mobile terminal device, and the electronic device (100) may output a second screen provided by the mobile terminal device that is different from the first screen. For example, the first screen may be a screen provided by a first application installed on the mobile terminal device, and the second screen may be a screen provided by a second application installed on the mobile terminal device. For example, the first screen and the second screen may be different screens provided by a single application installed on the mobile terminal device. For example, the first screen may be a screen including a remote control-type UI for controlling the second screen.

[0238] An electronic device (100) according to the present disclosure can output a standby screen. For example, if the electronic device (100) is not connected to an external device or if no input is received from the external device for a preset period of time, the electronic device (100) can output a standby screen. Conditions for the electronic device (100) to output a standby screen are not limited to the examples described above, and the standby screen can be output under various conditions.

[0239] The electronic device (100) may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device (100) may extract only the shape of a specific object from data received from an external device, acquire an amorphous object, and output a standby screen including the acquired amorphous object.

[0240] The electronic device (100) may further include a display (not shown).

[0241] The display (not shown) can be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, a PDP (Plasma Display Panel), etc. The display (not shown) may also include a driving circuit, a backlight unit, etc., which can be implemented as a type of a-si TFT (amorphous silicon thin film transistor), LTPS (low temperature poly silicon) TFT, OTFT (organic TFT), etc. The display (not shown) may be implemented as a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display, three-dimensional display), etc. According to various embodiments of the present disclosure, the display (not shown) may include not only a display panel that outputs an image, but also a bezel that houses the display panel. In particular, according to various embodiments of the present disclosure, the bezel may include a touch sensor (not shown) for detecting user interaction.

[0242] The electronic device (100) may further include a shutter unit (not shown).

[0243] The shutter portion (not shown) may include at least one of a shutter, a fixing member, a rail, or a body.

[0244] The shutter can block light output from the projection unit (112). The fixing member can fix the position of the shutter. The rail can be a path for moving the shutter and the fixing member. The body can be configured to include the shutter and the fixing member.

[0245] The movable member (122) may refer to a member for moving from a first position to a second position in a space where the electronic device (100) is placed. The electronic device (100) may control the movable member (122) to move the electronic device (100) using a force generated by the driving unit (120). The electronic device (100) may generate a force to be transmitted to the movable member (122) using a motor included in the driving unit (120).

[0246] The movable member (122) may include at least one wheel (e.g., a circular wheel). The electronic device (100) may move to a target location (or target position) through the movable member. When a user input or a control command is received, the electronic device (100) may rotate the movable member by transmitting a force generated through a motor to the movable member. The electronic device (100) may control the movable member to adjust the rotation speed, rotation direction, etc. The electronic device (100) may perform a movement operation (or movement function) by controlling the movable member based on the target location or the direction of movement, etc.

[0247] FIG. 3 is a drawing for explaining a mobile projector according to one embodiment.

[0248] The electronic device (100) may be implemented as a mobile device. The electronic device (100) may be implemented as a mobile projector or a mobile image output device.

[0249] The electronic device (100) may include a movable member (122). The movable member (122) may refer to a member for moving from a first position to a second position in a space where the electronic device (100) is placed. The movable member (122) may include at least one wheel (e.g., a circular wheel). The electronic device (100) may move to a target position (or goal position) through the movable member (122).

[0250] Referring to the embodiment (310) of FIG. 3, the electronic device (100) can be moved by a force applied by a user. When the user pushes the electronic device (100), the movable member (122) of the electronic device (100) can be rotated. The movable member (122) can include a wheel, and the electronic device (100) can be moved by the movable member (122) being rotated by an external force.

[0251] Referring to the embodiment (320) of FIG. 3, the movable member (122) can be moved via the fixed member (321). The fixed member (321) can include a movable rail. An electronic device (100) can be placed on the movable rail. The electronic device (100) can move on the movable rail. The movable rail is not a component included in the electronic device (100), but can be a component installed by the user.

[0252] The electronic device (100) can control the moving member (122) to move the electronic device (100) by using the force generated from the driving unit (120). The electronic device (100) can generate the force to be transmitted to the moving member (122) by using the motor included in the driving unit (120).

[0253] When a user input or control command is received, the electronic device (100) can rotate the moving member (122) by transmitting a force generated through a motor to the moving member (122). The electronic device (100) can control the moving member (122) to adjust the rotation speed, rotation direction, etc. The electronic device (100) can perform a movement action (or movement function) by controlling the moving member (122) based on a target position or a moving direction, etc.

[0254] The electronic device (100) can drive based on at least one of a preset movement speed or a preset acceleration. The preset movement speed or the preset acceleration can be changed according to a user's settings.

[0255] According to various embodiments, the electronic device (100) may control speed or acceleration based on a preset event. The electronic device (100) may identify whether the preset event has occurred. The electronic device (100) may acquire at least one of driving data (or map data) or sensing data to identify whether the preset event has occurred.

[0256] When a preset event is identified as occurring, the electronic device (100) may drive by changing the speed or acceleration. The preset event may include at least one of an event for driving to a target location or an event for identifying a preset object.

[0257] An event for driving to a target location may include at least one of an event for starting driving from the current location or an event for stopping driving at the target location. When a control command (or user input) for driving from the current location to the target location is obtained, the electronic device (100) may increase at least one of the speed or acceleration. If it is determined that the electronic device (100) has reached a threshold distance from the target location, the electronic device (100) may decrease at least one of the speed or acceleration.

[0258] The preset object may include an obstacle object. If an obstacle object is identified, the electronic device (100) may reduce acceleration. The acceleration may increase in the opposite direction of the direction of travel. If the acceleration is reduced, the speed increase of the electronic device (100) may decrease, and if the acceleration is in the opposite direction of the direction of travel, the speed may decrease.

[0259] According to various embodiments, the electronic device (100) can move over the fixed member (321) by force transmitted through the driving unit (120). The electronic device (100) can automatically move the fixed member (321) by using force generated from the driving unit (120) rather than an external force. The automatic movement operation can be described as a sliding operation.

[0260] According to various embodiments, the electronic device (100) may move to an identified target location based on a user input. The target location may include a target location to which the electronic device (100) is to move. The user may input a command to the electronic device (100) to move to the target location. The electronic device (100) may receive a user input for moving to the target location.

[0261] For example, the user input may include information on the location where the electronic device (100) is to move. The electronic device (100) may determine the location information included in the user input as a target location and move to the target location.

[0262] For example, the user input may include location information of the projection surface (10) on which the electronic device (100) outputs the projection image. The electronic device (100) may determine a target location at which the electronic device (100) outputs the projection image based on the location information of the projection surface (10) included in the user input. The electronic device (100) may move to the determined target location.

[0263] A user input including a target location can be received (or acquired) through an external device connected to the electronic device (100).

[0264] For example, the external device may include a remote control device capable of communicating with the electronic device (100).

[0265] For example, the external device may include a user terminal device capable of communicating with the electronic device (100).

[0266] The electronic device (100) can identify a target location through a sensor unit (121). The sensor unit (121) can obtain sensing data about the surroundings of the electronic device (100). The electronic device (100) can identify the target location based on the sensing data.

[0267] For example, the electronic device (100) can identify a laser light pointing at a target location by a user from sensing data. When a user points the laser light at a target location using a laser or the like, the electronic device (100) can sense the position of the laser light to identify the target location.

[0268] For example, the electronic device (100) can identify a user gesture indicating a target location from a sensing data. When the user points to the target location with a finger (or an object indicating a pointing direction), the electronic device (100) can sense the user's gesture and identify the target location.

[0269] An electronic device (100) may include a projection unit (112). The electronic device (100) may control the projection unit (112) to output a projected image.

[0270] According to various embodiments, the electronic device (100) may include a projection unit (112) utilizing an ultra-short throw (UST) method. The ultra-short throw method may refer to a method of projecting an image at a relatively close distance (e.g., less than 1 m). Despite the close distance, a clear projected image can be output to the projection surface (10).

[0271] According to various embodiments, the electronic device (100) may include a projection unit (112) using a general method. The projection unit (112) may include various types of light sources. For example, the projection unit (112) may include at least one light source among a lamp, an LED, and a laser. The general method may include a method of outputting a projection image at a distance exceeding 1 m.

[0272] According to various embodiments, the electronic device (100) can output a projection image using both the ultra-short focus method and the normal method at the same projection position. The electronic device (100) can output a projection image using both the ultra-short focus method and the normal method at the same point in time.

[0273] The electronic device (100) can distinguish a first area and a second area among the entire projection area for projecting a projection image. The electronic device (100) can output a projection image to the first area using an ultra-short focus method, and output a projection image to the second area using a general method.

[0274] For example, the projection image output to the first area and the projection image output to the second area may be sub-images generated based on the same projection image (source image).

[0275] For example, the projection image output to the first area and the projection image output to the second area may be different projection images.

[0276] For example, the electronic device (100) can output a projection image using a short focus method in a first area and a normal method in a second area using the same light source.

[0277] For example, the electronic device (100) can output a projection image using a short focus method in a first area and a normal method in a second area by using different light sources. The electronic device (100) can output a projection image using a short focus method in a first area through a first light source output from a first light source unit, and can output a projection image using a normal method in a second area through a second light source output from a second light source unit.

[0278] According to various embodiments, the electronic device (100) may be implemented as a stationary projector rather than a mobile projector. The electronic device (100) may be implemented in a form that does not include a mobile member.

[0279] FIG. 4 is a drawing for explaining the distance between a projection surface (10) and an electronic device (100) according to one embodiment.

[0280] Referring to FIG. 4, the electronic device (100) can determine a projection method based on the distance between the electronic device (100) and the projection surface (10).

[0281] The projection method may include at least one of an ultra-short throw (UST) method or a normal method. The ultra-short throw method may be described as the first method, and the normal method may be described as the second method. The electronic device (100) may acquire (or calculate) the distance between the position of the electronic device (100) and the position of the projection surface (10), and determine the projection method based on the acquired distance.

[0282] If the distance between the electronic device (100) and the projection surface (10) is less than or equal to a critical distance, the electronic device (100) can output a projection image using an ultra-short focus method. If the distance between the electronic device (100) and the projection surface (10) exceeds the critical distance, the electronic device (100) can output a projection image using a general method.

[0283] Referring to Example (410), a situation is shown where the distance between the electronic device (100) and the projection surface (10) is less than or equal to a critical distance (d1). The electronic device (100) can output a projection image using an ultra-short focus method.

[0284] Referring to Example (420), a situation is shown where the distance between the electronic device (100) and the projection surface (10) exceeds the critical distance (d1). The electronic device (100) can output a projection image using a general method.

[0285] The critical distance (d1) may be described as a first critical distance. If the distance between the electronic device (100) and the projection surface (10) exceeds the second critical distance (d2), the electronic device (100) may control the distance between the electronic device (100) and the projection surface (10) to be within the second critical distance (d2). The electronic device (100) may determine a target position at which the distance between the electronic device (100) and the projection surface (10) is within the second critical distance (d2), and may move to the target position. After moving, the electronic device (100) may output a projection image.

[0286] According to various embodiments, the electronic device (100) may include a plurality of lenses.

[0287] The electronic device (100) may include a first lens corresponding to a short-focus method. The electronic device (100) may include a second lens corresponding to a general method. The refractive indices of the first lens and the second lens may be different.

[0288] The electronic device (100) can determine a projection method using the projection environment (or surrounding environment). The electronic device (100) can determine a lens corresponding to the determined method. The electronic device (100) can output a projection image through the determined lens.

[0289] According to various embodiments, the electronic device (100) may include an integrated lens (or first lens). Based on the integrated lens, the electronic device (100) may output a projection image in an ultra-short throw (UST) manner and a conventional manner. The electronic device (100) may implement various projection methods with a single lens.

[0290] FIG. 5 is a drawing for explaining a projection surface (10) divided into multiple areas according to one embodiment.

[0291] Referring to FIG. 5, the electronic device (100) can classify the projection image (500) into a plurality of areas (510, 520, 530). The electronic device (100) can perform an image correction function for the plurality of classified areas.

[0292] The electronic device (100) can perform an image correction function. The image correction function may refer to a function for changing a projected image. The image correction function may include at least one of an operation for changing the resolution of an image, an operation for changing the brightness of an image, and an operation for changing the color of an image. The image correction function may be described as a content correction function.

[0293] The electronic device (100) can determine a target area for image correction among the entire area of ​​the projection image. After determining the target area, the electronic device (100) can perform an image correction function for the target area.

[0294] The electronic device (100) can divide (or classify) the entire area of ​​the projected image into multiple areas. The electronic device (100) can divide the entire area of ​​the projected image into multiple areas using brightness map information. The electronic device (100) can obtain a brightness value for each pixel of the projected image. The electronic device (100) can determine which brightness range the brightness value of each of the multiple pixels falls within, thereby distinguishing (or classifying) the class of each pixel. The brightness value can be described as a luminance value.

[0295] For example, it is assumed that a first range, a second range, and a third range are distinguished based on the range of brightness values. The electronic device (100) can analyze whether a pixel belongs to the first range, the second range, or the third range based on the brightness value of each of the plurality of pixels. The first range, the second range, and the third range can be described as a first class (or first group), a second class (or second group), and a third class (or third group). The electronic device (100) can distinguish an area for each range by determining which range (or class or group) the plurality of pixels belong to. The electronic device (100) can perform an image correction function for each distinguished area.

[0296] FIG. 6 is a diagram for explaining an operation of acquiring sensing data according to one embodiment.

[0297] Referring to the embodiment (610) of FIG. 6, the electronic device (100) may include a sensor unit (121). The sensor unit (121) may include an illuminance sensor (121-1). The electronic device (100) may obtain sensing data through the illuminance sensor (121-1). The electronic device (100) may obtain illuminance information of the surrounding environment based on the illuminance value included in the sensing data.

[0298] Referring to an embodiment (620) of FIG. 6, the electronic device (100) can obtain sensing data from an external device (200). The external device (200) can include a device capable of sensing an illuminance value. For example, the external device (200) can include at least one of an IoT (Internet of Things) camera and an illuminance sensor. The electronic device (100) can communicate with the external device (200). The electronic device (100) can transmit a control command for sensing an illuminance value to the external device (200). The external device (200) can obtain sensing data based on the control command received from the electronic device (100). The external device (200) can transmit the sensing data to the electronic device (100). The electronic device (100) can obtain an illuminance value included in the sensing data. The electronic device (100) can obtain illumination information of the surrounding environment based on the illumination value included in the sensing data.

[0299] Referring to the embodiment (630) of FIG. 6, the electronic device (100) may include a sensor unit (121). The sensor unit (121) may include a light sensor (121-1) and an image sensor (121-2).

[0300] The electronic device (100) can acquire a photographed image through an image sensor (121-2). The electronic device (100) can identify the location of the user (20) based on the photographed image.

[0301] The electronic device (100) can obtain sensing data at the location of the user (20). After moving to the location of the user (20), the electronic device (100) can obtain illumination data (or sensing data) through the illumination sensor (121-1).

[0302] According to various embodiments, the electronic device (100) may communicate with an external device (200). The external device (200) may include a lighting device or a display device. The electronic device (100) may transmit a control command to control brightness to the external device (200). The external device (200) may output a light source based on the control command.

[0303] FIG. 7 is a drawing for explaining an operation of outputting a projection image on a projection surface (10) according to one embodiment.

[0304] Referring to the embodiment (710) of FIG. 7, the electronic device (100) can obtain sensing data for the projection surface (10). The sensing data may include a photographed image. The electronic device (100) can obtain sensing data including the photographed image through the image sensor (121-2). The electronic device (100) can obtain the photographed image including the projection surface (10).

[0305] The electronic device (100) can capture a photographed image in a state (or environment) where the aperture is fixed and the shutter speed is fixed. The electronic device (100) can capture a photographed image based on sensitivity information. The sensitivity information may include information regarding exposure settings related to light. The sensitivity information may include information indicating the exposure sensitivity associated with the image sensor.

[0306] For example, sensitivity information may include ISO (International Organization for Standardization) sensitivity. A higher ISO sensitivity may indicate increased exposure to light. The average brightness of a captured image obtained at a first ISO sensitivity (or ISO value) may be brighter than the average brightness of a captured image obtained at a second ISO sensitivity, which is lower than the first ISO sensitivity.

[0307] After acquiring a photographed image, the electronic device (100) can acquire an average B (brightness) value based on the HSB (Hue, Saturation, Brightness) area.

[0308] The electronic device (100) can convert (or change) the captured image into the HSB region (or HSB color space). The HSB region can represent hue, saturation, and brightness for the target image. The electronic device (100) can convert the RGB values ​​included in the captured image into the HSB region. The electronic device (100) can obtain an HSB value including a hue value, a saturation value, and a brightness value for each of a plurality of pixels included in the captured image. The electronic device (100) can obtain a first value by adding up the brightness values ​​for all pixels, and obtain a second value by dividing the first value by the number of all pixels. The electronic device (100) can determine the second value as an average B value for the captured image.

[0309] An electronic device (100) can acquire a captured image through an image sensor. The electronic device (100) can identify a projection surface (10) by identifying an object representing the projection surface (10) among a plurality of objects included in the captured image. The electronic device (100) can identify an object representing the projection surface (10) or an area representing the projection surface (10) in the captured image. The area representing the projection surface (10) can be described as a projection surface area.

[0310] For example, the electronic device (100) can determine an area representing the projection surface (10) for obtaining a brightness value. The area for obtaining the brightness value can be determined as a target area. The electronic device (100) can obtain a brightness value using an average function, a maximum function, a minimum function, etc. for the target area. The electronic device (100) can obtain a brightness value of the target area. The electronic device (100) can obtain at least one of an average brightness value, a maximum brightness value, and a minimum brightness value of the target area. One of the brightness values ​​related to the target area can be determined as a representative brightness value.

[0311] For example, the electronic device (100) can obtain a brightness value for the entire area representing the projection surface (10). The brightness value can include at least one of an average brightness value, a maximum brightness value, and a minimum brightness value. The brightness value can be described as brightness information. The electronic device (100) can generate brightness map information based on the brightness value for the entire area representing the projection surface (10). The brightness map information can represent map information that maps the positions of each of a plurality of pixels included in the captured image and the brightness values ​​corresponding to the positions.

[0312] According to various embodiments, the electronic device (100) can capture a projection surface (10) without outputting an image. The electronic device (100) can obtain a captured image by capturing the projection surface (10) without outputting any image through the projection unit (112).

[0313] According to various embodiments, the electronic device (100) can capture a projection surface (10) while outputting a reference image. The reference image can be described as a text image or a preset image. When the reference image is output, the brightness of the projection surface (10) can be measured more accurately. In cases where it is difficult to accurately measure the brightness of the projection surface (10) depending on the surrounding environment, the electronic device (100) can capture an image by outputting a reference image to the projection surface (10) and projecting the reference image onto the projection surface (10).

[0314] The electronic device (100) can obtain a photographed image through an external device (200). The electronic device (100) can generate a control command for photographing the projection surface (10). The electronic device (100) can transmit the control command for photographing the projection surface (10) to the external device (200). The external device (200) can obtain a photographed image by photographing the projection surface (10) based on the control command. The external device (200) can transmit the photographed image to the electronic device (100). The electronic device (100) can receive the photographed image from the external device (200). The electronic device (100) can obtain a projection surface brightness value based on the photographed image received from the external device (200). The external device (200) can include an IoT (Internet of Things) camera or a user terminal device including a camera.

[0315] Referring to embodiment (720), at least one processor (111) can output a projection image (721) to a projection surface (10). An area of ​​the projection surface (10) where the projection image (721) is output can be identified as a projection area.

[0316] FIG. 8 is a drawing for explaining a correction distance table according to one embodiment.

[0317] Table (810) of Fig. 8 may represent a correction distance table. The correction distance table may include correction distances corresponding to environmental illuminance values ​​and projection surface brightness values. The environmental illuminance value may be described as an environmental illuminance value or an illuminance value of the surrounding environment. The projection surface brightness value may be described as a brightness value of the projection surface (10) or a projection surface luminance value.

[0318] The projection surface brightness value can be described as the first brightness value.

[0319] The electronic device (100) can obtain an ambient illuminance value through an illuminance sensor (121-1). The ambient illuminance value can be described as an ambient illuminance value. The electronic device (100) can obtain a projection surface brightness value through an image sensor (121-2).

[0320] The electronic device (100) can obtain (or identify) correction distance information corresponding to the environmental illuminance value and the projection surface brightness value among a plurality of correction distances included in the correction distance table. The electronic device (100) can change the projection position of the electronic device (100) based on the correction distance information.

[0321] For example, assuming that the ambient illuminance is 300 lux and the projection surface brightness is 100 ISO, the electronic device (100) can determine the compensation distance information as -20%. The electronic device (100) can move 20% closer to the projection surface (10).

[0322] The compensation distance table may include a screen size loss ratio corresponding to the compensation distance. As the screen gets closer to the projection surface (10), the screen size may decrease and the brightness may increase.

[0323] FIG. 9 is a diagram illustrating a projection position calculation module according to one embodiment.

[0324] Referring to the embodiment (910) of FIG. 9, the electronic device (100) can determine a projection position using a projection position calculation module. The electronic device (100) can input at least one of a current position, an environmental illuminance value, and a projection surface brightness value into the projection position calculation module. The electronic device (100) can obtain a projection position as output data of the projection position calculation module. The electronic device (100) can move to the projection position.

[0325] The projection position calculation module may be described as a projection position calculation model or a projection position determination model. The projection position calculation module may include a proportional expression for calculating an optimal movement distance.

[0326] According to various embodiments, the electronic device (100) may obtain correction distance information using the environmental illuminance value. In situations where the image sensor (121-2) is unavailable or the image quality of the captured image is low, reducing analysis accuracy, it may be difficult for the electronic device (100) to obtain the projection surface brightness value. The electronic device (100) may obtain correction distance information using only the environmental illuminance value.

[0327] When the environmental illuminance value is below a threshold value, the electronic device (100) can obtain compensation distance information. The electronic device (100) can move closer to the projection surface (10). The electronic device (100) can obtain compensation distance information based on the environmental illuminance value. The lower the environmental illuminance value, the greater the compensation distance. The lower the sensed illuminance value, the closer the electronic device (100) can decide to move to the projection surface (10).

[0328] According to various embodiments, the electronic device (100) can obtain correction distance information using the projection surface brightness value. The electronic device (100) may have difficulty obtaining the environmental illuminance value in a situation where the illuminance sensor (121-1) is not available. The electronic device (100) can obtain correction distance information using only the projection surface brightness value.

[0329] If the brightness value of the projection surface is lower than or equal to a threshold value, the electronic device (100) can obtain correction distance information. The electronic device (100) can move closer to the projection surface (10). The electronic device (100) can obtain correction distance information based on the brightness value of the projection surface. The lower the brightness value of the projection surface, the larger the correction distance. The lower the brightness value of the projection surface obtained from the captured image, the closer the electronic device (100) can decide to move to the projection surface (10).

[0330] According to various embodiments, the electronic device (100) can obtain correction distance information based on a previously stored distance-based brightness database.

[0331] The brightness value of the light source output from the projection unit (112) may be preset. If the brightness value of the light source output from the projection unit (112) is within a preset range, a representative brightness value may exist. The electronic device (100) may determine the average brightness value or the central brightness value that the projection unit (112) can output as the representative brightness value.

[0332] When a light source is output with a representative brightness value, the brightness value (third brightness value) of the projection area perceived may vary depending on distance. The closer the distance, the higher the brightness value (third brightness value) of the projection area may be.

[0333] The electronic device (100) can pre-store a distance-based brightness database containing brightness values ​​of projection areas at different distances in the memory (113). For example, the distance-based brightness database can include a brightness value of a projection area measured at 1 m, a brightness value of a projection area measured at 2 m, and a brightness value of a projection area measured at 3 m.

[0334] The distance-to-brightness database can be described as a distance-to-brightness table, distance-to-brightness table information, or distance-to-brightness mapping database.

[0335] For example, the electronic device (100) can predict the distance between the projection surface and the electronic device (100) based on the brightness value of the projection area measured at the current point in time and the previously stored distance-based brightness database. The electronic device (100) can obtain correction distance information based on the predicted distance.

[0336] For example, the electronic device (100) can identify correction distance information based on a previously stored distance-based brightness database to output a projection image with a desired brightness value.

[0337] According to various embodiments, the electronic device (100) can obtain correction distance information using the illuminance value of the surrounding environment. In the above description, the projection surface brightness value can be replaced with the illuminance value of the surrounding environment. Duplicate explanation is omitted.

[0338] FIG. 10 is a drawing for explaining an operation of outputting a projection image according to one embodiment.

[0339] Referring to the embodiment (1010) of FIG. 10, the electronic device (100) can output a projection image on the projection surface (10). The projection image can be described as content.

[0340] According to various embodiments, the electronic device (100) may receive a projected image through an external source device. The external source device may include a content provider device or a set-top box. The electronic device (100) may be connected to the external source device through an input / output interface. For example, the input / output interface may include HDMI.

[0341] The electronic device (100) can obtain brightness information (or brightness value) for a projected image (or projected content) received from an external source device. The brightness information can be described as average brightness information or an average brightness value. The electronic device (100) can obtain brightness information using pixel information of the projected image received from the external source device.

[0342] If the projection image is a still image, the electronic device (100) can obtain an average brightness value of a plurality of pixels included in the projection image.

[0343] If the projected image is a video, the electronic device (100) can obtain the average brightness value of each of the multiple frames included in the video.

[0344] The projection image may be a test image for brightness adjustment. The test image may be an image containing only a single color value. The test image may be a monochrome image.

[0345] Brightness information for a projected image (or projected content) may be described as a brightness value of the projected image. The brightness value of the projected image may be described as a second brightness value.

[0346] According to various embodiments, the electronic device (100) may receive a projection image from an external server. The electronic device (100) may analyze the projection image received from the external server to obtain brightness information of the projection image. The electronic device (100) may be connected to the external server through a communication interface (114). The communication interface (114) may include a wired communication module. The wired communication module may include a communication module for connecting to an Internet network. The external server may include a content providing server.

[0347] According to various embodiments, the electronic device (100) may receive a projected image through an antenna. The electronic device (100) may receive an RF (Radio Frequency) signal including the projected image through the antenna. The communication interface (114) may include a wireless communication module. The wireless communication module may include an antenna.

[0348] According to various embodiments, the electronic device (100) may receive a projection image from a user terminal device. The electronic device (100) may analyze the projection image received from the user terminal device to obtain brightness information of the projection image. The electronic device (100) may be connected to the user terminal device using a Wi-Fi communication module or a short-range communication module (e.g., NFC).

[0349] According to various embodiments, the electronic device (100) can acquire a photographed image using the image sensor (121-2) while outputting the projection image to the projection surface (10). After the projection image is output to the projection surface (10), the electronic device (100) can acquire a photographed image through the image sensor (121-2). The photographed image can include the projection image projected onto the projection surface (10).

[0350] According to various embodiments, the electronic device (100) can obtain a photographed image through an external device (200) while outputting a projection image to the projection surface (10). After the projection image is output to the projection surface (10), the electronic device (100) can obtain a photographed image through the external device (200). After the projection image is output to the projection surface (10), the electronic device (100) can generate a control command for capturing the projection surface (10) from the external device (200). The electronic device (100) can transmit the control command to the external device (200). The external device (200) can receive the control command and capture the projection surface (10). The external device (200) can obtain a photographed image and transmit the obtained photographed image to the electronic device (100). The electronic device (100) can receive the photographed image from the external device (200). The external device (200) may include an IoT (Internet of Things) camera or a user terminal device including a camera.

[0351] According to various embodiments, the electronic device (100) can calculate the sharpness of the captured image. If the sharpness of the captured image is below a threshold sharpness, the electronic device (100) can change the projection position to be closer to the projection surface (10).

[0352] According to various embodiments, the electronic device (100) may acquire the brightness value of the captured image. If the brightness value of the captured image is below a threshold value, the electronic device (100) may change the projection position. The changed projection position may include a position closer to the projection surface (10) than the current position.

[0353] The brightness value of the captured image can be described as a third brightness value.

[0354] According to various embodiments, the electronic device (100) can obtain a brightness value of a projected image. The electronic device (100) can obtain a brightness value of a captured image. Each brightness value may include an average brightness value or an average brightness value.

[0355] The electronic device (100) can obtain a difference between the brightness value of the projected image and the brightness value of the captured image. If the difference value is greater than a threshold value, the electronic device (100) can change the projection position. The changed projection position may include a position closer to the projection surface (10) than the current position.

[0356] If the difference value is less than the threshold value, the electronic device (100) may not change the projection position. If the difference value is within the threshold range, the electronic device (100) may not change the projection position.

[0357] According to various embodiments, the electronic device (100) may obtain an ambient illuminance value before outputting a projection image. Before outputting the projection image, correction distance information may be determined based on the ambient illuminance value. The electronic device (100) may determine a projection position based on the correction distance information.

[0358] The electronic device (100) can obtain the brightness value of the captured image after outputting the projection image. The electronic device (100) can compare the brightness value of the projected image with the brightness value of the captured image to determine whether to change the projection position. For example, the electronic device (100) can change the projection position and move to the changed projection position.

[0359] According to various embodiments, after outputting a projection image, the electronic device (100) can determine a projection position based on an environmental illuminance value, a brightness value of the projection image, and a brightness value of the captured image. The electronic device (100) can obtain a difference value between the brightness value of the projection image and the brightness value of the captured image.

[0360] The electronic device can change the projection position of the electronic device (100) when the environmental illuminance value is less than or equal to a first threshold value and the difference value is less than or equal to a second threshold value.

[0361] According to various embodiments, the electronic device (100) may obtain an ambient illuminance value before outputting a projection image. Before outputting the projection image, correction distance information may be determined based on the ambient illuminance value. The electronic device (100) may determine a projection position based on the correction distance information.

[0362] According to various embodiments, the electronic device (100) may obtain the brightness value of the projected image and the brightness value of the captured image after outputting the projected image. The electronic device (100) may compare the brightness value of the projected image and the brightness value of the captured image to determine whether to change the projection position. The electronic device (100) may obtain a difference value between the brightness value of the projected image and the brightness value of the captured image. The electronic device (100) may determine the projection position based on the difference value. If the difference value exceeds a threshold value, the electronic device (100) may change the projection position. The electronic device (100) may move closer to the projection surface (10) as the difference value increases.

[0363] FIG. 11 is a drawing for explaining an operation of obtaining distance information based on a projection surface (10), a user (20), and an electronic device (100), according to one embodiment.

[0364] Referring to the embodiment (1110) of FIG. 11, the electronic device (100) can obtain (or calculate) a distance (d20) between the electronic device (100) and the user (20). The sensor unit (121) can include a sensor for measuring the distance. The sensor for measuring the distance can include at least one of an image sensor (121-2), a lidar sensor, and a 3D ToF (Time of Flight) sensor.

[0365] The electronic device (100) can obtain (or calculate) the distance (d10) between the electronic device (100) and the projection surface (10). The electronic device (100) can obtain the first distance (d10) based on sensing data obtained through the sensor unit (121).

[0366] The electronic device (100) can obtain a third distance (d30) by adding the first distance (d10) and the second distance (d20). The distance (d30) can represent the distance between the projection surface (10) and the user (20).

[0367] The first distance (d10), the second distance (d20), and the third distance (d30) can be described as distance values, etc.

[0368] The electronic device (100) can identify the location of the user (20) based on at least one of the first distance (d10), the second distance (d20), and the third distance (d30). The electronic device (100) can determine the location of the user (20) in the space where the electronic device (100) exists.

[0369] The electronic device (100) can change the resolution of a projected image based on a preset event. The action of changing the resolution may include changing the size of the projected image. For example, if the resolution is changed while the position of the electronic device (100) is fixed, the size of the projected image output on the projection surface (10) may change.

[0370] The electronic device (100) can identify a movement distance for moving from a current location to a projection location. The preset event may include an event in which the movement distance is identified as being greater than a threshold distance.

[0371] If the movement distance is greater than a threshold distance, the electronic device (100) can change the resolution of the projection image.

[0372] As the electronic device (100) gets closer to the projection surface (10), the size of the projection area where the projection image output to the projection surface (10) is output may also decrease. The electronic device (100) can increase (or expand) the projection area by increasing the size of the projection image.

[0373] As the electronic device (100) moves away from the projection surface (10), the size of the projection area where the projection image output on the projection surface (10) is output may also increase. The electronic device (100) may reduce (or reduce) the projection area by reducing the size of the projection image.

[0374] If the movement distance is less than the threshold distance, the electronic device (100) can maintain the resolution of the projected image. If the movement distance is less than the threshold distance, the electronic device (100) can determine that the projected image output with the current settings is suitable for the user.

[0375] According to various embodiments, the electronic device (100) can obtain (or calculate) the measured size (s10) of the projection image output to the projection surface (10). The electronic device (100) can obtain (or calculate) the measured size of the projection image output after moving according to the movement distance.

[0376] The unit of the measured size (s10) of the projected image may be the same as the unit of distance. The measured size of the projected image may be expressed as the length of the projected image.

[0377] The electronic device (100) can obtain the degree of change in the measured size of the projection image. The degree of change may include a difference value between the measured size of the projection image before the change and the measured size of the projection image after the change.

[0378] The electronic device (100) can change the size of the UI (User Interface) elements provided by the electronic device (100) based on a change in the projection position (moved closer to the projection surface (10)).

[0379] FIG. 12 is a drawing for explaining an operation of changing the size of a UI element according to one embodiment.

[0380] Referring to embodiment (1210), the electronic device (100) can output a projection image (1211) and a UI element (1215).

[0381] Referring to embodiment (1220), the electronic device (100) can output a projection image (1211) at a specific location (second projection location) and a UI element (1225) of a changed size. The electronic device (100) can maintain the size of the projection image (1211) at the specific location (second projection location) and change the size of the UI element (1225).

[0382] When the first distance (d10) between the electronic device (100) and the projection surface (10) decreases, the electronic device (100) can increase (or enlarge) the size of the UI element. The electronic device (100) can determine the change ratio of the UI element based on the movement distance.

[0383] FIG. 13 is a drawing for explaining a screen for changing the size of a UI element according to one embodiment.

[0384] Referring to embodiment (1310) of FIG. 13, the electronic device (100) can change the size of a UI element based on a user input. When a user input for changing the size of a UI element is received, the electronic device (100) can change the size of the UI element and output it.

[0385] For example, when an event is identified in which the measurement size of the projection image changes, the electronic device (100) can output a guide screen (1311) for changing the UI element.

[0386] For example, if the degree of change in the measured size of the projection image exceeds a threshold value, the electronic device (100) can output a guide screen (1311) for changing the UI element.

[0387] Referring to embodiment (1310), the electronic device (100) may output a guide screen (1311) for changing the size of a UI element. The guide screen (1311) may include at least one of text information related to changing the size of the UI element and information indicating the degree of change.

[0388] When user input is received through the guide screen (1311), the electronic device (100) can change the size of the UI element based on the user input.

[0389] Referring to an embodiment (1320) of FIG. 13, the electronic device (100) can utilize a GUI (1322) to change the size of a UI element. The electronic device (100) can output a projection image (1321) together with the GUI (1322). The GUI (1322) can be described as a movement menu, a movement icon, a movement item, etc. When a user input for changing at least one of the position or size of the projection image (1321) is received through the GUI (1322), the electronic device (100) can change at least one of the position or size of the projection image (1321) based on the user input. When the GUI (1322) is moved by the user input, the user can recognize the changed projection image (1321) in real time.

[0390] According to various embodiments, if the degree of change in the measured size of the projection image is below a threshold value, the electronic device (100) may not change the size of the UI element. The electronic device (100) may maintain the size of the UI element.

[0391] According to various embodiments, if the degree of change in the measured size of the projection image is less than a threshold value, the electronic device (100) may output a guide screen (1311) for changing the UI element.

[0392] According to various embodiments, the electronic device (100) may identify (or obtain) a measured size of a UI element output to the projection surface (10). If the measured size of the UI element output to the projection surface (10) is less than or equal to a threshold value, the electronic device (100) may select a specific UI element based on a user input. For example, the user input may include an input for selecting a scroll button included in the electronic device (100).

[0393] FIG. 14 is a drawing for explaining a moving operation of an electronic device (100) according to one embodiment.

[0394] Referring to embodiment (1410) of FIG. 14, the electronic device (100) can move based on a projection position. The electronic device (100) can obtain a projection position for moving the electronic device (100).

[0395] According to various embodiments, the electronic device (100) can move based on the projection position without outputting a projected image. Once the projection position is identified (or acquired), the electronic device (100) can determine whether a projected image is being output. If the projected image is not being output, the electronic device (100) can move based on the projection position.

[0396] If a projection image is being output, the electronic device (100) can stop the projection operation of the projection image. After stopping the output of the projection image, the electronic device (100) can move based on the projection position.

[0397] According to various embodiments, when a projection image is being output, the electronic device (100) can move while maintaining the projection operation of the projection image. The electronic device (100) can simultaneously perform the operation of outputting the projection image and the operation of moving based on the projection position.

[0398] The electronic device (100) can change the resolution of the projection image while performing a movement motion. If the resolution of the projection image is changed during movement, the change in the size of the projection image (output on the projection surface (10)) that occurs due to the movement can be reduced.

[0399] An electronic device (100) can change the size of a UI element while performing a movement action. If the size of a UI element changes during movement, the change in the size of the UI element (output on the projection surface (10)) that occurs due to the movement can be reduced.

[0400] FIG. 15 is a diagram for explaining a notification for a location movement according to one embodiment.

[0401] Referring to the embodiment (1510) of FIG. 15, when a moving event is identified based on the projection position, the electronic device (100) can output a movement notification screen (1511).

[0402] The movement notification screen (1511) may include at least one of a UI (1511-1) requesting user input for movement of the location of the electronic device (100) or a UI (1511-2) for setting whether to display the movement notification screen.

[0403] When a user input including a movement command is received through the UI (1511-1), the electronic device (100) can move based on the projection position.

[0404] When a user input is received to set the device to move without a movement notification screen through the UI (1511-2), the electronic device (100) may no longer display the movement notification screen (1511). When the electronic device (100) moves after the user input is received, the electronic device (100) may not display the movement notification screen (1511).

[0405] According to various embodiments, the electronic device (100) can automatically move based on the projection position without providing a movement notification screen. The electronic device (100) can detect a change in the size of the projection image according to the movement. The size of the projection image output on the projection surface (10) can be described as a measured size. The electronic device (100) can obtain the degree of change in the measured size of the projection image. The electronic device (100) can control the movement speed so that the measured size does not change abruptly.

[0406] The electronic device (100) can move at a speed lower than the critical speed. When the electronic device (100) moves at a speed lower than the critical speed, the size of the projection image output to the projection surface (10) may not change rapidly.

[0407] FIG. 16 is a drawing for explaining a position movement criterion according to one embodiment.

[0408] Referring to the embodiment (1600) of FIG. 16, the electronic device (100) may be controlled to be located outside a preset range or threshold distance (r) with respect to the user (20) based on a preset event. The electronic device (100) may identify the location of the user (20). The electronic device (100) may be moved to be located outside the threshold distance (r) with respect to the location of the user (20).

[0409] The preset events may include events in which the strength of a communication signal used to receive a projection image is identified as being below a threshold strength.

[0410] The electronic device (100) can receive content including a projection image from an external device. The external device may be an external server or content providing device that provides content. For example, the external device may include a broadcast content providing server, an OTT (Over The Top) providing server, a set-top box device, etc. The electronic device (100) can establish a communication session with the external device and receive content based on the established communication session. The electronic device (100) can be connected to the external device for communication.

[0411] The electronic device (100) can identify the status of the communication connection with an external device. If the communication connection is weak, the output of the projected image may be interrupted or its quality may deteriorate. If the communication connection is weak, the synchronization of audio data and image data may be mismatched.

[0412] The communication connection status can be determined based on the strength of the communication signal. The electronic device (100) can identify the communication signal strength at the current location (the first location). If the communication signal strength is below a threshold strength, the electronic device (100) can determine that the communication connection status is poor. If the communication signal strength is below the threshold strength, the electronic device (100) can move to a target location. When the electronic device (100) moves, the communication signal strength can increase. The electronic device (100) can move to the target location based on the communication signal strength.

[0413] The target location may include any location that is more than a threshold distance away from the location of the user (20). The electronic device (100) may identify the location of the user (20). The electronic device (100) may determine one location (second location) among a plurality of locations that are more than a threshold distance away from the location of the user (20) as the target location. The electronic device (100) may determine the location closest to the electronic device (100) among the plurality of locations as the target location. The electronic device (100) may re-identify the communication signal strength after moving from the first location to the second location. If the communication signal strength identified at the second location is less than or equal to the threshold strength, the electronic device (100) may determine a third location, not the second location, among the plurality of locations as the target location.

[0414] FIG. 17 is a drawing for explaining a keystone correction function according to one embodiment.

[0415] Referring to embodiment (1710) of FIG. 17, when the inclination of the electronic device (100) changes due to positional movement, the electronic device (100) may perform a keystone correction function. The keystone correction function may include an operation of correcting a trapezoidal image into a rectangular image.

[0416] The electronic device (100) can output a projection image in a state where a vertical inclination exists.

[0417] Referring to Example (1720), the electronic device (100) can output a projection image (1721) in a state where a vertical inclination exists, and due to the vertical inclination, the projection image (1721) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. In order to solve a problem caused by the presence of a horizontal inclination, the electronic device (100) can perform a keystone function.

[0418] Referring to Example (1730), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (1731) becomes rectangular in shape.

[0419] FIG. 18 is a drawing for explaining a keystone correction function according to one embodiment.

[0420] Referring to the embodiment (1810) of FIG. 18, when the inclination of the electronic device (100) changes according to the position movement, the electronic device (100) can perform a keystone correction function.

[0421] The electronic device (100) can output a projection image in a state where a horizontal inclination exists.

[0422] Referring to Example (1820), the electronic device (100) can output a projection image (1821) in a state where a horizontal inclination exists, and due to the horizontal inclination, the projection image (1821) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. To solve a problem caused by the presence of the horizontal inclination, the electronic device (100) can perform a keystone function.

[0423] Referring to Example (1830), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (1831) becomes rectangular in shape.

[0424] According to various embodiments, the electronic device (100) can perform keystone correction at various points in time. It is assumed that the electronic device (100) is present at a first location (current location). It is assumed that the electronic device (100) moves to a second location (projection location) and outputs a projected image.

[0425] For example, the electronic device (100) can perform keystone correction at a first location. After completing the keystone correction at the first location, the electronic device (100) can move to a second location. The electronic device (100) can output a projection image on which keystone correction has been performed at the second location.

[0426] For example, the electronic device (100) can perform keystone correction while moving from a first position to a second position. The electronic device (100) can output a projection image on which keystone correction has been performed at the second position.

[0427] For example, the electronic device (100) can perform keystone correction at a second location. The electronic device (100) can output a projection image on which keystone correction has been performed at the second location.

[0428] According to various embodiments, the electronic device (100) can output a projection image while moving. To output a projection image while moving, the electronic device (100) can perform keystone correction in real time while moving. The electronic device (100) can perform keystone correction based on each position while moving from a first position to a second position. The electronic device (100) can output a projection image for which keystone correction has been performed in real time at each position while moving. The keystone correction can be performed gradually at each position.

[0429] FIG. 19 is a drawing for explaining a screen related to power information according to one embodiment.

[0430] Referring to FIG. 19, the electronic device (100) can obtain power information of the electronic device (100). The power information can include the remaining battery capacity of the electronic device (100).

[0431] Referring to Example (1910), if the remaining battery level is below a threshold value, the electronic device (100) may display a screen (1911) corresponding to a low battery event.

[0432] The screen (1910) may include at least one of a UI (1920) indicating that the remaining battery power is low, and a UI (1930) indicating an action corresponding to a low battery event. The action corresponding to the low battery event may include an action of lowering the brightness and moving toward the projection surface (10), or an action of reducing the size of the projection image and moving away from the projection surface (10). When a user input is selected through the UI (1930), the electronic device (100) may perform an action corresponding to the user input.

[0433] The UI (1930) may include at least one of an item to lower the brightness and move closer to the projection surface, an item to lower the screen size and move further away from the projection surface, and an item to lower the brightness without moving.

[0434] The electronic device (100) can perform an action corresponding to a low battery event without providing a screen (1910).

[0435] According to various embodiments, when the remaining battery level is below a threshold value, the electronic device (100) may reduce the brightness of the light source of the projection unit (112). When the brightness of the light source is reduced, battery consumption may be reduced. After reducing the brightness of the light source, the electronic device (100) may move toward the projection surface (10). This is because when moving toward the projection surface (10) while reducing the brightness of the light source, the brightness value of the projected image output to the projection surface (10) may be maintained. The moving distance may correspond to the amount of change in the brightness of the light source.

[0436] The electronic device (100) can obtain the amount of change in brightness of a light source. The electronic device (100) can move toward the projection surface (10) by a distance corresponding to the amount of change in brightness of the light source. The amount of change in brightness of the light source and the distance of movement may be proportional.

[0437] According to various embodiments, if the remaining battery power is below a threshold value, the electronic device (100) may reduce the size of the projected image. A reduction in the size of the projected image may reduce battery consumption. After reducing the size of the projected image, the electronic device (100) may move in a direction opposite to the projection surface (10). When the size of the projected image is reduced, the electronic device (100) may move in a direction opposite to the direction in which the electronic device (100) faces the projection surface (10). The electronic device (100) may move away from the projection surface (10) from its current position.

[0438] When the position of the electronic device (100) changes, the electronic device (100) can change the size of the UI element based on the movement distance.

[0439] The electronic device (100) can change the size of the UI element based on the movement distance. The electronic device (100) can change the size of the UI element in proportion to the movement distance. When the electronic device (100) moves toward the projection surface (10), the electronic device (100) can enlarge the size of the UI element based on the movement distance. When the electronic device (100) moves opposite to the projection surface (10), the electronic device (100) can reduce the size of the UI element based on the movement distance.

[0440] When the position of the electronic device (100) changes, the electronic device (100) may display a guide screen for changing the size of the UI element. The guide screen may include a setting menu for changing the size of the UI element. The guide screen may include a plurality of items for selecting the size of the UI element. When a user input for changing the size of the UI element is received through the guide screen, the electronic device (100) may change the size of the UI element based on the user input.

[0441] According to various embodiments, the electronic device (100) can obtain an environmental illuminance value in real time. When the environmental illuminance value changes, the electronic device (100) can change the brightness of the light source output from the projection unit (112) based on the changed environmental illuminance value.

[0442] When the environmental illuminance value decreases, the electronic device (100) can increase the brightness of the light source output from the projection unit (112).

[0443] As the environmental illuminance value increases, the electronic device (100) can reduce the brightness of the light source output from the projection unit (112).

[0444] Events that change the ambient illuminance value may include events that change the intensity of sunlight. For example, at 1:00 PM, sunlight may be strong, resulting in a high ambient illuminance value. At 8:00 PM, sunlight may be weak, resulting in a low ambient illuminance value.

[0445] An event that changes the ambient illuminance value may include an event that changes the interior lighting in the space where the electronic device (100) is located. For example, when a light switch is turned on in an interior space, the ambient illuminance value may increase due to the lighting.

[0446] FIG. 20 is a drawing for explaining an operation of changing a projection area according to one embodiment.

[0447] Referring to the embodiment (2010) of FIG. 20, when the size of a projection image changes, the electronic device (100) can newly identify a projection surface corresponding to the changed size. The electronic device (100) can determine a projection surface corresponding to the size of the projection image. It is assumed that there are multiple candidate projection surfaces in the space where the electronic device (100) is placed. The electronic device (100) can output the projection image to the first projection surface (2011) among the multiple candidate projection surfaces. Changing the size of the projection image may include an operation of changing the resolution of the projection image or an operation of changing the aspect ratio of the projection image.

[0448] When the size of the projection image increases, the electronic device (100) can determine whether the increased size of the projection image can be projected on the first projection surface (2011). The electronic device (100) can compare the size of the projection image with the size of the first projection surface (2011). If the size of the projection image is larger than the size of the first projection surface (2011), the electronic device (100) can determine to change the projection surface. The electronic device (100) can determine a second projection surface (2012) having a size larger than the size of the projection image among a plurality of candidate projection surfaces. The electronic device (100) can output the projection image on the second projection surface (2012).

[0449] According to various embodiments, the electronic device (100) may determine whether to move based on attribute information of content including a projected image. The attribute information of the content may include at least one of information on the ratio of high-frequency components included in the content and information on whether an edge object is included.

[0450] If the proportion of high-frequency components among the multiple components included in the content is greater than or equal to a critical ratio, the electronic device (100) can move toward the projection surface (10).

[0451] When the content includes an edge object, the electronic device (100) can move toward the projection surface (10).

[0452] When the electronic device (100) is moved toward the projection surface (10), the projection image may become clearer. The clarity of the projection image may indicate that the quality of the projection image is relatively high.

[0453] If the content is music-related, the electronic device (100) can move toward the projection surface (10). By moving toward the projection surface (10), the electronic device (100) can reduce battery consumption when outputting the content.

[0454] The electronic device (100) can identify a moving object in the space where the electronic device (100) exists through the sensor unit (121). The moving object may include at least one of a human object and an animal object. The electronic device (100) can determine whether a moving object is identified based on sensing data acquired through the sensor unit (121).

[0455] The electronic device (100) can determine the size or projection position of the projected image based on the position of the moving object. The electronic device (100) can determine the projection position as an area other than an area with a possibility of movement by considering the possibility of movement of the moving object. The electronic device (100) can determine an area where the moving object is not expected to move as the projection position.

[0456] The electronic device (100) may include a microphone (118). The electronic device (100) may receive user input through the microphone (118). The user input may include voice input. The electronic device (100) may perform a function corresponding to the user input based on the user input including the user's voice.

[0457] The function corresponding to the user input may include a full-screen output (Full View) function. The full-screen output function may be described as a full-screen output mode. The electronic device (100) may receive a voice command and perform a function corresponding to the voice command.

[0458] FIG. 21 is a drawing for explaining an operation of outputting a projection image using a plurality of devices according to one embodiment.

[0459] Referring to embodiment (2110) of FIG. 21, according to various embodiments, a projection image (2111) may be output to a projection surface (10) by a plurality of electronic devices including a projection unit. The plurality of electronic devices may include a first electronic device (100-1) and a second electronic device (100-2).

[0460] A first electronic device (100-1) can output a portion (2111-1) of a projection image (2111) to a projection surface (10), and a second electronic device (100-2) can output a portion (2111-2) of the projection image to the projection surface (10). The electronic device (100) can perform a synchronization operation to synchronize the portion projected by the first electronic device (100-1) and the portion projected by the second electronic device (100-2). The synchronization operation can include an operation for multiple electronic devices to output images (or frames) at the same point in time.

[0461] The electronic device (100) may perform an edge blending function when outputting a projection image to multiple electronic devices. The edge blending function may include an operation in which multiple electronic devices project their respective images to output a single screen.

[0462] When the position of the electronic device (100) changes, the electronic device (100) can re-perform the edge blending function.

[0463] Referring to the embodiment (2120) of FIG. 21, multiple electronic devices can display the same projection image (2121) by overlapping them on the projection surface (10). When different electronic devices (100) output the projection image (2121) in the same area, the brightness can increase. Multiple electronic devices can perform a synchronization operation to synchronize the projection image (2121).

[0464] FIG. 22 is a drawing for explaining an appropriate screen size according to one embodiment.

[0465] Referring to FIG. 22, the electronic device (100) can determine the projection position by considering the third distance (d30) between the projection surface (10) and the user (20).

[0466] Table (2210) may include information on an appropriate screen size according to a third distance (d30) between the projection surface (10) and the user (20) and information on a distance between the projection surface (10) and the electronic device (100) for outputting the appropriate screen size. The appropriate screen size information may indicate one of the horizontal length or the diagonal length of the screen.

[0467] The electronic device (100) can determine multiple groups according to the third distance (d30) between the projection surface (10) and the user (20). For example, the electronic device (100) can divide the third distance (d30) according to a preset unit or preset range.

[0468] The examples below assume a projection ratio of 1.5.

[0469] For example, the electronic device (100) may determine that the appropriate screen size is 0 m to 0.5 m when the third distance (d30) is 0 m to 1 m. If the appropriate screen size is 0 m to 0.5 m, the electronic device (100) may determine that the appropriate distance between the electronic device (100) and the projection surface (10) is 0.33 m or more.

[0470] The electronic device (100) can determine whether the first distance (d10) corresponding to the third distance (d30) is included in an appropriate distance (or appropriate distance range) corresponding to the third distance (d30).

[0471] The electronic device (100) may not move if the first distance (d10) corresponding to the third distance (d30) is included in the appropriate distance (or appropriate distance range) corresponding to the third distance (d30).

[0472] The electronic device (100) can move if the first distance (d10) corresponding to the third distance (d30) is not included in the appropriate distance (or appropriate distance range) corresponding to the third distance (d30). The electronic device (100) can identify (or calculate) a projection position for movement. The electronic device (100) can move to the appropriate distance (or appropriate distance range) corresponding to the third distance (d30).

[0473] FIG. 23 is a drawing for explaining an operation of determining a projection position using an environment before outputting a projection image, according to one embodiment.

[0474] Referring to FIG. 23, the electronic device (100) can obtain an environmental illuminance value based on illuminance data sensed at the current location (S2310).

[0475] The electronic device (100) can obtain a first brightness value of a projection surface area included in the sensed first captured image (S2320).

[0476] The electronic device (100) can determine a first projection position based on the environmental illuminance value and the first brightness value (S2330). The electronic device (100) can obtain a correction distance corresponding to the environmental illuminance value and the first brightness value from a correction distance table.

[0477] The electronic device (100) can output a projection image after moving to the first projection position (S2340).

[0478] FIG. 24 is a drawing for explaining an operation of determining a projection position using an environment after outputting a projection image, according to one embodiment.

[0479] Referring to FIG. 24, the electronic device (100) can output a projection image at a first projection position (S2410). Step S2410 may correspond to step S2340 of FIG. 23.

[0480] The electronic device (100) can obtain a second brightness value of the projection image (S2420). The second brightness value may refer to the original brightness. The electronic device (100) can obtain a third brightness value of the projection area included in the second captured image (S2430).

[0481] The electronic device (100) can obtain a difference value between the second brightness value and the third brightness value (S2440). The electronic device (100) can determine whether the difference value exceeds a threshold value (third threshold value) (S2450).

[0482] If the difference value exceeds the threshold value (S2450-Y), the electronic device (100) can determine a second projection position that is closer to the projection surface (10) than the first projection position (S2460). The electronic device (100) can move to the second projection position and output a projection image (S2470).

[0483] FIG. 25 is a drawing for explaining an operation of changing the size of a UI element by considering the measured size of a projection area, according to one embodiment.

[0484] Referring to FIG. 25, the electronic device (100) can output a projection image at a second projection position (S2510). Step S2510 may correspond to step S2470 of FIG. 24.

[0485] The electronic device (100) can obtain a measurement size of a projection area included in the sensed third captured image (S2520). The measurement size can include at least one of a horizontal length, a vertical length, a diagonal length, and an area of ​​the projection area included in the third captured image.

[0486] The electronic device (100) can obtain distance information (third distance, d30) between the projection surface (10) and the user (20) (S2530). The electronic device (100) can obtain an intermediate value (fifth value) obtained by dividing the measurement size by the distance information (third distance) (S2540).

[0487] The electronic device (100) can determine whether the median value (fifth value) exceeds the threshold value (fourth threshold value) (S2550).

[0488] If the median value (the fifth value) exceeds the threshold value (the fourth threshold value) (S2550-Y), the electronic device (100) can obtain a result value (the sixth value) obtained by dividing the threshold value (the fourth threshold value) by the median value (the fifth value) (S2560). The electronic device (100) can change the UI size based on the result value (the sixth value).

[0489] FIG. 26 is a drawing for explaining a control method of an electronic device (100) according to one embodiment.

[0490] Referring to FIG. 26, the control method of the electronic device (100) includes a step of obtaining an environmental illuminance value based on first sensing data (S2605), a step of obtaining a first brightness value representing the brightness of a projection surface area based on the first sensing data (S2610), a step of determining a first projection position based on the environmental illuminance value and the first brightness value (S2615), a step of outputting a projection image stored in the electronic device (100) at the first projection position (S2620), a step of obtaining a second brightness value representing the brightness of the projection image (S2625), a step of obtaining a third brightness value representing the brightness of the projection area based on the second sensing data after the projection image is output on the projection surface (S2630), a step of determining a second projection position based on the second brightness value and the third brightness value (S2635), and a step of outputting the projection image at the second projection position (S2640).

[0491] The step of obtaining an environmental illuminance value may include obtaining first sensing data including illuminance data, and obtaining an environmental illuminance value representing the intensity of light in the surrounding environment based on the illuminance data.

[0492] The step of obtaining the first brightness value may include obtaining first sensing data including a first captured image, identifying a first target area representing a projection surface area corresponding to a projection surface among a plurality of areas included in the first captured image, and determining an average brightness value of a plurality of pixels corresponding to the first target area as the first brightness value.

[0493] The electronic device (100) stores a correction distance table including a plurality of correction distances, and the step of determining the first projection position can identify a correction distance corresponding to an environmental illuminance value and a first brightness value among the plurality of correction distances, and determine the first projection position based on the correction distance.

[0494] The electronic device (100) may further include a motor and a moving member, and the control method may further include a step of supplying a force generated by the motor to the moving member to move from the current position to the first projection position.

[0495] The step of obtaining the second brightness value can obtain the average brightness value of a plurality of pixels included in the projection image as the second brightness value.

[0496] The step of obtaining the third brightness value may include obtaining second sensing data including a second captured image, identifying a second target area corresponding to a projection area where a projection image is output among a plurality of areas included in the second captured image, and obtaining an average brightness value of a plurality of pixels corresponding to the second target area as the third brightness value.

[0497] The step of determining the second projection position may include obtaining a difference value between the second brightness value and the third brightness value, and if the difference value exceeds a threshold value, determining a second projection position that is closer to the projection surface than the first projection position.

[0498] The control method may further include a step of obtaining a first distance between the electronic device (100) and the projection surface, a step of obtaining a second distance between the electronic device (100) and the user, a step of obtaining a third distance between the user and the projection surface based on the first distance and the second distance, a step of obtaining third sensing data including a third captured image, a step of identifying a third target area corresponding to a projection area where a projection image is output among a plurality of areas included in the third captured image, a step of identifying a measured size of the third target area, and a step of determining a size of a UI (User Interface) provided by the electronic device (100) based on the third distance and the measured size.

[0499] The step of determining the size of the UI is to increase the size of the UI if the ratio of the measured size divided by the third distance is less than or equal to the threshold ratio.

[0500] Figure 27 is a drawing for explaining an operation of changing a projection image according to distance.

[0501] By moving toward the projection surface (10) and reducing the projection area, the size of the projection image (content) can be reduced. When the size of the projection image is reduced, the power consumed in outputting the projection image can be saved.

[0502] Referring to an embodiment (2710) of FIG. 27, the electronic device (100) can output a projection image (2711) at a projection position a first distance away from the projection surface. The projection image (2711) can include a first region (2711-1) and a second region (2711-2). The first region (2711-1) and the second region (2711-2) can include different contents. The electronic device (100) can distinguish a plurality of regions (2711-1, 2711-2) using edge lines in the projection image (2711).

[0503] The electronic device (100) can identify an event that moves the projection position closer to the projection surface while reducing the size of the projected image. The electronic device (100) can identify a target area (2711-2) based on preset criteria among a plurality of areas (2711-1, 2711-2). The target area based on the preset criteria can include at least one of a smaller area and an area selected as the main area by a user setting.

[0504] Referring to an embodiment (2720) of FIG. 27, the electronic device (100) may move closer to the projection surface, but may output only a projection image (2721) corresponding to the target area (2711-2) among the plurality of areas (2711-1, 2711-2). The electronic device (100) may convert the size of the image corresponding to the target area (2711-2) and output a new projection image (2721).

[0505] For example, if the content is music-related, the electronic device (100) may move toward the projection surface (10). When moving toward the projection surface (10), the electronic device (100) may reduce the size of the first projection image when outputting the content, thereby reducing battery consumption. The first projection image related to music content may include a first area representing an image related to music and a second area representing music playback information. When an event for reducing the size of the first projection image is identified, the electronic device (100) may generate a second projection image that includes only the second area, and output the generated second projection image. The second projection image may be smaller in size than the first projection image with respect to the projection surface. The location at which the second projection image is output may be closer to the projection surface than the location at which the first projection image is output.

[0506] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0507] The methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0508] The various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic device and the display device.

[0509] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When the instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or under the control of the processor using other components. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. 'Non-transitory' means that the storage medium does not contain signals and is tangible, but does not distinguish between whether data is stored semi-permanently or temporarily in the storage medium.

[0510] According to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0511] Each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0512] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea of ​​the present disclosure.

Claims

1. In electronic devices, Sensor section; memory; A projection unit that outputs a light source to the projection surface; and comprising at least one processor; At least one processor of the above, Identifying a first projection position based on the environmental illuminance value and the first brightness value of the projection surface based on the first data acquired through the above sensor unit, Obtain a second brightness value corresponding to the brightness of the projection image output through the projection unit at the first projection position, While the above projection image is being output, a third brightness value corresponding to the brightness of the projection area is acquired based on the second data acquired through the sensor unit, An electronic device that controls the projection unit so that the projection image is output at a second projection position identified based on the second brightness value and the third brightness value.

2. In paragraph 1, At least one processor of the above, An electronic device that obtains the environmental illuminance value corresponding to the intensity of light in the surrounding environment based on the first data including illuminance data obtained through the illuminance sensor included in the sensor unit.

3. In paragraph 1, At least one processor of the above, Acquire the first data including the first image acquired through the image sensor included in the above sensor unit, An electronic device that identifies an average brightness value of a plurality of pixels of a first target area corresponding to the projection surface among a plurality of areas included in the first image as a first brightness value of the projection surface.

4. In paragraph 1, The above memory is, Store a correction distance table containing multiple correction distances, At least one processor of the above, An electronic device that identifies the first projection position based on a correction distance corresponding to the environmental illuminance value and the first brightness value among the plurality of correction distances.

5. In paragraph 1, The above electronic device, motor; including the absence of movement; At least one processor of the above, An electronic device that supplies force generated by the motor to the moving member to move from the current position to the first projection position.

6. In paragraph 1, At least one processor of the above, An electronic device that obtains an average brightness value of a plurality of pixels included in the projection image as the second brightness value.

7. In paragraph 1, At least one processor of the above, By means of an image sensor included in the above sensor unit, the second data including the second image is acquired, An electronic device that obtains an average brightness value of a plurality of pixels included in a second target area corresponding to the projection area where the projection image is output among a plurality of areas included in the second image as the third brightness value.

8. In paragraph 1, At least one processor of the above, An electronic device that identifies the second projection position that is closer to the projection surface than the first projection position when the difference between the second brightness value and the third brightness value exceeds a threshold value.

9. In paragraph 1, At least one processor of the above, Obtaining a third distance between the user and the projection surface based on a first distance between the electronic device and the projection surface and a second distance between the electronic device and the user, Through the image sensor included in the sensor section, based on third data including a third image, a measurement size of a third target area corresponding to a projection area where the projection image is output among a plurality of areas included in the third image is obtained, An electronic device that identifies the size of a UI (User Interface) provided by the electronic device based on the third distance and the measured size.

10. In paragraph 9, At least one processor of the above, An electronic device that increases the size of the UI if the ratio of the measured size divided by the third distance is less than or equal to a threshold ratio value.

11. In a method for controlling an electronic device, A step of identifying a first projection position based on an environmental illuminance value and a first brightness value of a projection surface based on the acquired first data; A step of obtaining a second brightness value corresponding to the brightness of the projection image at the first projection position; A step of obtaining a third brightness value corresponding to the brightness of the projection area based on the acquired second data while the above projection image is being output; and A control method, comprising: a step of outputting the projection image at a second projection position identified based on the second brightness value and the third brightness value.

12. In paragraph 11, The above control method is, A control method further comprising: a step of obtaining the environmental illuminance value corresponding to the light intensity of the surrounding environment based on the first data including illuminance data; 13. In paragraph 11, The above control method is, A step of obtaining the first data including the first image; and A control method further comprising: a step of identifying an average brightness value of a plurality of pixels of a first target area corresponding to the projection surface among a plurality of areas included in the first image as a first brightness value of the projection surface.

14. In paragraph 11, The above electronic device, Store a correction distance table containing multiple correction distances, The step of identifying the first projection position is: A control method for identifying the first projection position based on a correction distance corresponding to the environmental illuminance value and the first brightness value among the plurality of correction distances.

15. In paragraph 11, The above electronic device, motor; and including the absence of movement; The above control method is, A control method further comprising: a step of supplying force generated by the motor to the moving member to move from the current position to the first projection position;

Images