Electronic device and control method thereof

Abstract

An electronic device according to the present invention comprises: a sensor unit; a memory; a projection unit for outputting a projection image; and at least one processor. The at least one processor acquires edge information on the basis of a captured image acquired through the sensor unit, and controls the projection unit, on the basis of depth information acquired through the sensor unit, to output a projection image corrected to correspond to a projection region based on at least one of a first projection surface region or a second projection surface region included in the edge information.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof for outputting a projection image by determining one area among a plurality of candidate projection areas.

[0002] When an electronic device performing a projection function outputs a projection image, the electronic device can correct the projection image according to the arrangement of the electronic device and the projection direction toward the projection surface to finally output the projection image.

[0003] A typical example of image correction might be keystone correction. Keystone correction can refer to the process of correcting a trapezoidal image into a rectangular shape. Specifically, the need for keystone correction can be determined based on the direction in which the electronic device projects toward the projection surface. A function that automatically performs keystone correction might be the keystone function.

[0004] Even when a projector outputs a corrected projection image on the projection surface, the user may experience discomfort when viewing the output image depending on the projector's projection position. This is because the greater the angle at which correction is required, the more severe the distortion.

[0005] If the projector that outputs the projected image is fixed, the user must manually move the projector and adjust the projection angle. Manually operating the projector can be inconvenient.

[0006] When a projector automatically identifies a projection surface, it is difficult to determine which projection surface should be ultimately determined when multiple areas that can be determined as projection surfaces are identified.

[0007] The present disclosure is designed to improve the above-described problem, and an object of the present disclosure is to provide an electronic device and a control method thereof that analyze a projection surface to determine one projection area from among a plurality of candidate areas to output a projection image.

[0008] According to one embodiment, an electronic device includes a sensor unit including at least one sensor, a memory, a projection unit outputting a projection image, and at least one processor, wherein the at least one processor obtains edge information based on a photographed image obtained through the sensor unit, and controls the projection unit to output the projection image corrected to correspond to a projection area based on at least one of a first projection surface area and a second projection surface area included in the edge information based on depth information obtained through the sensor unit.

[0009] The at least one processor can identify an area corresponding to a plane larger than a threshold size in the edge information as the first projection surface area and the second projection surface area.

[0010] The at least one processor can control the projection unit to identify a first projection candidate area corresponding to the first projection surface area and a second projection candidate area corresponding to the second projection surface area based on the depth information and the preset resolution information, identify one of the first projection candidate area and the second projection candidate area as a projection area, and output a projection image to the projection area.

[0011] The at least one processor obtains the photographed image through an image sensor included in the sensor unit, obtains slope information of the first projection surface area and second slope information of the second projection surface area based on the depth information obtained through a distance sensor included in the sensor unit, identifies the first projection candidate area based on the first slope information, and identifies the second projection candidate area based on the second slope information, and the depth information may include a sparse depth map.

[0012] The at least one processor can obtain the edge information including the outline of at least one object in the captured image.

[0013] The at least one processor can identify an area corresponding to a larger value between a first size of the first projection candidate area and a second size of the second projection candidate area as the projection area.

[0014] The at least one processor obtains content information related to the projection image, and if the content type included in the content information is a preset type, the projection area can be identified based on the user's gaze direction.

[0015] The above-mentioned captured image is a first captured image, and the at least one processor, if the content type included in the content information is a preset type, can acquire a second captured image through an image sensor included in the sensor unit, identify the user's gaze direction included in the second captured image, and identify an area corresponding to the user's gaze direction among the first projection candidate area and the second projection candidate area as the projection area.

[0016] The at least one processor can obtain position information of the projection area, obtain a projection position and a projection angle based on the position information of the projection area, and control the projection unit to output the projection image to the projection area based on the projection position and the projection angle.

[0017] The projection image is a first projection image, and the at least one processor can control the projection unit to perform a correction function on the first projection image based on the projection position and the projection angle to obtain a second projection image, and output the second projection image to the projection area.

[0018] According to one embodiment, a control method of an electronic device includes the steps of obtaining edge information based on a photographed image, and outputting a projection image corrected to correspond to a projection area based on at least one of a first projection area and a second projection area included in the edge information based on depth information.

[0019] The step of identifying the first projection surface area and the second projection surface area can identify an area corresponding to a plane larger than a threshold size in the edge information as the first projection surface area and the second projection surface area.

[0020] The step of identifying the projection area may include identifying a first projection candidate area corresponding to the first projection surface area and a second projection candidate area corresponding to the second projection surface area from the edge information based on the depth information and the preset resolution information, identifying one of the first projection candidate area and the second projection candidate area as the projection area, and the step of outputting the projection image may output the projection image to the projection area.

[0021] The step of identifying the projection area may include acquiring the photographed image through an image sensor, acquiring slope information of the first projection surface area and second slope information of the second projection surface area based on the depth information acquired through a distance sensor, identifying the first projection candidate area based on the first slope information, and identifying the second projection candidate area based on the second slope information, wherein the depth information may include a sparse depth map.

[0022] The step of obtaining the edge information may obtain the edge information including the outline of at least one object in the photographed image.

[0023] The step of identifying the projection area may identify an area corresponding to a larger value between a first size of the first projection candidate area and a second size of the second projection candidate area as the projection area.

[0024] The step of identifying the projection area may include obtaining content information related to the projection image, and if the content type included in the content information is a preset type, identifying the projection area based on the user's gaze direction.

[0025] The above-mentioned captured image is a first captured image, and the step of identifying the projection area may include, if the content type included in the content information is a preset type, acquiring a second captured image through an image sensor, identifying the user's gaze direction included in the second captured image, and identifying an area corresponding to the user's gaze direction among the first projection candidate area and the second projection candidate area as the projection area.

[0026] The step of outputting the projection image may include obtaining position information of the projection area, obtaining a projection position and a projection angle based on the position information of the projection area, and outputting the projection image to the projection area based on the projection position and the projection angle.

[0027] FIG. 1 is a block diagram illustrating an electronic device according to one embodiment.

[0028] FIG. 2 is a block diagram illustrating a specific configuration of the electronic device of FIG. 1, according to one embodiment.

[0029] FIG. 3 is a drawing for explaining an image projection process according to one embodiment.

[0030] FIG. 4 is a drawing for explaining a photographed image according to one embodiment.

[0031] FIG. 5 is a drawing for explaining depth information according to one embodiment.

[0032] FIG. 6 is a diagram for explaining edge information according to one embodiment.

[0033] Figure 7 is a drawing for explaining a projection surface according to one embodiment.

[0034] FIG. 8 is a drawing for explaining a projection candidate area and a projection area according to one embodiment.

[0035] FIG. 9 is a diagram for explaining an operation of obtaining a projection candidate area according to one embodiment.

[0036] FIG. 10 is a drawing for explaining a horizontal slope according to one embodiment.

[0037] FIG. 11 is a drawing for explaining a vertical slope according to one embodiment.

[0038] Figure 12 is a drawing for explaining horizontal distortion according to one embodiment.

[0039] FIG. 13 is a drawing for explaining rotation information of an electronic device according to one embodiment.

[0040] FIG. 14 is a drawing for explaining rotation information of a projection surface according to one embodiment.

[0041] FIG. 15 is a drawing for explaining z-axis rotation information of a projection surface according to one embodiment.

[0042] FIG. 16 is a drawing for explaining y-axis rotation information of a projection surface according to one embodiment.

[0043] FIG. 17 is a drawing for explaining an operation of performing a keystone function by taking into account vertical inclination, according to one embodiment.

[0044] FIG. 18 is a drawing for explaining an operation of performing a keystone function while taking into account horizontal inclination, according to one embodiment.

[0045] FIG. 19 is a drawing for explaining an operation of outputting a projection image to a projection area according to one embodiment.

[0046] FIG. 20 is a diagram illustrating an operation of identifying multiple projection candidate regions according to one embodiment.

[0047] FIG. 21 is a drawing for explaining an operation of determining a projection area by considering a user's gaze direction according to one embodiment.

[0048] FIG. 22 is a drawing for explaining an operation of determining a projection area by considering a user's gaze direction according to one embodiment.

[0049] FIG. 23 is a diagram for explaining an operation of determining a projection area based on user input, according to one embodiment.

[0050] FIG. 24 is a drawing for explaining a guide screen for selecting a projection area according to one embodiment.

[0051] FIG. 25 is a drawing for explaining a guide screen for selecting a projection area according to one embodiment.

[0052] FIG. 26 is a drawing for explaining a guide screen for selecting a projection area according to one embodiment.

[0053] FIG. 27 is a drawing for explaining an operation of performing projection settings according to one embodiment.

[0054] FIG. 28 is a drawing for explaining an image correction operation according to one embodiment.

[0055] FIG. 29 is a drawing for explaining a screen distortion ratio according to one embodiment.

[0056] FIG. 30 is a drawing for explaining a screen correction ratio according to one embodiment.

[0057] FIG. 31 is a drawing for explaining a screen correction ratio according to one embodiment.

[0058] FIG. 32 is a drawing for explaining a method of controlling an electronic device according to one embodiment.

[0059] FIG. 33 is a drawing for explaining a mobile projector according to one embodiment.

[0060] FIG. 34 is a drawing for explaining the distance between a projection surface and an electronic device according to one embodiment.

[0061] FIG. 35 is a drawing for explaining a moving operation of an electronic device according to one embodiment.

[0062] FIG. 36 is a diagram for explaining a notification for a location movement according to one embodiment.

[0063] FIG. 37 is a drawing for explaining a keystone correction function according to one embodiment.

[0064] FIG. 38 is a drawing for explaining a keystone correction function according to one embodiment.

[0065] FIG. 39 is a drawing for explaining an operation of changing a projection area according to one embodiment.

[0066] FIG. 40 is a drawing for explaining an operation of outputting a projection image using a plurality of devices according to one embodiment.

[0067] Figure 41 is a drawing for explaining an operation of changing a projection image according to distance.

[0068] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0069] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. In certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0070] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0071] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0072] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0073] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0074] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0075] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor, excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0076] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0077] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0078] FIG. 1 is a block diagram illustrating an electronic device (100) according to one embodiment.

[0079] Referring to FIG. 1, the electronic device (100) may include at least one of a processor (111), a projection unit (112), a memory (113), and a sensor unit (121).

[0080] At least one processor (111) can perform overall control operations of the electronic device (100). Specifically, at least one processor (111) functions to control the overall operations of the electronic device (100). A specific description related to at least one processor (111) is described in FIG. 2.

[0081] The projection unit (112) is a configuration that projects images (projected images, contents, etc.) to the outside. A detailed description related to the projection unit (112) is described in Fig. 2.

[0082] The memory (113) can store a projection image projected through the projection unit (112). The projection image can refer to a still image as well as a continuous image (or a moving image). The projection image can refer to an image included in the content. The memory (113) can store the operating O / S.

[0083] The sensor unit (121) can acquire sensing data. The sensor unit (121) can include at least one of an image sensor and a distance sensor. The sensing data can include at least one of image data (or a captured image) and distance data.

[0084] At least one processor (111) can control operations performed in the electronic device (100).

[0085] At least one processor (111) can control the projection unit (112) to obtain edge information based on a photographed image obtained through the sensor unit (121), identify a first projection surface area and a second projection surface area included in the edge information based on depth information obtained through the sensor unit (121), identify a projection area based on one of the first projection surface area and the second projection surface area, and output a projection image corrected to correspond to the identified projection area.

[0086] At least one processor (111) can obtain a photographed image and depth information through a sensor unit (121), extract an outline included in the photographed image to obtain edge information, identify a first projection surface area and a second projection surface area from the edge information, identify a first projection candidate area corresponding to the first projection surface area and a second projection candidate area corresponding to the second projection surface area from the edge information based on the depth information, determine one of the first projection candidate area and the second projection candidate area as a projection area, and control the projection unit (112) to output a projection image to the projection area.

[0087] The projection area may be referred to as the target area. In the description below, the terms projection area and target area are used interchangeably.

[0088] According to various embodiments, the electronic device (100) can acquire sensing data at a fixed location. The electronic device (100) can acquire sensing data by rotating the sensor unit (121) in the y-axis direction or the z-axis direction at the fixed location.

[0089] According to various embodiments, the electronic device (100) can acquire sensing data while moving through a space where the electronic device (100) is located.

[0090] The electronic device (100) can obtain information on the walls, ceiling, floor, etc. of the space in which it is currently located based on sensing data. The electronic device (100) can identify a projection surface area capable of outputting a projection image among the surfaces included in the space in which it is currently located.

[0091] At least one processor (111) can acquire a captured image through an image sensor included in the sensor unit (121). The image sensor may include a camera. At least one processor (111) can acquire a captured image (or captured data) through the image sensor. A description of the captured image is provided in FIG. 4.

[0092] At least one processor (111) can obtain the depth information through a distance sensor included in the sensor unit. The distance sensor may include a depth camera, a ToF (Time of Flight) sensor, a sparse depth camera, etc.

[0093] Depth information may include a sparse depth map. A sparse depth map may represent a depth map in which the resources of distance data for each pixel included in the image are reduced below a threshold. The distance units represented in the sparse depth map may be divided into threshold ranges. For example, the sparse depth map may be divided into a first group (0 to 1 m), a second group (1 to 2 m), and a third group (3 m or more). The number of groups may be determined based on user settings or the characteristics of the sensor itself.

[0094] The electronic device (100) can acquire depth information through a distance sensor (or depth sensor). The depth information may be data below a critical resource. The depth information may include a sparse depth map. Using a sparse depth map can increase processing time and speed.

[0095] Depth information can be described as depth data, depth map, etc. A description of depth information is provided in Fig. 5.

[0096] According to various embodiments, at least one processor (111) may receive at least one of a captured image or depth information via an external device. The external device may be communicatively connected to the electronic device (100).

[0097] At least one processor (111) can identify at least one object in a captured image and obtain edge information including the outline of the at least one object. The edge information may include information that extracts only the outline (or contour) of at least one object included in the captured image. The edge information may be described as an edge map, edge data, edge map information, or an edge image. A description of the edge information is provided in FIG. 6.

[0098] At least one processor (111) can identify an area corresponding to a plane larger than a threshold size in edge information as a projection surface area.

[0099] At least one processor (111) can identify at least one planar area from edge information. The planar area can be described as an area corresponding to a plane, an area representing a plane, etc. At least one processor (111) can identify the size of the planar area. At least one processor (111) can identify a projection surface area by comparing the size of the planar area with a threshold size.

[0100] If the size of a specific planar area is greater than or equal to a threshold size, at least one processor (111) may determine the specific planar area as a projection plane area. The projection plane area may include an area identified as a projection plane or an area representing a plane on which a projection image can be output.

[0101] A plane may need to have a minimum size for the projection image to be output. Therefore, the threshold size may be determined based on the minimum size on which the projection image can be projected. The threshold size may be changed by the user.

[0102] The electronic device (100) can identify multiple projection surface areas.

[0103] According to various embodiments, it is assumed that there are a first side and a second side in space. The electronic device (100) can identify a first projection surface area on the first side and a second projection surface area on the second side.

[0104] According to various embodiments, the electronic device (100) can identify a first projection surface area and a second projection surface area on the first surface.

[0105] According to various embodiments, the electronic device (100) may identify a first projection surface area in a first space and a second projection surface area in a second space different from the first space. For example, the first space may be a living room and the second space may be a bedroom.

[0106] When a preset type of projection surface is identified among multiple projection surfaces, the electronic device (100) can output a projection image by giving priority to the identified projection surface. The preset type of projection surface may include a projection surface corresponding to a projection-only screen. The projection-only screen may be described as a projector screen, a projection screen panel, or the like.

[0107] According to various embodiments, when a projection surface of a preset type is identified among a plurality of projection surfaces, the electronic device (100) may assign a relatively higher weight to the projection surface of the preset type compared to other projection surfaces. Assigning a higher weight may increase the likelihood that the projection candidate area corresponding to the projection surface of the preset type will be determined as the projection area.

[0108] At least one processor (111) can identify a first projection candidate area and a second projection candidate area based on at least one of depth information and preset resolution information.

[0109] At least one processor (111) can identify at least one projection candidate area based on the projection surface area identified in the edge information. At least one processor (111) can identify the projection candidate area based on preset resolution information. The preset resolution information can include basic size information for outputting the projection image.

[0110] The preset resolution information may include at least one of the horizontal size, vertical size, and horizontal and vertical size ratio of the image.

[0111] For example, the resolution information may include at least one of 1920*1080, 3840*2160, and 16:9.

[0112] For example, the resolution information may include at least one of 800*600, 1024*768, 1280*960, and 4:3.

[0113] At least one processor (111) can identify an area in the projection surface area where a projection image is output based on resolution information. A plurality of actual areas where the projection image is to be output can be identified.

[0114] At least one processor (111) can identify a projection candidate area based on depth information. At least one processor (111) can identify a rotation angle of a projection surface area based on depth information. The rotation angle of the projection surface is described in FIG. 14.

[0115] At least one processor (111) can determine whether the projection image is suitable for outputting by considering the rotation angle of the projection surface area. If the rotation angle of the projection surface area is within a threshold angle, the at least one processor (111) can identify a projection candidate area in the projection surface area. If the rotation angle of the projection surface area is outside the threshold angle, the at least one processor (111) can not identify the projection candidate area in the projection surface area. The at least one processor (111) can obtain the inclination of the projection surface area (or projection surface) by using depth information.

[0116] At least one processor (111) can identify spatial information using depth information. Obtaining spatial information using both the captured image and depth information can yield more accurate results than obtaining spatial information using the captured image. The spatial information can be described as map information or depth map information.

[0117] At least one processor (111) can obtain slope information of a first projection surface area and second slope information of a second projection surface area based on depth information. At least one processor (111) can identify a first projection candidate area based on the first slope information and identify a second projection candidate area based on the second slope information. A description related to the slope information is described in FIG. 14.

[0118] If only one area in the projection area where the projection image is to be output is identified, at least one processor (111) can directly determine the identified area as the projection area. At least one processor (111) can directly output the projection image to the projection area. The projection area may include an area where the projection image is output. The projection area may be described as a target area, an image output area, a projection screen area, etc.

[0119] When a plurality of areas in which a projection image is to be output are identified in the projection surface area, at least one processor (111) can determine the identified plurality of areas as projection candidate areas.

[0120] At least one processor (111) can identify at least one projection candidate region based on at least one projection surface region identified in the edge information.

[0121] At least one processor (111) can identify a first projection candidate area and a second projection candidate area.

[0122] For example, the first projection candidate region may be an region identified in the first projection surface region, and the second projection candidate region may be an region identified in the second projection surface region.

[0123] For example, the first projection candidate area and the second projection candidate area may be areas identified in one projection surface area.

[0124] At least one processor (111) can determine a projection area based on at least one of the size of the projection candidate area, content information, and the user's gaze direction.

[0125] According to various embodiments, at least one processor (111) may determine an area corresponding to a larger value between a first size of a first projection candidate area and a second size of a second projection candidate area as a projection area.

[0126] At least one processor (111) can obtain (or calculate) a first size of a first projection candidate area.

[0127] At least one processor (111) can obtain (or calculate) a second size of a second projection candidate area.

[0128] At least one processor (111) can compare the first size and the second size. At least one processor (111) can compare the first size and the second size to determine one of the first projection candidate area and the second projection candidate area as the projection area. The projection area may be an area corresponding to a location where the projection image is output.

[0129] At least one processor (111) can determine a projection candidate area having the largest size among the sizes of the identified projection candidate areas as the projection area.

[0130] At least one processor (111) can determine a projection candidate area corresponding to a larger size among the first size and the second size as a projection area.

[0131] According to various embodiments, at least one processor (111) may obtain content information related to a projection image, and if a content type included in the content information is a preset type, a projection area may be determined based on a user's gaze direction.

[0132] The captured image is a first captured image, and at least one processor (111) can acquire a second captured image through an image sensor included in the sensor unit (121) if the content type included in the content information is a preset type, identify the user's gaze direction included in the second captured image, and determine an area corresponding to the user's gaze direction among the first projection candidate area and the second projection candidate area as a projection area.

[0133] Content information may include metadata that can represent the content. The metadata may include at least one of the following: content name, content type, content time, and content size.

[0134] Predefined types may include types that provide specific information. For example, a predefined type may include an information notification type that represents content for notifying dates, schedules, weather, etc. For example, dramas and movies may not be included in the information notification type.

[0135] If the content type related to the projection image is included in a preset type, at least one processor (111) can determine a projection area by considering the user's gaze direction. At least one processor (111) can select an area corresponding to the user's gaze direction. At least one processor (111) can determine a projection area from the selected area.

[0136] According to various embodiments, at least one processor (111) may identify (or select) a projection surface area corresponding to the user's gaze direction among a plurality of projection surface areas. At least one processor (111) may determine a projection candidate area from the identified (or selected) projection surface area. At least one processor (111) may determine a projection area from the determined projection candidate area.

[0137] According to various embodiments, at least one processor (111) may identify (or select) a projection candidate area corresponding to the user's gaze direction among a plurality of projection candidate areas. At least one processor (111) may determine a projection area from the identified (or selected) projection candidate areas.

[0138] If the content type related to the projection image is not included in the preset types, the projection surface area or projection candidate area can be identified (or determined) using the content size without considering the user's viewing direction.

[0139] At least one processor (111) can obtain position information of a projection area, obtain a projection position and a projection angle based on the position information of the projection area, and control a projection unit (112) to output a projection image to the projection area based on the projection position and the projection angle.

[0140] At least one processor (111) can obtain information about the determined projection area. At least one processor (111) can obtain position information (or coordinate information) of the projection area. The information about the projection area includes position information, and the position information can include three-dimensional coordinate information.

[0141] At least one processor (111) can identify a projection position based on position information of the projection area. The projection position may include a position to which at least one processor (111) moves to output a projection image to the projection area. A projection ratio may be determined based on the physical characteristics of the projection unit (112). At least one processor (111) can identify a position at which a projection image is appropriately output by considering the distance between the projection surface (10) (or projection area) and the electronic device (100) and the projection ratio.

[0142] At least one processor (111) can determine a projection position so that the projection area can be viewed directly by the electronic device (100). Directly viewing may mean the embodiment (1510) of FIG. 15.

[0143] Once the projection position is determined, at least one processor (111) can move to the determined projection position. The electronic device (100) can include a moving member (122). At least one processor (111) can supply power so that a driving force generated by a motor or the like can be transmitted to the moving member (122). At least one processor (111) can move to the projection position using the moving member (122).

[0144] At least one processor (111) can determine a projection angle by considering three-dimensional coordinate information and a projection position. At least one processor (111) can determine that the projection angle indicates a projection direction for outputting a projection image.

[0145] At least one processor (111) can utilize the rotation function of the projection unit (112) itself. At least one processor (111) can adjust the projection angle (or projection direction) by rotating the projection unit (112) at a fixed position. The projection angle can be rotated based on the x-axis, y-axis, and z-axis disclosed in FIG. 13.

[0146] The projection image is a first projection image, and at least one processor (111) can control the projection unit (112) to perform a correction function for the first projection image based on a projection position and a projection angle to obtain a second projection image, and output the second projection image to a projection area.

[0147] The correction function may include performing a keystone correction function, a leveling correction function, and a resolution change function.

[0148] Keystone correction can refer to the process of correcting a trapezoidal image into a rectangular one. Leveling can refer to the process of rotating an image. Resolution adjustment can refer to the process of changing the size of a projected image. Resolution adjustment can include upscaling or downscaling.

[0149] After performing the correction function, at least one processor (111) can control the projection unit (112) to output a projection image to the projection area. The output projection image may be an image on which correction has been performed.

[0150] According to various embodiments, the electronic device (100) may be implemented as a stationary projector rather than a mobile projector. The electronic device (100) may be implemented in a form that does not include a mobile member.

[0151] FIG. 2 is a block diagram for explaining a specific configuration of the electronic device (100) of FIG. 1, according to one embodiment.

[0152] Referring to FIG. 2, the electronic device (100) may include at least one of a processor (111), a projection unit (112), a memory (113), a communication interface (114), an operation interface (115), an input / output interface (116), a speaker (117), a microphone (118), a power supply unit (119), a driving unit (120), a sensor unit (121), or a moving member (122).

[0153] The configuration illustrated in FIG. 2 is merely an example of various embodiments, and some configurations may be omitted and new configurations may be added.

[0154] The content already explained in Fig. 1 is omitted.

[0155] At least one processor (111) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes a digital signal. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machines (ARM) processor, or may be defined by the relevant terminology. At least one processor (111) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). At least one processor (111) may perform various functions by executing computer executable instructions stored in a memory (113).

[0156] The projection unit (112) is a component that projects an image to the outside. According to various embodiments of the present disclosure, the projection unit (112) can be implemented in various projection methods (e.g., CRT (cathode-ray tube) method, LCD (Liquid Crystal Display) method, DLP (Digital Light Processing) method, laser method, etc.). For example, the CRT method has the same principle as a CRT monitor. The CRT method magnifies the image with a lens in front of the cathode-ray tube (CRT) and displays the image on the screen. Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of a three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0157] Another example is the LCD method, which displays images by passing light from a light source through liquid crystals. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into red, green, and blue by a dichroic mirror (a mirror that reflects only a specific color of light and transmits all others). After passing through the liquid crystals, the light can be refocused into a single point.

[0158] Another example is the DLP method, which displays images using a DMD (Digital Micromirror Device) chip. The DLP projection unit may include a light source, a color wheel, a DMD chip, a projection lens, etc. The light output from the light source can be colored as it passes through the rotating color wheel. The light passing through the color wheel is input to the DMD chip. The DMD chip contains numerous micromirrors and reflects the light input to the DMD chip. The projection lens can play a role in magnifying the light reflected from the DMD chip to the image size.

[0159] Another example is a laser system that uses a Diode Pumped Solid State (DPSS) laser and a galvanometer. A multi-color laser uses three DPSS lasers, one for each RGB color, with their optical axes overlapped by a special mirror. The galvanometer includes a mirror and a high-power motor that moves the mirror at high speeds. For example, the galvanometer can rotate the mirror at up to 40 kHz / sec. The galvanometer is mounted according to the scan direction, but since projectors typically scan in a planar manner, the galvanometer can also be positioned separately along the x and y axes.

[0160] The projection unit (112) may include various types of light sources. For example, the projection unit (112) may include at least one light source among a lamp, an LED, and a laser.

[0161] The projection unit (112) can output images in a 4:3 screen ratio, a 5:4 screen ratio, or a 16:9 wide screen ratio depending on the purpose of the electronic device (100) or the user's settings, and can output images in various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the screen ratio.

[0162] The projection unit (112) can perform various functions for adjusting the output image under the control of at least one processor (111). For example, the projection unit (112) can perform functions such as zoom, keystone, quick corner (4 corner) keystone, and lens shift.

[0163] Specifically, the projection unit (112) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, the zoom function can be performed depending on the distance from the screen. At this time, the zoom function may include a hardware method of adjusting the screen size by moving the lens and a software method of adjusting the screen size by cropping the image, etc. When the zoom function is performed, the focus of the image needs to be adjusted. For example, the method of adjusting the focus includes a manual focus method, an electric focus method, etc. The manual focus method refers to a method of focusing manually, and the electric focus method refers to a method of automatically focusing using a motor built into the projector when the zoom function is performed. When performing the zoom function, the projection unit (112) may provide a digital zoom function through software, and may provide an optical zoom function of performing the zoom function by moving the lens through the driving unit (120).

[0164] The projection unit (112) can perform a keystone correction function. If the height is not right for front projection, the screen may be distorted upwards or downwards. The keystone correction function refers to a function that corrects a distorted screen. For example, if distortion occurs in the left and right directions of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up and down directions, it can be corrected using vertical keystone. The quick corner (4 corner) keystone correction function is a function that corrects the screen when the center area of ​​the screen is normal but the corner areas are not balanced. The lens shift function is a function that moves the screen as it is when the screen is off the screen.

[0165] The projection unit (112) can automatically analyze the surrounding environment and projection environment without user input to provide zoom / keystone / focus functions. Specifically, the projection unit (112) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected by a sensor (depth camera, distance sensor, infrared sensor, light sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0166] The projection unit (112) can provide a lighting function using a light source. In particular, the projection unit (112) can provide a lighting function by outputting a light source using an LED. According to various embodiments, the projection unit (112) can include one LED, and according to other embodiments, the electronic device (100) can include a plurality of LEDs. The projection unit (112) can output a light source using a surface-emitting LED according to an implementation example. The surface-emitting LED can refer to an LED having a structure in which an optical sheet is arranged on the upper side of the LED so that the light source is evenly distributed and output. Specifically, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0167] The projection unit (112) can provide the user with a dimming function for adjusting the intensity of the light source. Specifically, when a user input for adjusting the intensity of the light source is received from the user through the operation interface (115) (e.g., a touch display button or dial), the projection unit (112) can control the LED to output the intensity of the light source corresponding to the received user input.

[0168] The projection unit (112) can provide a dimming function based on content analyzed by at least one processor (111) without user input. Specifically, the projection unit (112) can control the LED to output the intensity of a light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0169] The projection unit (112) can control the color temperature under the control of at least one processor (111). The at least one processor (111) can control the color temperature based on the content. Specifically, when the content is identified to be output, the at least one processor (111) can obtain frame-by-frame color information of the content whose output has been determined. Then, the at least one processor (111) can control the color temperature based on the obtained frame-by-frame color information. The at least one processor (111) can obtain at least one primary color of the frame based on the frame-by-frame color information. Then, the at least one processor (111) can adjust the color temperature based on the obtained at least one primary color. For example, the color temperature that the at least one processor (111) can adjust can be classified into a warm type or a cold type. It is assumed that a frame to be output (hereinafter, referred to as an output frame) includes a scene in which a fire has occurred. At least one processor (111) can identify (or obtain) that the primary color is red based on color information included in the current output frame. In addition, at least one processor (111) can identify a color temperature corresponding to the identified primary color (red). The color temperature corresponding to red may be a warm type. At least one processor (111) can use an artificial intelligence model to obtain the color information or primary color of the frame. According to various embodiments, the artificial intelligence model can be stored in the electronic device (100) (e.g., the memory (113)). According to another embodiment, the artificial intelligence model can be stored in an external server that can communicate with the electronic device (100).

[0170] The memory (113) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in at least one processor (111), or may be implemented as a separate memory from at least one processor (111). In this case, the memory (113) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0171] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that can be attached or detached to the electronic device (100), it may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc.

[0172] The memory (113) may store at least one command regarding the electronic device (100). In addition, the memory (113) may store an O / S (Operating System) for driving the electronic device (100). The memory (113) may also store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. In addition, the memory (113) may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

[0173] Specifically, various software modules for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (113), and at least one processor (111) may control the operation of the electronic device (100) by executing various software modules stored in the memory (113). That is, the memory (113) is accessed by at least one processor (111), and data reading / recording / modifying / deleting / updating, etc. may be performed by at least one processor (111).

[0174] In the present disclosure, the term memory (113) may be used to mean a storage unit, a ROM, a RAM within at least one processor (111), or a memory card (e.g., a micro SD card, a memory stick) mounted on an electronic device (100).

[0175] The communication interface (114) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication interface (114) may include a wireless communication module or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.

[0176] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0177] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, various connection information, such as the service set identifier (SSID) and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received.

[0178] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which is between visible light and millimeter waves.

[0179] In addition to the above-described communication method, other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0180] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a paired cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0181] The manipulation interface (115) may include various types of input devices. For example, the manipulation interface (115) may include a physical button. In this case, the physical button may include a function key, a directional key (e.g., a four-way key), or a dial button. According to various embodiments, the physical button may be implemented as multiple keys. According to another embodiment, the physical button may be implemented as one key. When the physical button is implemented as one key, the electronic device (100) may receive a user input in which one key is pressed for a threshold time or longer. When a user input in which one key is pressed for a threshold time or longer is received, at least one processor (111) may perform a function corresponding to the user input. For example, at least one processor (111) may provide a lighting function based on the user input.

[0182] The manipulation interface (115) can receive user input using a non-contact method. When receiving user input using a contact method, physical force must be transmitted to the electronic device (100). Therefore, a method for controlling the electronic device (100) regardless of physical force may be required. Specifically, the manipulation interface (115) can receive user gestures and perform operations corresponding to the received user gestures. The manipulation interface (115) can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0183] The manipulation interface (115) can receive user input using a touch method. For example, the manipulation interface (115) can receive user input via a touch sensor. According to various embodiments, the touch method can be implemented in a non-contact manner. For example, the touch sensor can determine whether the user's body has approached within a threshold distance. The touch sensor can identify user input even when the user does not touch the touch sensor. According to another implementation example, the touch sensor can identify user input when the user touches the touch sensor.

[0184] The electronic device (100) can receive user input in various ways other than the above-described operation interface (115). In various embodiments, the electronic device (100) can receive user input through an external remote control device. The external remote control device can be a remote control device corresponding to the electronic device (100) (e.g., a dedicated control device of the electronic device (100)) or a user's portable communication device (e.g., a smartphone or wearable device). The user's portable communication device can store an application for controlling the electronic device (100). The portable communication device can obtain user input through the stored application and transmit the obtained user input to the electronic device (100). The electronic device (100) can receive user input from the portable communication device and perform an operation corresponding to the user's control command.

[0185] The electronic device (100) can receive user input using voice recognition. According to various embodiments, the electronic device (100) can receive the user's voice through a microphone included in the electronic device (100). According to other embodiments, the electronic device (100) can receive the user's voice from a microphone or an external device. Specifically, the external device can acquire the user's voice through the microphone of the external device and transmit the acquired user's voice to the electronic device (100). The user's voice transmitted from the external device can be audio data or digital data converted from audio data (e.g., audio data converted into a frequency domain, etc.). The electronic device (100) can perform an operation corresponding to the received user's voice. Specifically, the electronic device (100) can receive audio data corresponding to the user's voice through the microphone. In addition, the electronic device (100) can convert the received audio data into digital data. In addition, the electronic device (100) can convert the converted digital data into text data using the STT (Speech To Text) function. According to various embodiments, the STT (Speech To Text) function can be performed directly in the electronic device (100).

[0186] According to another embodiment, the STT (Speech To Text) function may be performed by an external server. The electronic device (100) may transmit digital data to the external server. The external server may convert the digital data into text data and obtain control command data based on the converted text data. The external server may transmit the control command data (which may also include text data) to the electronic device (100). The electronic device (100) may perform an operation corresponding to the user's voice based on the obtained control command data.

[0187] The electronic device (100) may provide a voice recognition function using a single assistant (or artificial intelligence assistant, e.g., Bixby), but this is merely an example and the electronic device (100) may provide the voice recognition function using multiple assistants. In this case, the electronic device (100) may provide the voice recognition function by selecting one of the multiple assistants based on a trigger word corresponding to the assistant or a specific key present on the remote control.

[0188] The electronic device (100) can receive user input using screen interaction. Screen interaction may refer to a function of identifying whether a predetermined event occurs through an image projected by the electronic device (100) on the screen (or projection surface) and acquiring user input based on the predetermined event. The predetermined event may refer to an event in which a predetermined object is identified at a specific location (e.g., a location where a UI for receiving user input is projected). The predetermined object may include at least one of a part of the user's body (e.g., a finger), a pointer, or a laser point. If the predetermined object is identified at a location corresponding to the projected UI, the electronic device (100) can identify that a user input for selecting the projected UI has been received. For example, the electronic device (100) may project a guide image to display the UI on the screen. In addition, the electronic device (100) can identify whether the user selects the projected UI. Specifically, the electronic device (100) can identify that the user has selected the projected UI when a predetermined event is identified at a location of the projected UI. The projected UI can include at least one item. The electronic device (100) can perform spatial analysis to identify whether the predetermined event is at the location of the projected UI. The electronic device (100) can perform spatial analysis through a sensor (e.g., an image sensor, an infrared sensor, a depth camera, a distance sensor, etc.). By performing the spatial analysis, the electronic device (100) can identify whether the predetermined event occurs at a specific location (a location where the UI is projected). In addition, when the predetermined event is identified as occurring at a specific location (a location where the UI is projected), the electronic device (100) can identify that a user input for selecting a UI corresponding to the specific location has been received.

[0189] The input / output interface (116) is configured to input / output at least one of an audio signal and an image signal. The input / output interface (116) can receive at least one of an audio signal and an image signal from an external device, and can output a control command to the external device.

[0190] Depending on the implementation example, the input / output interface (116) may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0191] In various embodiments of the present disclosure, the input / output interface (116) may be implemented as at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (Dsubminiature), and DVI (Digital Visual Interface). According to various embodiments, the wired input / output interface may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0192] The electronic device (100) can receive data via a wired input / output interface, but this is merely an example of various embodiments, and can also receive power via the wired input / output interface. For example, the electronic device (100) can receive power from an external battery via a USB C-type or from an outlet via a power adapter. As another example, the electronic device (100) can receive power from an external device (e.g., a laptop or monitor) via a DP.

[0193] The audio signal may be implemented to be input through a wired input / output interface, and the image signal may be implemented to be input through a wireless input / output interface (or communication interface). Alternatively, the audio signal may be implemented to be input through a wireless input / output interface (or communication interface), and the image signal may be implemented to be input through a wired input / output interface.

[0194] The speaker (117) is a component that outputs an audio signal. In particular, the speaker (117) may include an audio output mixer, an audio signal processor, and an audio output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to various embodiments, the audio output module may include a plurality of speakers, and in this case, the audio output module may be arranged inside the main body, and sound emitted by covering at least a portion of the diaphragm of the audio output module may pass through a waveguide and be transmitted to the outside of the main body. The audio output module may include a plurality of audio output units, and the plurality of audio output units may be arranged symmetrically on the exterior of the main body, thereby radiating sound in all directions, that is, in a 360-degree omnidirectional manner.

[0195] The microphone (118) is a component for receiving a user's voice or other sounds and converting them into audio data. The microphone (118) can receive the user's voice in an activated state. For example, the microphone (118) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (118) can include various components such as a microphone for collecting the user's voice in analog form, an amplifier circuit for amplifying the collected user's voice, an A / D conversion circuit for sampling the amplified user's voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0196] The power supply unit (119) can receive power from an external source and supply power to various components of the electronic device (100). The power supply unit (119) according to various embodiments of the present disclosure can receive power through various methods. In various embodiments, the power supply unit (119) can receive power using a connector (130) as illustrated in FIG. 1. The power supply unit (119) can receive power using a 220 V DC power cord. However, the present invention is not limited thereto, and the electronic device (100) can receive power using a USB power cord or a wireless charging method.

[0197] The power supply unit (119) can be supplied with power using an internal battery or an external battery. The power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through the internal battery. For example, the power supply unit (119) can charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and can be supplied with power through the charged internal battery. The power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through an external battery. For example, when the electronic device (100) is connected to the external battery through various wired communication methods such as a USB power cord, a USB C-Type power cord, and a socket home, the power supply unit (119) can be supplied with power through the external battery. That is, the power supply unit (119) can be supplied with power directly from the external battery, or can charge the internal battery through the external battery and be supplied with power from the charged internal battery.

[0198] The power supply unit (119) according to the present disclosure can receive power using at least one of the multiple power supply methods described above.

[0199] With respect to power consumption, the electronic device (100) may have a power consumption value (e.g., 43 W) or lower due to socket type and other standards. In this case, the electronic device (100) may vary its power consumption to reduce power consumption when using a battery. That is, the electronic device (100) may vary its power consumption based on the power supply method, power usage, etc.

[0200] The driving unit (120) can drive at least one hardware component included in the electronic device (100). The driving unit (120) can generate a physical force and transmit it to at least one hardware component included in the electronic device (100).

[0201] The driving unit (120) can generate driving power for movement of a hardware component included in the electronic device (100) (e.g., movement of the electronic device (100)) or rotation of the component (e.g., rotation of a projection lens).

[0202] The driving unit (120) can adjust the projection direction (or projection angle) of the projection unit (112). The driving unit (120) can move the position of the electronic device (100). The driving unit (120) can control a moving member to move the electronic device (100). For example, the driving unit (120) can control the moving member using a motor.

[0203] The sensor unit (121) may include at least one sensor. Specifically, the sensor unit (121) may include at least one of a tilt sensor for sensing the tilt of the electronic device (100) and an image sensor for capturing an image. The tilt sensor may be an acceleration sensor or a gyro sensor, and the image sensor may mean a camera or a depth camera. The tilt sensor may be described as a motion sensor. The sensor unit (121) may include various sensors in addition to the tilt sensor or the image sensor. For example, the sensor unit (121) may include an illuminance sensor and a distance sensor. The distance sensor may be a ToF (Time of Flight). The sensor unit (121) may include a lidar sensor.

[0204] The electronic device (100) can control a lighting function by linking with an external device. Specifically, the electronic device (100) can receive lighting information from the external device. The lighting information can include at least one of brightness information or color temperature information set in the external device. The external device can refer to a device connected to the same network as the electronic device (100) (e.g., an IoT device included in the same home / work network) or a device that is not in the same network as the electronic device (100) but can communicate with the electronic device (100) (e.g., a remote control server). For example, assume that an external lighting device (IoT device) included in the same network as the electronic device (100) is outputting red light at a brightness of 50. The external lighting device (IoT device) can directly or indirectly transmit lighting information (e.g., information indicating that it is outputting red light at a brightness of 50) to the electronic device (100). The electronic device (100) can control the output of a light source based on the lighting information received from the external lighting device. For example, if the lighting information received from the external lighting device includes information to output red light at a brightness of 50, the electronic device (100) can output red light at a brightness of 50.

[0205] The electronic device (100) can control a lighting function based on biometric information. Specifically, at least one processor (111) can obtain the user's biometric information. The biometric information can include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. The biometric information can include various types of information in addition to the information described above. For example, the electronic device (100) can include a sensor for measuring biometric information. The at least one processor (111) can obtain the user's biometric information through the sensor and control the output of a light source based on the obtained biometric information. As another example, the at least one processor (111) can receive the biometric information from an external device through an input / output interface (116). The external device can refer to the user's portable communication device (e.g., a smartphone or a wearable device). The at least one processor (111) can obtain the user's biometric information from the external device and control the output of the light source based on the obtained biometric information. According to an implementation example, the electronic device (100) can identify whether the user is sleeping, and if the user is identified as sleeping (or preparing to sleep), at least one processor (111) can control the output of the light source based on the user's biometric information.

[0206] An electronic device (100) according to various embodiments of the present disclosure can provide various smart functions.

[0207] Specifically, the electronic device (100) is connected to a portable terminal device for controlling the electronic device (100), and a screen output from the electronic device (100) can be controlled through user input input from the portable terminal device. As an example, the portable terminal device can be implemented as a smartphone including a touch display, and the electronic device (100) receives screen data provided by the portable terminal device from the portable terminal device and outputs it, and a screen output from the electronic device (100) can be controlled according to user input input from the portable terminal device.

[0208] The electronic device (100) can share content or music provided by the mobile terminal device by connecting to the mobile terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC.

[0209] In addition, the mobile terminal device and the electronic device (100) can be connected in various connection methods. In various embodiments, the mobile terminal device can search for the electronic device (100) to perform a wireless connection, or the electronic device (100) can search for the mobile terminal device to perform a wireless connection. In addition, the electronic device (100) can output content provided by the mobile terminal device.

[0210] In various embodiments, when a mobile terminal device is placed near an electronic device (100) while specific content or music is being output from the mobile terminal device, and a preset gesture is detected through the display of the mobile terminal device (e.g., motion tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0211] In various embodiments, when the mobile terminal device is outputting specific content or music and the mobile terminal device comes closer to the electronic device (100) to a preset distance or less (e.g., non-contact tap view) or the mobile terminal device comes into contact with the electronic device (100) twice at a short interval (e.g., contact tap view), the electronic device (100) can output the content or music being output by the mobile terminal device.

[0212] In the above-described embodiment, it has been described that the same screen as the screen provided by the mobile terminal device is provided by the electronic device (100), but the present disclosure is not limited thereto. That is, when a connection is established between the mobile terminal device and the electronic device (100), the mobile terminal device may output a first screen provided by the mobile terminal device, and the electronic device (100) may output a second screen provided by the mobile terminal device that is different from the first screen. For example, the first screen may be a screen provided by a first application installed on the mobile terminal device, and the second screen may be a screen provided by a second application installed on the mobile terminal device. For example, the first screen and the second screen may be different screens provided by a single application installed on the mobile terminal device. For example, the first screen may be a screen including a remote control-type UI for controlling the second screen.

[0213] An electronic device (100) according to the present disclosure can output a standby screen. For example, if the electronic device (100) is not connected to an external device or if no input is received from the external device for a preset period of time, the electronic device (100) can output a standby screen. Conditions for the electronic device (100) to output a standby screen are not limited to the examples described above, and the standby screen can be output under various conditions.

[0214] The electronic device (100) may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device (100) may extract only the shape of a specific object from data received from an external device, acquire an amorphous object, and output a standby screen including the acquired amorphous object.

[0215] The electronic device (100) may further include a display.

[0216] The display may be implemented in various forms, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. The display may also include a driving circuit, a backlight unit, etc., which may be implemented in forms, such as an amorphous silicon thin film transistor (a-si TFT), a low temperature poly silicon (LTPS) TFT, and an organic TFT (OTFT). The display may be implemented in a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display), etc. According to various embodiments of the present disclosure, the display may include a display panel that outputs an image, as well as a bezel that houses the display panel. In particular, according to various embodiments of the present disclosure, the bezel may include a touch sensor for detecting user interaction.

[0217] The electronic device (100) may further include a shutter unit.

[0218] The shutter portion may include at least one of a shutter, a fixing member, a rail, or a body.

[0219] The shutter can block light output from the projection unit (112). The fixing member can fix the position of the shutter. The rail can be a path for moving the shutter and the fixing member. The body can be configured to include the shutter and the fixing member.

[0220] The movable member (122) may refer to a member for moving from a first position to a second position in a space where the electronic device (100) is placed. The electronic device (100) may control the movable member (122) to move the electronic device (100) using a force generated by the driving unit (120). The electronic device (100) may generate a force to be transmitted to the movable member (122) using a motor included in the driving unit (120).

[0221] The movable member (122) may include at least one wheel (e.g., a circular wheel). The electronic device (100) may move to a target location (or target position) through the movable member. When a user input or a control command is received, the electronic device (100) may rotate the movable member by transmitting a force generated through a motor to the movable member. The electronic device (100) may control the movable member to adjust the rotation speed, rotation direction, etc. The electronic device (100) may perform a movement operation (or movement function) by controlling the movable member based on the target location or the direction of movement, etc.

[0222] FIG. 3 is a drawing for explaining an image projection process according to one embodiment.

[0223] Referring to FIG. 3, the electronic device (100) may include at least one of a sensing data collection module (310), a projection area detection module (320), a projection setting module (330), and an image correction module (340).

[0224] The sensing data collection module (310) can acquire sensing data. The sensing data can include at least one of a captured image and depth information. The captured image can be received through an image sensor. The depth information can be received through a depth sensor. The sensing data collection module (310) can transmit the sensing data to the projection area detection module (321).

[0225] The sensing data collection module (310) can acquire at least one of spatial sensing data and device information. The spatial sensing data may include at least one of an RGB image or distance data. The device information may include at least one of pose information or acceleration information of the electronic device (100).

[0226] The sensing data collection module (310) can acquire at least one of an RGB image of space, a distance value between a projection surface (10) and an electronic device (100), and sensing data of an acceleration sensor.

[0227] For example, the sensing data collection module (310) can acquire sensing data at a single fixed location. The sensing data collection module (310) can acquire sensing data while rotating the electronic device (100) in the z-axis direction at a single fixed location.

[0228] For example, the sensing data collection module (310) can acquire sensing data while moving in a space within a preset range.

[0229] The projection area detection module (320) can detect the projection area based on the sensing data collected (or acquired) from the sensing data collection module (310). The projection area may be an area where a projection image is output.

[0230] The projection area detection module (320) may include at least one of an edge detection module (321), a projection surface area detection module (322), a projection candidate area detection module (323), and a projection area determination module (324).

[0231] The edge detection module (321) can detect (or extract) an outline (or contour) from a captured image. The edge detection module (321) can generate edge information based on the captured image. The edge detection module (321) can generate edge information based on the captured image received from the sensing data collection module (310). The edge detection module (321) can transmit the edge information to the projection surface area detection module (322).

[0232] The edge detection module (321) may be implemented as an artificial intelligence model. The edge detection module (321) may include a DNN model.

[0233] The projection surface area detection module (322) can identify the projection surface based on edge information. The projection surface area detection module (322) can distinguish multiple areas based on outlines included in the edge information. The projection surface area detection module (322) can identify a projection surface capable of outputting a projection image among the multiple areas. The projection surface can be described as a projection surface area. The projection surface area detection module (322) can transmit information about the projection surface to the projection candidate area detection module (323).

[0234] The projection surface area detection module (322) can obtain characteristic information of a projectible surface. The characteristic information can include at least one of the position of the projection surface, the degree of rotation of the projection surface, and the degree of inclination of the projection surface.

[0235] The projection surface area detection module (322) can re-perform the scan operation if the projection surface (or projection surface area) is not identified.

[0236] The projection surface area detection module (322) can perform an operation of using a recently used projection surface area when the projection surface (or projection surface area) is not identified.

[0237] The projection surface area detection module (322) can perform a plane segmentation function.

[0238] The projection candidate area detection module (323) can identify a projection candidate area, which is an area where a projection image is to be output. The projection candidate area can be described as a candidate projection area, a preliminary projection area, a projection preliminary area, etc. The projection candidate area detection module (323) can identify a projection candidate area on a projection surface where a projection image can be output. The projection candidate area detection module (323) can transmit information about the projection candidate area to the projection area determination module (324).

[0239] A projection surface can represent an entire, distinct area.

[0240] The projection candidate area can represent the area of ​​the projection surface where the projection image is actually output.

[0241] The projection candidate area detection module (323) can receive information on the projection surface area and depth information obtained by performing a plane segmentation function. The projection candidate area detection module (323) can merge (or map) distance data included in the information on the projection surface area and depth information.

[0242] The projection candidate area detection module (323) can obtain an inclination angle for each plane. The projection candidate area detection module (323) can calculate the angle of the bottom surface of the electronic device (100) based on the gravity direction obtained from the acceleration sensor.

[0243] The projection candidate area detection module (323) can identify a projection candidate area having a maximum size based on the calculated angle of the bottom surface of the electronic device (100), the inclination angle for each plane, and the preset resolution.

[0244] The projection area determination module (324) can determine a projection area for outputting a projection image based on information about the projection candidate area. The projection area determination module (324) can determine the projection area based on at least one of the content type, the gaze direction of the user object, content information, and the projection method (normal projection, ultra-short-focus projection).

[0245] For example, there may be multiple projection candidate regions and only one projection region.

[0246] For example, there may be one projection candidate region and one projection region.

[0247] The projection area determination module (324) can determine the projection area based on at least one of the size of the projection candidate area, the position of the projection candidate area, the user's gaze direction, and content information.

[0248] The projection area determination module (324) can perform an image correction function by considering the characteristic information of the projection surface and the optical characteristic information of the electronic device (100). The optical characteristic information of the electronic device (100) can include information indicating the physical characteristics of the projection unit (112).

[0249] The projection area determination module (324) can transmit the determined target area information to the projection setting module. The target area information can be described as information about the projection area.

[0250] The projection setting module (330) can apply settings related to the projection function based on information about the projection area. The operation of applying the settings can include an operation of determining and applying at least one of the projection position and the projection angle. The projection setting module (330) can transmit at least one of the projection position and the projection angle to the image correction module (340).

[0251] The image correction module (340) can perform an image correction function based on at least one of a projection position or a projection angle. The image correction function can include performing a keystone correction function, a leveling correction function, and a resolution change function.

[0252] Keystone correction can refer to the process of correcting a trapezoidal image into a rectangular one. Leveling can refer to the process of rotating an image. Resolution adjustment can refer to the process of changing the size of a projected image. Resolution adjustment can include upscaling or downscaling.

[0253] FIG. 4 is a drawing for explaining a photographed image according to one embodiment.

[0254] Referring to FIG. 4, the electronic device (100) can obtain a captured image (400). The electronic device (100) can obtain the captured image (400) through the sensor unit (121). The electronic device (100) can analyze the captured image (400) to identify the projection surface (10).

[0255] The projection surface (10) can be divided into a first region (411), a second region (412), a third region (413), and a fourth region (414). It is assumed that the first region (411) and the fourth region (414) have a check pattern, and the second region (412) and the fourth region (414) have no pattern. The electronic device (100) can identify the projection surface (10) including four regions. Each region can be described as a projection surface region.

[0256] FIG. 5 is a drawing for explaining depth information according to one embodiment.

[0257] Referring to FIG. 5, the electronic device (100) can obtain depth information (500). The electronic device (100) can obtain depth information (500) using a distance sensor included in the sensor unit (121). The depth information can be described as a depth image, depth data, distance data, distance information, etc. The distance sensor can include at least one of a distance camera, a depth sensor, and a depth camera. The depth information (500) can be an image indicating at what distance (or depth) each pixel included in the captured image is based on a sensing position.

[0258] The electronic device (100) can obtain depth information (510) in different ways. The depth information (510) may be a sparsely displayed image indicating the distance corresponding to each pixel. The depth information (510) may represent a sparse depth map.

[0259] FIG. 6 is a diagram for explaining edge information according to one embodiment.

[0260] Referring to FIG. 6, the electronic device (100) can obtain edge information (600). The electronic device (100) can obtain edge information (600) based on a photographed image of the projection surface (10).

[0261] Edge information may include information that extracts only the outline (or contour) of at least one object included in a captured image. Edge information may be described as an edge map, edge data, edge map information, edge image, etc.

[0262] The electronic device (100) can obtain edge information (600) by extracting the outline of at least one object included in the captured image (400) of FIG. 5.

[0263] For example, the electronic device (100) can obtain edge information (600) by extracting the outline of the projection surface (10) included in the captured image (400) of FIG. 5.

[0264] Figure 7 is a drawing for explaining a projection surface according to one embodiment.

[0265] Referring to FIG. 7, the electronic device (100) can identify a projection surface area based on edge information (600). The electronic device (100) can obtain information (700) about the projection surface area.

[0266] The projection surface area may include an area that includes a plane greater than or equal to a threshold area. The electronic device (100) may identify an area having a plane greater than or equal to a threshold area as a projection surface area based on edge information. The threshold area may be determined based on at least one of a user setting, content size, or the position of the electronic device (100).

[0267] The electronic device (100) can identify an area representing at least one plane in the edge information (600). The electronic device (100) can determine an area having an area greater than a threshold area as a projection surface area.

[0268] The electronic device (100) can identify a plurality of areas representing a plane. The electronic device (100) can determine an area having an area greater than a threshold area among the plurality of areas as a projection surface area.

[0269] The electronic device (100) can identify a first projection surface area (711), a second projection surface area (712), a third projection surface area (713), and a fourth projection surface area (714) based on edge information (600).

[0270] The electronic device (100) can store information about a first projection surface area (711), information about a second projection surface area (712), information about a third projection surface area (713), and information about a fourth projection surface area (714). The information about each projection surface area can include location information (or coordinate information) of the projection surface area.

[0271] FIG. 8 is a drawing for explaining a projection candidate area and a target area according to one embodiment.

[0272] Referring to FIG. 8, the electronic device (100) can identify a projection candidate area based on information about the projection surface area. The electronic device (100) can obtain information (800) about the projection candidate area.

[0273] A projection candidate area may include an area where a projection image can be output. Information about the projection candidate area may include location information (or coordinate information) of an area where a projection image can actually be output.

[0274] The size of the projection surface area can be greater than or equal to the size of the projection candidate area. The projection surface area can represent any area where projection itself is possible. The projection candidate area can represent an area defined so that the projected image can be output in the correct location.

[0275] The electronic device (100) can identify a first projection candidate area (811), a second projection candidate area (812), a third projection candidate area (813), and a fourth projection candidate area (814) based on edge information (600) and information about the projection surface area.

[0276] The electronic device (100) can determine a projection candidate area based on at least one of a preset resolution, a current location of the electronic device (100), and a projection ratio of the electronic device (100).

[0277] According to various embodiments, the electronic device (100) may determine a projection candidate area based on a preset resolution. The preset resolution may include screen ratio information. It is assumed that the screen ratio information is 16:9 (horizontal:vertical). The electronic device (100) may identify an area within the projection surface area where a rectangular frame with a 16:9 ratio can be output at its maximum size as a projection candidate area.

[0278] Referring to the embodiment (800-2) of FIG. 8, the electronic device (100) may determine one of the projection candidate areas as a target area. It is assumed that the second projection candidate area (812) is determined as the target area. The electronic device (100) may output a projection image to the second projection candidate area (812).

[0279] FIG. 9 is a diagram for explaining an operation of obtaining a projection candidate area according to one embodiment.

[0280] Referring to the embodiment (900) of FIG. 9, the electronic device (100) can obtain a captured image (400). The electronic device (100) can transmit the captured image (400) to an edge detection module (321). The electronic device (100) can obtain edge information (600) using the edge detection module (321). The electronic device (100) can transmit the edge information (600) to a projection surface detection module (322).

[0281] The electronic device (100) can obtain information (700) about a projection surface area based on a projection surface detection module (322). The electronic device (100) can transmit the information (700) about the projection surface area to a projection candidate area detection module (323).

[0282] The electronic device (100) can obtain information (800) about a projection candidate area based on the projection candidate area detection module (323).

[0283] The electronic device (100) can obtain depth information (500). The electronic device (100) can transmit the depth information (500) to the projection candidate area detection module (323).

[0284] For example, the electronic device (100) can obtain information (800) about a projection candidate area based on information (700) about a projection surface area and depth information (500).

[0285] For example, the electronic device (100) can obtain information (800) about a projection candidate area based on information (700) about a projection surface area.

[0286] FIG. 10 is a drawing for explaining a horizontal slope according to one embodiment.

[0287] Referring to FIG. 10, according to an embodiment (1010), an electronic device (100) can output a projection image (1011) in a horizontal projection direction onto a projection surface (10). It is assumed that the horizontal inclination is 0. The horizontal inclination may refer to the degree to which the electronic device (100) is tilted to the left or right toward the front.

[0288] According to an embodiment (1020), an electronic device (100) can output a projection image (1021) in a horizontal projection direction to a projection surface (10). It is assumed that the horizontal inclination (1022) is 30 degrees. When the horizontal inclination is 30 degrees to the right, the electronic device (100) can output the projection image (1021) to the right by 30 degrees to the right on the projection surface (10).

[0289] The horizontal slope can represent the rotation angle (yaw) with respect to the z-axis in Fig. 13.

[0290] FIG. 11 is a drawing for explaining a vertical slope according to one embodiment.

[0291] Referring to FIG. 11, according to an embodiment (1110), an electronic device (100) can output a projection image on a projection surface in a horizontal projection direction. It is assumed that the vertical inclination is 0. The vertical inclination may refer to the degree to which the electronic device (100) is tilted upward or downward toward the front. If the vertical inclination is 0, it may be a situation in which the projection image is output horizontally. A virtual line (1111) representing the floor and a virtual line (1111) along which the electronic device (100) faces the front may be the same (or parallel).

[0292] According to an embodiment (1120), the electronic device (100) can output a projection image on a projection surface in a horizontal projection direction. It is assumed that the vertical inclination (1122) is 30 degrees. If the vertical inclination is 30 degrees upward, the electronic device (100) can output the projection image upward by 30 degrees upward on the projection surface. The virtual line (1111) representing the floor surface and the virtual line (1121) along which the electronic device (100) faces the front may not be parallel. The vertical inclination (1122) may represent the angle between the virtual line (1111) representing the floor surface and the virtual line (1121) along which the electronic device (100) faces the front.

[0293] The vertical slope can represent the rotation angle (pitch) with respect to the y-axis in Fig. 13.

[0294] Figure 12 is a drawing for explaining horizontal distortion according to one embodiment.

[0295] Referring to FIG. 12, according to an embodiment (1210), an electronic device (100) can output a projection image without horizontal distortion. A reference for no horizontal distortion is indicated by a horizontal line (1211). According to an embodiment (1210), the reference horizontal line and the horizontal line of the electronic device (100) can be aligned.

[0296] According to an embodiment (1220), the electronic device (100) may have a horizontal deviation (1222) of 30 degrees to the right. The reference horizontal line (1211) and the horizontal line (1221) of the electronic device may differ by the horizontal deviation (1222).

[0297] The horizontal distortion can represent the rotation angle (roll) based on the x-axis of Fig. 13.

[0298] FIG. 13 is a drawing for explaining rotation information of an electronic device (100) according to one embodiment.

[0299] FIG. 13 is a drawing for explaining the horizontal distortion, horizontal inclination, and vertical inclination of the electronic device (100).

[0300] Example 13 (1310) of FIG. 13 is a graph defining rotation directions along the x, y, and z axes. Rotation around the x-axis can be defined as roll, rotation around the y-axis can be defined as pitch, and rotation around the z-axis can be defined as yaw.

[0301] Embodiment (1320) of Fig. 13 can explain the rotation direction of the projection surface (10) as the rotation direction defined in embodiment (1310). The x-axis rotation information of the projection surface (10) may correspond to a roll that rotates based on the x-axis of the projection surface (10). The y-axis rotation information of the projection surface (10) may correspond to a pitch that rotates based on the y-axis of the projection surface (10). The z-axis rotation information of the projection surface (10) may correspond to a yaw that rotates based on the z-axis of the projection surface (10).

[0302] The x-axis rotation information can be described as the first-axis rotation information or horizontal tilt information. The y-axis rotation information can be described as the second-axis rotation information or vertical tilt information. The z-axis rotation information can be described as the third-axis rotation information or horizontal tilt information.

[0303] The sensor unit (121) can obtain status information of the electronic device (100). The status information of the electronic device (100) may refer to the rotational status of the electronic device (100). The sensor unit (121) may include at least one of a gravity sensor, an acceleration sensor, or a gyro sensor. The x-axis rotation information of the electronic device (100) and the y-axis rotation information of the electronic device (100) may be determined based on sensing data obtained through the sensor unit (121). However, it may be difficult to set a specific standard for the z-axis rotation information of the electronic device (100) unless it is based on east, west, south, or north. Therefore, the electronic device (100) may consider the status information of the projection surface (10) without separately considering the z-axis rotation information of the electronic device (100). Specifically, the electronic device (100) may perform an image correction operation by considering the z-axis rotation information of the projection surface (10).

[0304] FIG. 14 is a drawing for explaining rotation information of a projection surface according to one embodiment.

[0305] Example 14 (1410) of FIG. 14 is a graph defining rotation directions along the x, y, and z axes. Rotation around the x-axis can be defined as roll, rotation around the y-axis can be defined as pitch, and rotation around the z-axis can be defined as yaw.

[0306] Embodiment (1420) of Fig. 14 can explain the rotation direction of the projection surface (10) as the rotation direction defined in embodiment (1410). The x-axis rotation information of the projection surface (10) may correspond to a roll that rotates based on the x-axis of the projection surface (10). The y-axis rotation information of the projection surface (10) may correspond to a pitch that rotates based on the y-axis of the projection surface (10). The z-axis rotation information of the projection surface (10) may correspond to a yaw that rotates based on the z-axis of the projection surface (10).

[0307] The x-axis rotation information can be described as the first-axis rotation information. The y-axis rotation information can be described as the second-axis rotation information. The z-axis rotation information can be described as the third-axis rotation information.

[0308] FIG. 15 is a drawing for explaining z-axis rotation information of a projection surface according to one embodiment.

[0309] Example 15 (1510) of FIG. 15 is a drawing of an electronic device (100) viewed from above, showing a situation in which the electronic device (100) outputs a projection image while the projection surface (10) is not rotated along the z-axis. It is assumed that the electronic device (100) is placed on a table (20).

[0310] Example 15 (1520) of FIG. 15 is a drawing of an electronic device (100) viewed from above, showing a situation in which the electronic device (100) outputs a projection image while the projection surface (10) is rotated counterclockwise by a certain angle (θ1) with respect to the z-axis. It is assumed that the electronic device (100) is placed on a table (20).

[0311] FIG. 16 is a drawing for explaining y-axis rotation information of a projection surface according to one embodiment.

[0312] Referring to the embodiment (1610) of Fig. 16, the projection surface (10) is shown in a state where it is not rotated around the y-axis.

[0313] Referring to embodiment (1620) of Fig. 16, a state in which the projection surface (10) is rotated around the y-axis is shown. Specifically, it is assumed that the projection surface (10) is rotated by a certain angle (θ2) around the y-axis.

[0314] FIG. 17 is a drawing for explaining an operation of performing a keystone function by taking into account vertical inclination, according to one embodiment.

[0315] Referring to the embodiment (1710) of FIG. 17, the electronic device (100) can output a projection image in a state where a vertical tilt exists.

[0316] Referring to Example (1720), the electronic device (100) can output a projection image (1721) in a state where a vertical inclination exists, and due to the vertical inclination, the projection image (1721) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. In order to solve a problem caused by the presence of a horizontal inclination, the electronic device (100) can perform a keystone function.

[0317] Referring to Example (1730), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (1731) becomes rectangular in shape.

[0318] FIG. 18 is a drawing for explaining an operation of performing a keystone function while taking into account horizontal inclination, according to one embodiment.

[0319] Referring to the embodiment (1810) of FIG. 18, the electronic device (100) can output a projection image in a state where a horizontal inclination exists.

[0320] Referring to Example (1820), the electronic device (100) can output a projection image (1821) in a state where a horizontal inclination exists, and due to the horizontal inclination, the projection image (1821) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. To solve a problem caused by the presence of the horizontal inclination, the electronic device (100) can perform a keystone function.

[0321] Referring to Example (1830), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (1831) becomes rectangular in shape.

[0322] FIG. 19 is a drawing for explaining an operation of outputting a projection image to a target area according to one embodiment.

[0323] Referring to FIG. 19, the electronic device (100) can acquire a captured image (S1910). The electronic device (100) can acquire depth information (S1920). The electronic device (100) can acquire edge information based on the captured image (S1930).

[0324] The electronic device (100) can identify the projection surface (10) (S1940). The electronic device (100) can identify the projection surface (10) by identifying a plane having a size greater than a threshold size. The electronic device (100) can identify the projection surface area.

[0325] The electronic device (100) can identify a projection candidate area (S1950). The projection candidate area can be included in the projection surface area.

[0326] The electronic device (100) can determine a target area based on a projection candidate area (S1960). The electronic device (100) can output a projection image to the target area (S1970).

[0327] FIG. 20 is a diagram illustrating an operation of identifying multiple projection candidate regions according to one embodiment.

[0328] It can correspond to steps S2010, S2020, S2030, S2060, and S2070 of Fig. 20. Duplicate explanation is omitted.

[0329] After acquiring edge information, the electronic device (100) can identify multiple projection surfaces based on the edge information (S2040). The electronic device (100) can identify multiple projection surface areas.

[0330] The electronic device (100) can identify a plurality of projection candidate areas based on a plurality of projection surfaces (or a plurality of projection surface areas) (S2050).

[0331] The electronic device (100) can determine one of a plurality of projection candidate areas as a target area. The electronic device (100) can output a projection image to the target area.

[0332] FIG. 21 is a drawing for explaining an operation of determining a target area by considering a user's gaze direction according to one embodiment.

[0333] Step S2110 of FIG. 21 may correspond to step S2050 of FIG. 20. Duplicate explanation is omitted.

[0334] After identifying multiple projection candidate areas, the electronic device (100) can obtain content information (S2120). The content information may include metadata that can represent the content. The metadata may include at least one of a content name, a content type, a content time, and a content size.

[0335] The electronic device (100) can determine whether the content type corresponds to a preset type (S2130).

[0336] If the content type is not a preset type (S2130-N), the electronic device (100) can determine the target area based on the content size (S2180).

[0337] If the content type is a preset type (S2130-Y), the electronic device (100) can acquire a captured image (S2140). The captured image acquired in step S1910 of FIG. 19 may be described as a first captured image, and the captured image acquired in step S2140 may be described as a second captured image.

[0338] The electronic device (100) can determine whether a user object is identified based on the second captured image (S2150). The electronic device (100) can identify whether an object representing the user is included in the second captured image.

[0339] If the second captured image does not contain a user object (S2150-N), the electronic device (100) can determine the target area based on the content size (S2180).

[0340] If the second captured image includes a user object (S2150-Y), the electronic device (100) can identify the gaze direction of the user object (S2160).

[0341] The electronic device (100) can identify a projection candidate area corresponding to the gaze direction of the user object (S2170). The electronic device (100) can identify (or select) an area corresponding to the gaze direction among a plurality of projection candidate areas.

[0342] The electronic device (100) can determine a target area from among the areas corresponding to the viewing direction based on the content size (S2180). The electronic device (100) can determine an area capable of outputting the content size from among the projection candidate areas as the target area. If there are multiple areas capable of outputting the content size, the electronic device (100) can determine the area with the largest area as the target area.

[0343] The electronic device (100) can output a projection image to a target area (S2190).

[0344] FIG. 22 is a drawing for explaining an operation of determining a target area by considering a user's gaze direction according to one embodiment.

[0345] Referring to the embodiment (2200) of FIG. 22, the electronic device (100) can identify four projection candidate areas (2211, 2212, 2213, 2214).

[0346] The electronic device (100) can identify a user object based on the second captured image. The electronic device (100) can identify the gaze direction of the user object. The electronic device (100) can identify (or select) a projection candidate area (2211, 2212) corresponding to the gaze direction among a plurality of projection candidate areas (2211, 2212, 2213, 2214).

[0347] The electronic device (100) can determine a target area among projection candidate areas (2211, 2212) corresponding to the identified (or selected) gaze direction.

[0348] For example, the electronic device (100) can determine the area with the largest area among multiple projection candidate areas (2211, 2212) as the target area.

[0349] According to various embodiments, the electronic device (100) may select a projection candidate area based on a projection method. The electronic device (100) may output a projection image using a first projection method (normal projection method) or a second projection method (ultra-short-focus projection method). There may be a first projection distance range required to output a projection image using the first projection method. There may be a second projection distance range required to output a projection image using the second projection method.

[0350] The electronic device (100) can identify the projection method of the electronic device (100). The electronic device (100) can select a projection candidate area based on a projection distance range corresponding to the identified projection method.

[0351] For example, it is assumed that the projection method of the electronic device (100) is the first projection method. The electronic device (100) can exclude projection candidate areas that cannot be output within the first projection distance range corresponding to the first projection method. The electronic device (100) can select projection candidate areas that can be output within the first projection distance range.

[0352] FIG. 23 is a diagram illustrating an operation of determining a target area based on user input, according to one embodiment.

[0353] Referring to FIG. 23, the electronic device (100) can identify multiple projection candidate areas (S2310). Step S2310 may correspond to step S2050 of FIG. 20.

[0354] The electronic device (100) can output a guide screen for a plurality of projection candidate areas (S2320).

[0355] The electronic device (100) can receive a user input for selecting one of a plurality of projection candidate areas (S2330). The user input can include at least one of a command for pressing a specific button, a voice command, and a user gesture.

[0356] The electronic device (100) can determine a projection candidate area corresponding to a user input as a target area (S2340). The electronic device (100) can output a projection image to the target area.

[0357] FIG. 24 is a drawing for explaining a guide screen for selecting a target area according to one embodiment.

[0358] Referring to FIG. 24, if there are multiple projection candidate areas, the electronic device (100) may provide a guide screen (2400). The guide screen (2400) may include at least one of a UI (2410) including information requesting selection of one of the multiple projection candidate areas and a UI (2420) indicating the multiple projection candidate areas.

[0359] The UI (2420) may include at least one of a first projection candidate area (2421) and a GUI (2431) representing the first projection candidate area (2421).

[0360] The UI (2420) may include at least one of a second projection candidate area (2422) and a GUI (2432) representing the second projection candidate area (2422).

[0361] The UI (2420) may include at least one of a third projection candidate area (2423) and a GUI (2433) representing the third projection candidate area (2423).

[0362] The UI (2420) may include at least one of a fourth projection candidate area (2424) and a GUI (2434) representing the fourth projection candidate area (2424).

[0363] GUI can stand for Graphic User Interface.

[0364] When a user input is received through the UI (2420), the electronic device (100) can determine an area corresponding to the user input as a target area.

[0365] FIG. 25 is a drawing for explaining a guide screen for selecting a target area according to one embodiment.

[0366] The guide screen (2500) of Fig. 25 may correspond to the guide screen (2400) of Fig. 24. The UI (2510) and UI (2520) may correspond to the UI (2410) and UI (2420) of Fig. 24. Duplicate explanations are omitted.

[0367] The UI (2520) may include at least one of a first projection candidate area (2521), a GUI (2531) representing the first projection candidate area (2521), and information (2541) representing the size of the first projection candidate area (2521).

[0368] The UI (2520) may include at least one of a second projection candidate area (2522), a GUI (2532) representing the second projection candidate area (2522), and information (2542) representing the size of the second projection candidate area (2522).

[0369] The UI (2520) may include at least one of a third projection candidate area (2523), a GUI (2533) representing the third projection candidate area (2523), and information (2543) representing the size of the third projection candidate area (2523).

[0370] The UI (2520) may include at least one of a fourth projection candidate area (2524), a GUI (2534) representing the fourth projection candidate area (2524), and information (2544) representing the size of the fourth projection candidate area (2524).

[0371] FIG. 26 is a drawing for explaining a guide screen for selecting a target area according to one embodiment.

[0372] The guide screen (2600) of Fig. 26 may correspond to the guide screen (2400) of Fig. 24. The UI (2610) and UI (2620) may correspond to the UI (2410) and UI (2420) of Fig. 24. Duplicate explanations are omitted.

[0373] The UI (2620) may include at least one of information (2641, 2644) indicating that a specific projection candidate area is not recommended or information (2642) indicating that a specific projection candidate area is recommended.

[0374] To determine a target area for outputting a projection image, the electronic device (100) may determine one target area. The electronic device (100) may provide a guide screen (2600) including information for recommending the determined target area.

[0375] FIG. 27 is a drawing for explaining an operation of performing projection settings according to one embodiment.

[0376] Referring to FIG. 27, the electronic device (100) can determine a target area (S2710). Step S2710 may correspond to steps S1960 of FIG. 19, S2060 of FIG. 20, and S2180 of FIG. 21. Duplicate descriptions are omitted.

[0377] The electronic device (100) can obtain location information of a target area (S2720). The location information may include coordinate information indicating the target area.

[0378] The electronic device (100) can obtain the projection position and projection angle based on the location information of the target area (S2730).

[0379] According to various embodiments, the electronic device (100) can obtain at least one of a projection position or a projection angle based on location information of the target area.

[0380] The electronic device (100) can output a projection image to a target area based on the projection position and projection angle (S2740).

[0381] FIG. 28 is a drawing for explaining an image correction operation according to one embodiment.

[0382] Steps S2810, S2820, S2830, and S2840 of FIG. 28 may correspond to steps S2710, S2720, S2730, and S2740 of FIG. 27. Duplicate explanations are omitted.

[0383] Upon obtaining the projection position and projection angle, the electronic device (100) can correct the projection image based on at least one of the content size, projection position, or projection angle (S2835). The electronic device (100) can perform an image correction function on the projection image. The image correction function can include performing a keystone correction function, a leveling correction function, and a resolution change function.

[0384] The electronic device (100) can output a corrected projection image to the target area based on the projection position and projection angle (S2840).

[0385] FIG. 29 is a drawing for explaining a screen distortion ratio according to one embodiment.

[0386] Referring to the embodiment (2910) of FIG. 29, the electronic device (100) can calculate the degree (or ratio) of screen distortion as it rotates in the y-axis (pitch) direction.

[0387] Example (2910) indicates that the electronic device (100) is rotated by α in the y-axis (pitch) direction.

[0388] FIG. 30 is a drawing for explaining a screen correction ratio according to one embodiment.

[0389] Referring to embodiment (3010) of Fig. 30, it is assumed that the electronic device (100) performs an image correction function while being rotated by α in the y-axis (pitch) direction. Embodiment (3010) may represent a process of calculating a screen change ratio when performing the image correction function.

[0390] w can represent the horizontal length of the original image (projection image) before performing the image correction function.

[0391] h can represent the vertical length of the original image (projection image) before performing the image correction function.

[0392] Other values ​​are described in Example 2910 of FIG. 29.

[0393] FIG. 31 is a drawing for explaining a screen correction ratio according to one embodiment.

[0394] The embodiment (3110) of FIG. 31 may represent a process of calculating the size of an original image (projected image) before performing an image correction function and the size of an original image (projected image) before performing an image correction function.

[0395] FIG. 32 is a drawing for explaining a control method of an electronic device (100) according to one embodiment.

[0396] Referring to FIG. 32, a control method of an electronic device (100) includes a step of obtaining a photographed image and depth information (S3205), a step of extracting an outline included in the photographed image to obtain edge information (S3210), a step of identifying a first projection surface area and a second projection surface area from the edge information (S3215), a step of identifying a first projection candidate area corresponding to the first projection surface area and a second projection candidate area corresponding to the second projection surface area from the edge information based on the depth information (S3220), a step of determining one of the first projection candidate area and the second projection candidate area as a target area (S3225), and a step of outputting a projection image to the target area (S3230).

[0397] The step of obtaining a photographed image and depth information (S3205) obtains a photographed image through an image sensor included in the electronic device (100), obtains depth information through a distance sensor included in the electronic device (100), and the step of identifying a first projection candidate area and a second projection candidate area obtains slope information of a first projection surface area and second slope information of a second projection surface area based on the depth information, identifies the first projection candidate area based on the first slope information, and identifies the second projection candidate area based on the second slope information, and the depth information may include a sparse depth map.

[0398] The step of obtaining edge information (S3210) can identify at least one object in a photographed image and obtain edge information including an outline of at least one object.

[0399] The step of identifying the first projection surface area and the second projection surface area (S3215) can identify an area corresponding to a plane larger than a threshold size in the edge information as the first projection surface area and the second projection surface area.

[0400] The step (S3220) of identifying the first projection candidate area and the second projection candidate area can identify the first projection candidate area and the second projection candidate area based on preset resolution information.

[0401] The step of determining the target area (S3225) may determine an area corresponding to a larger value between the first size of the first projection candidate area and the second size of the second projection candidate area as the target area.

[0402] The step of determining the target area (S3225) acquires content information related to the projection image, and if the content type included in the content information is a preset type, the target area can be determined based on the user's gaze direction.

[0403] The captured image is a first captured image, and the step (S3225) of determining a target area may include, if the content type included in the content information is a preset type, acquiring a second captured image through an image sensor included in the electronic device (100), identifying the user's gaze direction included in the second captured image, and determining an area corresponding to the user's gaze direction among the first projection candidate area and the second projection candidate area as the target area.

[0404] The control method further includes a step of acquiring position information of a target area and a step of acquiring a projection position and a projection angle based on the position information of the target area, and the step of outputting a projection image (S3230) can output the projection image to the target area based on the projection position and the projection angle.

[0405] The projection image is a first projection image, and the control method further includes a step of performing a correction function for the first projection image based on a projection position and a projection angle to obtain a second projection image, and the step of outputting the projection image (S3230) can output the second projection image to a target area.

[0406] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0407] The methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0408] The various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic device and the display device.

[0409] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When the instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or under the control of the processor using other components. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. 'Non-transitory' means that the storage medium does not contain signals and is tangible, but does not distinguish between whether data is stored semi-permanently or temporarily in the storage medium.

[0410] According to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0411] Each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0412] FIG. 33 is a drawing for explaining a mobile projector according to one embodiment.

[0413] The electronic device (100) may be implemented as a mobile device. The electronic device (100) may be implemented as a mobile projector or a mobile image output device.

[0414] The electronic device (100) may include a movable member (122). The movable member (122) may refer to a member for moving from a first position to a second position in a space where the electronic device (100) is placed. The movable member (122) may include at least one wheel (e.g., a circular wheel). The electronic device (100) may move to a target position (or goal position) through the movable member (122).

[0415] Referring to the embodiment (3310) of FIG. 33, the electronic device (100) can be moved by a force applied by a user. When the user pushes the electronic device (100), the movable member (122) of the electronic device (100) can be rotated. The movable member (122) can include a wheel, and the electronic device (100) can be moved by the movable member (122) being rotated by an external force.

[0416] Referring to the embodiment (3320) of FIG. 33, the movable member (122) can be moved via a fixed member (3321). The fixed member (3321) can include a movable rail. An electronic device (100) can be placed on the movable rail. The electronic device (100) can move on the movable rail. The movable rail is not a component included in the electronic device (100), but can be a component installed by a user.

[0417] The electronic device (100) can control the moving member (122) to move the electronic device (100) by using the force generated from the driving unit (120). The electronic device (100) can generate the force to be transmitted to the moving member (122) by using the motor included in the driving unit (120).

[0418] When a user input or control command is received, the electronic device (100) can rotate the moving member (122) by transmitting a force generated through a motor to the moving member (122). The electronic device (100) can control the moving member (122) to adjust the rotation speed, rotation direction, etc. The electronic device (100) can perform a movement action (or movement function) by controlling the moving member (122) based on a target position or a moving direction, etc.

[0419] The electronic device (100) can drive based on at least one of a preset movement speed or a preset acceleration. The preset movement speed or the preset acceleration can be changed according to a user's settings.

[0420] According to various embodiments, the electronic device (100) may control speed or acceleration based on a preset event. The electronic device (100) may identify whether the preset event has occurred. The electronic device (100) may acquire at least one of driving data (or map data) or sensing data to identify whether the preset event has occurred.

[0421] When a preset event is identified as occurring, the electronic device (100) may drive by changing the speed or acceleration. The preset event may include at least one of an event for driving to a target location or an event for identifying a preset object.

[0422] An event for driving to a target location may include at least one of an event for starting driving from the current location or an event for stopping driving at the target location. When a control command (or user input) for driving from the current location to the target location is obtained, the electronic device (100) may increase at least one of the speed or acceleration. If it is determined that the electronic device (100) has reached a threshold distance from the target location, the electronic device (100) may decrease at least one of the speed or acceleration.

[0423] The preset object may include an obstacle object. If an obstacle object is identified, the electronic device (100) may reduce acceleration. The acceleration may increase in the opposite direction of the direction of travel. If the acceleration is reduced, the speed increase of the electronic device (100) may decrease, and if the acceleration is in the opposite direction of the direction of travel, the speed may decrease.

[0424] According to various embodiments, the electronic device (100) can move over the fixed member (3321) by force transmitted through the driving unit (120). The electronic device (100) can automatically move the fixed member (3321) by using force generated from the driving unit (120) rather than an external force. The automatic movement operation can be described as a sliding operation.

[0425] According to various embodiments, the electronic device (100) may move to an identified target location based on a user input. The target location may include a target location to which the electronic device (100) is to move. The user may input a command to the electronic device (100) to move to the target location. The electronic device (100) may receive a user input for moving to the target location.

[0426] For example, the user input may include information on the location where the electronic device (100) is to move. The electronic device (100) may determine the location information included in the user input as a target location and move to the target location.

[0427] For example, the user input may include location information of the projection surface (10) on which the electronic device (100) outputs the projection image. The electronic device (100) may determine a target location at which the electronic device (100) outputs the projection image based on the location information of the projection surface (10) included in the user input. The electronic device (100) may move to the determined target location.

[0428] A user input including a target location can be received (or acquired) through an external device connected to the electronic device (100).

[0429] For example, the external device may include a remote control device capable of communicating with the electronic device (100).

[0430] For example, the external device may include a user terminal device capable of communicating with the electronic device (100).

[0431] The electronic device (100) can identify a target location through a sensor unit (121). The sensor unit (121) can obtain sensing data about the surroundings of the electronic device (100). The electronic device (100) can identify the target location based on the sensing data.

[0432] For example, the electronic device (100) can identify a laser light pointing at a target location by a user from sensing data. When a user points the laser light at a target location using a laser or the like, the electronic device (100) can sense the position of the laser light to identify the target location.

[0433] For example, the electronic device (100) can identify a user gesture indicating a target location from a sensing data. When the user points to the target location with a finger (or an object indicating a pointing direction), the electronic device (100) can sense the user's gesture and identify the target location.

[0434] An electronic device (100) may include a projection unit (112). The electronic device (100) may control the projection unit (112) to output a projected image.

[0435] According to various embodiments, the electronic device (100) may include a projection unit (112) utilizing an ultra-short throw (UST) method. The ultra-short throw method may refer to a method of projecting an image at a relatively close distance (e.g., less than 1 m). Despite the close distance, a clear projected image can be output to the projection surface (10).

[0436] According to various embodiments, the electronic device (100) may include a projection unit (112) using a general method. The projection unit (112) may include various types of light sources. For example, the projection unit (112) may include at least one light source among a lamp, an LED, and a laser. The general method may include a method of outputting a projection image at a distance exceeding 1 m.

[0437] According to various embodiments, the electronic device (100) can output a projection image using both the ultra-short focus method and the normal method at the same projection position. The electronic device (100) can output a projection image using both the ultra-short focus method and the normal method at the same point in time.

[0438] The electronic device (100) can distinguish a first area and a second area among the entire projection area for projecting a projection image. The electronic device (100) can output a projection image to the first area using an ultra-short focus method, and output a projection image to the second area using a general method.

[0439] For example, the projection image output to the first area and the projection image output to the second area may be sub-images generated based on the same projection image (source image).

[0440] For example, the projection image output to the first area and the projection image output to the second area may be different projection images.

[0441] For example, the electronic device (100) can output a projection image using a short focus method in a first area and a normal method in a second area using the same light source.

[0442] For example, the electronic device (100) can output a projection image using a short focus method in a first area and a normal method in a second area by using different light sources. The electronic device (100) can output a projection image using a short focus method in a first area through a first light source output from a first light source unit, and can output a projection image using a normal method in a second area through a second light source output from a second light source unit.

[0443] FIG. 34 is a drawing for explaining the distance between a projection surface (10) and an electronic device (100), according to one embodiment.

[0444] Referring to FIG. 34, the electronic device (100) can determine the projection method based on the distance between the electronic device (100) and the projection surface (10).

[0445] The projection method may include at least one of an ultra-short throw (UST) method or a normal method. The ultra-short throw method may be described as the first method, and the normal method may be described as the second method. The electronic device (100) may acquire (or calculate) the distance between the position of the electronic device (100) and the position of the projection surface (10), and determine the projection method based on the acquired distance.

[0446] If the distance between the electronic device (100) and the projection surface (10) is less than or equal to a critical distance, the electronic device (100) can output a projection image using an ultra-short focus method. If the distance between the electronic device (100) and the projection surface (10) exceeds the critical distance, the electronic device (100) can output a projection image using a general method.

[0447] Referring to Example (3410), a situation is shown where the distance between the electronic device (100) and the projection surface (10) is less than or equal to a critical distance (d1). The electronic device (100) can output a projection image using an ultra-short focus method.

[0448] Referring to Example (3420), a situation is shown where the distance between the electronic device (100) and the projection surface (10) exceeds the critical distance (d1). The electronic device (100) can output a projection image using a general method.

[0449] The critical distance (d1) may be described as a first critical distance. If the distance between the electronic device (100) and the projection surface (10) exceeds the second critical distance (d2), the electronic device (100) may control the distance between the electronic device (100) and the projection surface (10) to be within the second critical distance (d2). The electronic device (100) may determine a target position at which the distance between the electronic device (100) and the projection surface (10) is within the second critical distance (d2), and may move to the target position. After moving, the electronic device (100) may output a projection image.

[0450] According to various embodiments, the electronic device (100) may include a plurality of lenses.

[0451] The electronic device (100) may include a first lens corresponding to a short-focus method. The electronic device (100) may include a second lens corresponding to a general method. The refractive indices of the first lens and the second lens may be different.

[0452] The electronic device (100) can determine a projection method using the projection environment (or surrounding environment). The electronic device (100) can determine a lens corresponding to the determined method. The electronic device (100) can output a projection image through the determined lens.

[0453] According to various embodiments, the electronic device (100) may include an integrated lens (or first lens). Based on the integrated lens, the electronic device (100) may output a projection image in an ultra-short throw (UST) manner and a conventional manner. The electronic device (100) may implement various projection methods with a single lens.

[0454] FIG. 35 is a drawing for explaining a moving operation of an electronic device (100) according to one embodiment.

[0455] Referring to embodiment (3510) of FIG. 35, the electronic device (100) can move based on a projection position. The electronic device (100) can obtain a projection position for moving the electronic device (100).

[0456] According to various embodiments, the electronic device (100) can move based on the projection position without outputting a projected image. Once the projection position is identified (or acquired), the electronic device (100) can determine whether a projected image is being output. If the projected image is not being output, the electronic device (100) can move based on the projection position.

[0457] If a projection image is being output, the electronic device (100) can stop the projection operation of the projection image. After stopping the output of the projection image, the electronic device (100) can move based on the projection position.

[0458] FIG. 36 is a diagram for explaining a notification for a location movement according to one embodiment.

[0459] Referring to the embodiment (3610) of FIG. 36, when a moving event is identified based on the projection position, the electronic device (100) can output a movement notification screen (3611).

[0460] The movement notification screen (3611) may include at least one of a UI (3611-1) requesting user input for movement of the location of the electronic device (100) or a UI (3611-2) for setting whether to display the movement notification screen.

[0461] When a user input including a movement command is received through the UI (3611-1), the electronic device (100) can move based on the projection position.

[0462] When a user input is received to set the device to move without a movement notification screen through the UI (3611-2), the electronic device (100) may no longer display the movement notification screen (3611). When the electronic device (100) moves after the user input is received, the electronic device (100) may not display the movement notification screen (3611).

[0463] FIG. 37 is a drawing for explaining a keystone correction function according to one embodiment.

[0464] Referring to embodiment (3710) of FIG. 37, when the inclination of the electronic device (100) changes due to positional movement, the electronic device (100) may perform a keystone correction function. The keystone correction function may include an operation of correcting a trapezoidal image into a rectangular image.

[0465] The electronic device (100) can output a projection image in a state where a vertical inclination exists.

[0466] Referring to embodiment (3720), the electronic device (100) can output a projection image (3721) in a state where a vertical inclination exists, and due to the vertical inclination, the projection image (3721) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. In order to solve a problem caused by the presence of a horizontal inclination, the electronic device (100) can perform a keystone function.

[0467] Referring to embodiment (3730), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (3731) becomes rectangular in shape.

[0468] FIG. 38 is a drawing for explaining a keystone correction function according to one embodiment.

[0469] Referring to the embodiment (3810) of FIG. 38, when the inclination of the electronic device (100) changes according to the position movement, the electronic device (100) can perform a keystone correction function.

[0470] The electronic device (100) can output a projection image in a state where a horizontal inclination exists.

[0471] Referring to embodiment (3820), the electronic device (100) can output a projection image (3821) in a state where a horizontal inclination exists, and due to the horizontal inclination, the projection image (3821) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. To solve a problem caused by the presence of the horizontal inclination, the electronic device (100) can perform a keystone function.

[0472] Referring to embodiment (3830), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (3831) becomes rectangular in shape.

[0473] According to various embodiments, the electronic device (100) can perform keystone correction at various points in time. It is assumed that the electronic device (100) is located at a first location (current location). It is assumed that the electronic device (100) moves to a second location (projection location) and outputs a projected image. 338

[0474] For example, the electronic device (100) can perform keystone correction at a first location. After completing the keystone correction at the first location, the electronic device (100) can move to a second location. The electronic device (100) can output a projection image on which keystone correction has been performed at the second location.

[0475] For example, the electronic device (100) can perform keystone correction while moving from a first position to a second position. The electronic device (100) can output a projection image on which keystone correction has been performed at the second position.

[0476] For example, the electronic device (100) can perform keystone correction at a second location. The electronic device (100) can output a projection image on which keystone correction has been performed at the second location.

[0477] According to various embodiments, the electronic device (100) can output a projection image while moving. To output a projection image while moving, the electronic device (100) can perform keystone correction in real time while moving. The electronic device (100) can perform keystone correction based on each position while moving from a first position to a second position. The electronic device (100) can output a projection image for which keystone correction has been performed in real time at each position while moving. The keystone correction can be performed gradually at each position.

[0478] FIG. 39 is a drawing for explaining an operation of changing a projection area according to one embodiment.

[0479] Referring to the embodiment (3910) of FIG. 39, when the size of a projection image changes, the electronic device (100) can newly identify a projection surface corresponding to the changed size. The electronic device (100) can determine a projection surface corresponding to the size of the projection image. It is assumed that there are multiple candidate projection surfaces in the space where the electronic device (100) is placed. The electronic device (100) can output the projection image to the first projection surface (3911) among the multiple candidate projection surfaces. Changing the size of the projection image may include an operation of changing the resolution of the projection image or an operation of changing the aspect ratio of the projection image.

[0480] When the size of the projection image increases, the electronic device (100) can determine whether the increased size of the projection image can be projected on the first projection surface (3911). The electronic device (100) can compare the size of the projection image with the size of the first projection surface (3911). If the size of the projection image is larger than the size of the first projection surface (3911), the electronic device (100) can determine to change the projection surface. The electronic device (100) can determine a second projection surface (3912) having a size larger than the size of the projection image among a plurality of candidate projection surfaces. The electronic device (100) can output the projection image on the second projection surface (3912).

[0481] According to various embodiments, the electronic device (100) may determine whether to move based on attribute information of content including a projected image. The attribute information of the content may include at least one of information on the ratio of high-frequency components included in the content and information on whether an edge object is included.

[0482] If the proportion of high-frequency components among the multiple components included in the content is greater than or equal to a critical ratio, the electronic device (100) can move toward the projection surface (10).

[0483] When the content includes an edge object, the electronic device (100) can move toward the projection surface (10).

[0484] When the electronic device (100) is moved toward the projection surface (10), the projection image may become clearer. The clarity of the projection image may indicate that the quality of the projection image is relatively high.

[0485] FIG. 40 is a drawing for explaining an operation of outputting a projection image using a plurality of devices according to one embodiment.

[0486] Referring to embodiment (4010) of FIG. 40, according to various embodiments, a projection image (4011) may be output to a projection surface (10) by a plurality of electronic devices including a projection unit. The plurality of electronic devices may include a first electronic device (100-1) and a second electronic device (100-2).

[0487] A first electronic device (100-1) can output a portion (4011-1) of a projection image (4011) to a projection surface (10), and a second electronic device (100-2) can output a portion (4011-2) of the projection image to the projection surface (10). The electronic devices (100) can perform a synchronization operation to synchronize the portion projected by the first electronic device (100-1) and the portion projected by the second electronic device (100-2). The synchronization operation can include an operation for multiple electronic devices to output images (or frames) at the same point in time.

[0488] The electronic device (100) may perform an edge blending function when outputting a projection image to multiple electronic devices. The edge blending function may include an operation in which multiple electronic devices project their respective images to output a single screen.

[0489] When the position of the electronic device (100) changes, the electronic device (100) can re-perform the edge blending function.

[0490] Referring to the embodiment (4020) of FIG. 40, multiple electronic devices can display the same projection image (4021) by overlapping them on the projection surface (10). When different electronic devices (100) output the projection image (4021) in the same area, the brightness can increase. The multiple electronic devices can perform a synchronization operation to synchronize the projection image (4021).

[0491] Figure 41 is a drawing for explaining an operation of changing a projection image according to distance.

[0492] By moving toward the projection surface (10) and reducing the projection area, the size of the projection image (content) can be reduced. When the size of the projection image is reduced, the power consumed in outputting the projection image can be saved.

[0493] Referring to the embodiment (4110) of FIG. 41, the electronic device (100) can output a projection image (4111) at a projection position a first distance away from the projection surface. The projection image (4111) can include a first region (4111-1) and a second region (4111-2). The first region (4111-1) and the second region (4111-2) can include different contents. The electronic device (100) can distinguish a plurality of regions (4111-1, 4111-2) using edge lines in the projection image (4111).

[0494] The electronic device (100) can identify an event that moves the projection position closer to the projection surface while reducing the size of the projected image. The electronic device (100) can identify a target area (4111-2) based on preset criteria among a plurality of areas (4111-1, 4111-2). The target area based on the preset criteria can include at least one of a smaller area and an area selected as the main area by a user setting.

[0495] Referring to the embodiment (4120) of FIG. 41, the electronic device (100) may move closer to the projection surface, but may output only a projection image (4121) corresponding to the target area (4111-2) among the plurality of areas (4111-1, 4111-2). The electronic device (100) may convert the size of the image corresponding to the target area (4111-2) and output a new projection image (4121).

[0496] For example, if the content is music-related, the electronic device (100) may move toward the projection surface (10). When moving toward the projection surface (10), the electronic device (100) may reduce the size of the first projection image when outputting the content, thereby reducing battery consumption. The first projection image related to music content may include a first area representing an image related to music and a second area representing music playback information. When an event for reducing the size of the first projection image is identified, the electronic device (100) may generate a second projection image that includes only the second area, and output the generated second projection image. The second projection image may be smaller in size than the first projection image with respect to the projection surface. The location at which the second projection image is output may be closer to the projection surface than the location at which the first projection image is output.

[0497] The electronic device (100) may include a microphone (118). The electronic device (100) may receive user input through the microphone (118). The user input may include voice input. The electronic device (100) may perform a function corresponding to the user input based on the user input including the user's voice.

[0498] The function corresponding to the user input may include a full-screen output (Full View) function. The full-screen output function may be described as a full-screen output mode. The electronic device (100) may receive a voice command and perform a function corresponding to the voice command.

[0499] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea of ​​the present disclosure.

Claims

1. In electronic devices, A sensor unit comprising at least one sensor; memory; A projection unit that outputs a projection image; and comprising at least one processor; At least one processor of the above, Edge information is acquired based on the captured image obtained through the above sensor unit, An electronic device that controls the projection unit to output the projection image corrected to correspond to a projection area based on at least one of the first projection surface area and the second projection surface area included in the edge information based on depth information acquired through the sensor unit.

2. In paragraph 1, At least one processor of the above, An electronic device that identifies an area corresponding to a plane having a critical size or larger in the edge information as the first projection surface area and the second projection surface area.

3. In paragraph 1, At least one processor of the above, Based on the depth information and the preset resolution information, a first projection candidate area corresponding to the first projection surface area and a second projection candidate area corresponding to the second projection surface area are identified from the edge information, Identifying one of the first projection candidate area and the second projection candidate area as a projection area, An electronic device that controls the projection unit to output a projection image to the projection area.

4. In paragraph 3, At least one processor of the above, The above photographed image is acquired through the image sensor included in the above sensor unit, Based on the depth information acquired through the distance sensor included in the sensor unit, the slope information of the first projection surface area and the second slope information of the second projection surface area are acquired, Identifying the first projection candidate area based on the first slope information, Identify the second projection candidate area based on the second slope information above, The above depth information is, An electronic device comprising a sparse depth map.

5. In paragraph 3, At least one processor of the above, An electronic device that obtains edge information including an outline of at least one object in the captured image.

6. In paragraph 3, At least one processor of the above, An electronic device that identifies an area corresponding to a larger value between a first size of the first projection candidate area and a second size of the second projection candidate area as the projection area.

7. In paragraph 3, At least one processor of the above, Obtain content information related to the above projection image, An electronic device that identifies the projection area based on the user's gaze direction if the content type included in the above content information is a preset type.

8. In paragraph 7, The above photographed image is the first photographed image, At least one processor of the above, If the content type included in the above content information is a preset type, a second shooting image is acquired through the image sensor included in the sensor unit, Identify the user's gaze direction included in the second photographed image, An electronic device that identifies an area corresponding to the user's gaze direction among the first projection candidate area and the second projection candidate area as the projection area.

9. In paragraph 1, At least one processor of the above, Obtain location information of the above projection area, Obtain the projection position and projection angle based on the position information of the above projection area, An electronic device that controls the projection unit to output the projection image to the projection area based on the projection position and the projection angle.

10. In paragraph 9, The above projection image is a first projection image, At least one processor of the above, A second projection image is obtained by performing a correction function on the first projection image based on the projection position and the projection angle, An electronic device that controls the projection unit to output the second projection image to the projection area.

11. In a method for controlling an electronic device, A step of obtaining edge information based on a photographed image; A control method, comprising: a step of outputting a projection image corrected to correspond to a projection area based on at least one of a first projection area and a second projection area included in the edge information based on depth information; 12. In paragraph 11, The step of identifying the first projection surface area and the second projection surface area comprises: A control method for identifying an area corresponding to a plane having a critical size or larger in the edge information as the first projection surface area and the second projection surface area.

13. In paragraph 11, The step of identifying the above projection area is: Based on the depth information and the preset resolution information, a first projection candidate area corresponding to the first projection surface area and a second projection candidate area corresponding to the second projection surface area are identified from the edge information, Identifying one of the first projection candidate area and the second projection candidate area as a projection area, The step of outputting the above projection image is: A control method for outputting a projection image to the above projection area.

14. In paragraph 13, The step of identifying the above projection area is: The above photographed image is acquired through the image sensor, Based on the depth information acquired through the distance sensor, the slope information of the first projection surface area and the second slope information of the second projection surface area are acquired, Identifying the first projection candidate area based on the first slope information, Identify the second projection candidate area based on the second slope information above, The above depth information is, A control method comprising a sparse depth map.

15. In paragraph 13, The step of obtaining the above edge information is: A control method for obtaining edge information including an outline of at least one object in the above-described photographed image.

Images