Electronic apparatus and control method thereof

Abstract

This electronic device comprises: a projection unit; a memory for storing at least one piece of projection information; and at least one processor. The at least one processor is configured to: identify a projection position and a projection angle corresponding to an identified projection surface position on the basis of a user command; acquire correction information included in projection information corresponding to the projection surface position among the at least one piece of stored projection information; and move to the projection position to control the projection unit to output a projection image acquired by keystone correction on the basis of the corrected projection surface position in an area corresponding to the projection surface position corrected through the correction information.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device and a control method thereof that outputs a projection image on a projection surface while taking correction history into consideration.

[0002] Electronic devices that output projection images may experience distortion (or errors) in the image depending on the location of the projection surface, projection position, projection angle, etc.

[0003] If the position of the electronic device is fixed, the position of the projection surface can also be fixed, but if the size of the projection surface changes, the user may experience inconvenience in having to make new settings.

[0004] If the position of the electronic device is not fixed, the projection surface position, projection position, projection angle, etc. may change each time the projection function is performed, which may be inconvenient for the user to have to make new settings every time.

[0005] Even when the settings are set automatically, errors may occur depending on the hardware performance or environment of the electronic device (100). If errors occur, the distortion of the projected image may become severe or the focus may become out of focus.

[0006] The present disclosure is designed to improve the above-described problem, and an object of the present disclosure is to provide an electronic device and a control method thereof for outputting a projection image by correcting settings for a current projection surface by taking into account a correction history stored in relation to the output of the projection image.

[0007] According to one embodiment, an electronic device includes a projection unit, a memory storing at least one projection information, and at least one processor, wherein the at least one processor identifies a projection position and a projection angle corresponding to an identified projection surface position based on a user command, obtains correction information included in projection information corresponding to the projection surface position among the stored at least one projection information, moves to the projection position, and controls the projection unit to output a projection image obtained by keystone correction based on the corrected projection surface position to an area corresponding to the projection surface position corrected (or changed) through the correction information.

[0008] The memory stores first projection information including at least one of a first projection surface position or first correction information, the first correction information including information for correcting the first projection surface position to a third projection surface position, and the at least one processor can identify whether a second projection surface position identified based on the user command corresponds to the first projection surface position.

[0009] The at least one processor can move to correct the second projection surface position to the third projection surface position based on the first correction information included in the first projection information, and output the projection image to the third projection surface position, if the second projection surface position corresponds to the first projection surface position.

[0010] The at least one processor may obtain a first projection direction corresponding to the first projection surface position when the second projection surface position corresponds to the first projection surface position, obtain a second projection direction corresponding to the second projection surface position, and change the second projection surface position to the third projection surface position based on the first correction information when the second projection direction corresponds to the first projection direction.

[0011] The at least one processor may obtain a first projection direction based on a first projection position and a first projection surface position included in the first projection information, obtain a second projection direction based on a second projection position corresponding to the second projection surface position and the second projection surface position, and identify whether the second projection direction corresponds to the first projection direction based on a difference value between the first projection direction and the second projection direction.

[0012] The at least one processor may change the second projection surface position to the third projection surface position based on the first correction information if the difference value between the first projection direction and the second projection direction is less than a threshold value.

[0013] The at least one processor may change the first correction information to second correction information based on the difference value if the difference value between the first projection direction and the second projection direction is not less than a threshold value, and may change the second projection surface position to a fourth projection surface position based on the second correction information.

[0014] The at least one processor can control the projection unit to change at least one of the projection position or the projection angle based on the corrected projection surface position, and to output the projection image obtained by keystone correction based on at least one of the corrected projection surface position, the changed projection position, or the changed projection angle.

[0015] The at least one processor can control the projection unit to move to the projection position, verify at least one of the corrected projection surface position, the projection position, or the projection angle, and output the projection image obtained by keystone correction based on the verification result.

[0016] The at least one processor can control the projection unit to output the projection image while moving to the projection position.

[0017] According to one embodiment, a control method of an electronic device storing at least one piece of projection information includes the steps of identifying a projection position and a projection angle corresponding to a projection surface position identified based on a user command, obtaining correction information included in projection information corresponding to the projection surface position among the stored at least one piece of projection information, and moving to the projection position, outputting a projection image obtained by keystone correction based on the corrected projection surface position in an area corresponding to the projection surface position corrected through the correction information.

[0018] The electronic device stores first projection information including at least one of a first projection surface position or first correction information, the first correction information including information for correcting the first projection surface position to a third projection surface position, and the control method may further include a step of identifying whether a second projection surface position identified based on the user command corresponds to the first projection surface position.

[0019] The step of changing the projection surface position may further include: if the second projection surface position corresponds to the first projection surface position, correcting the second projection surface position to the third projection surface position based on the first correction information included in the first projection information; and the control method may further include a step of moving to output the projection image to the third projection surface position.

[0020] The step of changing the projection surface position may include, if the second projection surface position corresponds to the first projection surface position, obtaining a first projection direction corresponding to the first projection surface position, obtaining a second projection direction corresponding to the second projection surface position, and, if the second projection direction corresponds to the first projection direction, changing the second projection surface position to the third projection surface position based on the first correction information.

[0021] The step of changing the projection surface position may include obtaining a first projection direction based on a first projection position and the first projection surface position included in the first projection information, obtaining a second projection position corresponding to the second projection surface position and a second projection direction based on the second projection surface position, and identifying whether the second projection direction corresponds to the first projection direction based on a difference value between the first projection direction and the second projection direction.

[0022] The step of changing the projection surface position may change the second projection surface position to the third projection surface position based on the first correction information if the difference value between the first projection direction and the second projection direction is less than a threshold value.

[0023] The step of changing the projection surface position may include changing the first correction information to second correction information based on the difference value if the difference value between the first projection direction and the second projection direction is not less than a threshold value, and changing the second projection surface position to a fourth projection surface position based on the second correction information.

[0024] The step of generating the projection image may change at least one of the projection position or the projection angle based on the corrected projection surface position, and output the projection image obtained by keystone correction based on at least one of the corrected projection surface position, the changed projection position, or the changed projection angle.

[0025] The step of generating the projection image may include moving to the projection position, verifying at least one of the corrected projection surface position, the projection position, or the projection angle, and outputting the projection image obtained by keystone correction based on the verification result.

[0026] The above control method may further include a step of outputting the projection image while moving to the projection position.

[0027] FIG. 1 is a block diagram illustrating an electronic device according to one embodiment.

[0028] FIG. 2 is a block diagram illustrating a specific configuration of the electronic device of FIG. 1, according to one embodiment.

[0029] FIG. 3 is a block diagram illustrating at least one module included in an electronic device, according to one embodiment.

[0030] FIG. 4 is a drawing for explaining an operation of outputting a projection image by performing keystone correction according to one embodiment.

[0031] FIG. 5 is a diagram for explaining an operation of storing projection information according to one embodiment.

[0032] FIG. 6 is a drawing for explaining an operation of identifying projection information corresponding to a projection surface according to one embodiment.

[0033] FIG. 7 is a drawing for explaining a specific operation of identifying projection information corresponding to a projection surface according to one embodiment.

[0034] FIG. 8 is a drawing for explaining an operation of comparing projection directions according to one embodiment.

[0035] FIG. 9 is a drawing for explaining a specific operation of comparing projection directions according to one embodiment.

[0036] FIG. 10 is a drawing for explaining a horizontal slope according to one embodiment.

[0037] FIG. 11 is a drawing for explaining a vertical slope according to one embodiment.

[0038] Figure 12 is a drawing for explaining horizontal distortion according to one embodiment.

[0039] FIG. 13 is a drawing for explaining rotation information of an electronic device according to one embodiment.

[0040] FIG. 14 is a drawing for explaining rotation information of a projection surface according to one embodiment.

[0041] FIG. 15 is a drawing for explaining z-axis rotation information of a projection surface according to one embodiment.

[0042] FIG. 16 is a drawing for explaining y-axis rotation information of a projection surface according to one embodiment.

[0043] FIG. 17 is a drawing for explaining an operation of performing a keystone function by taking into account vertical inclination, according to one embodiment.

[0044] FIG. 18 is a drawing for explaining an operation of performing a keystone function while taking into account horizontal inclination, according to one embodiment.

[0045] FIG. 19 is a diagram for explaining an operation of storing projection information according to one embodiment.

[0046] FIG. 20 is a drawing for explaining an operation of performing correction using projection information according to one embodiment.

[0047] FIG. 21 is a drawing for explaining an operation of performing correction using projection information according to one embodiment.

[0048] FIG. 22 is a drawing for explaining an operation of performing correction using projection information according to one embodiment.

[0049] FIG. 23 is a drawing for explaining an operation of performing verification after moving to a projection position according to one embodiment.

[0050] FIG. 24 is a drawing for explaining an operation of performing verification after moving to a projection position according to one embodiment.

[0051] FIG. 25 is a drawing for explaining an operation of determining a projection reference point by considering a user position according to one embodiment.

[0052] FIG. 26 is a drawing for explaining an operation of performing keystone correction by taking into account a projection reference point according to one embodiment.

[0053] FIG. 27 is a drawing for explaining an operation of outputting a projection image while moving an electronic device, according to one embodiment.

[0054] FIG. 28 is a drawing for explaining a control operation of an electronic device according to one embodiment.

[0055] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0056] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0057] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0058] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0059] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0060] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0061] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0062] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0063] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0064] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0065] FIG. 1 is a block diagram illustrating an electronic device (100) according to one embodiment.

[0066] Referring to FIG. 1, the electronic device (100) may include at least one processor (111), at least one projection unit (112), and at least one memory (113).

[0067] At least one processor (111) can perform overall control operations of the electronic device (100). Specifically, at least one processor (111) functions to control the overall operations of the electronic device (100). A specific description related to at least one processor (111) is described in FIG. 2.

[0068] The projection unit (112) is a configuration that projects images (projected images, contents, etc.) to the outside. A detailed description related to the projection unit (112) is described in Fig. 2.

[0069] The memory (113) can store a projection image projected through the projection unit (112). The projection image can refer to a still image as well as a continuous image (or a moving image). The projection image can refer to an image included in the content. The memory (113) can store the operating O / S.

[0070] At least one processor (111) can control operations performed in the electronic device (100).

[0071] The memory (113) can store at least one projection information. The projection information can include various pieces of information used in performing a projection operation. The projection information can include at least one piece of information related to a projection surface or information necessary for performing a projection function.

[0072] For example, at least one processor (111) can store one projection information.

[0073] For example, at least one processor (111) can store two or more projection information. At least one processor (111) can store multiple projection information. Each of the multiple projection information can be distinguished by a projection surface. At least one processor (111) can store separate projection information in the memory (113) if the projection surfaces are different. For example, the multiple projection information stored in the memory (113) can include first projection information for a first projection surface and second projection information for a second projection surface.

[0074] Projection information stored in the memory (113) is described as first projection information, and the first projection information may include at least one of a first projection surface position, a first projection position, a first projection angle, and first correction information. The first projection surface position, the first projection position, the first projection angle, and the first correction information may be information that was used (or recorded) at a past point in time.

[0075] At least one projection information may be included in the history information. The history information may be stored in memory (113). The history information may include information indicating projection history. The projection information may include data from a past point in time related to a projection operation recorded through the electronic device (100). The projection information may include various information related to the projection.

[0076] Projection information may include at least one of projection surface position, projection position, projection angle, and correction information used by the electronic device (100) to perform the projection function. Projection information may include various information related to the projection function acquired at a past point in time.

[0077] The projection plane location included in the projection information may include coordinates indicating the location of the projection plane on which the projection image is output. The projection plane location may be described as projection plane position information, projection plane coordinates, projection plane coordinate information, etc.

[0078] For example, the projection surface location can be determined by the user's choice.

[0079] For example, the projection surface location may be a preset area.

[0080] For example, the projection surface location may be an area identified by the electronic device (100). At least one processor (111) may identify a projection surface suitable for outputting a projection image.

[0081] The projection location included in the projection information can indicate the location where the projection image is output. The projection location can be described as projection position information, projection coordinates, projection coordinate information, etc.

[0082] The projection plane position and projection position can be defined with preset coordinate axes.

[0083] For example, the projection plane position and the projection position may include two-dimensional coordinates. The two-dimensional coordinates may include an x-coordinate and a y-coordinate.

[0084] For example, the projection surface position and the projection position may include three-dimensional coordinates. The three-dimensional coordinates may include an x-coordinate, a y-coordinate, and a z-coordinate. A description thereof is provided in FIG. 13.

[0085] The x-coordinate may be written as the first axis coordinate. The y-coordinate may be written as the second axis coordinate. The z-coordinate may be written as the third axis coordinate.

[0086] The projection angle included in the projection information may indicate the output direction of the projection image at the time of outputting the projection image. The projection angle may include the projection rotation direction used when outputting the projection image.

[0087] The projection angle can be defined with respect to a preset coordinate axis.

[0088] For example, the projection angle can be defined as a roll angle, a pitch angle, and a yaw angle. A description thereof is provided in Fig. 13.

[0089] The roll angle may be described as a rotation angle about the first axis. The pitch angle may be described as a rotation angle about the second axis. The yaw angle may be described as a rotation angle about the third axis.

[0090] The correction information included in the projection information may include information indicating a history of changes to at least one of the initially determined projection surface position, projection position, and projection angle. The correction information may include correction settings that were input by the user (or automatically applied) at a past point in time.

[0091] For example, if the position of the projection surface changes from the initial setting, the correction information may include the changed value. The correction information may include various information related to the user's correction related to the projection function. The correction information may include projection setting information, projection setting value change information, projection function change information, projection surface position movement information, and projection angle change information.

[0092] The correction information may be recorded as a correction history. The correction information may include at least one of a correction position and a correction angle. The correction position may include at least one of a position correction value and an angle correction value. The position correction value may include at least one of a position correction value corresponding to a projection surface or a position correction value corresponding to a projection position.

[0093] For example, the correction position may include a correction position corresponding to the projection surface.

[0094] For example, the correction position may include a correction position corresponding to the projection position.

[0095] The correction angle can represent a correction for the projection direction.

[0096] When a correction function (or correction operation) is performed when outputting a projection image on a projection surface corresponding to the projection information, the correction information may be included in the projection information.

[0097] In one embodiment, when the projection surface position is corrected, the projection position and projection angle may be changed corresponding to the corrected (or changed) projection surface position.

[0098] In one embodiment, each of the projection surface position, projection position, and projection angle can be corrected (or changed).

[0099] At least one processor (111) can control the projection unit (112) to determine a projection surface position based on a user command, determine a projection position and a projection angle corresponding to the projection surface position, identify projection information corresponding to the projection surface position among at least one stored projection information, obtain correction information included in the identified projection information, change the projection surface position based on the correction information, perform keystone correction based on the corrected (or changed) projection surface position to generate a projection image, and then move to the projection position, and output the generated projection image to an area corresponding to the corrected projection surface position.

[0100] At least one processor (111) can obtain a user command. At least one processor (111) can obtain a user command including a command for outputting a projection image. The user command can be described as a user input.

[0101] For example, at least one processor (111) can obtain a user command through an operating interface (115) included in the electronic device (100).

[0102] For example, at least one processor (111) can obtain a user command through a microphone (118) included in the electronic device (100).

[0103] For example, at least one processor (111) can obtain a user command from an external device (e.g., a remote control) connected to the electronic device (100).

[0104] At least one processor (111) can determine a projection surface location based on a user command. At least one processor (111) can identify the determined projection surface location. The location of the projection surface can be described as a projection surface location.

[0105] Once the projection surface position is determined, at least one processor (111) can determine a projection position and a projection angle corresponding to the projection surface position. At least one processor (111) can output a projection image from the projection position to the projection surface position. At least one processor (111) can identify (or obtain) the projection angle to determine at what angle the projection image will be output from the projection position.

[0106] At least one processor (111) can identify projection information corresponding to a projection surface position among at least one projection information stored in the memory (113).

[0107] For convenience of distinction, the information included in the projection information is described as including the first projection surface position, projection surface position, first projection position, first projection angle, and first correction information.

[0108] The projection plane position, projection position, and projection angle determined after the user command is received are described as the second projection plane position, second projection position, and second projection angle.

[0109] At least one processor (111) can obtain a first projection surface position based on first projection information stored in memory (113). At least one processor (111) can identify whether a second projection surface position corresponds to the first projection surface position.

[0110] The corresponding actions of the projection surface positions are described in Figs. 6 and 7.

[0111] The memory (113) can store first projection information including at least one of a first projection surface position or first correction information. The first correction information can be information used to change the first projection surface position. At least one processor (111) can determine a second projection surface position based on a user command and identify whether the second projection surface position corresponds to the first projection surface position.

[0112] At least one processor (111) can obtain a distance (or difference) between a first projection surface position and a second projection surface position. If the distance is less than a threshold value, at least one processor (111) can identify that the first projection surface position and the second projection surface position correspond.

[0113] At least one processor (111) can obtain first correction information included in the first projection information, change the second projection surface position to a third projection surface position based on the first correction information, and move to the third projection surface position, if the second projection surface position corresponds to the first projection surface position.

[0114] At least one processor (111) can identify projection information including a projection surface position corresponding to a second projection surface position from at least one projection information stored in the memory (113). If the second projection surface position corresponds to a first projection surface position among the at least one projection surface position stored in the memory (113), at least one processor (111) can identify first projection information corresponding to the first projection surface position.

[0115] At least one processor (111) can identify whether the first projection information includes correction information. At least one processor (111) can identify the first correction information included in the first projection information.

[0116] At least one processor (111) can change (or correct) the second projection surface position to a third projection surface position based on the first correction information. If the first correction information is included in the first projection information, it can be determined that correction has been performed for the first projection surface indicating the first projection surface position. At least one processor (111) can perform the same correction operation at the second projection surface position based on the first correction information.

[0117] At least one processor (111) can move to output a projection image to a changed third projection surface position. At least one processor (111) can newly acquire a projection position based on the third projection surface position. At least one processor (111) can change the second projection position to a third projection position to output a projection image at the third projection surface position. At least one processor (111) can move to the third projection position.

[0118] At least one processor (111) can obtain a new projection angle based on the third projection surface position and the third projection position. At least one processor (111) can obtain a third projection angle based on the third projection surface position and the third projection position.

[0119] At least one processor (111) can control the projection unit (112) to output a projection image to a third projection surface position using a third projection angle at a third projection position.

[0120] If the second projection surface position determined (or acquired) according to the user command is identified as being the same as (or corresponding to) the first projection surface position stored in the memory (113), at least one processor (111) can change the second projection surface position to a third projection surface position using the first correction information corresponding to the first projection surface position.

[0121] According to one embodiment, at least one processor (111) may determine whether to change the first correction information by taking into account the projection direction.

[0122] If the second projection surface position is identified as being the same as the first projection surface position stored in the memory (113), at least one processor (111) can compare a first projection direction for outputting a projection image at the first projection surface position (or the first projection surface) and a second projection direction for outputting a projection image at the second projection surface position (or the second projection surface). At least one processor (111) can determine whether to change the first correction information based on the comparison result of the first projection direction and the second projection direction.

[0123] At least one processor (111) can obtain a first projection direction based on a first projection position and a first projection surface position included in the first projection information, obtain a second projection direction based on a second projection position corresponding to a second projection surface position and a second projection surface position, and identify whether the second projection direction corresponds to the first projection direction based on a difference value between the first projection direction and the second projection direction.

[0124] At least one processor (111) can change the second projection surface position to the third projection surface position based on the first correction information if the difference value between the first projection direction and the second projection direction is less than a threshold value.

[0125] At least one processor (111) can change the first correction information to the second correction information based on the difference value if the difference value between the first projection direction and the second projection direction is not less than a threshold value, and can change the second projection surface position to the fourth projection surface position based on the second correction information.

[0126] At least one processor (111) can obtain a first projection direction corresponding to the first projection surface position when the second projection surface position corresponds to the first projection surface position, obtain a second projection direction corresponding to the second projection surface position, and change the second projection surface position to a third projection surface position based on the first correction information when the second projection direction corresponds to the first projection direction.

[0127] At least one processor (111) can obtain a first projection direction including a direction vector from a first projection position to a first projection surface position. At least one processor (111) can obtain a second projection direction including a direction vector from a second projection position to a second projection surface position.

[0128] At least one processor (111) can identify whether the second projection direction corresponds to the first projection direction. At least one processor (111) can obtain a difference value between the second projection direction and the first projection direction. If the difference value is less than a threshold value, at least one processor (111) can identify that the second projection direction corresponds to the first projection direction.

[0129] If the difference value is less than the threshold value, at least one processor (111) may not change the first correction information. At least one processor (111) may change the second projection surface location to the third projection surface location using the first correction information.

[0130] If the difference value is greater than or equal to the threshold value, at least one processor (111) can change the first correction information to second correction information based on the difference value. At least one processor (111) can change the second projection surface position to a fourth projection surface position based on the second correction information. For example, if the projection direction differs by 180 degrees, some of the coordinate values ​​can be multiplied by a negative number. Specific descriptions related to this are described in FIGS. 8, 9, 20, 21, and 22.

[0131] The first projection direction and the second projection direction can be described as first projection direction information and second projection direction information.

[0132] The first projection direction and the second projection direction can be described as a first projection vector and a second projection vector.

[0133] At least one processor (111) can change at least one of a projection position or a projection angle based on a corrected projection surface position, and perform keystone correction based on at least one of the corrected projection surface position, the changed projection position, or the changed projection angle to generate a projection image.

[0134] For example, at least one processor (111) can change the second projection position to the third projection position based on the changed projection surface position (the third projection surface position or the fourth projection surface position).

[0135] For example, at least one processor (111) can change the second projection angle to a third projection angle based on the changed projection surface position (the third projection surface position or the fourth projection surface position).

[0136] For example, at least one processor (111) can change the second projection angle to the third projection angle based on the changed projection surface position (the third projection surface position or the fourth projection surface position) and the changed projection position (the third projection position).

[0137] At least one processor (111) can perform keystone correction based on at least one of a changed projection surface position (third projection surface position or fourth projection surface position), a changed projection position (third projection position), and a changed projection angle (third projection angle).

[0138] At least one processor (111) can move to a projection position, then verify at least one of the changed projection surface position, projection position, or projection angle, and perform keystone correction based on the verification result to generate a projection image.

[0139] At least one processor (111) may verify at least one of the projection surface position, the projection position, or the projection angle. The verification operation may actually include an operation of moving to an area within a threshold distance from the projection surface position and then determining whether the calculation result is appropriate.

[0140] For example, at least one processor (111) can verify the changed third projection surface position (or fourth projection surface position). At least one processor (111) can verify whether the changed projection surface position is substantially suitable for the user. If it is determined that an obstacle exists in the changed projection surface position or that a projection image cannot be output, at least one processor (111) can identify a new projection surface position (fifth projection surface position).

[0141] For example, at least one processor (111) can verify the changed third projection position. At least one processor (111) can identify whether a projection image can be output from the third projection position to the changed projection surface position. If an obstacle object exists, the projection image may not be output normally from the third projection position. If an obstacle object is identified at the third projection position, at least one processor (111) can change the third projection position to a fourth projection position.

[0142] For example, at least one processor (111) can verify the changed third projection angle. At least one processor (111) can determine whether a projection image can be output at a third projection surface position at a third projection angle at a third projection position. If it is determined that the projection image is not output normally, at least one processor (111) can change the third projection angle to a fourth projection angle.

[0143] At least one processor (111) can control the projection unit (112) to output a projection image while moving to a projection position.

[0144] At least one processor (111) can output a projection image during the movement process to provide the user with the projection image as quickly as possible. At least one processor (111) can generate a control command for moving from the current location to the projection location. At least one processor (111) can identify a movement path from the current location to the projection location.

[0145] At least one processor (111) can perform keystone correction based on each position included in the movement path. At least one processor (111) can continuously output a projection image to a projection surface position by performing keystone correction suitable for each position. A description related to this is described in FIG. 27.

[0146] In one embodiment, the process of calculating the projection position and projection angle determined according to a user command may be performed after changing the projection surface position.

[0147] According to one embodiment, the process of calculating a projection position and a projection angle according to a user command may be performed using map data. The map data may represent a map related to a space in which the electronic device (100) is placed. At least one processor (111) may identify at least one of a projection surface position, a projection position, and a projection angle based on the map data. The map data may be defined as two-dimensional coordinates or three-dimensional coordinates.

[0148] The electronic device (100) can utilize previous history information when outputting a projection image to a projection surface. At least one processor (111) can identify the correction history included in the history information. If the same correction history is applied to the same projection surface, unnecessary user operations can be reduced.

[0149] The electronic device (100) is described as being a mobile device. According to various embodiments, the electronic device (100) may be a stationary device.

[0150] FIG. 2 is a block diagram for explaining a specific configuration of the electronic device (100) of FIG. 1, according to one embodiment.

[0151] Referring to FIG. 2, the electronic device (100) may include at least one of a processor (111), a projection unit (112), a memory (113), a communication interface (114), an operation interface (115), an input / output interface (116), a speaker (117), a microphone (118), a power supply unit (119), a driving unit (120), a sensor unit (121), or a moving member (122).

[0152] The configuration illustrated in FIG. 2 is merely an example of various embodiments, and some configurations may be omitted and new configurations may be added.

[0153] The content already explained in Fig. 1 is omitted.

[0154] At least one processor (111) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes a digital signal. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machines (ARM) processor, or may be defined by the relevant terminology. At least one processor (111) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). At least one processor (111) may perform various functions by executing computer executable instructions stored in a memory (113).

[0155] The projection unit (112) is a component that projects an image to the outside. According to various embodiments of the present disclosure, the projection unit (112) can be implemented in various projection methods (e.g., CRT (cathode-ray tube) method, LCD (Liquid Crystal Display) method, DLP (Digital Light Processing) method, laser method, etc.). For example, the CRT method has the same principle as a CRT monitor. The CRT method magnifies the image with a lens in front of the cathode-ray tube (CRT) and displays the image on the screen. Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of a three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0156] Another example is the LCD method, which displays images by passing light from a light source through liquid crystals. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into red, green, and blue by a dichroic mirror (a mirror that reflects only a specific color of light and transmits all others). After passing through the liquid crystals, the light can be refocused into a single point.

[0157] Another example is the DLP method, which displays images using a DMD (Digital Micromirror Device) chip. The DLP projection unit may include a light source, a color wheel, a DMD chip, a projection lens, etc. The light output from the light source can be colored as it passes through the rotating color wheel. The light passing through the color wheel is input to the DMD chip. The DMD chip contains numerous micromirrors and reflects the light input to the DMD chip. The projection lens can play a role in magnifying the light reflected from the DMD chip to the image size.

[0158] Another example is a laser system that uses a Diode Pumped Solid State (DPSS) laser and a galvanometer. A multi-color laser uses three DPSS lasers, one for each RGB color, with their optical axes overlapped by a special mirror. The galvanometer includes a mirror and a high-power motor that moves the mirror at high speeds. For example, the galvanometer can rotate the mirror at up to 40 kHz / sec. The galvanometer is mounted according to the scan direction, but since projectors typically scan in a planar manner, the galvanometer can also be positioned separately along the x and y axes.

[0159] The projection unit (112) may include various types of light sources. For example, the projection unit (112) may include at least one light source among a lamp, an LED, and a laser.

[0160] The projection unit (112) can output images in a 4:3 screen ratio, a 5:4 screen ratio, or a 16:9 wide screen ratio depending on the purpose of the electronic device (100) or the user's settings, and can output images in various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the screen ratio.

[0161] The projection unit (112) can perform various functions for adjusting the output image under the control of at least one processor (111). For example, the projection unit (112) can perform functions such as zoom, keystone, quick corner (4 corner) keystone, and lens shift.

[0162] Specifically, the projection unit (112) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, the zoom function can be performed depending on the distance from the screen. At this time, the zoom function may include a hardware method of adjusting the screen size by moving the lens and a software method of adjusting the screen size by cropping the image, etc. When the zoom function is performed, the focus of the image needs to be adjusted. For example, the method of adjusting the focus includes a manual focus method, an electric focus method, etc. The manual focus method refers to a method of focusing manually, and the electric focus method refers to a method of automatically focusing using a motor built into the projector when the zoom function is performed. When performing the zoom function, the projection unit (112) may provide a digital zoom function through software, and may provide an optical zoom function of performing the zoom function by moving the lens through the driving unit (120).

[0163] The projection unit (112) can perform a keystone correction function. If the height is not right for front projection, the screen may be distorted upwards or downwards. The keystone correction function refers to a function that corrects a distorted screen. For example, if distortion occurs in the left and right directions of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up and down directions, it can be corrected using vertical keystone. The quick corner (4 corner) keystone correction function is a function that corrects the screen when the center area of ​​the screen is normal but the corner areas are not balanced. The lens shift function is a function that moves the screen as it is when the screen is off the screen.

[0164] The projection unit (112) can automatically analyze the surrounding environment and projection environment without user input to provide zoom / keystone / focus functions. Specifically, the projection unit (112) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected by a sensor (depth camera, distance sensor, infrared sensor, light sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0165] The projection unit (112) can provide a lighting function using a light source. In particular, the projection unit (112) can provide a lighting function by outputting a light source using an LED. According to various embodiments, the projection unit (112) can include one LED, and according to other embodiments, the electronic device (100) can include a plurality of LEDs. The projection unit (112) can output a light source using a surface-emitting LED according to an implementation example. The surface-emitting LED can refer to an LED having a structure in which an optical sheet is arranged on the upper side of the LED so that the light source is evenly distributed and output. Specifically, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0166] The projection unit (112) can provide the user with a dimming function for adjusting the intensity of the light source. Specifically, when a user input for adjusting the intensity of the light source is received from the user through the operation interface (115) (e.g., a touch display button or dial), the projection unit (112) can control the LED to output the intensity of the light source corresponding to the received user input.

[0167] The projection unit (112) can provide a dimming function based on content analyzed by at least one processor (111) without user input. Specifically, the projection unit (112) can control the LED to output the intensity of a light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0168] The projection unit (112) can control the color temperature under the control of at least one processor (111). The at least one processor (111) can control the color temperature based on the content. Specifically, when the content is identified to be output, the at least one processor (111) can obtain frame-by-frame color information of the content whose output has been determined. Then, the at least one processor (111) can control the color temperature based on the obtained frame-by-frame color information. The at least one processor (111) can obtain at least one primary color of the frame based on the frame-by-frame color information. Then, the at least one processor (111) can adjust the color temperature based on the obtained at least one primary color. For example, the color temperature that the at least one processor (111) can adjust can be classified into a warm type or a cold type. It is assumed that a frame to be output (hereinafter, referred to as an output frame) includes a scene in which a fire has occurred. At least one processor (111) can identify (or obtain) that the primary color is red based on color information included in the current output frame. In addition, at least one processor (111) can identify a color temperature corresponding to the identified primary color (red). The color temperature corresponding to red may be a warm type. At least one processor (111) can use an artificial intelligence model to obtain the color information or primary color of the frame. According to various embodiments, the artificial intelligence model can be stored in the electronic device (100) (e.g., the memory (113)). According to another embodiment, the artificial intelligence model can be stored in an external server that can communicate with the electronic device (100).

[0169] The memory (113) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in at least one processor (111), or may be implemented as a separate memory from at least one processor (111). In this case, the memory (113) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0170] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that can be attached or detached to the electronic device (100), it may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc.

[0171] The memory (113) may store at least one command regarding the electronic device (100). In addition, the memory (113) may store an O / S (Operating System) for driving the electronic device (100). The memory (113) may also store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. In addition, the memory (113) may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

[0172] Specifically, various software modules for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (113), and at least one processor (111) may control the operation of the electronic device (100) by executing various software modules stored in the memory (113). That is, the memory (113) is accessed by at least one processor (111), and data reading / recording / modifying / deleting / updating, etc. may be performed by at least one processor (111).

[0173] In the present disclosure, the term memory (113) may be used to mean a storage unit, a ROM, a RAM within at least one processor (111), or a memory card (e.g., a micro SD card, a memory stick) mounted on an electronic device (100).

[0174] The communication interface (114) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication interface (114) may include a wireless communication module or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.

[0175] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0176] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, various connection information, such as the service set identifier (SSID) and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received.

[0177] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which is between visible light and millimeter waves.

[0178] In addition to the above-described communication method, other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0179] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a paired cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0180] The manipulation interface (115) may include various types of input devices. For example, the manipulation interface (115) may include a physical button. In this case, the physical button may include a function key, a directional key (e.g., a four-way key), or a dial button. According to various embodiments, the physical button may be implemented as multiple keys. According to another embodiment, the physical button may be implemented as one key. When the physical button is implemented as one key, the electronic device (100) may receive a user input in which one key is pressed for a threshold time or longer. When a user input in which one key is pressed for a threshold time or longer is received, at least one processor (111) may perform a function corresponding to the user input. For example, at least one processor (111) may provide a lighting function based on the user input.

[0181] The manipulation interface (115) can receive user input using a non-contact method. When receiving user input using a contact method, physical force must be transmitted to the electronic device (100). Therefore, a method for controlling the electronic device (100) regardless of physical force may be required. Specifically, the manipulation interface (115) can receive user gestures and perform operations corresponding to the received user gestures. The manipulation interface (115) can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0182] The manipulation interface (115) can receive user input using a touch method. For example, the manipulation interface (115) can receive user input via a touch sensor. According to various embodiments, the touch method can be implemented in a non-contact manner. For example, the touch sensor can determine whether the user's body has approached within a threshold distance. The touch sensor can identify user input even when the user does not touch the touch sensor. According to another implementation example, the touch sensor can identify user input when the user touches the touch sensor.

[0183] The electronic device (100) can receive user input in various ways other than the above-described operation interface (115). In various embodiments, the electronic device (100) can receive user input through an external remote control device. The external remote control device can be a remote control device corresponding to the electronic device (100) (e.g., a dedicated control device of the electronic device (100)) or a user's portable communication device (e.g., a smartphone or wearable device). The user's portable communication device can store an application for controlling the electronic device (100). The portable communication device can obtain user input through the stored application and transmit the obtained user input to the electronic device (100). The electronic device (100) can receive user input from the portable communication device and perform an operation corresponding to the user's control command.

[0184] The electronic device (100) can receive user input using voice recognition. According to various embodiments, the electronic device (100) can receive the user's voice through a microphone included in the electronic device (100). According to other embodiments, the electronic device (100) can receive the user's voice from a microphone or an external device. Specifically, the external device can acquire the user's voice through the microphone of the external device and transmit the acquired user's voice to the electronic device (100). The user's voice transmitted from the external device can be audio data or digital data converted from audio data (e.g., audio data converted into a frequency domain, etc.). The electronic device (100) can perform an operation corresponding to the received user's voice. Specifically, the electronic device (100) can receive audio data corresponding to the user's voice through the microphone. In addition, the electronic device (100) can convert the received audio data into digital data. In addition, the electronic device (100) can convert the converted digital data into text data using the STT (Speech To Text) function. According to various embodiments, the STT (Speech To Text) function can be performed directly in the electronic device (100).

[0185] According to another embodiment, the STT (Speech To Text) function may be performed by an external server. The electronic device (100) may transmit digital data to the external server. The external server may convert the digital data into text data and obtain control command data based on the converted text data. The external server may transmit the control command data (which may also include text data) to the electronic device (100). The electronic device (100) may perform an operation corresponding to the user's voice based on the obtained control command data.

[0186] The electronic device (100) may provide a voice recognition function using a single assistant (or artificial intelligence assistant, e.g., Bixby™), but this is merely an example and the electronic device (100) may provide the voice recognition function using multiple assistants. In this case, the electronic device (100) may provide the voice recognition function by selecting one of the multiple assistants based on a trigger word corresponding to the assistant or a specific key present on the remote control.

[0187] The electronic device (100) can receive user input using screen interaction. Screen interaction may refer to a function of identifying whether a predetermined event occurs through an image projected by the electronic device (100) on the screen (or projection surface) and acquiring user input based on the predetermined event. The predetermined event may refer to an event in which a predetermined object is identified at a specific location (e.g., a location where a UI for receiving user input is projected). The predetermined object may include at least one of a part of the user's body (e.g., a finger), a pointer, or a laser point. If the predetermined object is identified at a location corresponding to the projected UI, the electronic device (100) can identify that a user input for selecting the projected UI has been received. For example, the electronic device (100) may project a guide image to display the UI on the screen. In addition, the electronic device (100) can identify whether the user selects the projected UI. Specifically, the electronic device (100) can identify that the user has selected the projected UI when a predetermined event is identified at a location of the projected UI. The projected UI can include at least one item. The electronic device (100) can perform spatial analysis to identify whether the predetermined event is at the location of the projected UI. The electronic device (100) can perform spatial analysis through a sensor (e.g., an image sensor, an infrared sensor, a depth camera, a distance sensor, etc.). By performing the spatial analysis, the electronic device (100) can identify whether the predetermined event occurs at a specific location (a location where the UI is projected). In addition, when the predetermined event is identified as occurring at a specific location (a location where the UI is projected), the electronic device (100) can identify that a user input for selecting a UI corresponding to the specific location has been received.

[0188] The input / output interface (116) is configured to input / output at least one of an audio signal and an image signal. The input / output interface (116) can receive at least one of an audio signal and an image signal from an external device, and can output a control command to the external device.

[0189] Depending on the implementation example, the input / output interface (116) may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0190] In various embodiments of the present disclosure, the input / output interface (116) may be implemented as at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (Dsubminiature), and DVI (Digital Visual Interface). According to various embodiments, the wired input / output interface may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs both audio signals and image signals.

[0191] The electronic device (100) can receive data via a wired input / output interface, but this is merely an example of various embodiments, and can also receive power via the wired input / output interface. For example, the electronic device (100) can receive power from an external battery via a USB C-type or from an outlet via a power adapter. As another example, the electronic device (100) can receive power from an external device (e.g., a laptop or monitor) via a DP.

[0192] The audio signal may be implemented to be input through a wired input / output interface, and the image signal may be implemented to be input through a wireless input / output interface (or communication interface). Alternatively, the audio signal may be implemented to be input through a wireless input / output interface (or communication interface), and the image signal may be implemented to be input through a wired input / output interface.

[0193] The speaker (117) is a component that outputs an audio signal. In particular, the speaker (117) may include an audio output mixer, an audio signal processor, and an audio output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to various embodiments, the audio output module may include a plurality of speakers, and in this case, the audio output module may be arranged inside the main body, and sound emitted by covering at least a portion of the diaphragm of the audio output module may pass through a waveguide and be transmitted to the outside of the main body. The audio output module may include a plurality of audio output units, and the plurality of audio output units may be arranged symmetrically on the exterior of the main body, thereby radiating sound in all directions, that is, in a 360-degree omnidirectional manner.

[0194] The microphone (118) is a component for receiving a user's voice or other sounds and converting them into audio data. The microphone (118) can receive the user's voice in an activated state. For example, the microphone (118) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (118) can include various components such as a microphone for collecting the user's voice in analog form, an amplifier circuit for amplifying the collected user's voice, an A / D conversion circuit for sampling the amplified user's voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0195] The power supply unit (119) can receive power from an external source and supply power to various components of the electronic device (100). The power supply unit (119) according to various embodiments of the present disclosure can receive power through various methods. In various embodiments, the power supply unit (119) can receive power using a connector (130) as illustrated in FIG. 1. The power supply unit (119) can receive power using a 220 V DC power cord. However, the present invention is not limited thereto, and the electronic device (100) can receive power using a USB power cord or a wireless charging method.

[0196] The power supply unit (119) can be supplied with power using an internal battery or an external battery. The power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through the internal battery. For example, the power supply unit (119) can charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and can be supplied with power through the charged internal battery. The power supply unit (119) according to various embodiments of the present disclosure can be supplied with power through an external battery. For example, when the electronic device (100) is connected to the external battery through various wired communication methods such as a USB power cord, a USB C-Type power cord, and a socket home, the power supply unit (119) can be supplied with power through the external battery. That is, the power supply unit (119) can be supplied with power directly from the external battery, or can charge the internal battery through the external battery and be supplied with power from the charged internal battery.

[0197] The power supply unit (119) according to the present disclosure can receive power using at least one of the multiple power supply methods described above.

[0198] With respect to power consumption, the electronic device (100) may have a power consumption value (e.g., 43 W) or lower due to socket type and other standards. In this case, the electronic device (100) may vary its power consumption to reduce power consumption when using a battery. That is, the electronic device (100) may vary its power consumption based on the power supply method, power usage, etc.

[0199] The driving unit (120) can drive at least one hardware component included in the electronic device (100). The driving unit (120) can generate a physical force and transmit it to at least one hardware component included in the electronic device (100).

[0200] The driving unit (120) can generate driving power for movement of a hardware component included in the electronic device (100) (e.g., movement of the electronic device (100)) or rotation of the component (e.g., rotation of a projection lens).

[0201] The driving unit (120) can adjust the projection angle of the projection unit (112). The driving unit (120) can move the position of the electronic device (100). The driving unit (120) can control a moving member to move the electronic device (100). For example, the driving unit (120) can control the moving member using a motor.

[0202] The sensor unit (121) may include at least one sensor. Specifically, the sensor unit (121) may include at least one of a tilt sensor for sensing the tilt of the electronic device (100) and an image sensor for capturing an image. The tilt sensor may be an acceleration sensor or a gyro sensor, and the image sensor may mean a camera or a depth camera. The tilt sensor may be described as a motion sensor. The sensor unit (121) may include various sensors in addition to the tilt sensor or the image sensor. For example, the sensor unit (121) may include an illuminance sensor and a distance sensor. The distance sensor may be a ToF (Time of Flight). The sensor unit (121) may include a lidar sensor.

[0203] The electronic device (100) can control a lighting function by linking with an external device. Specifically, the electronic device (100) can receive lighting information from the external device. The lighting information can include at least one of brightness information or color temperature information set in the external device. The external device can refer to a device connected to the same network as the electronic device (100) (e.g., an IoT device included in the same home / work network) or a device that is not in the same network as the electronic device (100) but can communicate with the electronic device (100) (e.g., a remote control server). For example, assume that an external lighting device (IoT device) included in the same network as the electronic device (100) is outputting red light at a brightness of 50. The external lighting device (IoT device) can directly or indirectly transmit lighting information (e.g., information indicating that it is outputting red light at a brightness of 50) to the electronic device (100). The electronic device (100) can control the output of a light source based on the lighting information received from the external lighting device. For example, if the lighting information received from the external lighting device includes information to output red light at a brightness of 50, the electronic device (100) can output red light at a brightness of 50.

[0204] The electronic device (100) can control a lighting function based on biometric information. Specifically, at least one processor (111) can obtain the user's biometric information. The biometric information can include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. The biometric information can include various types of information in addition to the information described above. For example, the electronic device (100) can include a sensor for measuring biometric information. The at least one processor (111) can obtain the user's biometric information through the sensor and control the output of a light source based on the obtained biometric information. As another example, the at least one processor (111) can receive the biometric information from an external device through an input / output interface (116). The external device can refer to the user's portable communication device (e.g., a smartphone or a wearable device). The at least one processor (111) can obtain the user's biometric information from the external device and control the output of the light source based on the obtained biometric information. According to an implementation example, the electronic device (100) can identify whether the user is sleeping, and if the user is identified as sleeping (or preparing to sleep), at least one processor (111) can control the output of the light source based on the user's biometric information.

[0205] An electronic device (100) according to various embodiments of the present disclosure can provide various smart functions.

[0206] Specifically, the electronic device (100) is connected to a portable terminal device for controlling the electronic device (100), and a screen output from the electronic device (100) can be controlled through user input input from the portable terminal device. As an example, the portable terminal device can be implemented as a smartphone including a touch display, and the electronic device (100) receives screen data provided by the portable terminal device from the portable terminal device and outputs it, and a screen output from the electronic device (100) can be controlled according to user input input from the portable terminal device.

[0207] The electronic device (100) can share content or music provided by the mobile terminal device by connecting to the mobile terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC.

[0208] In addition, the mobile terminal device and the electronic device (100) can be connected in various connection methods. In various embodiments, the mobile terminal device can search for the electronic device (100) to perform a wireless connection, or the electronic device (100) can search for the mobile terminal device to perform a wireless connection. In addition, the electronic device (100) can output content provided by the mobile terminal device.

[0209] In various embodiments, when a mobile terminal device is placed near an electronic device (100) while specific content or music is being output from the mobile terminal device, and a preset gesture is detected through the display of the mobile terminal device (e.g., motion tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0210] In various embodiments, when the mobile terminal device is outputting specific content or music and the mobile terminal device comes closer to the electronic device (100) to a preset distance or less (e.g., non-contact tap view) or the mobile terminal device comes into contact with the electronic device (100) twice at a short interval (e.g., contact tap view), the electronic device (100) can output the content or music being output by the mobile terminal device.

[0211] In the above-described embodiment, it has been described that the same screen as the screen provided by the mobile terminal device is provided by the electronic device (100), but the present disclosure is not limited thereto. That is, when a connection is established between the mobile terminal device and the electronic device (100), the mobile terminal device may output a first screen provided by the mobile terminal device, and the electronic device (100) may output a second screen provided by the mobile terminal device that is different from the first screen. For example, the first screen may be a screen provided by a first application installed on the mobile terminal device, and the second screen may be a screen provided by a second application installed on the mobile terminal device. For example, the first screen and the second screen may be different screens provided by a single application installed on the mobile terminal device. For example, the first screen may be a screen including a remote control-type UI for controlling the second screen.

[0212] An electronic device (100) according to the present disclosure can output a standby screen. For example, if the electronic device (100) is not connected to an external device or if no input is received from the external device for a preset period of time, the electronic device (100) can output a standby screen. Conditions for the electronic device (100) to output a standby screen are not limited to the examples described above, and the standby screen can be output under various conditions.

[0213] The electronic device (100) may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device (100) may extract only the shape of a specific object from data received from an external device, acquire an amorphous object, and output a standby screen including the acquired amorphous object.

[0214] The electronic device (100) may further include a display.

[0215] The display may be implemented in various forms, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. The display may also include a driving circuit, a backlight unit, etc., which may be implemented in forms, such as an amorphous silicon thin film transistor (a-si TFT), a low temperature poly silicon (LTPS) TFT, and an organic TFT (OTFT). The display may be implemented in a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display), etc. According to various embodiments of the present disclosure, the display may include a display panel that outputs an image, as well as a bezel that houses the display panel. In particular, according to various embodiments of the present disclosure, the bezel may include a touch sensor for detecting user interaction.

[0216] The electronic device (100) may further include a shutter unit.

[0217] The shutter portion may include at least one of a shutter, a fixing member, a rail, or a body.

[0218] The shutter can block light output from the projection unit (112). The fixing member can fix the position of the shutter. The rail can be a path for moving the shutter and the fixing member. The body can be configured to include the shutter and the fixing member.

[0219] The movable member (122) may refer to a member for moving from a first position to a second position in a space where the electronic device (100) is placed. The electronic device (100) may control the movable member (122) to move the electronic device (100) using a force generated by the driving unit (120). The electronic device (100) may generate a force to be transmitted to the movable member (122) using a motor included in the driving unit (120).

[0220] The movable member (122) may include at least one wheel (e.g., a circular wheel). The electronic device (100) may move to a target location (or target position) through the movable member. When a user input or a control command is received, the electronic device (100) may rotate the movable member by transmitting a force generated through a motor to the movable member. The electronic device (100) may control the movable member to adjust the rotation speed, rotation direction, etc. The electronic device (100) may perform a movement operation (or movement function) by controlling the movable member based on the target location or the direction of movement, etc.

[0221] FIG. 3 is a block diagram illustrating at least one module included in an electronic device (100), according to one embodiment.

[0222] The electronic device (100) may include at least one of a driving unit (120), a motor (120-1), a sensor unit (121), at least one processor (111), a keystone setting module (111-1), a keystone calculation module (111-2), a user gaze estimation module (111-3), a projection unit (112), and a map data storage module (113-1). The electronic device (100) may be controlled overall using at least one processor (111).

[0223] At least one processor (111) can control the motor (120-1) using the driving unit (120). At least one processor (111) can control the motor (120-1) to rotate or stop through the driving unit (120).

[0224] For example, at least one processor (111) can control the sensor unit (121) using the driving unit (120).

[0225] The sensor unit (121) may include at least one of an image sensor (121-1), an acceleration sensor (121-2), and a distance sensor (121-3).

[0226] The image sensor (121-1) may include a camera. The sensing data acquired through the image sensor (121-1) may include a captured image.

[0227] The acceleration sensor (121-2) can sense the acceleration of the electronic device (100). The acceleration sensor (121-2) may include an IMU (Inertial Measurement Unit) sensor.

[0228] The distance sensor (121-3) can sense distance information related to the surrounding environment of the electronic device (100). For example, the electronic device (100) can sense distance information from the electronic device (100) to a specific object through the distance sensor (121-3). The distance sensor (121-3) can include at least one of a LiDAR (Light Detection and Ranging) sensor, a 3D sensor, and a ToF (Time of Flight) sensor.

[0229] For example, at least one processor (111) can control the sensor unit (121) directly without going through the driving unit (120).

[0230] The sensing data obtained from the sensor unit (121) can be transmitted to at least one processor (111). At least one processor (111) can obtain the sensing data obtained from the sensor unit (121).

[0231] Upon receiving a user command to output a projection image, at least one processor (111) may request map data from the map data storage module (113-1). At least one processor (111) may receive map data related to the space where the electronic device (100) is currently located from the map data storage module (113-1).

[0232] At least one processor (111) can identify a location of a projection surface determined (or pre-determined) by a user from map data. At least one processor (111) can determine a projection position by considering the location of the projection surface and resolution information (or size information) of the projection image. At least one processor (111) can perform keystone correction based on the projection surface location and the projection location.

[0233] At least one processor (111) can request information necessary for keystone correction from the keystone setting module (111-1). At least one processor (111) can obtain keystone correction information necessary for keystone correction from the keystone setting module (111-1).

[0234] At least one processor (111) can perform keystone correction based on the projection surface position, the resolution information of the projection image, the projection position, and the keystone correction information obtained from the keystone setting module (111-1). At least one processor (111) can perform keystone correction using the keystone calculation module (111-2). At least one processor (111) can transmit the projection surface position, the resolution information of the projection image, the projection position, and the keystone correction information obtained from the keystone setting module (111-1) to the keystone calculation module (111-2).

[0235] The keystone calculation module (111-2) can generate a projection image on which keystone correction has been performed based on the projection surface position, resolution information of the projection image, projection position, and keystone correction information. The keystone calculation module (111-2) can transmit the projection image on which keystone correction has been performed to the projection unit (112).

[0236] At least one processor (111) can control the projection unit (112) to output a projection image on which keystone correction has been performed.

[0237] According to various embodiments, at least one processor (111) may identify a user location using a user location estimation module (111-3). At least one processor (111) may identify a user location using the user location estimation module (111-3). The user location estimation module (111-3) may identify a user location using a camera or a microphone.

[0238] For example, at least one processor (111) can identify a user location through a captured image acquired through a camera.

[0239] For example, at least one processor (111) can identify a user's location using recorded audio acquired through a microphone. For example, at least one processor (111) can record audio in real time through two microphones. At least one processor (111) can identify a user's location using two simultaneously recorded audios and two microphone locations.

[0240] FIG. 4 is a drawing for explaining an operation of outputting a projection image by performing keystone correction according to one embodiment.

[0241] Referring to FIG. 4, the electronic device (100) can acquire user input (S410). The user input may include a command for outputting a projection image. The user input may be described as a projection command, a user command, etc.

[0242] Based on user input, the electronic device (100) can determine a projection position and a projection angle (S420). The projection position can indicate a position at which the electronic device (100) will output a projection image. The projection angle can indicate a direction in which the electronic device (100) will output the projection image at the projection position. The projection angle can be determined based on the projection surface position. The electronic device (100) can output the projection image at a projection surface position selected (or specified) by the user. The electronic device (100) can determine the projection angle based on the projection position and the projection surface position.

[0243] The electronic device (100) can perform keystone correction on a projection image to be output from a projection position (S430).

[0244] The electronic device (100) can output a projection image with keystone correction performed based on the projection angle at the projection position (S440). The electronic device (100) can move from the current position to the projection position.

[0245] For example, keystone correction may be performed at a point before the electronic device (100) moves.

[0246] For example, keystone correction can be performed while the electronic device (100) is moving.

[0247] For example, keystone correction may be performed at a point in time after the electronic device (100) has moved.

[0248] FIG. 5 is a diagram for explaining an operation of storing projection information according to one embodiment.

[0249] Referring to FIG. 5, the electronic device (100) can obtain user input (S510). The user input can include a command for outputting a projection image to a specific projection surface.

[0250] The electronic device (100) can determine the projection surface position (S520). When a user input is obtained, the electronic device (100) can determine the projection surface position corresponding to the user input.

[0251] For example, the projection surface location can be selected by the user. The electronic device (100) can obtain the projection surface location based on the projection surface selected by the user.

[0252] For example, the projection surface position may be a preset position. The electronic device (100) may determine the preset position as the projection surface position. The preset position may be a fixed position. The preset position may be a position where the most recent projection image was output.

[0253] The electronic device (100) can determine a projection position and a projection angle (S530). The electronic device (100) can determine the projection position based on the projection surface position. The electronic device (100) can determine a position that is a preset distance from the projection surface position as the projection position. The electronic device (100) can obtain map data. The electronic device (100) can identify the projection surface position from the map data. The map data can include coordinate information about the space where the electronic device (100) is located.

[0254] The electronic device (100) can identify a projection surface location from map data and determine a location a preset distance from the identified projection surface location as a projection location. If there are multiple projection locations, the projection locations can be described as candidate projection locations. The electronic device (100) can determine one of the multiple candidate projection locations as the final projection location.

[0255] The electronic device (100) can determine a projection angle for outputting a projection image to a determined projection surface location. The electronic device (100) can obtain (or calculate) the distance between the projection surface location and the projection location. The electronic device (100) can determine a projection angle for outputting a projection image to the projection surface location.

[0256] For example, the projection surface position and projection position can be defined by the x-axis and y-axis (2 dimensions).

[0257] For example, the projection surface position, the projection position can be defined by the x-axis, y-axis, and z-axis (3 dimensions).

[0258] For example, the projection angle can be defined as roll, pitch, and yaw. A description thereof is provided in Fig. 13.

[0259] The electronic device (100) can obtain correction information. The correction information may include at least one of a correction position or a correction angle. The correction position may include information for correcting the position of the projection surface. The correction angle may include information for correcting the projection angle.

[0260] The electronic device (100) can change the projection surface position based on the correction position (S540). The electronic device (100) can correct the projection surface position by changing the projection surface position by the correction position. The electronic device (100) can change the projection surface position from the first projection surface position to the second projection surface position based on the correction position.

[0261] The electronic device (100) can change the projection angle based on the correction angle (S550). The electronic device (100) can correct the correction angle by changing the projection angle by the correction angle. The electronic device (100) can change the projection angle from a first projection angle to a second projection angle based on the correction angle.

[0262] The electronic device (100) can perform keystone correction based on the projection surface position, projection position, and projection angle (S560). Specific descriptions related to keystone correction are described in FIGS. 17 and 18. The electronic device (100) can generate a projection image on which keystone correction has been performed (S570).

[0263] The electronic device (100) can store projection surface position, projection position, projection angle, and correction information as projection information (S580). The electronic device (100) can store the projection information in the memory (113). The memory (113) can store history information related to the projection history. The history information can include at least one projection information.

[0264] For example, when outputting a projection image on a first projection surface, the electronic device (100) can obtain the first projection surface position, the first projection position, the first projection angle, correction information, etc. used to output the projection image as projection information. The history information can store multiple projection information. When the projection image is output on three projection surfaces, the history information can include three projection information.

[0265] In various embodiments, the operation of correcting the projection angle may be omitted. The operation of storing the correction information for the projection angle or the operation of performing the correction for the projection angle may be omitted.

[0266] FIG. 6 is a drawing for explaining an operation of identifying projection information corresponding to a projection surface according to one embodiment.

[0267] Steps S610, S620, and S630 of FIG. 6 may correspond to steps S510, S520, and S530 of FIG. 5. Duplicate explanations are omitted.

[0268] The electronic device (100) can identify projection information corresponding to the determined projection surface (S640). The electronic device (100) can identify projection information corresponding to the determined projection surface among a plurality of projection information stored in the memory (113). The plurality of projection information may be included in the history information. The history information may be stored in the memory (113).

[0269] The history information may include separate projection information for each projection surface. For example, the history information may include first projection information for a first projection surface and second projection information for a second projection surface. If the electronic device (100) is identified as outputting a projection image on the first projection surface, the electronic device (100) may obtain (or identify) the first projection information corresponding to the first projection surface.

[0270] If projection information corresponding to the determined projection surface is not identified (S640-N), the electronic device (100) can perform keystone correction based on at least one of the projection surface position, projection position, or projection angle (S650). The electronic device (100) can perform keystone correction directly without correction.

[0271] When projection information corresponding to the determined projection surface is identified (S640-Y), the electronic device (100) can obtain correction information corresponding to the projection surface position (S660). The electronic device (100) can identify projection information corresponding to the projection surface position and obtain projection information included in the identified projection information.

[0272] The electronic device (100) can perform keystone correction based on at least one of the projection surface position, projection position, projection angle, or correction information (S670). Unlike step S650, the electronic device (100) can perform keystone correction by additionally utilizing correction information.

[0273] Based on the result of performing keystone correction, the electronic device (100) can generate a projection image on which keystone correction has been performed (S680). The electronic device (100) can obtain the projection image on which keystone correction has been performed. The electronic device (100) can store the obtained projection image in the memory (113). The electronic device (100) can control the projection unit (112) to output the projection image based on a preset event.

[0274] The preset event may include at least one of an event in which the electronic device (100) arrives at the projection image and an event in which keystone correction is performed.

[0275] FIG. 7 is a drawing for explaining a specific operation of identifying projection information corresponding to a projection surface according to one embodiment.

[0276] Referring to FIG. 7, the electronic device (100) may store first projection information including a first projection surface position, a first projection position, a first projection angle, or first correction information in the memory (113) (S705). The electronic device (100) may store the first projection information in the history information included in the memory (113). Step S705 may indicate an operation in which projection history is automatically stored when a projection image is output to a specific projection surface (the first projection surface).

[0277] Assume that a user command to output a projection image is received while the first projection information is stored.

[0278] The electronic device (100) can determine at least one of the second projection surface position, the second projection position, or the second projection angle based on a user command (or user input) (S706).

[0279] The electronic device (100) can identify whether the first projection surface position corresponds to the second projection surface position (S740). The electronic device (100) can compare the first projection surface position and the second projection surface position. The electronic device (100) can obtain coordinate information indicating the first projection surface position. The electronic device (100) can obtain coordinate information indicating the second projection surface position.

[0280] The electronic device (100) can obtain a first difference value between the x-coordinate of the first projection surface position and the x-coordinate of the second projection surface position. The electronic device (100) can identify whether the first difference value is less than a threshold value.

[0281] The electronic device (100) can obtain a second difference value between the y-coordinate of the first projection surface position and the y-coordinate of the second projection surface position. The electronic device (100) can identify whether the second difference value is less than a threshold value.

[0282] The electronic device (100) can obtain a third difference value between the z-coordinate of the first projection surface position and the z-coordinate of the second projection surface position. The electronic device (100) can identify whether the third difference value is less than a threshold value.

[0283] Assume that the projection surface position is defined in three dimensions (x-coordinate, y-coordinate).

[0284] If the first difference value and the second difference value are less than the threshold value, the electronic device (100) can identify that the first projection surface position corresponds to the second projection surface position.

[0285] Assume that the projection surface position is defined in three dimensions (x-coordinate, y-coordinate, z-coordinate).

[0286] If the first difference value and the third difference value are less than the threshold value, the electronic device (100) can identify that the first projection surface position corresponds to the second projection surface position.

[0287] If the second difference value and the third difference value are less than the threshold value, the electronic device (100) can identify that the first projection surface position corresponds to the second projection surface position.

[0288] If the first projection surface position does not correspond to the second projection surface position (S740-N), the electronic device (100) can perform keystone correction based on at least one of the second projection surface position, the second projection position, or the second projection angle (S750).

[0289] If the first projection surface position corresponds to the second projection surface position (S740-Y), the electronic device (100) can obtain first correction information corresponding to the second projection surface position (S760).

[0290] The electronic device (100) can perform keystone correction based on at least one of the second projection surface position, the second projection position, the second projection angle, or the first correction information (S770).

[0291] The electronic device (100) can generate (or acquire) a projection image on which keystone correction has been performed (S780).

[0292] FIG. 8 is a drawing for explaining an operation of comparing projection directions according to one embodiment.

[0293] Referring to FIG. 8, the electronic device (100) can store first correction information related to the first projection surface (S840). When outputting a projection image on the first projection surface, the electronic device (100) can store information related to the first projection surface as first projection information. The correction information used on the first projection surface can be stored as first correction information, and the first correction information can be included in the first projection information.

[0294] The electronic device (100) can determine a second projection surface according to a user command (S860). The electronic device (100) can determine a second projection surface on which to output a projection image based on the user command.

[0295] The electronic device (100) can obtain a first projection direction for a first projection surface and a second projection direction for a second projection surface (S871). The electronic device (100) can identify whether the first projection direction corresponds to the second projection direction (S872). Whether the first projection direction and the second projection direction correspond can be determined based on the direction in which the projection image is output. Specific operations related thereto are described in FIGS. 9, 20, 21, and 22.

[0296] If the first projection direction corresponds to the second projection direction (S872-Y), the electronic device (100) can perform keystone correction based on at least one of the second projection surface position, the second projection position, the second projection angle, or the first correction information (S873).

[0297] If the first projection direction does not correspond to the second projection direction (S872-N), the electronic device (100) can change the first correction information to the second correction information based on the difference in the projection direction (S874). The electronic device (100) can change the first correction information for the first projection surface to the second correction information based on the difference value in the projection direction. The difference value in the projection direction can represent the difference value between the first projection direction and the second projection direction.

[0298] The electronic device (100) can perform keystone correction based on at least one of the second projection surface position, the second projection position, the second projection angle, or the second correction information (S875).

[0299] The electronic device (100) can generate (or acquire) a projection image on which keystone correction has been performed (S880).

[0300] FIG. 9 is a drawing for explaining a specific operation of comparing projection directions according to one embodiment.

[0301] The embodiment of FIG. 9 may be a specific embodiment of steps S872 and S874 of FIG. 8.

[0302] The electronic device (100) can calculate a first projection vector based on the first projection surface position and the first projection position included in the first projection information (S972-1). The electronic device (100) can obtain a first projection vector representing a vector from the first projection position to the first projection surface position.

[0303] The electronic device (100) can calculate a second projection vector based on the second projection plane position and the second projection position determined according to a user command (or user input) (S972-2). The electronic device (100) can obtain a second projection vector representing a vector from the second projection plane position to the second projection plane position.

[0304] The electronic device (100) can obtain a difference value between a first projection vector and a second projection vector (S972-3). The electronic device (100) can identify whether the difference value is less than a threshold value (S972-4).

[0305] For example, the electronic device (100) can obtain a difference value for each vector component and determine whether the difference value for each vector component is less than a threshold value.

[0306] For example, the electronic device (100) can convert a vector component into a representative value (or absolute value) representing a single value. The electronic device (100) can obtain a difference value between a first representative value representing a first projection vector and a second representative value representing a second projection vector. The electronic device (100) can determine whether the difference value between the first representative value and the second representative value is less than a threshold value.

[0307] If the difference value is less than the threshold value (S972-4-Y), the electronic device (100) may change at least one of the second projection position or the second projection angle based on the first correction information included in the first projection information (S974-1). A description related to this is described in FIG. 20.

[0308] If the difference value is not less than the threshold value (S972-4-N), the electronic device (100) can change the first correction information to second correction information based on the difference value (S974-2).

[0309] The electronic device (100) can change at least one of the second projection position or the second projection angle based on the second correction information (S974-3). A description related to this is provided in FIGS. 21 and 22.

[0310] The projection vector can be a difference vector. The reference point (starting position) of the difference vector can be the projection position.

[0311] FIG. 10 is a drawing for explaining a horizontal slope according to one embodiment.

[0312] Referring to FIG. 10, according to an embodiment (1010), an electronic device (100) can output a projection image (1011) in a horizontal projection direction onto a projection surface (10). It is assumed that the horizontal inclination is 0. The horizontal inclination may refer to the degree to which the electronic device (100) is tilted to the left or right toward the front.

[0313] According to an embodiment (1020), an electronic device (100) can output a projection image (1021) in a horizontal projection direction to a projection surface (10). It is assumed that the horizontal inclination (1022) is 30 degrees. When the horizontal inclination is 30 degrees to the right, the electronic device (100) can output the projection image (1021) to the right by 30 degrees to the right on the projection surface (10).

[0314] The horizontal inclination can represent the rotation angle (yaw) with respect to the z-axis in Fig. 13. The horizontal inclination can be described as the yaw angle.

[0315] FIG. 11 is a drawing for explaining a vertical slope according to one embodiment.

[0316] Referring to FIG. 11, according to an embodiment (1110), an electronic device (100) can output a projection image on a projection surface in a horizontal projection direction. It is assumed that the vertical inclination is 0. The vertical inclination may refer to the degree to which the electronic device (100) is tilted upward or downward toward the front. If the vertical inclination is 0, it may be a situation in which the projection image is output horizontally. A virtual line (1111) representing the floor and a virtual line (1111) along which the electronic device (100) faces the front may be the same (or parallel).

[0317] According to an embodiment (1120), the electronic device (100) can output a projection image on a projection surface in a horizontal projection direction. It is assumed that the vertical inclination (1122) is 30 degrees. If the vertical inclination is 30 degrees upward, the electronic device (100) can output the projection image upward by 30 degrees upward on the projection surface. The virtual line (1111) representing the floor surface and the virtual line (1121) along which the electronic device (100) faces the front may not be parallel. The vertical inclination (1122) may represent the angle between the virtual line (1111) representing the floor surface and the virtual line (1121) along which the electronic device (100) faces the front.

[0318] The vertical slope can represent the rotation angle (pitch) relative to the y-axis in Fig. 13. The vertical slope can be described as a pitch angle.

[0319] Figure 12 is a drawing for explaining horizontal distortion according to one embodiment.

[0320] Referring to FIG. 12, according to an embodiment (1210), an electronic device (100) can output a projection image without horizontal distortion. A reference for no horizontal distortion is indicated by a horizontal line (1211). According to an embodiment (1210), the reference horizontal line and the horizontal line of the electronic device (100) can be aligned.

[0321] According to an embodiment (1220), the electronic device (100) may have a horizontal deviation (1222) of 30 degrees to the right. The reference horizontal line (1211) and the horizontal line (1221) of the electronic device may differ by the horizontal deviation (1222).

[0322] Horizontal distortion can represent the rotation angle (roll) with respect to the x-axis in Fig. 13. Horizontal distortion can be described as a roll angle.

[0323] FIG. 13 is a drawing for explaining rotation information of an electronic device (100) according to one embodiment.

[0324] FIG. 13 is a drawing for explaining the horizontal distortion, horizontal inclination, and vertical inclination of the electronic device (100).

[0325] Example 13 (1310) of FIG. 13 is a graph defining rotation directions along the x, y, and z axes. Rotation around the x-axis can be defined as roll, rotation around the y-axis can be defined as pitch, and rotation around the z-axis can be defined as yaw.

[0326] Embodiment (1320) of Fig. 13 can explain the rotation direction of the projection surface (10) as the rotation direction defined in embodiment (1310). The x-axis rotation information of the projection surface (10) may correspond to a roll that rotates based on the x-axis of the projection surface (10). The y-axis rotation information of the projection surface (10) may correspond to a pitch that rotates based on the y-axis of the projection surface (10). The z-axis rotation information of the projection surface (10) may correspond to a yaw that rotates based on the z-axis of the projection surface (10).

[0327] The x-axis rotation information can be described as the first-axis rotation information or horizontal tilt information. The y-axis rotation information can be described as the second-axis rotation information or vertical tilt information. The z-axis rotation information can be described as the third-axis rotation information or horizontal tilt information.

[0328] The sensor unit (121) can obtain status information of the electronic device (100). The status information of the electronic device (100) may refer to the rotational status of the electronic device (100). The sensor unit (121) may include at least one of a gravity sensor, an acceleration sensor, or a gyro sensor. The x-axis rotation information of the electronic device (100) and the y-axis rotation information of the electronic device (100) may be determined based on sensing data obtained through the sensor unit (121). However, it may be difficult to set a specific standard for the z-axis rotation information of the electronic device (100) unless it is based on east, west, south, or north. Therefore, the electronic device (100) may consider the status information of the projection surface (10) without separately considering the z-axis rotation information of the electronic device (100). Specifically, the electronic device (100) may perform an image correction operation by considering the z-axis rotation information of the projection surface (10).

[0329] FIG. 14 is a drawing for explaining rotation information of a projection surface according to one embodiment.

[0330] Example 14 (1410) of FIG. 14 is a graph defining rotation directions along the x, y, and z axes. Rotation around the x-axis can be defined as roll, rotation around the y-axis can be defined as pitch, and rotation around the z-axis can be defined as yaw.

[0331] Embodiment (1420) of Fig. 14 can explain the rotation direction of the projection surface (10) as the rotation direction defined in embodiment (1410). The x-axis rotation information of the projection surface (10) may correspond to a roll that rotates based on the x-axis of the projection surface (10). The y-axis rotation information of the projection surface (10) may correspond to a pitch that rotates based on the y-axis of the projection surface (10). The z-axis rotation information of the projection surface (10) may correspond to a yaw that rotates based on the z-axis of the projection surface (10).

[0332] The x-axis rotation information can be described as the first-axis rotation information. The y-axis rotation information can be described as the second-axis rotation information. The z-axis rotation information can be described as the third-axis rotation information.

[0333] FIG. 15 is a drawing for explaining z-axis rotation information of a projection surface according to one embodiment.

[0334] Example 15 (1510) of FIG. 15 is a drawing of an electronic device (100) viewed from above, showing a situation in which the electronic device (100) outputs a projection image while the projection surface (10) is not rotated along the z-axis. It is assumed that the electronic device (100) is placed on a table (20).

[0335] Example 15 (1520) of FIG. 15 is a drawing of an electronic device (100) viewed from above, showing a situation in which the electronic device (100) outputs a projection image while the projection surface (10) is rotated counterclockwise by a certain angle (θ1) with respect to the z-axis. It is assumed that the electronic device (100) is placed on a table (20).

[0336] FIG. 16 is a drawing for explaining y-axis rotation information of a projection surface according to one embodiment.

[0337] Referring to the embodiment (1610) of Fig. 16, the projection surface (10) is shown in a state where it is not rotated around the y-axis.

[0338] Referring to embodiment (1620) of Fig. 16, a state in which the projection surface (10) is rotated around the y-axis is shown. Specifically, it is assumed that the projection surface (10) is rotated by a certain angle (θ2) around the y-axis.

[0339] FIG. 17 is a drawing for explaining an operation of performing a keystone function by taking into account vertical inclination, according to one embodiment.

[0340] Referring to the embodiment (1710) of FIG. 17, the electronic device (100) can output a projection image in a state where a vertical tilt exists.

[0341] Referring to Example (1720), the electronic device (100) can output a projection image (1721) in a state where a vertical inclination exists, and due to the vertical inclination, the projection image (1721) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. In order to solve a problem caused by the presence of a horizontal inclination, the electronic device (100) can perform a keystone function.

[0342] Referring to Example (1730), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (1731) becomes rectangular in shape.

[0343] FIG. 18 is a drawing for explaining an operation of performing a keystone function while taking into account horizontal inclination, according to one embodiment.

[0344] Referring to the embodiment (1810) of FIG. 18, the electronic device (100) can output a projection image in a state where a horizontal inclination exists.

[0345] Referring to Example (1820), the electronic device (100) can output a projection image (1821) in a state where a horizontal inclination exists, and due to the horizontal inclination, the projection image (1821) can be output in a trapezoidal shape rather than a rectangular shape, which is the original image shape. To solve a problem caused by the presence of the horizontal inclination, the electronic device (100) can perform a keystone function.

[0346] Referring to embodiment (1830), the electronic device (100) can perform a keystone function to transform the original image so that the final output projection image (1831) becomes rectangular in shape.

[0347] FIG. 19 is a diagram for explaining an operation of storing projection information according to one embodiment.

[0348] In the embodiment (1910) of Fig. 19, information on multiple projection surfaces (11, 12, 13) can be stored in the memory (113). Information on each of the multiple projection surfaces (11, 12, 13) can be described as projection information.

[0349] Projection information may include at least one of a projection surface reference, a projection surface position, a correction position, a projection angle, and a correction angle. Projection information may include correction information, and the correction information may include at least one of a correction position or a correction angle.

[0350] A projection plane reference may include information defining the reference of the projection plane to define the projection plane. The projection plane reference may be described as reference information of the projection plane. The projection plane reference may include at least one of a coordinate reference or an angle reference.

[0351] The coordinate reference can represent a reference corresponding to a three-dimensional coordinate axis (or a two-dimensional coordinate axis). The coordinate reference can be one of the following: Left Top, Left Bottom, Right Top, or Right Bottom.

[0352] The angular reference may represent a reference corresponding to a three-dimensional rotation axis (roll, pitch, yaw). The angular reference may be at least one of clockwise (Clock) or counterclockwise (Counter-Clock).

[0353] The correction position can indicate the position of the projection surface that has been corrected.

[0354] The correction angle can represent a value that corrects the angle related to the output of the projection image.

[0355] It is assumed that among the multiple projection surfaces (11, 12, 13), there is a user correction history for the projection surface (11) and the projection surface (12), and there is no correction history for the projection surface (13).

[0356] The electronic device (100) can identify the position (x1, y1, z1) of the projection surface (11). The electronic device (100) can obtain a correction position (xc1, yc1, zc1) for the position (x1, y1, z1) of the projection surface (11). When correction is completed for the projection surface (11), the electronic device (100) can identify the corrected projection surface (11-2).

[0357] The electronic device (100) can identify the projection angles (R1, P1, Y1) of the projection surface (11). The electronic device (100) can obtain correction angles (Rc1, Pc1, Yc1) for the projection angles (R1, P1, Y1) of the projection surface (11).

[0358] For example, the correction angles (Rc1, Pc1, Yc1) can be determined based on the position of the projection surface (11-2). When the position of the projection surface (11-2) is modified, the electronic device (100) can change the projection angles (R1, P1, Y1) using the correction angles (Rc1, Pc1, Yc1).

[0359] For example, the correction angles (Rc1, Pc1, Yc1) can be determined based on user input (or automatically determined correction values) that change the correction angles.

[0360] The electronic device (100) can obtain and store first projection information including at least one of a projection surface position (x1, y1, z1), a correction position (xc1, yc1, zc1), a projection angle (R1, P1, Y1), and a correction angle (Rc1, Pc1, Yc1). The first projection information may be information corresponding to the first projection surface (11).

[0361] The electronic device (100) can identify the position (x2, y2, z2) of the projection surface (12). The electronic device (100) can obtain a correction position (xc2, yc2, zc2) for the position (x2, y2, z2) of the projection surface (12). When correction is completed for the projection surface (12), the electronic device (100) can identify the corrected projection surface (12-2).

[0362] The electronic device (100) can identify the projection angles (R2, P2, Y2) of the projection surface (12). The electronic device (100) can obtain correction angles (Rc2, Pc2, Yc2) for the projection angles (R2, P2, Y2) of the projection surface (12).

[0363] For example, the correction angles (Rc2, Pc2, Yc2) can be determined based on the position of the projection surface (12-2). When the position of the projection surface (12-2) is modified, the electronic device (100) can change the projection angles (R2, P2, Y2) using the correction angles (Rc2, Pc2, Yc2).

[0364] For example, the correction angles (Rc2, Pc2, Yc2) can be determined based on user input (or automatically determined correction values) that change the correction angles.

[0365] The electronic device (100) can obtain and store second projection information including at least one of a projection surface position (x2, y2, z2), a correction position (xc2, yc2, zc2), a projection angle (R2, P2, Y2), and a correction angle (Rc2, Pc2, Yc2). The second projection information may be information corresponding to the second projection surface (12).

[0366] The electronic device (100) can identify the position (x3, y3, z3) of the projection surface (13). The electronic device (100) can identify the projection angle (R3, P3, Y3) of the projection surface (13).

[0367] The electronic device (100) can obtain and store third projection information including at least one of a projection surface position (x3, y3, z3), a correction position (xc3, yc3, zc3), a projection angle (R3, P3, Y3), and a correction angle (Rc3, Pc3, Yc3). The third projection information may be information corresponding to a third projection surface (13).

[0368] Table 19 (1920) of FIG. 19 may represent history information including first projection information, second projection information, and third projection information.

[0369] FIG. 20 is a drawing for explaining an operation of performing correction using projection information according to one embodiment.

[0370] Example 20 (2010) of FIG. 20 shows a situation in which a projection image is output to a projection surface (21) corresponding to a projection surface (11).

[0371] The electronic device (100) may determine to output a projection image to the projection surface (21) based on a user command. The electronic device (100) may determine whether projection information corresponding to the projection surface (21) is included in the history information (2020).

[0372] It is assumed that the y-coordinate of the projection surface (11) and the y-coordinate of the projection surface (21) are the same. It is assumed that the z-coordinate of the projection surface (11) and the z-coordinate of the projection surface (21) are the same. The electronic device (100) can identify that the projection surface (21) corresponds to the projection surface (11). The electronic device (100) can determine that the projection surface (21) is parallel to the projection surface (11).

[0373] When the projection surface (21) is identified as corresponding to the projection surface (11), the electronic device (100) can correct the position and projection angle of the projection surface using the first projection information related to the projection surface (11).

[0374] When it is determined to output a projection image on the projection surface (21) according to a user command, the electronic device (100) can identify the projection surface position (x4, y4, z4) with respect to the projection surface (21). The electronic device (100) can obtain the projection angle (R4, P4, Y4) based on the projection surface position (x4, y4, z4).

[0375] The electronic device (100) can determine whether a projection surface corresponding to the projection surface (21) is included in the history information (2020). The electronic device (100) can determine whether a projection surface position corresponding to the projection surface position (x4, y4, z4) is included in the history information (2020). The fact that the projection surfaces or projection surface positions correspond may mean that the comparison objects are parallel. The electronic device (100) can determine whether a projection surface parallel to the projection surface (21) is included in the history information (2020).

[0376] It is assumed that the projection surface (21) is parallel to the projection surface (11). The electronic device (100) can identify first projection information corresponding to the projection surface (11) related to the projection surface position (x1, y1, z1). The electronic device (100) can obtain at least one of a correction position (xc1, yc1, zc1) or a correction angle (Rc1, Pc1, Yc1) from the first projection information.

[0377] The electronic device (100) can change the projection surface position (x4, y4, z4) based on the correction position (xc1, yc1, zc1). The electronic device (100) can change the projection angle (R4, P4, Y4) based on the correction angle (Rc1, Pc1, Yc1).

[0378] The electronic device (100) can output a projection image based on at least one of a corrected projection surface position or a corrected projection angle.

[0379] The electronic device (100) can determine whether to additionally change the correction information by considering the projection direction. The first projection information can include the projection position. The electronic device (100) can obtain a first projection direction (or first projection vector) indicating the first projection position to the first projection surface position with respect to the projection surface (11).

[0380] The electronic device (100) can obtain a second projection direction (or second projection vector) indicating from the second projection position to the second projection surface position with respect to the projection surface (21).

[0381] The electronic device (100) can determine whether the first projection direction and the second projection direction are the same. If the first projection direction and the second projection direction are the same, the electronic device (100) may not change the first correction information. The electronic device (100) can correct at least one of the projection surface position (x4, y4, z4) or the projection angle (R4, P4, Y4) based on the first correction information.

[0382] The projection surface (21-2) position of Fig. 20 can represent the corrected projection surface position.

[0383] Table (2030) can represent projection information for the projection surface (21).

[0384] FIG. 21 is a drawing for explaining an operation of performing correction using projection information according to one embodiment.

[0385] In the embodiment (2110) of Fig. 21, unlike the embodiment (2010) of Fig. 20, the projection direction may be diametrically opposite. In the embodiment of Fig. 21, it is assumed that the projection surface (11) and the projection surface (22) are parallel. In Fig. 21, it is assumed that the position of the projection surface is corrected based on the electronic device (100) facing the projection surface. The electronic device (100) can correct the position of the projection surface in the same direction (right) based on the projection surface (11, 22) facing the electronic device (100).

[0386] Table (2120) may correspond to table (2020) of Fig. 20. Duplicate explanation is omitted. Table (2120) may represent history information including projection information for multiple projection surfaces.

[0387] Table (2130) can represent projection information for the projection surface (22).

[0388] The electronic device (100) can obtain a second projection direction (or second projection vector) indicating from the second projection position to the second projection surface position with respect to the projection surface (22).

[0389] If the first projection direction and the second projection direction are not the same, the electronic device (100) can obtain a difference value between the first projection direction and the second projection direction. The electronic device (100) can change the first correction information to the second correction information based on the difference value.

[0390] The electronic device (100) can correct at least one of the projection surface position (x4, y4, z4) or the projection angle (R4, P4, Y4) based on the second correction information.

[0391] The second correction information may include at least one of a second correction position (-xc1, yc1, zc1) or a second correction angle (-Rc1, Pc1, Yc1).

[0392] The electronic device (100) can change the first correction position (xc1, yc1, zc1) to the second correction position (-xc1, -yc1, zc1) based on the difference value. If the projection direction is opposite to the x-axis direction, the electronic device (100) can change the x-coordinate and y-coordinate of the correction position by the difference value (negative value applied).

[0393] The electronic device (100) can change the first correction angle (Rc1, Pc1, Yc1) to the second correction angle (-Rc1, Pc1, Yc1) based on the difference value. If the projection direction is opposite to the x-axis direction, the electronic device (100) can change the roll angle of the correction angle by the difference value (negative value applied).

[0394] The projection surface (22-2) position of Fig. 21 can represent the corrected projection surface position.

[0395] FIG. 22 is a drawing for explaining an operation of performing correction using projection information according to one embodiment.

[0396] In the embodiment (2210) of FIG. 22, the electronic device (100) can correct the projection surface position in the opposite direction (left) based on the projection surface (11, 22) from which the electronic device (100) faces. The electronic device (100) can correct the projection surface position closer to the wall in order to output a projection image closer to the wall.

[0397] Table (2220) may correspond to table (2020) of FIG. 20. Duplicate explanation is omitted. Table (2220) may represent history information including projection information for multiple projection surfaces.

[0398] Table (2230) can represent projection information for the projection surface (22).

[0399] The electronic device (100) can change the first correction position (xc1, yc1, zc1) to the second correction position (-xc1, yc1, zc1) based on the difference value. If the projection direction is opposite to the x-axis direction, the electronic device (100) can change the x-coordinate of the correction position by the difference value (negative value applied).

[0400] The electronic device (100) can change the first correction angle (Rc1, Pc1, Yc1) to the second correction angle (-Rc1, Pc1, -Yc1) based on the difference value. If the projection direction is opposite to the x-axis direction, the electronic device (100) can change the roll angle and yaw angle of the correction angle by the difference value (negative value applied).

[0401] The projection surface (22-3) position of Fig. 22 can represent the corrected projection surface position.

[0402] The correction positions described in FIGS. 21 and 22 may mean correction values ​​applied to the correction operation, and the correction angles may mean correction values ​​applied to the correction operation.

[0403] Depending on the various embodiments, the correction position and correction angle may mean the final values ​​after the correction operation is completed.

[0404] FIG. 23 is a drawing for explaining an operation of performing verification after moving to a projection position according to one embodiment.

[0405] Referring to FIG. 23, the electronic device (100) can acquire a first projection image (original image) (S2305). The electronic device (100) can generate a second projection image on which keystone correction has been performed (S2310). The electronic device (100) can move to a determined projection position (S2315). The electronic device (100) can verify at least one of the projection surface position, projection position, or projection angle (S2320).

[0406] The electronic device (100) can obtain an error value through the verification result. The electronic device (100) can obtain the second projection surface position, the second projection position, and the second projection angle before moving to the second projection position. The electronic device (100) can perform a verification operation after moving to the second projection position. The electronic device (100) can perform verification for each of the second projection surface position, the second projection position, and the second projection angle at the second projection position.

[0407] Unlike the projection information stored in the history information, an obstacle may exist or the floor slope may have changed. The electronic device (100) can determine whether to change at least one of the projection surface position, projection position, or projection angle again based on the verification result. After moving to the second projection position, the electronic device (100) can obtain the third projection surface position, the third projection position, and the third projection angle, respectively, for verification. The electronic device (100) can perform a verification operation by comparing the information obtained before the movement (the second projection surface position, the second projection position, the second projection angle) with the information obtained after the movement (the third projection surface position, the third projection position, the third projection angle).

[0408] The electronic device (100) can identify whether the error value obtained based on the verification result is less than a threshold value (S2325). The electronic device (100) can identify the difference between the information obtained before movement (second projection surface position, second projection position, second projection angle) and the information obtained after movement (third projection surface position, third projection position, third projection angle) as the error value.

[0409] If the error value is less than the threshold value (S2325-Y), the electronic device (100) can output a second projection image (S2330).

[0410] If the error value is not less than the threshold value (S2325-N), the electronic device (100) can correct at least one of the projection surface position, the projection position, or the projection angle based on the current position (S2335)

[0411] The electronic device (100) can generate a third projection image by performing keystone correction based on the correction result (S2340). The electronic device (100) can output the third projection image (S2345).

[0412] FIG. 24 is a drawing for explaining an operation of performing verification after moving to a projection position according to one embodiment.

[0413] Steps S2405, S2410, S2415, S2430, S2435, S24450, and S2445 of FIG. 24 may correspond to steps S2305, S2310, S2315, S2330, S2335, S23450, and S2345 of FIG. 23. Duplicate explanations are omitted.

[0414] After moving to the projection position, the electronic device (100) can output a second projection image (S2421). The electronic device (100) can acquire a photographed image including the output second projection image through the image sensor (121-1) included in the sensor unit (121).

[0415] The electronic device (100) can identify the degree of distortion of the projection image output on the projection surface based on the captured image (S2422). The electronic device (100) can calculate the degree of distortion of the projection image based on the captured image.

[0416] If the distortion level is less than the threshold value (S2423-Y), the electronic device (100) can output a second projection image.

[0417] If the distortion level is not less than the threshold (S2423-N), the electronic device (100) can perform steps S2435, S2440, and S2445.

[0418] FIG. 25 is a drawing for explaining an operation of determining a projection reference point by considering a user position according to one embodiment.

[0419] The electronic device (100) can determine a portion of the ceiling as a projection surface (10). When outputting a projection image on the ceiling, the vertical direction of the projection image can be determined based on a reference point. It is assumed that the reference point of the projection image is the leftmost and topmost.

[0420] The electronic device (100) can determine the reference point of the projection image based on the user's location.

[0421] Example (2510) can output a projection image based on a projection surface (10) and a reference point (2511) based on the position of the user (30).

[0422] Example (2520) can output a projection image based on a projection surface (10) and a reference point (2521) based on the position of the user (30).

[0423] The electronic device (100) can identify candidate reference points (2511, 2521) among the four vertices representing the projection surface (10). The electronic device (100) can determine one of the candidate reference points (2511, 2521) as the final reference point based on the user's location. The electronic device (100) can determine the reference point closer to the user's location among the candidate reference points (2511, 2521) as the final reference point.

[0424] In the embodiment (2510), the electronic device (100) may determine a reference point (2511) that is closer to the location of the user (30) among the candidate reference points (2511, 2521) as the final reference point.

[0425] In the embodiment (2520), the electronic device (100) may determine a reference point (2521) that is closer to the location of the user (30) among the candidate reference points (2511, 2521) as the final reference point.

[0426] FIG. 26 is a drawing for explaining an operation of performing keystone correction by taking into account a projection reference point according to one embodiment.

[0427] Referring to FIG. 26, the electronic device (100) can obtain a first projection image (or original image) (S2605). The electronic device (100) can determine whether the projection surface is parallel to the xy plane (S2610).

[0428] If the projection surface is not parallel to the xy plane (S2610-N), the electronic device (100) can generate a second projection image with keystone correction performed (S2615). The electronic device (100) can move to a projection position (S2620). After moving to the second projection position, the electronic device (100) can output the second projection image (S2625).

[0429] If the projection surface is parallel to the xy plane (S2610-Y), the electronic device (100) can move to the projection position (S2630). The electronic device (100) can obtain audio (or audio signal) including the user's voice (S2635).

[0430] The electronic device (100) can identify the user's location based on audio (S2640). The electronic device (100) can identify the projection reference point based on the projection surface location and the user's location (S2645).

[0431] The electronic device (100) can perform keystone correction based on at least one of a projection reference point, a projection surface position, a projection position, a projection angle, or correction information (S2650). The electronic device (100) can perform a second projection image on which keystone correction has been performed (S2655). The electronic device (100) can output the second projection image (S2660).

[0432] FIG. 27 is a drawing for explaining an operation of outputting a projection image while moving an electronic device (100) according to one embodiment.

[0433] Referring to FIG. 27, the electronic device (100) can continue to output a projection image even while moving.

[0434] According to an embodiment (2710), the electronic device (100) can perform keystone correction based on the first position and output a projection image (2711) on which keystone correction has been performed.

[0435] According to an embodiment (2720), the electronic device (100) can perform keystone correction based on the second position and output a projection image (2721) on which keystone correction has been performed.

[0436] The electronic device (100) can perform keystone correction based on the moving position while moving from a first position to a second position. The electronic device (100) can output a projection image on which keystone correction has been performed at each position.

[0437] The electronic device (100) can continuously output a projection image even while moving to a destination. Since the electronic device (100) performs keystone correction in real time, it can output a projection image without distortion even while moving.

[0438] FIG. 28 is a drawing for explaining a control operation of an electronic device (100) according to one embodiment.

[0439] Referring to FIG. 28, a control method of an electronic device storing at least one projection information includes a step of determining a projection surface position based on a user command (S2805), a step of determining a projection position and a projection angle corresponding to the projection surface position (S2810), a step of identifying projection information corresponding to the projection surface position among the stored at least one projection information (S2815), a step of obtaining correction information included in the identified projection information (S2820), a step of changing the projection surface position based on the correction information (S2825), a step of performing keystone correction based on the corrected projection surface position to generate a projection image (S2830), and a step of outputting the generated projection image to an area corresponding to the corrected projection surface position after moving to the projection position (S2835).

[0440] The electronic device stores first projection information including at least one of a first projection surface position or first correction information, the first correction information being information used to change the first projection surface position, and the control method may further include a step of determining a second projection surface position based on a user command, and a step of identifying whether the second projection surface position corresponds to the first projection surface position.

[0441] The step of obtaining correction information (S2820) may further include obtaining first correction information included in the first projection information if the second projection surface position corresponds to the first projection surface position, and the step of changing the projection surface position may further include changing the second projection surface position to a third projection surface position based on the first correction information, and the control method may further include a step of moving to output a projection image to the third projection surface position.

[0442] The step of changing the projection surface position (S2825) may include obtaining a first projection direction corresponding to the first projection surface position when the second projection surface position corresponds to the first projection surface position, obtaining a second projection direction corresponding to the second projection surface position, and changing the second projection surface position to a third projection surface position based on the first correction information when the second projection direction corresponds to the first projection direction.

[0443] The step of changing the projection surface position (S2825) may be performed by obtaining a first projection direction based on the first projection position and the first projection surface position included in the first projection information, obtaining a second projection direction based on the second projection position and the second projection surface position corresponding to the second projection surface position, and identifying whether the second projection direction corresponds to the first projection direction based on a difference value between the first projection direction and the second projection direction.

[0444] The step of changing the projection surface position (S2825) may change the second projection surface position to the third projection surface position based on the first correction information if the difference value between the first projection direction and the second projection direction is less than a threshold value.

[0445] The step of changing the projection surface position (S2825) may change the first correction information to the second correction information based on the difference value if the difference value between the first projection direction and the second projection direction is not less than a threshold value, and may change the second projection surface position to the fourth projection surface position based on the second correction information.

[0446] The step of generating a projection image (S2830) may include changing at least one of a projection position or a projection angle based on a corrected projection surface position, and performing keystone correction based on at least one of the corrected projection surface position, the changed projection position, or the changed projection angle to generate a projection image.

[0447] The step of generating a projection image (S2830) may include moving to a projection position, verifying at least one of a corrected projection surface position, a projection position, or a projection angle, and performing keystone correction based on the verification result to generate a projection image.

[0448] The control method may further include the step of outputting a projection image while moving to a projection position.

[0449] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0450] The methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0451] The various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic device and the display device.

[0452] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When the instructions are executed by a processor, the processor may directly or under the control of the processor use other components to perform a function corresponding to the instructions. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain signals and is tangible, but does not distinguish between whether data is stored semi-permanently or temporarily in the storage medium.

[0453] According to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0454] Each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0455] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea of ​​the present disclosure.

Claims

1. In electronic devices, Projection section; a memory storing at least one projection information; and comprising at least one processor; At least one processor of the above, Identify the projection position and projection angle corresponding to the identified projection surface position based on the user command, Obtaining correction information included in projection information corresponding to the projection surface position among at least one of the stored projection information, An electronic device that controls the projection unit to move to the projection position and output a projection image obtained by keystone correction based on the corrected projection surface position in an area corresponding to the corrected projection surface position through the correction information.

2. In paragraph 1, The above memory is, Store first projection information including at least one of the first projection surface position and the first correction information, The above first correction information is, Including information for correcting the first projection surface position to the third projection surface position, At least one processor of the above, An electronic device that identifies whether a second projection surface location identified based on the user command corresponds to the first projection surface location.

3. In paragraph 2, At least one processor of the above, If the second projection surface position corresponds to the first projection surface position, the second projection surface position is corrected to the third projection surface position based on the first correction information included in the first projection information, An electronic device that moves to output the projection image to the third projection surface location.

4. In paragraph 3, At least one processor of the above, If the second projection surface position corresponds to the first projection surface position, a first projection direction corresponding to the first projection surface position is obtained, Obtain a second projection direction corresponding to the second projection surface position, An electronic device that changes the second projection surface position to the third projection surface position based on the first correction information when the second projection direction corresponds to the first projection direction.

5. In paragraph 4, At least one processor of the above, Obtaining a first projection direction based on the first projection position and the first projection surface position included in the first projection information, Obtain a second projection position corresponding to the second projection surface position and a second projection direction based on the second projection surface position, An electronic device that identifies whether the second projection direction corresponds to the first projection direction based on a difference value between the first projection direction and the second projection direction.

6. In paragraph 5, At least one processor of the above, An electronic device that changes the second projection surface position to the third projection surface position based on the first correction information when the difference value between the first projection direction and the second projection direction is less than a threshold value.

7. In paragraph 5, At least one processor of the above, If the difference value between the first projection direction and the second projection direction is not less than a threshold value, the first correction information is changed to second correction information based on the difference value, An electronic device that changes the second projection surface position to a fourth projection surface position based on the second correction information.

8. In paragraph 1, At least one processor of the above, Changing at least one of the projection position or the projection angle based on the above-mentioned corrected projection surface position, An electronic device that controls the projection unit to output the projection image obtained by keystone correction based on at least one of the corrected projection surface position, the changed projection position, or the changed projection angle.

9. In paragraph 1, At least one processor of the above, After moving to the above projection position, verify at least one of the above corrected projection surface position, the above projection position or the above projection angle, An electronic device that controls the projection unit to output the projection image obtained by keystone correction based on the verification result.

10. In paragraph 1, At least one processor of the above, An electronic device that controls the projection unit to output the projection image while moving to the projection position.

11. A method for controlling an electronic device storing at least one projection information, A step of identifying a projection position and a projection angle corresponding to the identified projection surface position based on a user command; A step of obtaining correction information included in projection information corresponding to the projection surface position among at least one of the stored projection information; A control method, comprising: a step of moving to the projection position and outputting a projection image obtained by keystone correction based on the corrected projection surface position in an area corresponding to the corrected projection surface position through the correction information; 12. In paragraph 11, The above electronic device, Store first projection information including at least one of the first projection surface position and the first correction information, The above first correction information is, Including information for correcting the first projection surface position to the third projection surface position, The above control method is, A control method further comprising: a step of identifying whether the second projection surface position identified based on the user command corresponds to the first projection surface position; 13. In paragraph 12, The step of changing the projection surface position is: If the second projection surface position corresponds to the first projection surface position, the second projection surface position is corrected to the third projection surface position based on the first correction information included in the first projection information, The above control method is, A control method further comprising: a step of moving to output the projection image to the third projection surface position; 14. In paragraph 13, The step of changing the projection surface position is: If the second projection surface position corresponds to the first projection surface position, a first projection direction corresponding to the first projection surface position is obtained, Obtain a second projection direction corresponding to the second projection surface position, A control method for changing the second projection surface position to the third projection surface position based on the first correction information when the second projection direction corresponds to the first projection direction.

15. In paragraph 14, The step of changing the projection surface position is: Obtaining a first projection direction based on the first projection position and the first projection surface position included in the first projection information, Obtain a second projection position corresponding to the second projection surface position and a second projection direction based on the second projection surface position, A control method for identifying whether the second projection direction corresponds to the first projection direction based on a difference value between the first projection direction and the second projection direction.

Images