Electronic device for projecting image and method for controlling the same

Abstract

The electronic device according to an embodiment of the present disclosure includes: sensors including a first sensor for detecting a distance between the electronic device and a projection plane and a second sensor for detecting an inclination of the electronic device; a memory; a projection unit; and at least one processor configured to obtain first environment information through the first sensor and the second sensor, control the projection portion to output a projection image to the projection plane based on first setting information corresponding to the first environment information among the plurality of pieces of setting information stored in the memory, and a control unit that obtains second environment information by the first sensor and the second sensor when a motion of the electronic apparatus is detected by the second sensor, and controls the projection unit to output a projection image to the projection plane based on second setting information corresponding to the second environment information when the first environment information is changed to the second environment information.

Description

Technical Field

[0001] Devices and methods consistent with the present disclosure relate to an electronic device for projecting an image and a control method thereof, and more particularly, to an electronic device for projecting an image and a control method thereof that can change settings for projecting an image based on a movement of the electronic device. Background Art

[0002] The image projected on the flat projection plane may have various shapes based on the rotation degree of the projector. Even if the projector is facing the projection plane, if the projector is not in a perfectly horizontal state, the projected image may be distorted and output.

[0003] To correct a distorted image, the projector can perform correction on the image itself. In addition to the operation of correcting the image itself, the projector can also control the output settings through the lens shift function or the projection ratio adjustment function.

[0004] When a projector is repeatedly used in a specific space, a user can use a projector to which optimal settings have been applied. However, even if the optimal settings are applied to the projector, it is difficult to position the projector in the same manner.

[0005] In addition, even in the case where an image with optimal settings has been output, the electronic device may be moved while the image is being output. The electronic device may be moved due to a user's mistake or an accidental collision. In the case where the electronic device is moved, it is inconvenient because the user must manually operate the settings again. Summary of the invention

[0006] Technical solutions to technical problems

[0007] The present disclosure provides an electronic device and a control method thereof, which can automatically change existing settings to output the same projection image when the electronic device is moved.

[0008] Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments.

[0009] According to aspects of the present disclosure, an electronic device may include: a sensor, including a first sensor and a second sensor, the first sensor being configured to detect a distance between the electronic device and a projection plane, and the second sensor being configured to detect an inclination of the electronic device; a memory, storing a plurality of setting information; a projector; and at least one processor, configured to: obtain first environmental information through the first sensor and the second sensor; control the projector to output a projection image to the projection plane based on first setting information among the plurality of setting information, the first setting information corresponding to the first environmental information; obtain second environmental information through the first sensor and the second sensor based on movement of the electronic device detected through the second sensor; and control the projector to output a projection image to the projection plane based on second setting information corresponding to the second environmental information based on the first environmental information being changed into the second environmental information.

[0010] The first environmental information or the second environmental information may include at least one of information about the inclination of the electronic device, information about the distance between the electronic device and the projection plane, and information about objects around the electronic device, and the first setting information or the second setting information may include at least one of the projection ratio of the image, the resolution of the image, the brightness of the image, and the volume of the audio.

[0011] The at least one processor may be further configured to obtain second environmental information through the first sensor and the second sensor based on that the motion of the electronic device is not detected within a predetermined time after the motion of the electronic device is detected through the second sensor.

[0012] The at least one processor may also be configured to: based on the first distance between the electronic device and the projection plane included in the first environmental information, control the projection unit to output a projection image having a first projection size to the projection plane based on the first distance and the first projection ratio.

[0013] The at least one processor may also be configured to: based on the second distance between the electronic device and the projection plane included in the second environmental information, control the projection unit to output a projection image having a first projection size to the projection plane based on the first distance, the second distance and the first projection ratio.

[0014] The at least one processor may be further configured to: control the projection unit to change a size of the projection image based on a ratio of the first distance to the second distance, and output the projection image having the changed size to the projection plane.

[0015] The at least one processor may also be configured to: based on the second distance between the electronic device and the projection plane included in the second environmental information, control the projection unit to output a projection image having a first projection size to the projection plane based on the second distance and the second projection ratio.

[0016] The at least one processor may be further configured to obtain information about a second projection ratio based on the second distance and the first projection size.

[0017] At least one processor can also be configured to: based on the first environmental information including a first distance between the electronic device and the projection plane, control the projection unit to output a projection image to the projection plane based on a first brightness corresponding to the first distance; and based on the second environmental information including a second distance between the electronic device and the projection plane, control the projection unit to output a projection image to the projection plane based on a second brightness corresponding to the second distance.

[0018] The at least one processor may be further configured to provide a user interface (UI) configured to indicate whether second setting information corresponding to the second environment information is applied based on the first environment information being changed to the second environment information.

[0019] According to aspects of the present disclosure, a method for controlling an electronic device, the electronic device including a first sensor and a second sensor, the first sensor being configured to detect a distance between the electronic device and a projection plane, the second sensor being configured to detect an inclination of the electronic device, the method may include: obtaining first environmental information through the first sensor and the second sensor; outputting a projection image to the projection plane based on first setting information corresponding to the first environmental information; obtaining second environmental information through the first sensor and the second sensor based on movement of the electronic device detected through the second sensor; and outputting a projection image to the projection plane based on second setting information corresponding to the second environmental information based on the first environmental information being changed into the second environmental information.

[0020] The first environmental information or the second environmental information may include at least one of information about the inclination of the electronic device, information about the distance between the electronic device and the projection plane, and information about objects around the electronic device, and the first setting information or the second setting information may include at least one of the projection ratio of the image, the resolution of the image, the brightness of the image, and the volume of the audio.

[0021] Based on the fact that the motion of the electronic device is not detected within a predetermined time after the motion of the electronic device is detected by the second sensor, the second environmental information may be obtained by the first sensor and the second sensor.

[0022] Outputting the projection image to the projection plane based on the first setting information may include: based on the first distance between the electronic device and the projection plane included in the first environment information, outputting the projection image having a first projection size to the projection plane based on the first distance and a first projection ratio.

[0023] Outputting the projection image to the projection plane based on the second setting information may include: based on the second distance between the electronic device and the projection plane included in the second environment information, outputting the projection image having a first projection size to the projection plane based on the first distance, the second distance and the first projection ratio.

[0024] The method may include changing a size of the projected image based on a ratio of the first distance to the second distance, and outputting the projected image having the changed size to a projection plane.

[0025] The method may include: based on the second distance between the electronic device and the projection plane included in the second environmental information, outputting a projection image having a first projection size to the projection plane based on the second distance and a second projection ratio.

[0026] The method may include obtaining information about a second projection ratio based on the second distance and the first projection size.

[0027] The method may include: based on a first distance between the electronic device and the projection plane included in first environmental information, outputting a projection image to the projection plane based on a first brightness corresponding to the first distance; and based on a second distance between the electronic device and the projection plane included in second environmental information, outputting a projection image to the projection plane based on a second brightness corresponding to the second distance.

[0028] The method may include providing a user interface (UI) configured to indicate whether second setting information corresponding to the second environment information is applied based on the first environment information being changed to the second environment information. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0030] Figure 1 is a perspective view showing the appearance of an electronic device according to an embodiment of the present disclosure.

[0031] Figure 2 is a block diagram showing a configuration of an electronic device according to an embodiment of the present disclosure.

[0032] Figure 3 It shows in detail Figure 2 A block diagram of a configuration of an electronic device.

[0033] Figure 4 is a perspective view showing the appearance of the electronic device in the embodiment of the present disclosure.

[0034] Figure 5 is a perspective view showing the appearance of an electronic device in still another embodiment of the present disclosure.

[0035] Figure 6 is a perspective view showing the appearance of an electronic device in still another embodiment of the present disclosure.

[0036] Figure 7 is a perspective view showing the appearance of an electronic device in still another embodiment of the present disclosure.

[0037] Figure 8 It shows Figure 7 A perspective view of a state in which the electronic device is rotated.

[0038] Fig. 9 is a diagram for explaining information about the rotation of an electronic device.

[0039] Fig.10 is a diagram for explaining information regarding y-axis rotation of an electronic device.

[0040] Fig.11 is a diagram for explaining information regarding x-axis rotation of an electronic device.

[0041] Fig.12 This is a diagram for explaining information about the rotation of the projection plane.

[0042] Fig.13 It is a diagram for explaining information about the z-axis rotation of the projection plane.

[0043] Fig.14 It is a diagram for explaining information about the y-axis rotation of the projection plane.

[0044] Fig.15 It is a diagram for explaining a function of adjusting a lens shift function and a projection ratio of an electronic device.

[0045] Fig.16 A diagram for explaining the leveling correction and keystone correction functions.

[0046] Fig.17 is a flowchart for explaining the operation of applying setting information.

[0047] Fig.18 is a flowchart for explaining an operation of applying setting information corresponding to environment information.

[0048] Fig.19 is a flowchart for explaining an operation of applying setting information corresponding to space information.

[0049] Fig. 20 A table for explaining the spatial information is shown.

[0050] Fig.21 is a flowchart for explaining an example in which environmental information is changed.

[0051] Fig. 22 is a flowchart for explaining an operation of obtaining sensing data based on the motion of an electronic device.

[0052] Fig.23 is a flowchart for explaining an operation of outputting a projection image without adjusting the projection ratio.

[0053] Fig.24 This is a flowchart for explaining an operation of outputting a projection image by adjusting the projection ratio.

[0054] Fig.25 : is a flowchart for explaining an operation of outputting a projection image by adjusting the projection ratio while further considering the critical ratio.

[0055] Fig.26 is a diagram for explaining an example in which the distance between the electronic device and the projection plane is reduced.

[0056] Fig. 27 is a diagram for explaining an example in which the distance between the electronic device and the projection plane increases.

[0057] Fig.28 is a diagram for explaining an operation of outputting a projection image by an electronic device in a case where a distance between the electronic device and a projection plane is changed.

[0058] Fig.29 It is a diagram for explaining the critical ratio.

[0059] Fig.30 is a diagram for explaining an operation of considering a highest critical ratio in an example in which a distance between an electronic device and a projection plane increases.

[0060] Fig.31 is a diagram for explaining an operation of considering a minimum critical ratio in an example in which a distance between an electronic device and a projection plane decreases.

[0061] Fig.32 : is a diagram for explaining leveling correction in various examples.

[0062] Fig.33 : is a diagram for explaining leveling correction in various examples.

[0063] Fig.34 are diagrams for explaining the keystone correction function in various examples.

[0064] Fig.35 are diagrams for explaining the keystone correction function in various examples.

[0065] Fig.36 are diagrams for explaining the keystone correction function in various examples.

[0066] Fig.37 are diagrams for explaining the keystone correction function in various examples.

[0067] Fig.38 are diagrams for explaining the keystone correction function in various examples.

[0068] Fig.39 are diagrams for explaining the lens shift function in various examples.

[0069] Fig.40 It is a diagram for explaining operations using object information in various examples.

[0070] Fig.41 It is a diagram for explaining operations using object information in various examples.

[0071] Fig.42 is a flowchart for explaining operations using object information in various examples.

[0072] Fig.43 : is a diagram for explaining an operation of providing a guide image to a user in various examples.

[0073] Fig.44 : is a diagram for explaining an operation of providing a guide image to a user in various examples.

[0074] Fig.45 : is a diagram for explaining an operation of providing a guide image to a user in various examples.

[0075] Fig.46 is a flowchart for explaining an operation of outputting audio by an electronic device when a distance between the electronic device and a projection plane changes.

[0076] Fig.47 is a flowchart for explaining an operation of outputting audio by an electronic device when a distance between the electronic device and a projection plane changes.

[0077] Fig.48 is a flowchart for explaining an operation of changing the brightness of a projected image by an electronic device when the distance between the electronic device and a projection plane changes.

[0078] Fig.49 is a flowchart for explaining an operation of changing the brightness of a projected image by an electronic device when the distance between the electronic device and a projection plane changes.

[0079] Fig.50 A diagram for explaining a system including an electronic device and a terminal device.

[0080] Fig.51is a flowchart for explaining a control method of an electronic device according to an embodiment. DETAILED DESCRIPTION

[0081] The present disclosure will be described in detail below with reference to the accompanying drawings.

[0082] Considering the functions in the present disclosure, currently widely used general terms are selected as the terms used in the embodiments of the present disclosure, but may be changed based on the intention of those skilled in the art or the emergence of judicial precedents, new technologies, etc. In addition, in certain cases, there may be terms arbitrarily selected by the applicant. In this case, the meanings of these terms are mentioned in detail in the corresponding description section of the present disclosure. Therefore, the terms used in the present disclosure need to be defined based on the meanings of the terms and contents throughout the disclosure rather than the simple names of the terms.

[0083] In the present disclosure, expressions “having”, “may have”, “including”, “may include”, etc. indicate the existence of corresponding features (eg, values, functions, operations, or components such as parts), without excluding the existence of additional features.

[0084] The expression “at least one of A or / and B” may mean “A or B” or “both A and B”.

[0085] The expressions "first", "second", etc. used in the present disclosure may define various components regardless of the order or importance of the components. These expressions are only used to distinguish one component from another component and do not limit the corresponding components.

[0086] When mentioning that any component (e.g., a first component) is "(operably or communicatively) coupled" or "connected to" another component (e.g., a second component), it should be understood that any component may be directly coupled to the other component or may be coupled to the other component through yet another component (e.g., a third component).

[0087] Unless the context clearly indicates otherwise, singular terms may include their plural forms. It should be understood that the terms "comprising" or "formed by" used in the present disclosure specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof mentioned in the present disclosure, and do not exclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0088] In the present disclosure, a "module" or "device" can perform at least one function or operation and can be implemented by hardware or software, or by a combination of hardware and software. In addition, in addition to the "module" or "device" that needs to be implemented by specific hardware, multiple "modules" or multiple "devices" can be integrated into at least one module and can be implemented by at least one processor.

[0089] In the present disclosure, terms such as “user” may refer to a person who uses an electronic device, or may refer to a device (eg, an artificial intelligence electronic device) that uses the electronic device.

[0090] Hereinafter, embodiments of the present disclosure are described in more detail with reference to the accompanying drawings.

[0091] Figure 1 is a perspective view showing an appearance of an electronic device 100 according to an embodiment of the present disclosure.

[0092] refer to Figure 1 The electronic device 100 may include a head 103 , a body 105 , a projection lens 110 , a connector 130 , or a cover 107 .

[0093] The electronic device 100 may be a device of various forms. Specifically, the electronic device 100 may be a projector device that magnifies an image and projects it onto a wall or a screen, and the projector device may be a liquid crystal display (LCD) projector, or may be a digital light processing (DLP) type projector using a digital micromirror device (DMD).

[0094] In addition, the electronic device 100 may be a home or industrial display device, a lighting device used in daily life, or an audio device including an audio module. The electronic device 100 may be implemented as a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a wearable device, a home appliance device, etc. The electronic device 100 according to an embodiment of the present disclosure is not limited to the above-mentioned devices, and may be implemented as an electronic device 100 having two or more functions of the above-mentioned devices. For example, the electronic device 100 may be used as a display device, a lighting device, or an audio device (based on the manipulation of the processor, its projector function is turned off and its lighting function or speaker function is turned on), or may be used as an artificial intelligence (AI) speaker or communication device including a microphone.

[0095] The body 105 is a housing constituting an exterior appearance, and may support or protect components of the electronic device 100 (eg, Figure 3 The shape of the body 105 can be close to Figure 1 However, the shape of the body 105 is not limited thereto, and according to various embodiments of the present disclosure, the body 105 may be implemented in various geometric shapes, such as a column with a polygonal cross-section, a cone, or a sphere.

[0096] The body 105 may have a size that enables a user to hold or move the body with one of his or her hands, or may be implemented in a miniature size that enables a user to easily carry the body or a size that enables the body to be held on a table or coupled to a lighting device.

[0097] The material of the main body 105 may be matte metal or synthetic resin to prevent the user's fingerprints or dust from dirtying the main body. Alternatively, the exterior of the main body 105 may be made of a smooth glossy material.

[0098] The body 105 may have a friction area formed in a partial area of ​​the exterior of the body 105 to facilitate the user to hold and move the body 105. Alternatively, the body 105 may have a curved grip portion or a support member 108a at least located in a partial area (refer to Figure 4 ), so that the user can hold the corresponding part.

[0099] The projection lens 110 may be formed on one surface of the body 105 and projects light passing through the lens array to the outside of the body 105. The projection lens 110 according to various embodiments of the present disclosure may be an optical lens coated with a low dispersion coating to reduce chromatic aberration. The projection lens 110 may be a convex lens or a condenser lens, and the projection lens 110 according to an embodiment of the present disclosure may adjust the focus by adjusting the positions of the plurality of sub-lenses.

[0100] The head 103 may be coupled to one surface of the body 105 so as to support and protect the projection lens 110. The head 103 may be coupled to the body 105 to rotate within a predetermined angle range based on one surface of the body 105.

[0101] The user or the processor can automatically or manually rotate the head 103 to freely adjust the projection angle of the projection lens 110. Alternatively, the head 103 may include a neck coupled to and extending from the body 105, so that the head 103 can adjust the projection angle of the projection lens 110 by tilting backward or forward.

[0102] In a state where the position and angle of the body 105 are fixed, the electronic device 100 can project light or an image to a desired position by adjusting the direction of the head 103 while adjusting the projection angle of the projection lens 110. In addition, the head 103 may include a handle that the user can hold after rotating the head in a desired direction.

[0103] A plurality of openings may be formed in the outer peripheral surface of the body 105. Through the plurality of openings, the audio output from the audio outputter may be output to the outside of the body 105 of the electronic device 100. The audio outputter may include a speaker, and the speaker may be used for general purposes such as reproduction of multimedia or reproduction of recordings, and output of voice.

[0104] According to an embodiment of the present disclosure, the body 105 may include a heat dissipation fan disposed therein, and when the heat dissipation fan is in operation, air or heat in the body 105 may be discharged through the plurality of openings. Therefore, the electronic device 100 may discharge heat generated by driving the electronic device 100 to the outside, and prevent the electronic device 100 from overheating.

[0105] The connector 130 can connect the electronic device 100 to an external device to send or receive electronic signals or receive power from an external device. The connector 130 according to an embodiment of the present disclosure can be physically connected to an external device. The connector 130 may include an input / output interface for connecting its communication with an external device or receiving power from an external device in a wired or wireless manner. For example, the connector 130 may include a high-definition multimedia interface (HDMI) connection terminal, a universal serial bus (USB) connection terminal, a secure digital (SD) card accommodating slot, an audio connection terminal, or a power socket. Alternatively, the connector 130 may include a Bluetooth, wireless fidelity (Wi-Fi) or wireless charging connection module to connect to an external device in a wireless manner.

[0106] In addition, the connector 130 may have a socket structure connected to an external lighting device, and may be connected to a socket receiving slot of the external lighting device to receive power. The size and specification of the connector 130 having a socket structure may be implemented in various ways in consideration of the receiving structure of the external device that can be coupled thereto. For example, according to the international standard E26, the diameter of the engagement portion of the connector 130 may be 26 mm, and in this case, the electronic device 100 may be coupled to an external lighting device such as a stand to replace a commonly used light bulb. When the electronic device 100 is coupled to a conventional socket located on the ceiling, projection may be performed vertically. Therefore, the socket-coupled electronic device 100 cannot be rotated, and in this case, the screen cannot be rotated either. Therefore, by allowing the head 103 to rotate on one surface of the body 105 to have an adjusted projection angle, so that the electronic device 100 may be rotated even when it is coupled to the socket and receives power, the electronic device 100 may project or rotate the screen to a desired position when the socket is coupled to the stand on the ceiling.

[0107] The connector 130 may include a coupling sensor, and the coupling sensor may detect whether the connector 130 is coupled to an external device, its coupling state, or its coupling target and send it to the processor, and the processor may control the driving of the electronic device 100 based on the received detection value.

[0108] The cover 107 may be coupled to or separated from the body 105 and protect the connector 130 so that the connector 130 is not always exposed to the outside. Figure 1 The shape of the body 105 shown is a continuous shape or a shape corresponding to the shape of the connector 130. The cover 107 may support the electronic device 100, and the electronic device 100 may be used by coupling the electronic device 100 to the external holder or holding the electronic device 100 on the external holder when the external holder is coupled to the cover 107.

[0109] In the electronic device 100 according to various embodiments of the present disclosure, a battery may be located inside the cover 107. The battery may include, for example, a primary battery that cannot be recharged, a secondary battery that can be recharged, or a fuel cell.

[0110] The electronic device 100 may include a camera module, and the camera module may capture a still image or a video. According to an embodiment of the present disclosure, the camera module may include at least one lens, an image sensor, an image signal processor, or a flash.

[0111] The electronic device 100 may include a protective case so that the electronic device 100 is easily carried while being protected. Alternatively, the electronic device 100 may include a stand that supports or fixes the body 105 or a bracket that can be coupled to a wall surface or a partition.

[0112] In addition, the electronic device 100 can also be connected to various external devices by using its socket structure and provide various functions. For example, the electronic device 100 can be connected to an external camera device by using the socket structure. The electronic device 100 can provide an image stored in the connected camera device or an image being captured using the projection portion 111. In addition, the electronic device 100 can be connected to a battery module by using the socket structure to receive power. The electronic device 100 can be connected to an external device by using the socket structure, which is only an example, and can be connected to an external device by using another interface (e.g., USB).

[0113] Figure 2 is a block diagram showing a configuration of an electronic device 100 according to an embodiment of the present disclosure.

[0114] refer to Figure 2, the electronic device 100 may include a projection unit 111, a sensor 113 (or a sensor unit or a sensor unit), and a processor 114. The processor 114 may include one or more processors, each of which may be deployed on a single electronic device or multiple electronic devices. That is, the processing described herein may be performed by an electronic device, an external device, or a combination of the two. As described herein, the processor 114 and other described processors may be referred to as at least one processor.

[0115] The projection part 111 (or projection part or projection unit or projection device or projection element) may output an image to be output from the electronic device 100 to a projection plane. The projection part 111 may be referred to as a light outputter. The projection part 111 may include a projection lens 110 .

[0116] The projection unit 111 may output an image to a projection plane. Figure 3 A detailed description of the projection unit 111 is described. Although described as projecting an image by using the projection unit, the electronic device 100 may project an image in various ways. The projection unit 111 may include a projection lens 110. The projection plane may be a part of a physical space into which an image is output, or may be a separate screen.

[0117] The sensor 113 may include at least one of a first sensor 113-1 or a second sensor 113-2. The first sensor 113-1 may be a sensor (or a sensor portion or a sensor unit) that obtains sensing data for analyzing state information of the electronic device 100. The second sensor 113-2 may be a sensor (or a sensor portion or a sensor unit) that obtains sensing data for analyzing state information of the projection plane 10.

[0118] The processor 114 may perform overall control operations of the electronic device 100. The processor 114 may be used to control overall operations of the electronic device 100.

[0119] The keystone correction function may be performed in various ways.

[0120] In an example, the processor 114 may automatically perform a keystone correction function. The processor 114 may automatically perform a keystone correction function based on the obtained state information. In the case where the keystone correction function is automatically performed, the keystone correction function may be described as an automatic keystone correction function.

[0121] In an example, the trapezoidal correction function may be performed manually. The processor 114 may perform the trapezoidal correction function based on user input or user manipulation. For example, when a user is viewing an image projected on a projection plane, the user may use the trapezoidal correction function by manipulating the electronic device 100 so that the projected image has a rectangular shape.

[0122] The trapezoidal correction function may be a function for solving a problem of outputting a trapezoidal image on a projection plane due to a tilted electronic device 100. The trapezoidal correction function may be a function for correcting an image so that the trapezoidal image output on the projection plane is output as a rectangular or square image. The trapezoidal correction function may also be referred to as trapezoidal correction. Trapezoidal correction may be divided into horizontal trapezoidal correction or vertical trapezoidal correction based on its direction.

[0123] The leveling correction function may be performed in various ways.

[0124] In an example, the processor 114 may automatically perform the leveling correction function. The processor 114 may automatically perform the leveling correction function based on the obtained state information. In the case where the leveling correction function is automatically performed, the leveling correction function may be described as an automatic leveling function.

[0125] In an example, the leveling correction function may be performed manually. The processor 114 may perform the leveling correction function based on user input or user manipulation. For example, when a user is viewing an image projected on a projection plane, the user may use the leveling correction function by manipulating the electronic device 100 to rotate the projected image.

[0126] The leveling correction function may be a function of rotating an image. The processor 114 may control the projection image to be output by rotating the image by a specific angle using the leveling correction function.

[0127] In an example, the processor 114 may perform the leveling correction function by using software. The processor 114 may correct the image using the leveling correction function to output a rotated image. In addition, the processor 114 may control the projecting unit 111 to output a rotated image.

[0128] In an example, the processor 114 may perform a leveling correction function by using hardware. The processor 114 may rotate the image by rotating the projection lens 110 included in the projection section 111. In addition, the processor 114 may rotate the image by controlling a fixing member included in the electronic device 100. The fixing member may be a member that contacts a specific surface so that the electronic device 100 is fixed thereto. The processor 114 may control the image to be rotated and output by rotating the fixing member or adjusting its length.

[0129] In addition, the processor 114 may obtain a final projection image by performing at least one of a keystone correction function or a leveling correction function, and control the projecting unit 111 to output the final projection image to the projection plane.

[0130] The electronic device 100 may output a projection image after performing at least one of a keystone correction function or a leveling correction function, thereby providing a projection image suitable for a user.

[0131] Processor 114 may provide the projected image in a variety of ways.

[0132] In an example, the processor 114 may output a corrected projection image after performing at least one of a keystone correction function or a leveling correction function on the projection image.

[0133] In an example, the processor 114 may output an original projection image before performing a keystone correction function or a leveling correction function on the projection image, and output a corrected projection image after performing at least one of the keystone correction function or the leveling correction function on the original projection image.

[0134] The electronic device 100 may include a sensor 113 , and the sensor 113 may include a first sensor 113 - 1 and a second sensor 113 - 2 .

[0135] The state information of the electronic device 100 may include the tilt of the electronic device 100 or the rotation angle of the electronic device 100. The state information of the electronic device 100 may include at least one of information about the x-axis rotation of the electronic device 100, information about the y-axis rotation of the electronic device 100, or information about the z-axis rotation of the electronic device 100. Figures 10 to 13 Describes its detailed description. Fig.12 Description of information regarding x-axis rotation of the electronic device 100. Fig.11 Description of information regarding the y-axis rotation of the electronic device 100. Fig.10 Description of information regarding z-axis rotation of the electronic device 100 is described.

[0136] The state information of the projection plane 10 may include the inclination of the projection plane 10 or the rotation angle of the electronic device 100. The state information of the projection plane 10 may include at least one of information about the x-axis rotation of the projection plane 10, information about the y-axis rotation of the projection plane 10, or information about the z-axis rotation of the projection plane 10.

[0137] The x-axis may be described as a first axis, the y-axis may be described as a second axis, and the z-axis may be described as a third axis.

[0138] The sensor 113 may include a first sensor 113 - 1 for detecting a distance between the electronic device 100 and a projection plane (eg, referred to as the projection plane 10 described in the following figures) and a second sensor 113 - 2 for detecting a tilt of the electronic device 100 .

[0139] At least one processor 114 can: obtain first environmental information through the first sensor 113-1 and the second sensor 113-2; control the projection unit 111 to output a projection image to the projection plane 10 based on first setting information corresponding to the first environmental information among multiple setting information stored in the memory 112; obtain second environmental information through the first sensor 113-1 and the second sensor 113-2 when the movement of the electronic device 100 is detected by the second sensor 113-2; and control the projection unit 111 to output (or project) the projection image to the projection plane 10 based on the second setting information corresponding to the second environmental information when the first environmental information is changed to the second environmental information.

[0140] The at least one processor 114 may obtain sensing data through the first sensor 113-1 and the second sensor 113-2. The at least one processor 114 may obtain first environmental information based on the sensing data. The first environmental information may be various information that affects the operation of outputting a projection image.

[0141] The electronic device 100 may store a plurality of setting information corresponding to the environmental information in the memory 112. The setting information may indicate settings suitable for specific environmental information. For example, in the case where the first distance is the distance between the electronic device 100 and the projection plane 10, there may be a projection ratio suitable for the first distance. The projection ratio may be used as the setting information.

[0142] The first sensor 113-1 may be a distance sensor. In addition, the second sensor 113-2 may be an acceleration sensor or a gyro sensor.

[0143] The first sensor 113-1 may include at least one sensor for detecting the state of the projection plane 10 and the distance between the first sensor 113-1 and the projection plane 10. The state of the projection plane 10 may indicate its inclination or rotation angle. That is, the first sensor 113-1 may include a sensor for measuring the inclination of the projection plane 10 or the rotation angle of the projection plane 10. The first sensor 113-1 may include a distance sensor for measuring its distance from the projection plane 10. For example, the first sensor 113-1 may include at least one time-of-flight (ToF) sensor.

[0144] The second sensor 113-2 may include at least one sensor for detecting the state of the electronic device 100. The state of the electronic device 100 may indicate its inclination or rotation angle. That is, the second sensor 113-2 may include a sensor for measuring the inclination of the electronic device 100 or the rotation angle of the electronic device 100. For example, the second sensor 113-2 may include at least one of a gravity sensor, an acceleration sensor, or a gyro sensor.

[0145] When outputting a projection image based on the first setting information, the at least one processor 114 may obtain sensing data through the second sensor 113-2. The at least one processor 114 may analyze the motion of the electronic device 100 based on the sensing data. When the motion of the electronic device 100 is detected, the at least one processor 114 may obtain sensing data through the first sensor 113-1 and the second sensor 113-2.

[0146] The at least one processor 114 may obtain the second environment information based on the sensing data obtained after detecting the motion of the electronic device 100. Since the electronic device 100 has been moved, the first environment information may be different from the second environment information.

[0147] At least one processor 114 may identify whether the first environment information is changed to the second environment information. In the case of identifying that the first environment information is changed to the second environment information, at least one processor 114 may identify second setting information suitable for the second environment information. At least one processor 114 may output a projection image to the projection plane 10 based on the second setting information.

[0148] The first environmental information or the second environmental information may include at least one of information about the inclination of the electronic device 100, information about the distance between the electronic device 100 and the projection plane 10, and information about objects around the electronic device 100, and the first setting information or the second setting information may include at least one of a projection ratio of an image, a resolution of an image, brightness of an image, or a volume of audio.

[0149] The first setting information or the second setting information may include at least one of information about a keystone correction function, information about a function of changing an image size, or information about a focusing function. The information about each function may indicate whether the function is executed, information necessary for executing the function, etc.

[0150] The information about the inclination of the electronic device 100 may indicate the inclination or rotation of the electronic device 100. The information about the inclination may include at least one of information about the x-axis rotation of the electronic device, information about the y-axis rotation of the electronic device, or information about the z-axis rotation of the electronic device. Figures 9 to 11 A detailed description of information about the tilt of the electronic device 100 is described.

[0151] Information about the distance between the electronic device 100 and the projection plane 10 may be obtained based on the sensing data obtained from the first sensor 113 - 1 .

[0152] Information about an object may be obtained based on the sensing data obtained from the first sensor 113-1. The object may be described as an obstacle.

[0153] refer to Fig. 20 Description A detailed description of the settings information.

[0154] The at least one processor 114 may output a projection image based on the projection information. The projection information may include at least one of environment information or setting information.

[0155] The environmental information may also include reflectivity of the projection plane, size of the projection plane, shape of the projection plane, and information about the inclination of the projection plane. The information about the inclination of the projection plane may include at least one of information about the x-axis rotation of the projection plane, information about the y-axis rotation of the projection plane, or information about the z-axis rotation of the projection plane.

[0156] The setting information may also include information such as the brightness or contrast of the image. In addition, the setting information may also include information such as the quality, channel, left-right balance of the audio.

[0157] The at least one processor 114 may detect the movement of the electronic device 100 in real time. The at least one processor 114 may obtain sensing data from the second sensor 113-2 in real time. In addition, the at least one processor 114 may detect the movement of the electronic device 100 based on the sensing data obtained by the second sensor 113-2. The at least one processor 114 may also obtain sensing data from the first sensor 113-1 and the second sensor 113-2 only when the electronic device 100 is moved. Fig. 22 Describe its detailed description.

[0158] In various examples, the at least one processor 114 may obtain sensing data through the first sensor 113-1 and the second sensor 113-2 in real time after detecting the motion of the electronic device 100. The at least one processor 114 may obtain the second environment information in real time based on the sensing data.

[0159] In various examples, in a case where the motion of the electronic device 100 is not detected within a predetermined time after the motion of the electronic device 100 is detected, the at least one processor 114 may obtain sensing data through the first sensor 113 - 1 and the second sensor 113 - 2 .

[0160] In a case where the motion of the electronic device 100 is not detected within a predetermined time after the motion of the electronic device 100 is detected through the second sensor 113 - 2 , the at least one processor 114 may obtain second environmental information through the first sensor 113 - 1 and the second sensor 113 - 2 .

[0161] When the first environmental information includes a first distance between the electronic device 100 and the projection plane 10 , the at least one processor 114 may control the projection unit 111 to output a projection image having a first projection size to the projection plane 10 based on the first distance and the first projection ratio.

[0162] The at least one processor 114 may obtain the distance between the electronic device 100 and the projection plane 10 as the first distance based on the sensing data. In the case where the distance included in the first environment information is the first distance, the at least one processor 114 may obtain information about a first projection ratio corresponding to the first distance.

[0163] In various examples, the first projection ratio may be a base projection ratio.

[0164] In various examples, the first projection ratio may be determined based on the first distance and the size of the projection plane 10. The at least one processor 114 may obtain information about an optimal projection ratio such that the projected image does not deviate from the projection plane 10. The identified projection ratio may be a first projection ratio.

[0165] In various examples, the first projection ratio may be a ratio stored based on an existing setting of a user.

[0166] At least one processor 114 may output a projection image to the projection plane 10 having a first projection ratio at a first distance. The size of the output projection image may be a first projection size. The first projection size may indicate the size of the projection image actually output to the projection plane 10 based on the first setting information.

[0167] The electronic device 100 may be moved while outputting a projection image having the first setting information at a first time point. The existing environment information is likely to be changed, so the at least one processor 114 may need to apply new setting information.

[0168] The user may desire the same size as the projection image size output at the first point in time. The reason is that at the first point in time, the user has already viewed the content with the optimal settings.

[0169] The at least one processor 114 may need to change setting information according to environmental information that changes based on the motion of the electronic device 100 .

[0170] In various examples, in the case where the environmental information is changed, at least one processor 114 may change the resolution of the image. Changing the resolution of the image may indicate an operation of changing the original size of the projected image.

[0171] When the second environmental information includes the second distance between the electronic device 100 and the projection plane 10 , the at least one processor 114 may control the projection unit 111 to output a projection image having a first projection size to the projection plane 10 based on the first distance, the second distance and the first projection ratio.

[0172] The at least one processor 114 may control the projection unit 111 to change the size of the projection image based on the ratio of the first distance to the second distance, and output the changed projection image having the first projection size to the projection plane 10 .

[0173] refer to Fig.23 , Fig.26 , Fig. 27 and Fig.28 Describes the specific operation of changing the size of the projected image.

[0174] In various examples, when the environmental information is changed, the at least one processor 114 may change the projection ratio. Changing the projection ratio may indicate adjusting the refractive index of the lens included in the projecting portion 111 while maintaining the original size of the image. The at least one processor 114 may change the projection ratio by using optical characteristics.

[0175] Meanwhile, when the second environmental information includes a second distance between the electronic device 100 and the projection plane 10 , at least one processor 114 may control the projection unit 111 to output a projection image having a first projection size to the projection plane 10 based on the second distance and the second projection ratio.

[0176] The at least one processor 114 may obtain information about a second projection ratio based on the second distance and the first projection size.

[0177] refer to Fig.24 , Fig.26 , Fig. 27 , Fig.28 Describes the specific operations for changing the projection ratio.

[0178] The electronic device 100 may have a critical projection ratio based on characteristics of a lens included in the projection portion 111. For example, the electronic device 100 may change the projection ratio between a first critical ratio and a second critical ratio.

[0179] refer to Fig.25 , Fig.29 , Fig.30 and Fig.31 Describe specific operations related to critical ratios.

[0180] When the first environmental information includes a first distance between the electronic device 100 and the projection plane 10, at least one processor 114 can control the projection unit 111 to output a projection image to the projection plane 10 based on a first brightness corresponding to the first distance, and when the second environmental information includes a second distance between the electronic device 100 and the projection plane 10, control the projection unit 111 to output a projection image to the projection plane 10 based on a second brightness corresponding to the second distance.

[0181] refer to Fig.48 and 49 Describes an example of changing brightness based on distance. Fig.46 and Fig.47 An example of changing setting information of audio based on distance is described.

[0182] At least one processor 114 may perform control on the projected image so that at least one processor 114 may provide a user interface (UI) (e.g., the projected image may include a user interface) for guiding / instructing whether to apply the second setting information corresponding to the second environment information when the first environment information is changed to the second environment information. The at least one processor 114 may generate the second projected image by including the UI in the first projected image. In addition, the at least one processor 114 may output the second projected image including the UI.

[0183] refer to Figure 42 to Figure 45 Describes the specific operations of the UI used to guide user input.

[0184] The electronic device 100 may detect a change in a factor affecting the output of a projected image. The electronic device 100 may then change the setting information based on the changed factor to provide the user with the existing projection quality. The electronic device 100 may automatically change the setting information so that the user does not have to perform a separate manual manipulation. Even if information about the inclination is changed based on the movement of the electronic device 100 or whether an object is present is changed, the electronic device 100 may provide the user with a projection image having the same quality or size.

[0185] Figure 3 It shows in detail Figure 2 A block diagram of a configuration of an electronic device 100 is shown.

[0186] refer to Figure 3 , the electronic device 100 may include a projection portion 111 , a memory 112 , a sensor 113 , a processor 114 , a user interface 115 , an input / output interface 116 , an audio outputter 117 , a power supply 118 , and a shutter 120 . Figure 3 The shown configurations are merely examples, some configurations may be omitted therefrom and new configurations may be added thereto.

[0187] Omissions and references Figure 2 Description Description of the duplicate description.

[0188] The projection unit 111 may be a component that projects an image to the outside. The projection unit 111 according to an embodiment of the present disclosure may be implemented in various projection types (e.g., a cathode ray tube (CRT) type, a liquid crystal display (LCD) type, a digital light processing (DLP) type, or a laser type). As an example, the CRT type has a principle substantially the same as that of a CRT monitor. The CRT type may display an image on a screen by magnifying the image using a lens in front of the cathode ray tube (CRT). The CRT type may be divided into a single tube type and a three tube type based on the number of cathode ray tubes, and in the case of the three tube type, the cathode ray tubes of red, green, and blue are separated from each other.

[0189] For example, the LCD type can display an image by allowing light emitted from a light source to pass through liquid crystal. The LCD type can be divided into a single-panel type and a three-panel type. In the case of the three-panel type, the light emitted from the light source can be separated into red, green, and blue in a dichroic mirror (a reflector that reflects only light of a specific color and allows the rest of the light to pass through), then can pass through liquid crystal, and then can be gathered into one place again.

[0190] For another example, the DLP type can display an image by using a digital micromirror device (DMD) chip. The DLP type projection unit may include a light source, a color wheel, a DMD chip, a projection lens, etc. The light emitted from the light source may be colored when passing through a rotating color wheel. The light passing through the color wheel may be input into the DMD chip. The DMD chip may include a plurality of micromirrors and reflect the light input into the DMD chip. The projection lens may expand the light reflected from the DMD chip to the image size.

[0191] As another example, the laser type may include a diode pumped solid-state (DPSS) laser and a galvanometer. A laser type that outputs various colors may use a laser in which three DPSS lasers are installed for red, green, and blue (RGB), respectively, and their optical axes are overlapped with each other by using a special mirror. The galvanometer may include a mirror and a high-power motor, and move the mirror at high speed. For example, the galvanometer may rotate the mirror at a speed of up to 40KHz / second. The galvanometer may be installed along the scanning direction, and in general, the projector performs a planar scan, so the galvanometer may also be set by dividing the galvanometer plan into an x-axis and a y-axis.

[0192] The projection part 111 may include various types of light sources. For example, the projection part 111 may include at least one light source of a lamp, a light emitting diode (LED), and a laser.

[0193] The projection unit 111 can output images with a screen ratio of 4:3, a screen ratio of 5:4, or a wide screen ratio of 16:9 based on the purpose of the electronic device 100, the user's settings, etc., and can output images with various resolutions (for example, wide video graphics array WVGA (854×480 pixels), super video graphics array SVGA (800×600 pixels), extended graphics array XGA (1024×768 pixels), wide extended graphics array WXGA (1280×720 pixels), WXGA (1280×800 pixels), super extended graphics array SXGA (1280×1024 pixels), ultra extended graphics array UXGA (1600×1200 pixels), full high definition HD (1920×1080 pixels)) based on the screen ratio.

[0194] The projection unit 111 may perform various functions for adjusting the output image under the control of the processor 114. For example, the projection unit 111 may perform a zoom function, a keystone correction function, a fast corner (or four corner) keystone correction function, a lens shift function, and the like.

[0195] The projection unit 111 can enlarge or reduce the image based on its distance from the screen (i.e., the projection distance). That is, the projection unit 111 can perform a zoom function based on its distance from the screen. The zoom function may include a hardware method for adjusting the screen size by moving the lens, and a software method for adjusting the screen size by cropping the image, etc. In the case of performing the zoom function, it is necessary to adjust the focus of the image. For example, a method for adjusting the focus may include a manual focusing method, an electric focusing method, etc. The manual focusing method may indicate a method for manually adjusting the focus, and the electric focusing method may indicate a method for the projector to automatically adjust the focus by using a built-in motor when performing the zoom function. When performing the zoom function, the projection unit 111 may provide a digital zoom function through software, and may provide an optical zoom function for performing the zoom function by moving the lens using a drive unit.

[0196] In addition, the projection unit 111 may perform a trapezoidal correction function. When the height does not match the front projection, the screen may be distorted upward or downward. The trapezoidal correction function may be a function of correcting a distorted screen. For example, in the case where the screen is distorted in the horizontal direction, the horizontal trapezoidal correction may be used to correct the distortion, and in the case where the screen is distorted in the vertical direction, the vertical trapezoidal correction may be used to correct the distortion. The fast corner (or four-corner) trapezoidal correction function may be a function of correcting distortion when the balance between the corner areas of the screen is not appropriate and the central area of ​​the screen is normal. The lens shift function may be a function of moving the screen as is when the screen is outside the screen area.

[0197] The projection unit 111 can provide zoom / keystone correction / focusing functions by automatically analyzing the surrounding environment and the projection environment without user input. The projection unit 111 can automatically provide zoom / keystone correction / focusing functions based on the distance between the electronic device 100 and the screen detected by a sensor (e.g., a depth camera, a distance sensor, an infrared sensor, or an illumination sensor), information about the space where the electronic device 100 is currently located, information about the amount of ambient light, etc.

[0198] In addition, the projection unit 111 can provide a lighting function by using a light source. Specifically, the projection unit 111 can provide a lighting function by outputting a light source using an LED. In the example, the projection unit 111 may include one LED, and in the example, the electronic device may include a plurality of LEDs. In the implementation example, the projection unit 111 can output a light source by using a surface-emitting LED. The surface-emitting LED can be an LED in which an optical sheet is arranged at the upper side of the LED so that the light source is evenly dispersed and output. When the light source is output by the LED, the light source can be evenly dispersed by the optical sheet, and the light source dispersed by the optical sheet can be introduced into the display panel.

[0199] The projection unit 111 may provide a dimming function for adjusting the intensity of the light source to the user. When receiving a user input for adjusting the intensity of the light source from the user through the user interface 115 (e.g., a touch display button or a dial), the projection unit 111 may control the LED to output the intensity of the light source corresponding to the received user input.

[0200] In addition, the projection part 111 can provide a dimming function without user input based on the content analyzed by the processor 114. The projection part 111 can control the intensity of the LED output light source based on information about the currently provided content (eg, content type or content brightness).

[0201] The projection unit 111 can control the color temperature by controlling the processor 114. The processor 114 can control the color temperature based on the content. In the case of identifying that the content is to be output, the processor 114 can obtain the color information of each frame of the content whose output is determined. Then, the processor 114 can control the color temperature based on the color information of each frame obtained. The processor 114 can obtain at least one main color of the frame based on the color information of each frame. Then, the processor 114 can adjust the color temperature based on the at least one main color obtained. In addition, the color temperature that the processor 114 can adjust can be divided into warm color type or cold color type. The frame to be output (hereinafter, the output frame) can include a fire scene. The processor 114 can identify (or obtain) that the main color is red based on the color information included in the current output frame. Then, the processor 114 can identify the color temperature corresponding to the identified main color (red). The color temperature corresponding to red can be a warm color type. The processor 114 can use an artificial intelligence model to obtain the color information or main color of the frame. In an example, the artificial intelligence model may be stored in the electronic device 100 (eg, the memory 112 ). In an example, the artificial intelligence model may be stored in an external server that may communicate with the electronic device 100 .

[0202] The electronic device 100 may be interlocked with an external device to control a lighting function. The electronic device 100 may receive lighting information from the external device. The lighting information may include at least one of brightness information or color temperature information set by the external device. The external device may be a device connected to the same network as the electronic device 100 (e.g., an Internet of Things (IoT) device included in the same home / work network) or a device that is not connected to the same network as the electronic device 100 but is capable of communicating with the electronic device (e.g., a remote control server). For example, an external lighting device (e.g., an IoT device) included in the same network as the electronic device 100 may output red light with a brightness of 50. The external lighting device (e.g., an IoT device) may directly or indirectly send lighting information (e.g., information indicating that a red light with a brightness of 50 is being output) to the electronic device 100. The electronic device 100 may control the output of the light source based on the lighting information received from the external lighting device. For example, in the case where the lighting information received from the external lighting device includes information indicating that a red light with a brightness of 50 is output, the electronic device 100 may output a red light with a brightness of 50.

[0203] The electronic device 100 may control the lighting function based on biometric information. The processor 114 may obtain the biometric information of the user. The biometric information may include at least one of the user's body temperature, heart rate, blood pressure, respiration, or electrocardiogram. The biometric information may also include various information in addition to the aforementioned information. For example, the electronic device may include a sensor for measuring biometric information. The processor 114 may obtain the biometric information of the user through the sensor, and control the output of the light source based on the obtained biometric information. For example, the processor 114 may receive biometric information from an external device through the input / output interface 116. The external device may be a portable communication device of the user (e.g., a smart phone or a wearable device). The processor 114 may obtain the biometric information of the user from the external device, and control the output of the light source based on the obtained biometric information. In an example, the electronic device may identify whether the user is sleeping, and in the case of identifying that the user is sleeping (or preparing to sleep), the processor 114 may control the output of the light source based on the biometric information of the user.

[0204] The memory 112 may store at least one instruction regarding the electronic device 100. In addition, the memory 112 may store an operating system (O / S) for driving the electronic device 100. In various examples of the present disclosure, the memory 112 may also store various software programs or applications for operating the electronic device 100. In addition, the memory 112 may include a semiconductor memory (such as a flash memory) or a magnetic storage medium (such as a hard disk).

[0205] In various examples of the present disclosure, the memory 112 may store various software modules for operating the electronic device 100, and the processor 114 may control the operation of the electronic device 100 by executing the various software modules stored in the memory 112. That is, the memory 112 may be accessed by the processor 114, and the processor 114 may perform reading, recording, correction, deletion, updating, etc. of data in the memory 112.

[0206] In the present disclosure, the term “memory 112 ” may include the memory 112 , a read only memory (ROM) or a random access memory (RAM) in the processor 114 , or a memory card (eg, a micro secure digital (SD) card or a memory stick) installed in the electronic device 100 .

[0207] The sensor 113 may include at least one sensor. The sensor 113 may include at least one of a tilt sensor for detecting the tilt of the electronic device 100 or an image sensor for capturing an image. The tilt sensor may be an acceleration sensor or a gyroscope sensor, and the image sensor may be a camera module or a depth camera. The tilt sensor may be described as a motion sensor. In addition, the sensor 113 may also include various sensors other than the tilt sensor or the image sensor. For example, the sensor 113 may include an illumination sensor and a distance sensor. The sensor 113 may also include a lidar sensor.

[0208] The user interface 115 may include various types of input devices. For example, the user interface 115 may include a physical button. The physical button may include a function key, a direction key (e.g., a four-way key), or a dial button. In an example, the physical button may be implemented as a plurality of keys. In an example, the physical button may be implemented as a single key. In the case where the physical button is implemented as a single key, the electronic device 100 may receive a user input of pressing the single key for a critical time or longer. When receiving a user input of pressing a key for a critical time or longer, the processor 114 may execute a function corresponding to the user input. For example, the processor 114 may provide a lighting function based on the user input.

[0209] In addition, the user interface 115 can receive user input by using a non-contact method. In the case of receiving user input by using a contact method, it may be necessary to transfer physical force to the electronic device. Therefore, a method of controlling an electronic device regardless of physical force may be required. The user interface 115 can receive user gestures and can perform operations corresponding to the received user gestures. The user interface 115 can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0210] In addition, the user interface 115 can receive user input by using a touch method. For example, the user interface 115 can receive user input through a touch sensor. In an example, the touch method can be implemented as a non-contact method. For example, the touch sensor can determine whether the user's body is close within a critical distance. Even if the user does not touch the touch sensor, the touch sensor can also recognize the user input. In an example, the touch sensor can recognize the user input that the user touches the touch sensor.

[0211] In addition to the above-mentioned user interface, the electronic device 100 can also receive user input in various ways. In an example, the electronic device 100 can receive user input from an external remote control device. The external remote control device can be a remote control device corresponding to the electronic device 100 (for example, a control device dedicated to the electronic device) or a portable communication device of the user (for example, a smart phone or a wearable device). The user's portable communication device can store applications for controlling electronic devices. The portable communication device can obtain user input from the application stored therein and send the obtained user input to the electronic device 100. The electronic device 100 can receive user input from the portable communication device and perform operations corresponding to the user's control command.

[0212] The electronic device 100 may receive user input by using voice recognition. In an example, the electronic device 100 may receive a user voice through a microphone included in the electronic device. In an example, the electronic device 100 may receive a user voice from a microphone or an external device. The external device may obtain a user voice through a microphone of the external device and send the obtained user voice to the electronic device 100. The user voice sent from the external device may be audio data or digital data converted from audio data (e.g., audio data converted to a frequency domain). The electronic device 100 may perform an operation corresponding to the received user voice. The electronic device 100 may receive audio data corresponding to the user voice through a microphone. Then, the electronic device 100 may convert the received audio data into digital data. Then, the electronic device 100 may convert the converted digital data into text data by using a speech-to-text (STT) function. In an example, the speech-to-text (STT) function may be directly performed by the electronic device 100, and in an example, the speech-to-text (STT) function may be performed by an external server.

[0213] The electronic device 100 may send digital data to an external server. The external server may convert the digital data into text data and obtain control command data based on the converted text data. The external server may send control command data (which may also include text data here) to the electronic device 100. The electronic device 100 may perform an operation corresponding to the user's voice based on the obtained control command data.

[0214] The electronic device 100 can be operated by using an assistant (or a computer such as Bixby TM The electronic device 100 may provide the voice recognition function by using an artificial intelligence agent such as a remote controller, which is only an example, and the electronic device 100 may provide the voice recognition function by using a variety of assistants. The electronic device 100 may provide the voice recognition function by selecting one of the multiple assistants based on a trigger word corresponding to the assistant or a specific key included in the remote controller.

[0215] The electronic device 100 may receive user input by using screen interaction. The screen interaction may indicate a function in which the electronic device identifies whether a predetermined event is generated by an image projected onto a screen (or projection plane), and obtains user input based on the predetermined event. The predetermined event may be an event in which a predetermined object is identified at a specific location (e.g., a location to which a UI for receiving user input is projected). The predetermined object may include at least one of a user's body part (e.g., a finger), a pointer, or a laser point. In the case of identifying that a predetermined object exists at a location corresponding to the projected UI, the electronic device 100 may identify that the electronic device 100 receives a user input for selecting the projected UI. For example, the electronic device 100 may project a guide image showing the UI onto the screen. Then, the electronic device 100 may identify whether the user has selected the projected UI. In the case of identifying a predetermined event at the location of the projected UI, the electronic device 100 may identify that the user has selected the projected UI. The projected UI may include at least one item. The electronic device 100 may perform spatial analysis to identify whether a predetermined event exists at the location of the projected UI. The electronic device 100 may perform spatial analysis through a sensor (e.g., an image sensor, an infrared sensor, a depth camera, or a distance sensor). The electronic device 100 may identify whether a predetermined event has occurred at a specific location (i.e., the location to which the UI is projected) by performing spatial analysis. In addition, when it is identified that a predetermined event has occurred at a specific location (i.e., the location to which the UI is projected), the electronic device 100 may identify that the electronic device 100 has received a user input for selecting a UI corresponding to the specific location.

[0216] The input / output interface 116 is a component for inputting or outputting at least one of an audio signal or an image signal. The input / output interface 116 may receive at least one of an audio signal or an image signal from an external device and output a control command to the external device.

[0217] The input / output interface 116 according to an embodiment of the present disclosure may be implemented as a wired input / output interface of at least one of a High Definition Multimedia Interface (HDMI), a Mobile High Definition Link (MHL), a Universal Serial Bus (USB), a USB Type-C, a DisplayPort (DP), Thunderbolt, a Video Graphics Array (VGA) port, a Red, Green, and Blue (RGB) port, a D-SUB, or a Digital Video Interface (DVI). In an example, the wired input / output interface may be implemented as an interface that inputs or outputs only an audio signal and an interface that inputs or outputs only an image signal, or as one interface that inputs or outputs both an audio signal and an image signal.

[0218] In addition, the electronic device 100 may receive data through a wired input / output interface, which is only an example, and the electronic device 100 may receive power through a wired input / output interface. For example, the electronic device 100 may receive power from an external battery through a USB Type-C, or receive power from a socket through a power adapter. For example, the electronic device may receive power from an external device (e.g., a laptop computer or a monitor) through a display port (DP).

[0219] The input / output interface 116 according to an embodiment of the present disclosure may be implemented as a wireless input / output interface that performs communication by using at least one of a communication method such as Wireless Fidelity (Wi-Fi), Wi-Fi Direct, Bluetooth, ZigBee, a third generation (3G), a third generation partnership project (3GPP), or a long term evolution (LTE). In an example, the wireless input / output interface may be implemented as an interface that inputs or outputs only an audio signal and an interface that inputs or outputs only an image signal, or as one interface that inputs or outputs both an audio signal and an image signal.

[0220] Furthermore, the audio signal may be input through the wired input / output interface, and the image signal may be input through the wireless input / output interface. Alternatively, the audio signal may be input through the wireless input / output interface, and the image signal may be input through the wired input / output interface.

[0221] The audio output 117 is a component that outputs an audio signal. Specifically, the audio output 117 may include an audio output mixer, an audio signal processor, and an audio output module. The audio output mixer may mix a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may mix an analog audio signal and another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The audio output module may include a speaker or an output terminal. According to an embodiment, the audio output module may include a plurality of speakers. In this case, the audio output module may be disposed in the main body, and the audio emitted when covering at least a portion of the diaphragm of the audio output module may be sent to the outside of the main body through a waveguide. The audio output module may include a plurality of audio output units, and the plurality of audio output units may be symmetrically arranged outside the main body, so that audio may be emitted in all directions (i.e., all directions in 360 degrees).

[0222] The power supply 118 may receive power from the outside and supply power to various components of the electronic device 100. The power supply 118 according to an embodiment of the present disclosure may receive power in various ways. In an example, the power supply 118 may receive power by using a Figure 1The power supply 118 may receive power by using a USB power line or by using a wireless charging method.

[0223] In addition, the power supply 118 can receive power by using an internal battery or an external battery. The power supply 118 according to an embodiment of the present disclosure can receive power through the internal battery. For example, the power supply 118 can charge the internal battery by using at least one of a 220V DC power line, a USB power line, or a USB C-type power line, and can receive power through the charged internal battery. In addition, the power supply 118 according to an embodiment of the present disclosure can receive power through an external battery. For example, in the case where the electronic device and the external battery are connected by various wired communication methods such as a USB power line, a USB C-type power line, a socket slot, etc., the power supply 118 can receive power through an external battery. That is, the power supply 118 can receive power directly from the external battery, or charge the internal battery through an external battery and receive power from the charged internal battery.

[0224] The power supply 118 according to the present disclosure may receive power by using at least one of the aforementioned various power supply methods.

[0225] Regarding power consumption, the electronic device 100 may have power consumption of a predetermined value (e.g., 43 W) or less due to a socket type, another standard, etc. The electronic device 100 may change power consumption to reduce power consumption when using a battery. That is, the electronic device 100 may change power consumption based on a power supply method, power usage, etc.

[0226] The electronic device 100 according to an embodiment of the present disclosure may provide various smart functions.

[0227] The electronic apparatus 100 may be connected to a portable terminal device that controls the electronic apparatus 100, and a screen output from the electronic apparatus 100 may be controlled by a user input input from the portable terminal device. For example, the portable terminal device may be implemented as a smart phone including a touch display, the electronic apparatus 100 may receive screen data provided by the portable terminal device from the portable terminal device and output the data, and may control a screen output by the electronic apparatus 100 based on the user input input from the portable terminal device.

[0228] The electronic apparatus 100 may be connected to a portable terminal device by using various communication methods such as miracast, airplay, wireless executable dalvik (DEX), and a remote personal computer (PC) method, and may share content or music provided by the portable terminal device.

[0229] In addition, the portable terminal device and the electronic device 100 can be connected to each other through various connection methods. In an example, the portable terminal device can search for the electronic device 100 and perform a wireless connection therewith, or the electronic device 100 can search for the portable terminal device and perform a wireless connection therewith. Then, the electronic device 100 can output the content provided from the portable terminal device.

[0230] In an example, when a portable terminal device is located around the electronic apparatus and then a predetermined gesture (e.g., a motion tap view) is detected through the display of the portable terminal device, while specific content or music is being output from the portable terminal device, the electronic apparatus 100 can output the content or music being output from the portable terminal device.

[0231] In the example, when it is detected that the portable terminal device is within a predetermined distance or less around the electronic device 100 (e.g., non-contact tap view), or when the portable terminal device touches the electronic device 100 twice at short intervals while specific content or music is being output from the portable terminal device (e.g., contact tap view), the electronic device 100 can output the content or music being output from the portable terminal device.

[0232] In the above example, the screen provided by the portable terminal device is the same as the screen provided by the electronic device 100. However, the present disclosure is not limited to this. That is, when the portable terminal device and the electronic device 100 are connected to each other, the portable terminal device can output a first screen provided by the portable terminal device, and the electronic device 100 can output a second screen provided by the portable terminal device, which is different from the first screen. For example, the first screen may be a screen provided by a first application installed in the portable terminal device, and the second screen may be a screen provided by a second application installed in the portable terminal device. For example, the first screen and the second screen may be screens different from each other provided by an application installed in the portable terminal device. In addition, for example, the first screen may be a screen including a UI in the form of a remote controller for controlling the second screen.

[0233] The electronic device 100 according to the present disclosure may output a standby screen. For example, when the electronic device 100 and an external device are not connected to each other, or when no input is received from an external device within a predetermined time, the electronic device 100 may output a standby screen. The conditions under which the electronic device 100 outputs the standby screen are not limited to the above examples, and the standby screen may be output based on various conditions.

[0234] The electronic device 100 may output a standby screen in the form of a blue screen, and the present disclosure is not limited thereto. For example, the electronic device 100 may obtain an atypical object by extracting only the shape of a specific object from data received from an external device, and output a standby screen including the obtained atypical object.

[0235] The shutter 120 may include at least one of a shutter, a fixing member, a rail, a body, or a motor.

[0236] The shutter may block light output from the projection unit 111. The fixing member may fix the position of the shutter. The track may be a path for moving the shutter or the fixing member. The body may be a component including the shutter and the fixing member. The motor may be a component included in the shutter 120 that generates a driving force for movement of the component (e.g., movement of the body) or rotation of the component (e.g., rotation of the shutter).

[0237] Figure 4 is a perspective view showing the appearance of the electronic device 100 in the embodiment of the present disclosure.

[0238] refer to Figure 4 , the electronic device 100 may include a support (or “handle”) 108 a.

[0239] In various examples, the support 108a may be a handle or a ring provided for a user to hold or move the electronic device 100. Alternatively, the support 108a may be a stand that supports the main body 105 when the main body 105 is placed on its side.

[0240] like Figure 4 As shown, the support 108a may have a hinge structure so that the support is coupled to or separated from the outer peripheral surface of the main body 105, and may be selectively separated from or fixed to the outer peripheral surface of the main body 105 based on the needs of the user. The number, shape or arrangement structure of the support 108a may be implemented in various ways without limitation. The support 108a may be built into the main body 105 and taken out and used by the user based on the needs of the user. Alternatively, the support 108a may be implemented as a separate accessory and attached to or removed from the electronic device 100.

[0241] The support 108a may include a first support surface 108a-1 and a second support surface 108a-2. The first support surface 108a-1 may be a surface facing the outside of the body 105 when the support 108a is separated from the outer peripheral surface of the body 105, and the second support surface 108a-2 may be a surface facing the inside of the body 105 when the support 108a is separated from the outer peripheral surface of the body 105.

[0242] The first support surface 108a-1 may extend from the lower portion of the body 105 to the upper portion to be away from the body 105, and the first support surface 108a-1 may have a flat or uniformly curved shape. In the case where the electronic device 100 is held in a manner such that the outer side surface of the body 105 contacts the bottom (i.e., in the case where the electronic device 100 is set in a manner such that the projection lens 110 faces forward), the first support surface 108a-1 may support the body 105. In an example where the electronic device 100 includes two or more support members 108a, the projection angle of the head 103 and the projection lens 110 may be adjusted by adjusting the interval between the two support members 108a or the hinge opening angle.

[0243] The second support surface 108a-2 may be a surface touched by a user or an external holding structure when the support member 108a is supported by the user or the external holding structure, and may have a shape corresponding to the gripping structure of the user's hand or the external holding structure so that the electronic device 100 does not slip when supported or moved. The user can move the electronic device 100 by facing the projection lens 110 forward, fixing the head 103, and holding the support member 108a, and use the electronic device 100 like a flashlight.

[0244] The support member groove 104 may be a groove structure provided in the body 105 and accommodating the support member 108a when the support member 108a is not used, and as shown in FIG. Figure 4 As shown, the support member groove 104 can be implemented as a groove structure corresponding to the shape of the support member 108a in the outer peripheral surface of the main body 105. By using the support member groove 104, when the support member 108a is not used, the support member 108a can be stored on the outer peripheral surface of the main body 105, and the outer peripheral surface of the main body 105 can be kept smooth.

[0245] Alternatively, the support member 108a may be stored inside the main body 105, and when the support member 108a is needed, it may be taken out to the outside of the main body 105. In this case, the support member groove 104 may be introduced into the interior of the main body 105 to accommodate the support member 108a, and the second support surface 108a-2 may have a door that engages with the outer peripheral surface of the main body 105 or opens or closes the individual support member groove 104.

[0246] The electronic device 100 may include various kinds of accessories that facilitate use or storage of the electronic device 100. For example, the electronic device 100 may include a protective case so that the electronic device 100 is easy to carry while being protected. Alternatively, the electronic device 100 may include a tripod that supports or fixes the body 105, or a bracket that can be coupled to an outer surface of the electronic device and fixes the electronic device 100.

[0247] Figure 5 is a perspective view showing the appearance of an electronic device 100 in still another embodiment of the present disclosure.

[0248] refer to Figure 5 , the electronic device 100 may include a support member (or "handle") 108b.

[0249] In various examples, the support 108b may be a handle or a ring provided for a user to hold or move the electronic device 100. Alternatively, the support 108b may be a bracket that supports the main body 105 to be oriented at any angle when the main body 105 is placed on its side.

[0250] like Figure 5 As shown, the support 108b can be connected to the main body 105 at a predetermined point (e.g., 2 / 3 to 3 / 4 of the height of the main body) of the main body 105. When the support 108 is rotated toward the main body, the support 108b can support the main body 105 so that it is oriented at any angle when the main body 105 is placed on its side.

[0251] Figure 6 is a perspective view showing the appearance of an electronic device 100 in still another embodiment of the present disclosure.

[0252] refer to Figure 6 , the electronic device 100 may include a support (or “handle”) 108c. In various examples, the support 108c may include: a base plate 108c-1 that supports the electronic device 100 on the ground; and two support members 108c-2 that connect the base plate 108c-1 to the body 105.

[0253] In an example of the present disclosure, the two support members 108c-2 may have the same height, and a section of each of the two support members 108c-2 may be coupled or separated from each other by a groove provided on an outer peripheral surface of the body 105 and a hinge member 108c-3.

[0254] The two supporting members may be hinge-coupled to the body 105 at a predetermined point of the body 105 (eg, a point of 1 / 3 to 2 / 4 of the height of the body).

[0255] In a case where the two supporting members and the main body are connected to each other through the hinge member 108 c - 3 , the main body 105 may rotate based on a virtual horizontal axis formed by the two hinge members 108 c - 3 , thereby adjusting a projection angle of the projection lens 110 .

[0256] Figure 6 An example in which two support members 108c-2 are connected to the main body 105 is shown, but the present disclosure is not limited thereto and may be Figure 7 and Figure 8 As shown, a support member and the main body 105 may be connected to each other via a hinge member.

[0257] Figure 7 is a perspective view showing the appearance of an electronic device 100 in still another embodiment of the present disclosure.

[0258] Figure 8 It shows Figure 7 A perspective view of a state in which the electronic device 100 is rotated.

[0259] refer to Figure 7 and Figure 8 In various examples of the present disclosure, the support member 108d may include: a base plate 108d-1, which supports the electronic device 100 on the ground; and a support member 108d-2, which connects the base plate 108d-1 with the main body 105.

[0260] In addition, a section of one supporting member 108 d - 2 may be coupled to or separated from the main body by a groove provided on one peripheral surface of the main body 105 and a hinge member.

[0261] In the case where one support member 108d-2 and the main body 105 are coupled to each other through one hinge member, the main body 105 may rotate based on a virtual horizontal axis formed by the one hinge member, such as Figure 8 shown.

[0262] Figure 4 , Figure 5 , Figure 6 , Figure 7 or Figure 8 The illustrated support is only an example, and the electronic device 100 may include support members of various positions or shapes.

[0263] Fig. 9 is a diagram for explaining information about the rotation of the electronic device 100 .

[0264] Fig. 9 Example 910 shows a diagram defining a rotation direction along the x-axis, y-axis, or z-axis. Roll may be a rotation about the x-axis, pitch may be a rotation about the y-axis, and yaw may be a rotation about the z-axis.

[0265] refer to Fig. 9 In example 920, the rotation direction of projection plane 10 may be described as the rotation direction defined in example 910. Information about the x-axis rotation of projection plane 10 may correspond to roll (i.e., rotation performed based on the x-axis of projection plane 10). Information about the y-axis rotation of projection plane 10 may correspond to pitch (i.e., rotation performed based on the y-axis of projection plane 10). Information about the z-axis rotation of projection plane 10 may correspond to yaw (i.e., rotation performed based on the z-axis of projection plane 10).

[0266] The information about the x-axis rotation may be described as information about the rotation of the first axis, information about the inclination of the first axis, or horizontal twist information. In addition, the information about the y-axis rotation may be described as information about the rotation of the second axis, information about the inclination of the second axis, or vertical inclination information. In addition, the information about the z-axis rotation may be described as information about the rotation of the third axis, information about the inclination of the third axis, or horizontal inclination information.

[0267] The first sensor 113-1 may obtain state information (or information about the tilt) of the electronic device 100. The state information of the electronic device 100 may indicate a rotation state of the electronic device 100. The first sensor 113-1 may include at least one of a gravity sensor, an acceleration sensor, or a gyro sensor. Information about the x-axis rotation of the electronic device 100 and information about the y-axis rotation of the electronic device 100 may be determined based on the sensing data obtained by the first sensor 113-1.

[0268] The information about the z-axis rotation may be obtained according to the extent to which the electronic device 100 rotates based on the movement of the electronic device 100. For example, the information about the z-axis rotation may indicate the extent to which the electronic device 100 rotates along the z-axis at a second time point based on a first time point.

[0269] Fig.10 2 is a diagram for explaining information regarding y-axis rotation of the electronic device 100 .

[0270] Fig.10 Example 1010 in FIG. 1 shows a state where the electronic device 100 is not rotated around the y-axis.

[0271] Fig.10 The example 1020 in FIG. 1 shows a state where the electronic device 100 rotates around the y-axis. The electronic device 100 may rotate around the y-axis by a predetermined angle 1022 .

[0272] Fig.11 is a diagram for explaining information regarding x-axis rotation of the electronic device 100 .

[0273] Fig.11 The example 1110 in FIG. 1 shows a state where the electronic device 100 is not rotated around the x-axis. The reference horizontal line 1111 may be the same as a horizontal line of the electronic device 100 that is not rotated around the x-axis.

[0274] Fig.11 The example 1120 in FIG. 1 shows a state where the electronic device 100 rotates around the x-axis. The electronic device 100 may rotate around the x-axis by a predetermined angle 1122. The reference horizontal line 1111 and the horizontal line 1121 of the electronic device may differ from each other by a predetermined angle 1122.

[0275] Fig.12 It is a diagram for explaining information on the rotation of the projection plane 10 .

[0276] Fig.12 Example 1210 shows a diagram defining a rotation direction along the x-axis, y-axis, or z-axis. Roll may be a rotation about the x-axis, pitch may be a rotation about the y-axis, and yaw may be a rotation about the z-axis.

[0277] refer to Fig.12 In example 1220, the rotation direction of projection plane 10 may be described as the rotation direction defined in example 1210. Information about the x-axis rotation of projection plane 10 may correspond to roll (i.e., rotation performed based on the x-axis of projection plane 10). Information about the y-axis rotation of projection plane 10 may correspond to pitch (i.e., rotation performed based on the y-axis of projection plane 10). Information about the z-axis rotation of projection plane 10 may correspond to yaw (i.e., rotation performed based on the z-axis of projection plane 10).

[0278] The information about the x-axis rotation may be described as information about the rotation of the first axis or information about the inclination of the first axis. In addition, the information about the y-axis rotation may be described as information about the rotation of the second axis or information about the inclination of the second axis. In addition, the information about the z-axis rotation may be described as information about the rotation of the third axis or information about the inclination of the third axis.

[0279] Fig.13 1 is a diagram for explaining information on the z-axis rotation of the projection plane 10 .

[0280] Fig.13 Example 1310 shows the electronic device 100 viewed from above, where the electronic device 100 outputs a projection image in a state where the projection plane 10 is not rotated along the z-axis. The electronic device 100 may be located on a table 20.

[0281] Fig.13Example 1320 shows the electronic device 100 viewed from above, where the electronic device 100 outputs a projection image in a state where the projection plane 10 is rotated counterclockwise by a predetermined angle θ1 based on the z-axis. The electronic device 100 may be located on the table 20 .

[0282] Fig.14 1 is a diagram for explaining information on the y rotation of the projection plane 10 .

[0283] Fig.14 Example 1410 shows a state where the projection plane 10 is not rotated around the y-axis.

[0284] Fig.14 Example 1420 shows a state where the projection plane 10 is rotated around the y-axis. The projection plane 10 may be rotated around the y-axis by a predetermined angle θ2.

[0285] Fig.15 1 is a diagram for explaining a function of adjusting a lens shift function and a projection ratio of the electronic device 100 .

[0286] refer to Fig.15 , the electronic device 100 may perform a lens shift function. The lens shift function may include an operation of changing the arrangement of the lens.

[0287] For example, in example 1510, the electronic device 100 may be positioned on the right based on the center of the projection plane 10. The electronic device 100 may output a projection image 1511 on the right based on the center of the projection plane 10. The area in which the electronic device 100 outputs light may be described as an output area 1512. The output area 1512 may include at least one of a projection area 1512-1 or a remaining area 1512-2. The projection area 1512-1 may indicate an area in which a projection image is output. The remaining area 1512-2 may indicate an area in which, although a projection image is not output, light irradiated by the electronic device 100 is output. The remaining area may be described as a gray area.

[0288] The electronic device 100 can change the direction of the lens output light by moving the lens. In example 1515, the electronic device 100 can output light in the left direction of the electronic device 100 instead of the front of the electronic device 100 by shifting the lens. Therefore, the projection image 1516 can be output at the center of the projection plane 10 by the lens shift function.

[0289] refer to Fig.15 , the electronic device 100 may perform a projection ratio (or throw ratio) adjustment function. The projection ratio adjustment function may include an operation of adjusting a predetermined projection ratio based on characteristics of a lens included in the electronic device 100.

[0290] For example, in example 1520, the electronic device 100 may output a projection image 1521 to the projection plane 10 based on a first projection ratio. The electronic device 100 may change the first projection ratio to a second projection ratio. Changing the projection ratio indicates that the size of the output projection image is changed even if the distance between the electronic device 100 and the projection plane 10 is the same. In the case where the first projection ratio and the second projection ratio are different from each other, the electronic device 100 may change the size of the projection image output to the projection plane 10 by adjusting the projection ratio. In example 1525, based on the degree of change in the projection ratio, the changed projection image 1526 may be larger or smaller than the existing projection image 1521. The projection ratio may be different based on the characteristics of the lens included in the electronic device 100.

[0291] Fig.16 A diagram for explaining the leveling correction and keystone correction functions.

[0292] refer to Fig.16 , the electronic device 100 may perform a leveling correction function. The leveling correction function may be described as a leveling function. The leveling correction may be described as a concept included in the concept of trapezoidal correction. For example, the trapezoidal correction may include at least one of a trapezoidal correction based on an x-axis rotation of the electronic device 100, a trapezoidal correction based on a y-axis rotation of the electronic device 100, or a trapezoidal correction based on a z-axis rotation of the electronic device 100. The leveling correction may indicate a trapezoidal correction based on an x-axis rotation.

[0293] For example, in example 1610 , the electronic device 100 may rotate around the x-axis. In a state where the electronic device 100 rotates around the x-axis, the projected image 1611 may be rotated and then output to an output area 1612 of the projection plane 10 .

[0294] Therefore, the electronic device 100 can correct (or change) the image by performing leveling correction (or keystone correction based on x-axis rotation). In example 1615, after performing the leveling correction, the electronic device 100 can output the corrected projection image 1616 to the projection plane 10. In addition to the operation of rotating the projection image, the electronic device 100 can also change the size of the projection image based on the output area 1612. The electronic device 100 can change the size of the projection image so that the corrected projection image 1616 is output in the output area 1612.

[0295] refer to Fig.16 , the electronic device 100 can perform a keystone correction function.

[0296] For example, in example 1620, the electronic device 100 may rotate around the z-axis. In the state where the electronic device 100 rotates around the z-axis, the projected image 1621 may be distorted and then output to the output area 1622 of the projection plane 10. Its distorted shape may be a trapezoid or a rotated trapezoid.

[0297] Therefore, the electronic device 100 can correct (or change) the image by performing a trapezoidal correction based on the z-axis rotation. The trapezoidal correction can indicate an operation of manually correcting the original image so that the image is output in a rectangular shape. In example 1625, after performing the trapezoidal correction, the electronic device 100 can output a corrected projection image 1626 to the projection plane 10. In addition to the operation of correcting the projection image, the electronic device 100 can also change the size of the projection image based on the output area 1622. The electronic device 100 can change the size of the projection image so that the corrected projection image 1626 is output in the output area 1622.

[0298] Fig.17 is a flowchart for explaining the operation of applying setting information.

[0299] refer to Fig.17 , in operation S1705, the electronic device 100 may receive power. Power may be supplied to each hardware component included in the electronic device 100. In operation S1710, the electronic device 100 may identify whether a setting screen is provided to the first user. In the case where the setting screen is not provided to the first user (S1710-N), in operation S1715, the electronic device 100 may output a projection image based on basic setting information.

[0300] When it is identified that the setting screen is provided to the first user (S1710-Y), in operation S1720, the electronic device 100 may provide the setting screen to the first user. In operation S1725, the electronic device 100 may identify whether a user input for setting is received. When the user input for setting is not received (S1725-N), in operation S1715, the electronic device 100 may output a projection image based on the basic setting information.

[0301] When receiving a user input for setting (S1725-Y), the electronic device 100 may store setting information corresponding to the user input in operation S1730. In operation S1735, the electronic device 100 may output a projection image based on the setting information corresponding to the user input.

[0302] Fig.18 is a flowchart for explaining an operation of applying setting information corresponding to environment information.

[0303] refer to Fig.18In operation S1805, the electronic device 100 may obtain sensing data through the sensor 113. In operation S1810, the electronic device 100 may determine whether environmental information is recognized. When environmental information is not recognized (S1810-N), in operation S1815, the electronic device 100 may output a projection image based on basic setting information. The environmental information may include at least one of information about the device, information about the projection plane, and information about the object. The electronic device 100 may recognize environmental information based on the sensing data.

[0304] When the environment information is recognized (S1810-Y), the electronic device 100 may determine whether setting information corresponding to the environment information is recognized in operation S1820. When the setting information corresponding to the environment information is not recognized (S1810-N), the electronic device 100 may output a projection image based on the basic setting information in operation S1815.

[0305] When the setting information corresponding to the environment information is identified (S1820-Y), in operation S1815, the electronic apparatus 100 may output a projection image based on the setting information.

[0306] Fig.19 is a flowchart for explaining an operation of applying setting information corresponding to space information.

[0307] refer to Fig.19 In operation S1905, the electronic device 100 may obtain sensing data through the sensor 113. In operation S1910, the electronic device 100 may determine whether to identify predetermined space information based on the sensing data. The space information may indicate information about the space pre-stored in the electronic device 100. For example, the user may pre-store information about a space that the user frequently uses, and the electronic device 100 may apply the pre-stored setting information to output a projection image in the corresponding space.

[0308] When the predetermined space information is not recognized (S1910-N), the electronic device 100 may output a projection image based on the basic setting information in operation S1915.

[0309] When the predetermined space information is recognized (S1910-Y), the electronic device 100 may output a projection image based on setting information corresponding to the space information in operation S1920.

[0310] Fig. 20 A table for explaining the spatial information is shown.

[0311] refer to Fig. 20Table 2010, the electronic device 100 may include different setting information for each space. The setting information may include at least one of information about images, information about audio, and information about objects. The information about images may include at least one of a projection ratio, resolution, brightness, and contrast of the image. The information about audio may include at least one of the volume, channel, and effect of the audio. The effect may indicate a sound effect based on spatial characteristics. The effect may be described as enhancement. The information about objects may include at least one of the type and position of the object.

[0312] The electronic device 100 may pre-store different setting information for each space based on the user's setting. When a specific space is identified based on the sensing data, the electronic device 100 may output a projection image based on the setting information corresponding to the identified space.

[0313] Fig.21 is a flowchart for explaining an example in which environmental information is changed.

[0314] refer to Fig.21 In operation S2105, the electronic device 100 may obtain sensing data through the sensor 113. In operation S2110, the electronic device 100 may identify first environmental information based on the sensing data. In operation S2115, the electronic device 100 may output a projection image based on first setting information corresponding to the first environmental information.

[0315] In operation S2120, the electronic device 100 may identify whether the first environment information is changed to the second environment information. In the case where the first environment information is not changed to the second environment information (S2120-N), the electronic device 100 may repeatedly output the projection image based on the first setting information.

[0316] In a case where the first environment information is changed to the second environment information (S2120-Y), in operation S2125, the electronic device 100 may output a projection image based on second setting information corresponding to the second environment information.

[0317] Fig. 22 is a flowchart for explaining an operation of obtaining sensing data based on the motion of the electronic device 100 .

[0318] refer to Fig. 22In operation S2205, the electronic device 100 may obtain sensing data of the first sensor and the second sensor. In operation S2210, the electronic device 100 may identify first environmental information based on the sensing data. In operation S2215, the electronic device 100 may output a projection image based on first setting information corresponding to the first environmental information. In operation S2220, the electronic device 100 may identify a movement of the electronic device 100 based on the sensing data of the second sensor.

[0319] When it is recognized that the electronic apparatus 100 is not moved (S2220-N), the electronic apparatus 100 may repeatedly output the projection image based on the first setting information.

[0320] When it is recognized that the electronic device 100 moves (S2220-Y), in operation S2225, the electronic device 100 may obtain sensing data of the first sensor and the second sensor. In operation S2230, the electronic device 100 may recognize whether the first environment information is changed to the second environment information.

[0321] In various examples, after detecting the motion of the electronic device 100, the electronic device 100 may obtain sensing data in real time through the first sensor 113-1 and the second sensor 113-2. The electronic device 100 may obtain the second environment information in real time based on the sensing data.

[0322] In various examples, if the motion of the electronic device 100 is not detected within a predetermined time after the motion of the electronic device 100 is detected, the electronic device 100 may obtain sensing data through the first sensor 113-1 and the second sensor 113-2. The electronic device 100 may obtain second environmental information based on the sensing data.

[0323] In a case where the first environment information is not changed to the second environment information (S2230-N), the electronic device 100 may repeatedly output the projection image based on the first setting information.

[0324] In a case where the first environment information is changed to the second environment information (S2230-Y), in operation S2235, the electronic device 100 may output a projection image based on second setting information corresponding to the second environment information.

[0325] Fig.23 is a flowchart for explaining an operation of outputting a projection image without adjusting the projection ratio.

[0326] refer to Fig.23, in operation S2305, the electronic device 100 may obtain sensing data. The electronic device 100 may obtain a first distance between the electronic device 100 and the projection plane 10. In operation S2310, the electronic device 100 may output a projection image 10 having a first projection size to the projection plane based on the first distance and the first projection ratio. In operation S2315, the electronic device 100 may identify whether the first distance is changed to a second distance.

[0327] In a case where the first distance is not changed to the second distance ( S2315 -N), the electronic device 100 may repeatedly output a projection image having a first projection size to the projection plane 10 based on the first distance and the first projection ratio.

[0328] In the case where the first distance is changed to the second distance (S2315-Y), in operation S2320, the electronic device 100 may change the size of the projection image based on the ratio of the first distance to the second distance. In operation S2325, the electronic device 100 may output the changed projection image having the first projection size to the projection plane 10 based on the first distance, the second distance and the first projection ratio. Fig.28 Describe the detailed calculation method related to this.

[0329] Fig.24 This is a flowchart for explaining an operation of outputting a projection image by adjusting the projection ratio.

[0330] Fig.24 Operations S2405, S2410, and S2415 may correspond to Fig.23 Therefore, repeated description thereof is omitted.

[0331] In the case where the first distance is changed to the second distance (S2415-Y), in operation S2420, the electronic device 100 may identify a second projection ratio based on the second distance and the first projection size. In operation S2425, the electronic device 100 may output a projection image having the first projection size to the projection plane 10 based on the second distance and the second projection ratio. Fig.28 Describe the detailed calculation method related to this.

[0332] Fig.25 : is a flowchart for explaining an operation of outputting a projection image by adjusting the projection ratio while further considering the critical ratio.

[0333] Fig.25 Operations S2505, S2510, S2515, and S2520 may correspond to Fig.24 Therefore, repeated description thereof is omitted.

[0334] After obtaining the second projection ratio, in operation S2525, the electronic device 100 may identify whether the second projection ratio is less than the first critical ratio. The first critical ratio may indicate the lowest critical projection ratio of the electronic device 100. In the case where the second projection ratio is less than the first critical ratio (S2525-Y), in operation S2530, the electronic device 100 may change the size of the projected image based on the first projection size, the second distance, and the first critical ratio. In operation S2535, the electronic device 100 may output the changed projection image having the first projection size to the projection plane 10 based on the first distance, the second distance, and the first critical ratio. Reference Fig.30 Describe the calculations associated with this.

[0335] In the case where the second projection ratio is not less than the first critical ratio (S2525-N), in operation S2540, the electronic device 100 may identify whether the second projection ratio is the second critical ratio or less. The second critical ratio may indicate the highest critical projection ratio of the electronic device 100. In the case where the second projection ratio is the second critical ratio or less (S2540-Y), in operation S2545, the electronic device 100 may output a projection image having a first projection size to the projection plane 10 based on the second distance and the second projection ratio.

[0336] In case the second projection ratio is not the second critical ratio or less (S2540-Y), in operation S2550, the electronic device 100 may provide the user with information for guiding the movement of the electronic device 100. In case the second projection ratio is greater than the second critical ratio, the electronic device 100 may display a guide screen to the user.

[0337] Fig.26 1 is a diagram for explaining an example in which the distance between the electronic device 100 and the projection plane 10 is reduced.

[0338] Fig.26 An example in which the electronic device 100 approaches the projection plane 10 is shown.

[0339] In example 2610 , x1 may be the distance between the electronic device 100 and the projection plane 10 , and y1 may be the projection size of the outputted projection image.

[0340] In example 2620, x2 may be the distance between the electronic device 100 and the projection plane 10, and y2 may be the projection size of the output projection image. Fig.26 , x2 can be a value smaller than x1, and y2 can be a value smaller than y1.

[0341] In example 2630, when the distance between the electronic device 100 and the projection plane 10 is reduced, the electronic device 100 may change the image size without adjusting the projection ratio. For example, the electronic device 100 may not have a function of adjusting the projection ratio, or may not output a projection image with an existing projection size y1 when adjusting the projection ratio. In this case, the electronic device 100 may output a projection image with a first projection size by changing the image size itself. In example 2630, the image size may be changed (or increased) without adjusting the projection ratio, so the image area may be increased and the remaining area may be reduced compared to example 2620.

[0342] In example 2640, the electronic device 100 may adjust the projection ratio in the case where the distance between the electronic device 100 and the projection plane 10 is reduced. The electronic device 100 may output a projection image having an existing projection size y1 by adjusting the projection ratio.

[0343] Fig. 27 1 is a diagram for explaining an example in which the distance between the electronic device 100 and the projection plane 10 increases.

[0344] In example 2710 , x1 may be the distance between the electronic device 100 and the projection plane 10 , and y1 may be the projection size of the outputted projection image.

[0345] In example 2720, x2 may be the distance between the electronic device 100 and the projection plane 10, and y2 may be the projection size of the output projection image. Fig. 27 , x2 can be a value greater than x1, and y2 can be a value greater than y1.

[0346] In example 2730, when the distance between the electronic device 100 and the projection plane 10 increases, the electronic device 100 may change the image size without adjusting the projection ratio. For example, the electronic device 100 may not have a function of adjusting the projection ratio, or even if the projection ratio is adjusted, a projection image with an existing projection size y1 may not be output. In this case, the electronic device 100 may output a projection image with a first projection size by changing the image size itself. In example 2730, the image size may be changed (or reduced) without adjusting the projection ratio, so the image area may be reduced and the remaining area may be increased compared to example 2720.

[0347] In example 2740, the electronic device 100 may adjust the projection ratio in the case where the distance between the electronic device 100 and the projection plane 10 increases. The electronic device 100 may output a projection image having an existing projection size y1 by adjusting the projection ratio.

[0348] Fig.28 1 is a diagram for explaining an operation of outputting a projection image by the electronic device 100 in a case where the distance between the electronic device 100 and the projection plane 10 is changed.

[0349] refer to Fig.28 In example 2810, x1 may be the distance between the electronic device 100 and the projection plane 10, and y1 may be the projection size of the output projection image. The projection ratio may be y1 / x1.

[0350] In example 2820, x2 may be the distance between the electronic device 100 and the projection plane 10, and y2 may be the projection size of the output projection image. The projection ratio may be y2 / x2 (or y1 / x1).

[0351] In example 2830, when the distance between the electronic device 100 and the projection plane 10 changes, the electronic device 100 may change the image size without adjusting the projection ratio. The electronic device 100 may change the size by multiplying the existing image size by y1 / y2 (or x1 / x2). Then, the electronic device 100 may output the changed projection image. The projection ratio may be y2 / x2 (or y1 / x1). y1 may be the projection size of the projection image.

[0352] In example 2840, when the distance between the electronic device 100 and the projection plane 10 changes, the electronic device 100 can adjust the projection ratio. The electronic device 100 can output a projection image with an existing projection size y1 by adjusting the projection ratio. The projection ratio may be y1 / x2. y1 may be the projection size of the projection image.

[0353] Fig.29 It is a diagram for explaining the critical ratio.

[0354] refer to Fig.29 , the projection ratio may be set to a predetermined range based on the characteristics of the electronic device 100. For example, the projection ratio may be limited to 1 to 1.5. The projection ratio is only an example and may be different based on the characteristics of the lens included in the electronic device 100.

[0355] Referring to example 2910, the range of the projection ratio of the electronic device 100 may be a first critical ratio or greater and a second critical ratio or less. The first critical ratio may be y_th1 / x_th. The second critical ratio may be yth2_xth. x_th, y_th1, or y_th2 may only indicate a value measured at a reference distance and may not be an absolute value required for calculating the projection ratio.

[0356] y_th1 may be a projection size of the projection image when projected at the reference distance x_th at a first critical ratio. Therefore, the first critical ratio may indicate a lowest critical projection ratio.

[0357] y_th2 may be a projection size of the projection image when projected at the reference distance x_th at the second critical ratio. Therefore, the second critical ratio may indicate a highest critical projection ratio.

[0358] Fig.30 1 is a diagram for explaining an operation of considering the highest critical ratio in an example in which the distance between the electronic device 100 and the projection plane 10 increases.

[0359] refer to Fig.30 , the electronic device 100 may change the projection ratio and the image size in consideration of the critical ratio.

[0360] In example 3010, x1 may be the distance between the electronic device 100 and the projection plane 10, and y1 may be the projection size of the output projection image. The projection ratio may be y1 / x1.

[0361] In example 3020, x2 may be the distance between the electronic device 100 and the projection plane 10, and y2 may be the projection size of the output projection image. The projection ratio may be y2 / x2 (or y1 / x1).

[0362] The electronic device 100 may not be able to provide a projection ratio required to output a projection image having the existing projection size y1. The electronic device 100 may adjust the projection ratio to be almost a first critical ratio, which is a minimum critical ratio.

[0363] In example 3030, the electronic device 100 may minimize the projection ratio so that a projection image with a minimum size will be displayed. The electronic device 100 may adjust the projection ratio to a first critical ratio p_th1. The projection size may be x2*p_th1. The projection size x2*p_th1 may indicate the minimum size of the projection image at the current distance x2. The electronic device 100 may change the image size to output a projection image with an existing projection size y1.

[0364] In example 3040, the electronic device 100 may change the size by multiplying the existing image size by y1 / (x2*p_th1). Then, the electronic device 100 may output the changed projection image to the projection plane 10. The projection ratio may be p_th1. y1 may be the projection size of the projection image.

[0365] Fig.31 is a diagram for explaining an operation of considering the lowest critical ratio in an example in which the distance between the electronic device 100 and the projection plane 10 decreases.

[0366] refer to Fig.31 , the electronic device 100 may change the projection ratio and the image size in consideration of the critical ratio.

[0367] In example 3110, x1 may be the distance between the electronic device 100 and the projection plane 10, and y1 may be the projection size of the output projection image. The projection ratio may be y1 / x1.

[0368] In example 3120, x2 may be the distance between the electronic device 100 and the projection plane 10, and y2 may be the projection size of the output projection image. The projection ratio may be y2 / x2 (or y1 / x1).

[0369] The electronic device 100 may not be able to provide a projection ratio required to output a projection image having the current projection size y1. The electronic device 100 may adjust the projection ratio to a second critical ratio at most, which is the highest critical ratio.

[0370] In example 3130, the electronic device 100 may maximize the projection ratio so that a projection image having a maximum size will be displayed. The electronic device 100 may adjust the projection ratio to a second critical ratio p_th2. The projection size may be x2*p_th2. The projection size x2*p_th2 may indicate the maximum size of the projection image at the current distance x2. Fig.30 Unlike the example of , in the case where the distance becomes too close, the size may exceed the limitation of the projection ratio. Therefore, even if the image size is changed, the projection image with the original projection size y1 cannot be output. Therefore, the electronic device 100 can notify the user of the limitation.

[0371] In example 3140, the electronic device 100 may provide the user with one of the following information: information 3141 indicating that the current situation exceeds the limit of the projection ratio; or information 3142 indicating that it is necessary to move the electronic device 100. The information 3142 directing the need to move the electronic device 100 may include information requesting that the projector be moved away from the projection plane.

[0372] Fig.32 : is a diagram for explaining leveling correction in various examples.

[0373] In example 3210 , the electronic device 100 may output a projection image 3211 to the projection plane 10 in a stable state.

[0374] In example 3220, based on the movement of the electronic device 100, the electronic device 100 may rotate counterclockwise around the x-axis while facing the projection plane 10. Therefore, both the projection image 3221 and the output region 3222 in which the projection image 3221 is output may be rotated.

[0375] In example 3230, the electronic device 100 may correct (or change) the image by performing a leveling correction (or a keystone correction based on x-axis rotation). Then, the electronic device 100 may output the corrected projection image 3231 to the projection plane 10. In addition to the operation of rotating the projection image, the electronic device 100 may also change the size of the projection image based on the output area 3222. The electronic device 100 may change the size of the projection image so that the corrected projection image 3231 is output in the output area 3222.

[0376] Fig.33 : is a diagram for explaining leveling correction in various examples.

[0377] Fig.33 Examples 3310, 3320, and 3330 may correspond to Fig.32 Examples 3210, 3220, and 3230. Therefore, repeated descriptions thereof are omitted.

[0378] However, with Fig.32 different, Fig.33 The example of exemplifies that the electronic device 100 rotates clockwise around the x-axis.

[0379] Fig.34 are diagrams for explaining the keystone correction function in various examples.

[0380] In example 3410 , the electronic device 100 may output a projection image 3411 to the projection plane 10 in a stable state.

[0381] In example 3420, based on the movement of the electronic device 100, the electronic device 100 may rotate in a specific direction (e.g., counterclockwise) around the y-axis when facing the projection plane 10. Therefore, both the projection image 3421 and the output area 3422 in which the projection image 3421 is output may be rotated. In a state where the electronic device 100 rotates around the y-axis, the projection image 3421 may be distorted and then output to the output area 3422 of the projection plane 10. The distorted shape may be a trapezoid or a rotated trapezoid.

[0382] In example 3430, the electronic device 100 may correct (or change) an image by performing a trapezoidal correction based on a y-axis rotation. The trapezoidal correction may indicate an operation of manually correcting an original image so that the image is output in a rectangular shape. After performing the trapezoidal correction, the electronic device 100 may output a corrected projection image 3431 to the projection plane 10. In addition to the operation of correcting the projection image, the electronic device 100 may also change the size of the projection image based on the output area 3422. The electronic device 100 may change the size of the projection image so that the corrected projection image 3431 is output in the output area 3422.

[0383] Fig.35 are diagrams for explaining the keystone correction function in various examples.

[0384] Fig.35 Examples 3510, 3520, and 3530 may correspond to Fig.34 Examples 3410, 3420 and 3430. Therefore, repeated descriptions thereof are omitted.

[0385] However, with Fig.34 different, Fig.35 The example shows that the electronic device 100 rotates clockwise around the y-axis.

[0386] Fig.36 are diagrams for explaining the keystone correction function in various examples.

[0387] In example 3610, the electronic device 100 may output a projection image 3611 to the projection plane 10 in a stable state.

[0388] In example 3620, based on the movement of the electronic device 100, the electronic device 100 may rotate in a specific direction (e.g., counterclockwise) around the z-axis when facing the projection plane 10. Therefore, both the projection image 3621 and the output area 3622 in which the projection image 3621 is output may be rotated. In a state where the electronic device 100 rotates around the z-axis, the projection image 3621 may be distorted and then output to the output area 3622 of the projection plane 10. The distorted shape may be a trapezoid or a rotated trapezoid.

[0389] In example 3630, the electronic device 100 may correct (or change) an image by performing a keystone correction based on a z-axis rotation. Keystone correction may indicate an operation of manually correcting an original image so that the image is output in a rectangular shape. After performing the keystone correction, the electronic device 100 may output a corrected projection image 3631 to the projection plane 10. In addition to the operation of correcting the projection image, the electronic device 100 may also change the size of the projection image based on the output area 3622. The electronic device 100 may change the size of the projection image so that the corrected projection image 3631 is output in the output area 3622.

[0390] Fig.37 are diagrams for explaining the keystone correction function in various examples.

[0391] Fig.37 Examples 3710, 3720, and 3730 may correspond to Fig.36 Examples 3610, 3620 and 3630. Therefore, repeated description thereof is omitted.

[0392] However, with Fig.36 different, Fig.37 The example shows that the electronic device 100 rotates clockwise around the z-axis.

[0393] Fig.38 are diagrams for explaining the keystone correction function in various examples.

[0394] Fig.38 Examples 3810, 3820, and 3830 may correspond to Fig.37 Examples 3410, 3420 and 3430. Therefore, redundant descriptions thereof are omitted.

[0395] In example 3820 , in the case where the movement of the electronic device 100 is relatively violent, the projection image 3821 and the output area 3822 to which the projection image 3821 is output may be output outside the projection plane 10 .

[0396] In example 3830, the electronic device 100 may also consider the projection plane 10 and the output area 3822 when performing keystone correction. The electronic device 100 may adjust the image size so that the projection image 3831 is not output outside the projection plane 10.

[0397] Fig.39 are diagrams for explaining the lens shift function in various examples.

[0398] In example 3910, the electronic device 100 may output a projection image 3911 to the projection plane 10 in a stable state.

[0399] In example 3920, based on the movement of the electronic device 100, the electronic device 100 may be positioned on the right based on the center of the projection plane 10. The electronic device 100 may output a projection image 3921 on the right based on the center of the projection plane 10.

[0400] In example 3930, the electronic device 100 can change the direction of the lens output light by moving the lens. The electronic device 100 can shift the lens to output light to the left based on the front of the projection plane 10 instead of the front of the electronic device 100. Therefore, the projection image 3931 can be output at the center of the projection plane 10 through the lens shift function. Since the lens shift function is performed, in the event of image distortion, keystone correction can also be performed. Fig.39 Embodiment 3930 shows a case where keystone correction is performed to correct distortion. However, since the lens shift function is performed, keystone correction may not be performed when no image distortion occurs.

[0401] Fig.40 is a diagram for explaining operations using information about an object in various examples.

[0402] refer to Fig.40 , the electronic device 100 may change the position at which the projection image is output by using the information about the object.

[0403] In example 4010, the electronic device 100 may recognize an object around the electronic device 100 through a camera module. The electronic device 100 may recognize an object 30 existing around the projection plane 10.

[0404] In example 4020, the electronic device 100 may output a projection image 4021 by avoiding the position of the object 30 on the projection plane 10. The electronic device 100 may determine the remaining area in the projection plane 10 except the area where the object 30 is located as the output area. The electronic device 100 may output the projection image 4021 to the determined remaining area.

[0405] When the predetermined object 30 is recognized, the electronic device 100 may output audio corresponding to the predetermined object 30. For example, in case a flower pot is recognized, the electronic device 100 may output music represented as A corresponding to the flower pot through the audio outputter 117 (eg, speaker).

[0406] Fig.41 is a diagram for explaining operations using information about an object in various examples.

[0407] refer to Fig.41 , the electronic device 100 may change the position at which the projection image is output by using the information about the object.

[0408] In example 4110, the electronic device 100 may obtain information about the object. The information about the object may be information indicating that the object 30 exists in the left area of ​​the projection plane 10. Therefore, the projection image 4111 may be output to the right area of ​​the projection plane 10.

[0409] In example 4120, the electronic device 100 may recognize in real time (or every predetermined time unit) whether there is an object 30. In the absence of the object 30, the electronic device 100 may display a projection image 4121 on the right area of ​​the projection plane 10 as before.

[0410] In example 4130, the electronic device 100 may detect that there is no object 30. In the case where the object 30 is recognized to be absent, the electronic device 100 may output a projection image 4131 based on the entire area of ​​the projection plane 10. Therefore, the size of the projection image 4131 displayed in example 4131 may be larger than the size of the projection image 4121 displayed in example 4120. Therefore, visibility may be better from the user's perspective.

[0411] Fig.42 is a flowchart for explaining operations of using information about objects in various examples.

[0412] Fig.42 Operations S4205, S4210, S4215, and S4220 may correspond to Fig.21 Therefore, repeated description thereof is omitted.

[0413] When the first environment information is changed to the second environment information (S4220-Y), the electronic device 100 may output a guide image for applying second setting information corresponding to the second environment information in operation S4225. In operation S4230, the electronic device 100 may identify whether a user input is received through the guide image.

[0414] In case that the user input for applying the second setting information is not received through the guide image (S4230-N), the electronic device 100 may repeatedly output the projection image based on the first setting information.

[0415] In case of receiving a user input for applying the second setting information through the guide image (S4230-Y), the electronic device 100 may output a projection image based on the second setting information corresponding to the second environment information in operation S4235.

[0416] Fig.43is a diagram of an operation of providing a guide image to a user in various examples according to an embodiment of the present disclosure.

[0417] In example 4310, the electronic device 100 may output at least one of the following items: UI 4311 for guiding application of new setting information (e.g., indicating whether new setting information is required or whether an environmental change is detected); or UI 4312 for receiving user input. The UI 4311 for guiding application of new setting information may include text information.

[0418] The UI 4321 and UI 4324 of example 4320 may correspond to the UI 4311 and UI 4312 of example 4310. The electronic device 100 may also output UI 4322 and UI 4323 for guiding the projection image to which the setting information is applied. The UI 4322 may include an image displaying the projection image output based on the current setting information. The UI 4323 may include an image displaying the projection image output based on the setting information to be changed. The user may easily grasp how to change the setting information through the UI 4322 and UI 4323.

[0419] For example, the electronic device 100 may be rotated rightward (or clockwise around the y-axis) when facing the projection plane 10 based on the movement of the electronic device 100. The UI 4322 may display a projection image output based on the current state of the electronic device 100 and the existing setting information (or the first setting information). The UI 4323 may display a projection image output based on the current state of the electronic device 100 and the setting information (or the second setting information) to be changed. The UI 4323 may include a projection image on which keystone correction is completed. In addition, the UI 4322 and the UI 4323 may include text information corresponding to each case.

[0420] Fig.44 : is a diagram for explaining an operation of providing a guide image to a user in various examples.

[0421] Fig.44 Example 4410 assumes that Fig.40 The electronic device 100 may provide a guide image for applying new setting information by recognizing the object 30.

[0422] UIs 4411 , 4412 , 4413 , and 4414 of Example 4410 may correspond to UIs 4321 , 4322 , 4323 , and 4324 of Example 4320 .

[0423] For example, the electronic device 100 may identify the object 30 in the partial area of ​​the projection plane 10 based on the movement of the electronic device 100. The UI 4412 may display a projection image output based on the current state of the electronic device 100 and the existing setting information (or the first setting information). The UI 4413 may display a projection image output based on the current state of the electronic device 100 and the setting information (or the second setting information) to be changed. The UI 4423 may include a projection image output to an area avoiding the object 30. In addition, the UIs 4412 and 4413 may include text information corresponding to each case.

[0424] Fig.45 : is a diagram for explaining an operation of providing a guide image to a user in various examples.

[0425] Fig.45 The example 4510 assumes that Fig.41 The electronic device 100 may provide a guide image for applying new setting information if the object 30 is not recognized.

[0426] UIs 4511 , 4512 , 4513 , and 4514 of example 4510 may correspond to UIs 4321 , 4322 , 4323 , and 4324 of example 4320 .

[0427] For example, the electronic device 100 may no longer recognize that the object 30 exists in a partial area of ​​the projection plane 10 based on the movement of the electronic device 100. UI 4512 may display a projection image output based on the current state of the electronic device 100 and the existing setting information (or the first setting information). UI 4513 may display a projection image output based on the current state of the electronic device 100 and the setting information to be changed (or the second setting information). UI 4512 may display information (e.g., a dotted line) indicating the location where the object 30 once existed. UI 4513 may include a projection image output to the projection plane 10 where the object 30 does not exist. In addition, UIs 4512 and 4513 may include text information corresponding to each situation.

[0428] Fig.46 1 is a flowchart for explaining an operation of outputting audio by the electronic device 100 in a case where the distance between the electronic device 100 and the projection plane 10 changes.

[0429] refer to Fig.46In operation S4605, the electronic device 100 may obtain sensing data. Then, in operation S4610, the electronic device 100 may identify a distance between the user and the electronic device 100 based on the sensing data. The identified distance may be a first distance. In operation S4615, the electronic device 100 may output audio based on first setting information corresponding to the first distance.

[0430] In operation S4620, the electronic device 100 may identify whether the distance between the user and the electronic device 100 is changed to the second distance. The electronic device 100 may identify the distance between the user and the electronic device 100 based on the sensing data obtained in real time (or in a predetermined time unit). In addition, the electronic device 100 may identify whether the distance between the user and the electronic device 100 is changed.

[0431] In the case where the distance between the user and the electronic device 100 does not change (S4620-N), the electronic device 100 may repeatedly output audio based on the first setting information. In the case where the distance between the user and the electronic device 100 changes (S4620-Y), in operation S4625, the electronic device 100 may output audio based on the second setting information corresponding to the changed distance (or the second distance).

[0432] The first setting information or the second setting information may include at least one of volume, channel, or effect of the audio.

[0433] Fig.47 1 is a flowchart for explaining an operation of outputting audio by the electronic device 100 in a case where the distance between the electronic device 100 and the projection plane 10 changes.

[0434] refer to Fig.47 , the electronic device 100 may output the volume of the audio differently based on the distance between the electronic device 100 and the user.

[0435] In example 4710, the first distance x1 may be the distance between the electronic device 100 and the user. The electronic device 100 may output audio having a volume corresponding to the first distance x1.

[0436] In example 4720, the second distance x2 may be the distance between the electronic device 100 and the user. The electronic device 100 may output audio having a volume corresponding to the second distance x2.

[0437] As the distance between the user and the electronic device 100 decreases, the electronic device 100 can output audio with a lower volume. On the other hand, as the distance between the user and the electronic device 100 increases, the electronic device 100 can output audio with a higher volume. The reason is that the farther the user is away, the more likely the user will not hear the sound. Even if the user leaves, the volume of the audio is increased, and the user can hear constant audio based on the distance.

[0438] For example, 3 may be the volume of the audio corresponding to the first distance x1. In the case where the second distance x2 is greater than the first distance x1, 5 may be the volume of the audio corresponding to the second distance x2. The higher the volume, the louder the sound can be output.

[0439] Fig.48 1 is a flowchart for explaining an operation of changing the brightness of a projected image by the electronic device 100 when the distance between the electronic device 100 and the projection plane 10 changes.

[0440] Fig.48 Operations S4805, S4810, and S4820 may correspond to Fig.46 Therefore, repeated description thereof is omitted.

[0441] In a case where it is recognized that the first distance is the distance between the projection plane 10 and the electronic device 100 , the electronic device 100 may output a projection image based on first setting information corresponding to the first distance.

[0442] After outputting the projection image based on the first setting information, the electronic device 100 may identify whether the first distance is changed based on the sensing data. In the case where the first distance is not changed (S4820-N), the electronic device 100 may repeatedly output the projection image based on the first setting information. In the case where the first distance is changed (S4820-Y), in operation S4825, the electronic device 100 may output the projection image based on the second setting information corresponding to the changed second distance.

[0443] The first setting information or the second setting information may include at least one of a projection ratio, a resolution, a brightness, or a contrast of an image.

[0444] Fig.49 1 is a flowchart for explaining an operation of changing the brightness of a projected image by the electronic device 100 when the distance between the electronic device 100 and the projection plane 10 changes.

[0445] refer to Fig.49 , the electronic device 100 may output the brightness of the image differently based on the distance between the electronic device 100 and the projection plane 10 .

[0446] In example 4910, the first distance x1 may be a distance between the electronic device 100 and the projection plane 10. The electronic device 100 may output an image having a brightness corresponding to the first distance x1.

[0447] In example 4920, the second distance x2 may be the distance between the electronic device 100 and the projection plane 10. The electronic device 100 may output an image having a brightness corresponding to the second distance x2.

[0448] As the distance between the projection plane 10 and the electronic device 100 decreases, the electronic device 100 can output an image with lower brightness. On the other hand, as the distance between the projection plane 10 and the electronic device 100 increases, the electronic device 100 can output an image with higher brightness. The reason is that as the projection plane 10 is farther away, the output projection image looks lighter. Even in the case where the projection plane 10 is farther away, the brightness of the image can be higher, and a constant brightness can be provided to the user based on the difference in distance.

[0449] For example, 3 may be the brightness of the image corresponding to the first distance x1. In the case where the second distance x2 is greater than the first distance x1, 5 may be the brightness of the image corresponding to the second distance x2.

[0450] Fig.50 1 is a diagram for explaining a system including an electronic device 100 and a terminal device 200 .

[0451] refer to Fig.50 , the electronic device 100 can communicate with the terminal device 200. The terminal device 200 can indicate the user's device, and the electronic device 100 and the terminal device 200 can be connected to each other in a wireless manner. The projection image projected by the electronic device 100 can also be displayed on the terminal device 200. The terminal device 200 can display the projection image to be output by the electronic device 100 through a display included in the terminal device 200.

[0452] The terminal device 200 may transmit the projection image to be output to the projection plane 10 to the electronic apparatus 100. In addition, the electronic apparatus 100 may output the projection image received from the terminal device 200.

[0453] The terminal device 200 may display a guide image for user input on a display included in the terminal device 200. Figure 42 to Figure 45 The described guide image is described as being output from the electronic device 100. In various examples, the terminal device 200 may display the reference image based on a control signal received from the electronic device 100. Figure 42 to Figure 45 Describe the boot image.

[0454] The terminal device 200 may receive a user input through the displayed guide image. The terminal device 200 may transmit information corresponding to the received user input to the electronic device 100.

[0455] The electronic apparatus 100 may output a projection image based on the new setting information according to information corresponding to the user input received from the terminal device 200 .

[0456] Fig.51 is a flowchart of a control method of an electronic device according to an embodiment of the present disclosure.

[0457] refer to Fig.51 , a control method for an electronic device, the electronic device comprising: a first sensor for detecting a distance between the electronic device and a projection plane; and a second sensor for detecting an inclination of the electronic device, the control method may include: in operation S5105, obtaining first environmental information through the first sensor and the second sensor; in operation S5110, outputting a projection image to the projection plane based on first setting information corresponding to the first environmental information among a plurality of setting information; in operation S5115, in a case where a movement of the electronic device is detected through the second sensor, obtaining second environmental information through the first sensor and the second sensor; and in operation S5120, in a case where it is recognized that the first environmental information is changed to the second environmental information, outputting a projection image to the projection plane based on the second setting information corresponding to the second environmental information.

[0458] The first environmental information or the second environmental information may include at least one of information about the inclination of the electronic device, information about the distance between the electronic device and the projection plane, and information about identified objects around the electronic device, and the first setting information or the second setting information may include at least one of the projection ratio of the image, the resolution of the image, the brightness of the image, and the volume of the audio.

[0459] In operation S5115 of obtaining the second environmental information, when the motion of the electronic device is not detected within a predetermined time after the motion of the electronic device is detected by the second sensor, the second environmental information may be obtained by the first sensor and the second sensor.

[0460] In operation S5110 of outputting a projection image to a projection plane based on first setting information, when a first distance between the electronic device and the projection plane is included in the first environmental information, a projection image having a first projection size may be output to the projection plane based on the first distance and a first projection ratio.

[0461] In operation S5120 of outputting a projection image to a projection plane based on second setting information, when the second environmental information includes a second distance between the electronic device and the projection plane, a projection image having a first projection size can be output to the projection plane based on the first distance, the second distance, and the first projection ratio.

[0462] In operation S5120 of outputting the projection image to the projection plane based on the second setting information, the size of the projection image may be changed based on the ratio of the first distance to the second distance, and the changed projection image having the first projection size may be output to the projection plane.

[0463] In operation S5120 of outputting a projection image to the projection plane based on the second setting information, when the second distance between the electronic device and the projection plane is included in the second environment information, a projection image having a first projection size can be output to the projection plane based on the second distance and the second projection ratio.

[0464] In operation S5120 of outputting the projection image to the projection plane based on the second setting information, information about the second projection ratio may be obtained based on the second distance and the first projection size.

[0465] The control method may also include: when the first environmental information includes a first distance between the electronic device and the projection plane, outputting the projection image to the projection plane based on a first brightness corresponding to the first distance; and when the second environmental information includes a second distance between the electronic device and the projection plane, outputting the projection image to the projection plane based on a second brightness corresponding to the second distance.

[0466] The control method may further include, in a case where it is recognized that the first environment information is changed to the second environment information, outputting a UI for guiding whether to apply second setting information corresponding to the second environment information.

[0467] like Fig.51 The control method of the electronic device 100 shown in FIG. Figure 2 or Figure 3 The present invention may be performed by the electronic device 100 having a configuration of, and may also be performed by an electronic device having another configuration.

[0468] The methods in various examples of the present disclosure described above may be implemented in the form of an application that can be installed on an existing electronic device.

[0469] Furthermore, the methods in the various examples of the present disclosure described above may be implemented only by software upgrade or hardware upgrade of a conventional electronic device.

[0470] Furthermore, the various examples of the present disclosure described above may be performed by an embedded server included in the electronic device, or an external server of at least one of the electronic device or the display apparatus.

[0471] According to an embodiment of the present disclosure, the various examples described above may be implemented in software including instructions stored in a machine-readable storage medium (e.g., a computer-readable storage medium). A machine may be a device that calls stored instructions from a storage medium and operates based on the called instructions, and may include an electronic device in the disclosed embodiments. In the case where the instruction is executed by a processor, the processor may directly execute a function corresponding to the instruction, or other components may execute a function corresponding to the instruction under the control of the processor. The instruction may include code provided or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory" indicates that the storage medium is tangible and does not include a signal, and does not distinguish whether the data is stored semi-permanently or temporarily in the storage medium.

[0472] In addition, according to an embodiment of the present disclosure, the methods in the above various examples can be provided by being included in a computer program product. The computer program product can be traded between a seller and a buyer as a product. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or through an application store (e.g., Play Store TM ) Online distribution. When distributed online, at least part of the computer program product may be at least temporarily stored in a storage medium (eg, a manufacturer's server, an application store's server, or a memory of a relay server) or temporarily provided in the storage medium.

[0473] In addition, each component (e.g., module or program) in the various examples described above may include one entity or multiple entities, and some of the corresponding subcomponents described above may be omitted or other subcomponents may also be included in the various examples. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into one entity, and the functions performed by the respective corresponding components before integration may be performed in the same or similar manner. The operations performed by the modules, programs, or other components in the various examples may be performed in a sequential manner, in a parallel manner, in an iterative manner, or in a heuristic manner, at least some of the operations may be performed in a different order or omitted, or other operations may be added.

[0474] Although the embodiments of the present disclosure are shown and described above, the present disclosure is not limited to the above specific embodiments, and various modifications may be made by those skilled in the art to which the present disclosure belongs without departing from the scope and spirit of the present disclosure disclosed in the appended claims. These modifications also fall within the scope of the present disclosure.

Claims

1. An electronic device, include: Sensors, including: A first sensor configured to detect a distance between the electronic device and a projection plane; and a second sensor configured to detect a tilt of the electronic device; Memory; Projector; and At least one processor configured to: obtaining first environmental information through the first sensor and the second sensor; Based on first setting information corresponding to the first environment information among a plurality of setting information stored in the memory, controlling the projector to output a projection image to the projection plane; Based on detecting the movement of the electronic device through the second sensor, obtaining second environmental information through the first sensor and the second sensor; and Based on the change of the first environmental information to the second environmental information, the projector is controlled to output the projection image to the projection plane based on second setting information corresponding to the second environmental information.

2. The electronic device according to claim 1, in, The first environmental information or the second environmental information includes at least one of the following: information about the inclination of the electronic device, information about the distance between the electronic device and the projection plane, and information about objects around the electronic device, and The first setting information or the second setting information includes at least one of the following: a projection ratio of an image, a resolution of the image, a brightness of the image, and a volume of an audio.

3. The electronic device according to claim 1, in, The at least one processor is further configured to obtain the second environmental information through the first sensor and the second sensor based on not detecting the motion of the electronic device within a predetermined time after the motion of the electronic device is detected through the second sensor.

4. The electronic device according to claim 1, in, The at least one processor is further configured to: based on a first distance between the electronic device and the projection plane included in the first environmental information, control the projector to output a projection image having a first projection size to the projection plane based on the first distance and a first projection ratio.

5. The electronic device according to claim 4, in, The at least one processor is also configured to: based on the second distance between the electronic device and the projection plane included in the second environmental information, control the projector to output a projection image having the first projection size to the projection plane based on the first distance, the second distance and the first projection ratio.

6. The electronic device according to claim 5, in, The at least one processor is further configured to control the projector to perform the following operations: changing a size of the projected image based on a ratio of the first distance to the second distance; and The projection image having the changed size is output to the projection plane.

7. The electronic device according to claim 4, in, The at least one processor is further configured to: based on a second distance between the electronic device and the projection plane included in the second environmental information, control the projector to output a projection image having the first projection size to the projection plane based on the second distance and a second projection ratio.

8. The electronic device according to claim 7, in, The at least one processor is further configured to obtain information about the second projection ratio based on the second distance and the first projection size.

9. The electronic device according to claim 1, in, The at least one processor is further configured to: Based on a first distance between the electronic device and the projection plane included in the first environmental information, controlling the projector to output the projection image to the projection plane based on a first brightness corresponding to the first distance; as well as Based on a second distance between the electronic device and the projection plane included in the second environmental information, the projector is controlled to output the projection image to the projection plane based on a second brightness corresponding to the second distance.

10. The electronic device according to claim 1, in, The at least one processor is further configured to provide a user interface UI configured to indicate whether the second setting information corresponding to the second environment information is applied based on the first environment information being changed to the second environment information.

11. A method for controlling an electronic device, the electronic device comprising a first sensor and a second sensor, the first sensor being configured to detect a distance between the electronic device and a projection plane, the second sensor being configured to detect an inclination of the electronic device, the method include: obtaining first environmental information through the first sensor and the second sensor; outputting a projection image to the projection plane based on first setting information corresponding to the first environment information among a plurality of setting information; Based on detecting the movement of the electronic device through the second sensor, obtaining second environmental information through the first sensor and the second sensor; as well as Based on the change of the first environmental information to the second environmental information, the projection image is output to the projection plane based on second setting information corresponding to the second environmental information.

12. The method according to claim 11, in, The first environmental information or the second environmental information includes at least one of the following: information about the inclination of the electronic device, information about the distance between the electronic device and the projection plane, and information about objects around the electronic device, and The first setting information or the second setting information includes at least one of the following items: a projection ratio of an image, a resolution of the image, a brightness of the image, and a volume of an audio.

13. The method according to claim 11, in, The second environmental information is obtained through the first sensor and the second sensor based on that the motion of the electronic device is not detected within a predetermined time after the motion of the electronic device is detected through the second sensor.

14. The method according to claim 11, in, Outputting the projection image to the projection plane based on the first setting information includes: Based on the first distance between the electronic device and the projection plane included in the first environmental information, a projection image with a first projection size is output to the projection plane based on the first distance and a first projection ratio.

15. The method according to claim 14, in, Outputting the projection image to the projection plane based on the second setting information includes: Based on the second distance between the electronic device and the projection plane included in the second environmental information, a projection image having the first projection size is output to the projection plane based on the first distance, the second distance and the first projection ratio.

Images