Electronic apparatus and controlling method thereof

Abstract

An electronic device is disclosed. The electronic device comprises a memory for storing an image, a sensor unit including at least one sensor, a projection unit including a projection lens for outputting an image to a projection surface, and a processor that obtains distance information from the electronic device to the projection surface through the sensor unit, obtains output size information of the image based on the distance information to the projection surface obtained through the sensor unit, obtains projection surface information corresponding to the curvature of the projection surface through the sensor unit, obtains movement information of the projection lens based on the output size information of the image and the projection surface information, and controls the projection unit to output an image based on the movement information.

Description

Technology Field

[0001] The present disclosure relates to an electronic device that outputs an image through a projection unit and a method for controlling the same, and more specifically, to an electronic device and a method for controlling the same that control the output of an image to a projection surface including a curve. Background Technology

[0002] A projector can output an image to a projection surface through a projection unit. Here, the projection surface may have a very wide overall area where only flat parts exist, but in some cases, the space may be narrow, causing curvature.

[0003] For example, the projection plane can be divided into multiple regions (front or side). If an image is output across (or overlaps) multiple regions, there may be a problem with distortion.

[0004] In this case, if only corrections to reduce the existing image size are performed, a problem may arise where the image becomes excessively small. Additionally, if the user manually moves the projector, fine adjustments may be difficult, which could cause inconvenience to the user. The problem to be solved

[0005] The present disclosure is designed to improve upon the aforementioned problems, and the purpose of the present disclosure is to provide an electronic device and a method for controlling the same that output an image based on movement information for moving a projection lens using the size and projection plane information of the output image. means of solving the problem

[0006] An electronic device according to the present embodiment for achieving the above-described purpose includes a memory for storing an image, a sensor unit including at least one sensor, a projection unit including a projection lens for outputting the image to a projection surface, and a processor that obtains distance information from the electronic device to the projection surface through the sensor unit, obtains output size information of the image based on the distance information to the projection surface obtained through the sensor unit, obtains projection surface information corresponding to the curvature of the projection surface through the sensor unit, obtains movement information of the projection lens based on the output size information of the image and the projection surface information, and controls the projection unit to output the image based on the movement information.

[0007] Meanwhile, the sensor unit may include a distance sensor, and the movement information may include at least one of a movement direction and a movement distance, and the processor may control the projection unit so that the projection lens moves based on the movement direction and the movement distance.

[0008] Meanwhile, the processor can identify the curvature position of the projection surface, divide the projection surface into a first area and a second area based on the curvature position, identify either the first area or the second area as an output area, and control the projection unit to output the image to the identified output area.

[0009] Meanwhile, the processor can obtain the size of the first region and the size of the second region, and can identify the region with the larger size between the first region and the second region as the output region.

[0010] Meanwhile, the processor can identify the first area as the output area if the size of the first part output in the first area among the areas where the image is output is larger than the size of the second part output in the second area among the areas where the image is output.

[0011] Meanwhile, the processor can obtain the size of the output area, change the size of the image based on the size of the output area, and control the projection unit to output the changed image to the output area.

[0012] Meanwhile, the processor can change the size of the image while maintaining the aspect ratio of the image.

[0013] Meanwhile, the processor can obtain the size of the output area, and if the size of the output area is larger than the output size of the image, the size of the image can be enlarged, and if the size of the output area is smaller than the output size of the image, the size of the image can be reduced.

[0014] Meanwhile, the processor can acquire movement information based on a movement limit value corresponding to the projection lens, and if the movement distance included in the movement information is greater than the movement limit value, it can control the projection unit to output a UI (User Interface) for guiding the position of the electronic device.

[0015] Meanwhile, the sensor unit may include an image sensor, and the processor may determine whether the image is output to both the first area and the second area based on the captured image obtained through the image sensor when the projection surface includes a first area and a second area, and if the image is output to both the first area and the second area, it may obtain movement information of the projection lens.

[0016] A control method for an electronic device including a projection lens for outputting an image to a projection surface according to one embodiment of the present disclosure comprises the steps of: obtaining distance information from the electronic device to the projection surface; obtaining output size information of the image based on the distance information to the projection surface; obtaining projection surface information corresponding to the curvature of the projection surface; obtaining movement information of the projection lens based on the output size information of the image and the projection surface information; and outputting the image based on the movement information.

[0017] Meanwhile, the above movement information may include at least one of a movement direction and a movement distance, and the control method may further include a step of moving the projection lens based on the movement direction and the movement distance.

[0018] Meanwhile, the control method may further include the steps of identifying the curvature position of the projection surface, dividing the projection surface into a first area and a second area based on the curvature position, and identifying either the first area or the second area as an output area, and the step of outputting the image may output the image to the identified output area.

[0019] Meanwhile, the step of identifying either the first area or the second area as an output area may involve obtaining the size of the first area and the size of the second area, and identifying the area with the larger size between the first area and the second area as the output area.

[0020] Meanwhile, the step of identifying either the first area or the second area as an output area may be such that if the size of the first part output in the first area among the areas where the image is output is larger than the size of the second part output in the second area among the areas where the image is output, the first area may be identified as the output area.

[0021] Meanwhile, the control method may further include the step of obtaining the size of the output area and the step of changing the size of the image based on the size of the output area, and the step of outputting the image may output the changed image to the output area.

[0022] Meanwhile, the step of changing the size of the image can change the size of the image while maintaining the aspect ratio of the image.

[0023] Meanwhile, the control method may further include the step of obtaining the size of the output area, the step of enlarging the size of the image if the size of the output area is larger than the output size of the image, and the step of reducing the size of the image if the size of the output area is smaller than the output size of the image.

[0024] Meanwhile, the step of acquiring the movement information may acquire the movement information based on a movement limit value corresponding to the projection lens, and the control method may further include the step of outputting a UI (User Interface) for guiding the position of the electronic device if the movement distance included in the movement information is greater than the movement limit value.

[0025] Meanwhile, the step of acquiring the above movement information can identify whether the image is output to both the first area and the second area based on the captured image acquired through the image sensor when the projection surface includes the first area and the second area, and if the image is output to both the first area and the second area, the movement information of the projection lens can be acquired. Brief explanation of the drawing

[0026] FIG. 1 is a perspective view illustrating the appearance of an electronic device according to one embodiment of the present disclosure. FIG. 2a is a block diagram illustrating an electronic device according to one embodiment of the present disclosure. FIG. 2b is a block diagram illustrating the specific configuration of FIG. 2a. FIG. 3 is a perspective view illustrating the appearance of an electronic device according to other embodiments of the present disclosure. FIG. 4a is a perspective view illustrating the appearance of an electronic device according to another embodiment of the present disclosure. FIG. 4b is a perspective view illustrating the appearance of an electronic device according to another embodiment of the present disclosure. FIG. 4c is a perspective view illustrating the appearance of an electronic device according to another embodiment of the present disclosure. FIG. 4d is a perspective view showing the electronic device of FIG. 4c in a rotated state. Figure 5 is a flowchart illustrating the operation of outputting an image based on the movement information of the lens. Figure 6 is a diagram illustrating the operation of acquiring distance information. Figure 7 is a diagram illustrating the operation of obtaining size information of an output image. Figure 8 is a diagram illustrating the operation of identifying the bending position in the vertical direction. FIG. 9 is a diagram illustrating the operation of identifying the bending position in the horizontal direction. Figure 10 is a diagram illustrating the operation of analyzing a projection plane. FIG. 11 is a flowchart illustrating an operation to identify one of a plurality of regions included in a projection surface as an output region according to one embodiment. FIG. 12 is a diagram illustrating the operation of dividing a projection plane into multiple regions. FIG. 13 is a diagram illustrating the operation of identifying one of a plurality of regions as an output region. FIG. 14 is a diagram illustrating the operation of identifying an area excluding an object from a projection plane as an output area. FIG. 15 is a flowchart illustrating an operation to identify one of a plurality of regions included in a projection surface as an output region according to another embodiment. FIG. 16 is a diagram illustrating the operation of identifying the size of the area where an image is output in each of a plurality of areas. Figure 17 is a flowchart illustrating the operation of changing the size of an image based on the size of the output area. Figure 18 is a flowchart illustrating the operation of comparing the output size of an image and the size of the output area. FIG. 19 is a drawing for explaining the operation of reducing the size of an image and outputting it according to one embodiment. FIG. 20 is a drawing for explaining an embodiment in which an image is displayed in all of a plurality of regions connected in the horizontal direction. FIG. 21 is a drawing for explaining the operation of reducing the size of an image and outputting it according to another embodiment. FIG. 22 is a diagram illustrating the operation of expanding the size of an image for output. FIG. 23 is a flowchart illustrating the operation of outputting an image based on the movement information of a projection lens. FIG. 24 is a drawing for explaining the operation of changing the position where an image is output according to one embodiment. FIG. 25 is a drawing for explaining an embodiment in which an image is displayed in all of multiple areas connected in the vertical direction. FIG. 26 is a drawing illustrating an operation to change the position where an image is output according to another embodiment. FIG. 27 is a flowchart illustrating the operation of outputting an image by considering the movement limit value of the projection lens. Figure 28 is a diagram illustrating a UI displayed when the movement limit value of the projection lens is exceeded. FIG. 29 is a flowchart illustrating a method for controlling an electronic device according to one embodiment of the present disclosure. Specific details for implementing the invention

[0027] The present disclosure will be described in detail below with reference to the attached drawings.

[0028] The terms used in the embodiments of this disclosure have been selected to be as widely used as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant explanatory section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0029] In this specification, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, operations, or components such as parts) and do not exclude the presence of additional features.

[0030] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0031] Expressions such as "first," "second," "first," or "second" used in this specification may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0032] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0033] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "consisting of" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0034] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0035] In this specification, the term "user" may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0036] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.

[0037] FIG. 1 is a perspective view illustrating the appearance of an electronic device (100) according to one embodiment of the present disclosure.

[0038] Referring to FIG. 1, the electronic device (100) may include a head (103), a body (105), a projection lens (110), a connector (130), or a cover (107).

[0039] The electronic device (100) can be a device of various forms. In particular, the electronic device (100) may be a projector device that magnifies and projects an image onto a wall or screen, and the projector device may be an LCD projector or a DLP (digital light processing) projector using a DMD (digital micromirror device).

[0040] Additionally, the electronic device (100) may be a home or industrial display device, or a lighting device used in daily life, or a sound device including a sound module, or may be implemented as a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a wearable device, or a home appliance. Meanwhile, the electronic device (100) according to one embodiment of the present disclosure is not limited to the devices described above, and the electronic device (100) may be implemented as an electronic device (100) having two or more functions of the devices described above. For example, the electronic device (100) may be used as a display device, a lighting device, or a sound device by turning off the projector function and turning on the lighting function or speaker function according to the operation of the processor, and may be used as an AI speaker by including a microphone or a communication device.

[0041] The main body (105) is a housing that forms the exterior and can support or protect components of an electronic device (100) placed inside the main body (105) (e.g., configurations shown in FIG. 2a and FIG. 2b). The shape of the main body (105) may have a structure close to a cylinder as shown in FIG. 1. However, the shape of the main body (105) is not limited thereto, and according to various embodiments of the present disclosure, the main body (105) may be implemented in various geometric shapes such as a column, a cone, or a sphere having a polygonal cross-section.

[0042] The size of the main body (105) may be such that a user can hold or move it with one hand, may be implemented in a super-compact size for easy portability, and may be implemented in a size that can be mounted on a table or combined with a lighting device.

[0043] The material of the main body (105) may be made of a matte metal or synthetic resin so that the user's fingerprints or dust do not adhere to it, or, the exterior of the main body (105) may be made of a smooth glossy finish.

[0044] A friction area may be formed in a portion of the exterior of the main body (105) so that a user can grip and move it. Alternatively, the main body (105) may be provided with a folded gripping portion or support (108a, see FIG. 3) that a user can grip in at least a portion of the area.

[0045] A projection lens (110) is formed on one surface of the main body (105) to project light that has passed through a lens array to the outside of the main body (105). In various embodiments, the projection lens (110) may be an optical lens with a low-dispersion coating to reduce chromatic aberration. The projection lens (110) may be a convex lens or a condensing lens, and in one embodiment, the projection lens (110) may adjust the focus by adjusting the positions of a plurality of sub-lenses.

[0046] The head (103) is provided to be coupled to one side of the main body (105) to support and protect the projection lens (110). The head (103) can be coupled to the main body (105) so as to be swivelable within a preset angle range relative to one side of the main body (105).

[0047] The head (103) can be swiveled automatically or manually by a user or processor to freely adjust the projection angle of the projection lens (110). Alternatively, although not shown in the drawing, the head (103) may be coupled to the main body (105) and may include a neck extending from the main body (105), so that the head (103) may be tilted or tilted to adjust the projection angle of the projection lens (110).

[0048] The electronic device (100) can project light or an image to a desired location by adjusting the direction of the head (103) and the emission angle of the projection lens (110) while the position and angle of the main body (105) are fixed. Additionally, the head (103) may include a handle that can be grasped after being rotated in a desired direction by the user.

[0049] A plurality of openings may be formed on the outer surface of the main body (105). Audio output from the audio output unit may be output to the outside of the main body (105) of the electronic device (100) through the plurality of openings. The audio output unit may include a speaker, and the speaker may be used for general purposes such as multimedia playback, recording playback, voice output, etc.

[0050] According to one embodiment of the present disclosure, a heat dissipation fan (not shown) may be provided inside the main body (105), and when the heat dissipation fan (not shown) is driven, air or heat inside the main body (105) can be discharged through a plurality of openings. Therefore, the electronic device (100) can discharge heat generated by the operation of the electronic device (100) to the outside and prevent the electronic device (100) from overheating.

[0051] The connector (130) can connect the electronic device (100) to an external device to transmit and receive electrical signals or receive power from an external source. According to one embodiment of the present disclosure, the connector (130) can be physically connected to an external device. In this case, the connector (130) may include an input / output interface and may communicate with the external device via wired or wireless means or receive power. For example, the connector (130) may include an HDMI connection terminal, a USB connection terminal, an SD card receiving slot, an audio connection terminal, or a power outlet, or may include a Bluetooth, Wi-Fi, or wireless charging connection module that is wirelessly connected to an external device.

[0052] Additionally, the connector (130) may have a socket structure connected to an external lighting device and may receive power by being connected to a socket receiving groove of the external lighting device. The size and specifications of the socket structure connector (130) can be implemented in various ways considering the receiving structure of the external device that can be coupled. For example, according to the international standard E26, the diameter of the joint portion of the connector (130) may be implemented as 26 mm, in which case the electronic device (100) can be coupled to an external lighting device such as a stand by replacing a conventionally used light bulb. Meanwhile, when coupled to a socket located on the existing ceiling, the electronic device (100) has a structure that projects from top to bottom, and if the electronic device (100) does not rotate due to the socket coupling, the screen also cannot rotate. Accordingly, even when power is supplied through a socket connection, the electronic device (100) can rotate. The electronic device (100) is socket-connected to a stand on the ceiling, and the head (103) swivels on one side of the main body (105) to adjust the projection angle, thereby allowing the screen to be projected to a desired position or the screen to be rotated.

[0053] The connector (130) may include a coupling sensor, and the coupling sensor may sense whether the connector (130) and an external device are coupled, the coupling state, or the coupling target and transmit this to a processor, and the processor may control the operation of the electronic device (100) based on the received detection value.

[0054] The cover (107) can be attached to and detached from the main body (105) and can protect the connector (130) so that the connector (130) is not always exposed to the outside. The shape of the cover (107) may have a shape that is continuous with the main body (105) as shown in FIG. 1, or it may be implemented to correspond to the shape of the connector (130). The cover (107) can support an electronic device (100), and the electronic device (100) can be attached to the cover (107) and used by being attached to or mounted on an external stand.

[0055] In various embodiments of the electronic device (100), a battery may be provided inside the cover (107). The battery may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0056] Although not illustrated in the drawings, the electronic device (100) may include a camera module, and the camera module may capture still images and video. According to one embodiment, the camera module may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0057] Although not shown in the drawing, the electronic device (100) may include a protective case (not shown) to protect the electronic device (100) and to allow for easy transport, or may include a stand (not shown) that supports or fixes the main body (105), or a bracket (not shown) that can be attached to a wall or partition.

[0058] Additionally, the electronic device (100) can be connected to various external devices using a socket structure to provide various functions. In one embodiment, the electronic device (100) can be connected to an external camera device using a socket structure. The electronic device (100) can provide images stored in the connected camera device or images currently being captured using a projection unit (111). In another embodiment, the electronic device (100) can be connected to a battery module using a socket structure to receive power. Meanwhile, although the electronic device (100) can be connected to an external device using a socket structure, this is merely one embodiment, and it can be connected to an external device using another interface (e.g., USB, etc.).

[0059] FIG. 2a is a block diagram illustrating an electronic device according to one embodiment of the present disclosure.

[0060] Referring to FIG. 2a, the electronic device (100) may include a projection unit (111), a memory (112), a sensor unit (113), and a processor (114).

[0061] The projection unit (111) can perform the function of outputting an image to a projection surface. A specific description related to the projection unit (111) is provided in FIG. 2b. Here, although described as a projection unit, the electronic device (100) can project an image in various ways. Here, the projection unit (111) may include a projection lens (110). Here, the projection surface may be a part of the physical space where the image is output or a separate screen.

[0062] Additionally, the projection unit (111) may include a projection lens (110) for outputting an image to a projection surface and a movement control unit (not shown) for moving the projection lens (110). At least one of the projection distance and projection direction of the projection lens (110) may be changed by the movement control unit (not shown). The projection lens (110) may be a component included in the projection unit (111). Here, the projection lens (110) may be moved by the control of the processor (114). When the projection lens (110) is moved, the output position and output size of the image may be changed.

[0063] The memory (112) can store a first image and a second image that are output to a projection surface. Here, the memory (112) can store images. Specifically, the memory (112) can store at least one image that is to be output through the projection unit (111). Here, the image may include video in addition to a still image. Also, it may be described as content instead of an image. A detailed description related to the memory (112) is described in FIG. 2B.

[0064] The sensor unit (113) may include at least one sensor. The sensor unit (113) may include at least one of various types of sensors. Here, the sensor unit (113) may include at least one of a distance sensor that senses distance, a three-dimensional space recognition sensor that analyzes space, or an image sensor. Here, the distance sensor may refer to a sensor that acquires sensing data for measuring distance. Here, the three-dimensional space recognition sensor may refer to a sensor that acquires sensing data for recognizing three-dimensional space. Here, the sensor unit (113) may include at least one of an infrared sensor, an ultrasonic sensor, a laser sensor, a LiDAR sensor, and an image sensor. Here, the image sensor may include at least one of a camera or a depth camera. Here, the tilt sensor may include at least one of an accelerometer and a gyroscope.

[0065] The processor (114) can perform overall control operations of the electronic device (100). Specifically, the processor (114) functions to control the overall operation of the electronic device (100).

[0066] The processor (114) may include a projection unit (111). Here, the projection unit (111) can output an image to a projection surface.

[0067] The processor (114) can obtain distance information from the electronic device (100) to the projection surface through the sensor unit (113), obtain output size information of the image based on the distance information obtained through the sensor unit (113), obtain projection surface information corresponding to the curvature of the projection surface through the sensor unit (113), obtain movement information of the projection lens (110) based on the output size information of the image and the projection surface information, and control the projection unit (111) to output an image based on the movement information.

[0068] Here, the processor (114) can acquire sensing data for distance measurement through the sensor unit (113). And, the processor (114) can acquire distance information between the projection surface and the electronic device (100) based on the acquired sensing data.

[0069] Here, the processor (114) can obtain output size information of the image based on distance information to the projection surface. Here, the output size information of the image may refer to the actual size of the image output to the projection surface. Therefore, even if an image of the same resolution is output, the output size information of the image may vary depending on the distance information. A specific explanation related to this is described in FIG. 7.

[0070] Here, the processor (114) can obtain projection surface information based on sensing data obtained through the sensor unit (113). Here, the projection surface may refer to a space where an image is to be displayed, and the projection surface may refer to a wall or a screen, etc.

[0071] Here, the projection surface information may include at least one of the projection surface size, projection surface position, projection surface material, projection surface shape, whether or not curvature is included in the projection surface, curvature position included in the projection surface, curvature length included in the projection surface, and number of curvatures included in the projection surface.

[0072] According to one embodiment, the sensing data used to acquire distance information and the sensing data used to acquire projection surface information may be acquired through the same sensor. For example, both the distance information and the projection surface information may be acquired through a first sensor. Here, the first sensor may be a LiDAR sensor.

[0073] According to another embodiment, the sensing data used to acquire distance information and the sensing data used to acquire projection surface information may be acquired through different sensors. For example, distance information may be acquired through a first sensor and projection surface information may be acquired through a second sensor. Here, the first sensor may be an infrared sensor and the second sensor may be a LiDAR sensor.

[0074] Here, the processor (114) can identify a curvature included in the projection surface based on sensing data. The curvature may refer to a boundary line, boundary area, corner, etc., for distinguishing between a wall (first projection surface) and a wall (second projection surface). Here, the processor (114) can identify at least one of the location of the curvature, the length of the curvature, or the total number of curvatures.

[0075] Here, the processor (114) can determine movement information of the projection lens (110) based on the output size information of the image and the curvature information of the projection surface. Specifically, the processor (114) can divide the projection surface into a plurality of regions based on the curvature information of the projection surface. Here, the plurality of regions may include at least one of a wall surface, a floor surface, or a ceiling surface recognized around the electronic device (100).

[0076] Here, the processor (114) can determine one of the multiple regions as an output region and can move the projection lens (110) so that an image can be output only to the determined single region. For example, if an image is displayed across multiple regions as in the embodiment of FIG. 16 or the embodiment of FIG. 25, the image may be distorted. Therefore, the processor (114) can move the projection lens (110) so that the image can be output to a single region.

[0077] In order to output an image to only one of the multiple regions, the processor (114) may move the projection lens (110). For example, the processor (114) may move the projection lens (110) to change the output direction of the image, as in the embodiment of FIG. 24 or the embodiment of 26.

[0078] Here, the processor (114) can obtain information on the size of the output area.

[0079] Here, the processor (114) can identify whether an image can be output to a determined output area without changing its size. The processor (114) can compare the output size of the image with the size of the output area.

[0080] If the image output size is larger than the size of the output area, the processor (114) needs to reduce the image so that the image can be output to only one area. Therefore, the processor (114) can perform a downscaling operation to reduce the image.

[0081] According to one embodiment, if the image output size is less than the size of the output area, the processor (114) can output the image directly to the output area.

[0082] According to another embodiment, if the image output size is less than the size of the output area, the processor (114) can correct the image to the maximum size and output it. Specifically, the processor (114) can perform an upscaling operation to enlarge the size of the image based on the size of the output area. An operation to change the image size is described in FIG. 18.

[0083] Here, the processor (114) can move the projection lens (110) based on movement information and correct the size of the image by comparing the size of the output area with the size of the image output. Then, the processor (114) can output the corrected image to the output area.

[0084] Meanwhile, the movement information may include at least one of the movement direction and the movement distance, and the processor (114) can control the projection unit (111) so that the projection lens (110) moves based on the movement direction and the movement distance.

[0085] Here, the processor (114) can move the projection lens (110) in directions such as up, down, left, and right relative to the fixed axis of the projection lens (110). Additionally, the processor (114) can move the projection lens (110) by a calculated distance.

[0086] Meanwhile, the processor (114) can identify the curvature position of the projection surface, divide the projection surface into a first area and a second area based on the curvature position, identify either the first area or the second area as an output area, and control the projection unit (111) to output an image to the identified output area.

[0087] Here, the curvature location can identify the location of the curvature included in the projection plane. Here, the curvature location can be described as a boundary line, boundary area, boundary location, edge, etc.

[0088] Here, the processor (114) can analyze the projection surface to identify locations where curvature exists. Then, the processor (114) can divide the projection surface into multiple regions based on the identified curvature locations. Then, the processor (114) can determine one of the multiple regions as an output region. Then, the processor (114) can move the projection lens (110) or correct the size of the image to output an image to the determined output region.

[0089] Meanwhile, the processor (114) can obtain the size of a first region and the size of a second region, and can identify the region with the larger size between the first region and the second region as an output region.

[0090] Here, the processor (114) can compare the size of each of the multiple regions and output an image only to the region with the largest size. A specific explanation related to this is described in FIGS. 11 to 14.

[0091] Meanwhile, the processor (114) can identify the first area as an output area if the size of the first part output in the first area among the areas where the image is output is larger than the size of the second part output in the second area among the areas where the image is output.

[0092] Here, the processor (114) can compare the sizes of images output in multiple areas and output the entire image only in the area where the image is displayed larger. An explanation related to this is described in FIGS. 15 and 16.

[0093] Meanwhile, the processor (114) can obtain the size of the output area, change the size of the image based on the size of the output area, and control the projection unit (111) to output the changed image to the output area.

[0094] Here, there may be cases where the processor (114) needs to change the size of the image. This is because the output size of the image may be larger than the size of the output area. In this case, the processor (114) can downscale the image. Additionally, there may be a need to enlarge the image to the maximum possible size in the output area and provide it to the user. In this case, the processor (114) can upscale the image. A detailed explanation regarding this is described in FIG. 18.

[0095] Meanwhile, the processor (114) can change the size of the image while maintaining the aspect ratio of the image.

[0096] Here, the processor (114) can maintain the aspect ratio of the image when changing the size of the image. For example, if the aspect ratio of the original image was 16:9, the aspect ratio of 16:9 can be maintained during the process of changing the size of the image.

[0097] According to other implementation examples, the processor (114) can change the size of the image without maintaining the aspect ratio.

[0098] Meanwhile, the processor (114) can obtain the size of the output area, and if the size of the output area is larger than the output size of the image, the size of the image can be enlarged, and if the size of the output area is smaller than the output size of the image, the size of the image can be reduced.

[0099] Here, the processor (114) may not change the size of the image if the size of the output area matches the output size of the image. Here, the processor (114) may consider the size of the output area when changing the size of the image.

[0100] Meanwhile, the processor (114) can obtain movement information based on a movement limit value corresponding to the projection lens (110), and if the movement distance included in the movement information is greater than the movement limit value, it can control the projection unit (111) to output a UI (User Interface) for guiding the position of the electronic device (100).

[0101] Here, the movement limit value may refer to the maximum movement distance that the projection lens (110) can move. The movement limit value may be described as the maximum movement distance. Since the processor (114) cannot move the projection lens (110) beyond the movement limit value, a situation may occur where the optimal screen cannot be provided solely by moving the projection lens (110). Here, the processor (114) may output a UI including a command to move the electronic device (100) to provide the optimal screen. A detailed explanation related to this is described in FIGS. 27 and 28.

[0102] Meanwhile, the processor (114) can identify whether an image is output to both the first area and the second area based on a captured image obtained through an image sensor when the projection surface includes the first area and the second area, and if an image is output to both the first area and the second area, it can obtain movement information of the projection lens (110).

[0103] Here, the processor (114) can analyze the projection surface to distinguish multiple regions (first region and second region). Here, the processor (114) can identify whether an image is being output across multiple regions. If the image is not being output across multiple regions, the processor (114) may not move the projection lens (110).

[0104] If it is identified that an image is output simultaneously to multiple areas, the processor (114) can obtain movement information for moving the projection lens (110). Specific movement operations of the projection lens (110) are described in FIGS. 24 to 26.

[0105] According to one embodiment, the processor (114) can perform an image size change operation after acquiring movement information of the projection lens (110).

[0106] According to another embodiment, the processor (114) can obtain movement information of the projection lens (110) after first performing an image size change operation.

[0107] According to another embodiment, the processor (114) can synthesize the acquired information to simultaneously perform the operation of acquiring movement information of the projection lens (110) and the operation of changing the size of the image.

[0108] An electronic device (100) according to one embodiment of the present disclosure can provide a screen most suitable for the current projection surface to a user by utilizing the output size of an image and projection surface information. Specifically, the electronic device (100) can correct the size of the image to correspond to the output area while moving the projection lens (110). Here, by moving the projection lens (110), the electronic device (100) can provide a screen suitable for a wider space, and by changing the size of the image, it can enlarge or reduce the size of the image to create a suitable screen. Accordingly, the processor (114) can create and provide a suitable screen to a user despite a distorted projection surface (or a projection surface including curvature).

[0109] FIG. 2b is a block diagram illustrating the specific configuration of FIG. 2a.

[0110] Referring to FIG. 2b, the electronic device (100) may include a projection unit (111), a memory (112), a sensor unit (113), a processor (114), a user interface (115), an input / output interface (116), an audio output unit (117), and a power supply unit (118). Here, some descriptions of the projection unit (111), memory (112), sensor unit (113), and processor (114) are described in FIG. 2a, so redundant descriptions are omitted. Meanwhile, the configuration shown in FIG. 2b is merely one embodiment, and some configurations may be omitted, and new configurations may be added.

[0111] The projection unit (111) is configured to project an image outward. According to one embodiment of the present disclosure, the projection unit (111) can be implemented using various projection methods (e.g., a cathode-ray tube (CRT) method, a liquid crystal display (LCD) method, a digital light processing (DLP) method, a laser method, etc.). For example, the CRT method is basically the same principle as a CRT monitor. The CRT method magnifies the image using a lens in front of the cathode-ray tube (CRT) to display an image on a screen. Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of the three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0112] As another example, the LCD method displays an image by transmitting light from a light source through a liquid crystal. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into Red, Green, and Blue by a dichroic mirror (a mirror that reflects only specific colors of light and allows the rest to pass through), then passes through the liquid crystal, and finally converges back into one place.

[0113] As another example, the DLP method is a technique that displays images using a DMD (Digital Micromirror Device) chip. The projection unit of the DLP method may include a light source, a color wheel, a DMD chip, and a projection lens. Light emitted from the light source can acquire color as it passes through a rotating color wheel. The light passing through the color wheel is input into the DMD chip. The DMD chip contains numerous micro-mirrors and reflects the light input into it. The projection lens performs the function of magnifying the light reflected from the DMD chip to the size of the image.

[0114] As another example, the laser method includes DPSS (Diode Pumped Solid State) lasers and galvanometers. Lasers that output various colors utilize a laser formed by installing three DPSS lasers for each RGB color and superimposing their optical axes using special mirrors. The galvanometer includes mirrors and high-output motors to move the mirrors at high speeds. For example, a galvanometer can rotate the mirror at a maximum speed of 40 KHz / sec. The galvanometer is mounted according to the scanning direction; since projectors generally perform planar scanning, the galvanometer can also be positioned along the x and y axes.

[0115] Meanwhile, the projection unit (111) may include various types of light sources. For example, the projection unit (111) may include at least one light source among a lamp, an LED, and a laser.

[0116] The projection unit (111) can output images with a 4:3 aspect ratio, a 5:4 aspect ratio, or a 16:9 wide aspect ratio depending on the use of the electronic device (100) or the user's settings, and can output images with various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the aspect ratio.

[0117] Meanwhile, the projection unit (111) can perform various functions to adjust the output image under the control of the processor (114). For example, the projection unit (111) can perform functions such as zoom, keystone, quick corner (4-corner) keystone, lens shift, etc.

[0118] Specifically, the projection unit (111) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, a zoom function can be performed depending on the distance from the screen. At this time, the zoom function may include a hardware method that adjusts the screen size by moving a lens and a software method that adjusts the screen size by cropping the image. Meanwhile, when the zoom function is performed, the focus of the image needs to be adjusted. For example, the focus adjustment method includes a manual focus method and an electric method. A manual focus method refers to a method of manually adjusting the focus, and an electric method refers to a method in which the projector automatically adjusts the focus using a motor built into it when the zoom function is performed. When performing the zoom function, the projection unit (111) may provide a digital zoom function through software and may provide an optical zoom function that performs the zoom function by moving the lens through a driving unit.

[0119] Additionally, the projection unit (111) can perform a keystone function. If the height is not correct for front projection, the screen may be distorted upward or downward. The keystone function refers to a function that corrects the distorted screen. For example, if distortion occurs in the left-right direction of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up-down direction, it can be corrected using vertical keystone. The quick corner (4-corner) keystone function is a function that corrects the screen when the central area of ​​the screen is normal but the corner areas are unbalanced. The lens shift function is a function that moves the screen as is when the screen is off the screen.

[0120] Meanwhile, the projection unit (111) can automatically provide zoom / keystone / focus functions by analyzing the surrounding environment and projection environment without user input. Specifically, the projection unit (111) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected through sensors (depth camera, distance sensor, infrared sensor, illuminance sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0121] Additionally, the projection unit (111) can provide a lighting function using a light source. In particular, the projection unit (111) can provide a lighting function by outputting a light source using an LED. According to one embodiment, the projection unit (111) may include a single LED, and according to another embodiment, the electronic device may include a plurality of LEDs. Meanwhile, the projection unit (111) may output a light source using a surface-emitting LED according to an implementation example. Here, the surface-emitting LED may refer to an LED having a structure in which an optical sheet is placed on the upper side of the LED so that the light source is evenly distributed and output. Specifically, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0122] Meanwhile, the projection unit (111) can provide a dimming function to the user to adjust the intensity of the light source. Specifically, when user input to adjust the intensity of the light source is received from the user through the user interface (140) (e.g., a touch display button or a dial), the projection unit (111) can control the LED to output the intensity of the light source corresponding to the received user input.

[0123] Additionally, the projection unit (111) can provide a dimming function based on content analyzed by the processor (114) without user input. Specifically, the projection unit (111) can control an LED to output the intensity of a light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0124] Meanwhile, the projection unit (111) can control the color temperature by the control of the processor (114). Here, the processor (114) can control the color temperature based on the content. Specifically, when the content is identified as being output, the processor (114) can obtain frame-by-frame color information of the content determined to be output. Then, the processor (114) can control the color temperature based on the obtained frame-by-frame color information. Here, the processor (114) can obtain at least one main color of the frame based on the frame-by-frame color information. Then, the processor (114) can adjust the color temperature based on at least one obtained main color. For example, the color temperature that the processor (114) can adjust can be classified as a warm type or a cold type. Here, it is assumed that the frame to be output (hereinafter output frame) contains a scene where a fire has occurred. The processor (114) can identify (or obtain) that the main color is red based on the color information included in the current output frame. And, the processor (114) can identify a color temperature corresponding to the identified primary color (red). Here, the color temperature corresponding to red may be a warm type. Meanwhile, the processor (114) may use an artificial intelligence model to obtain color information of the frame or the primary color. According to one embodiment, the artificial intelligence model may be stored in an electronic device (100) (e.g., memory (112)). According to another embodiment, the artificial intelligence model may be stored in an external server capable of communicating with the electronic device (100).

[0125] Meanwhile, the electronic device (100) can control lighting functions by linking with an external device. Specifically, the electronic device (100) can receive lighting information from an external device. Here, the lighting information may include at least one of brightness information or color temperature information set by the external device. Here, the external device may refer to a device connected to the same network as the electronic device (100) (e.g., an IoT device included in the same home / company network) or a device that is not on the same network as the electronic device (100) but can communicate with the electronic device (e.g., a remote control server). For example, assume that an external lighting device (IoT device) included in the same network as the electronic device (100) is outputting red light at a brightness of 50. The external lighting device (IoT device) can transmit lighting information (e.g., information indicating that it is outputting red light at a brightness of 50) to the electronic device (100) directly or indirectly. Here, the electronic device (100) can control the output of the light source based on the lighting information received from the external lighting device. For example, if the lighting information received from an external lighting device includes information that outputs red light at a brightness of 50, the electronic device (100) can output red light at a brightness of 50.

[0126] Meanwhile, the electronic device (100) can control the lighting function based on biometric information. Specifically, the processor (114) can acquire the user's biometric information. Here, the biometric information may include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. Here, the biometric information may include various information in addition to the information described above. As an example, the electronic device may include a sensor for measuring biometric information. The processor (114) can acquire the user's biometric information through the sensor and control the output of the light source based on the acquired biometric information. As another example, the processor (114) can receive biometric information from an external device through an input / output interface (116). Here, the external device may refer to the user's portable communication device (e.g., a smartphone or a wearable device). The processor (114) can acquire the user's biometric information from the external device and control the output of the light source based on the acquired biometric information. Meanwhile, according to an embodiment, the electronic device can identify whether the user is sleeping, and if it is identified that the user is sleeping (or preparing to sleep), the processor (114) can control the output of the light source based on the user's biometric information.

[0127] The memory (112) may store at least one instruction regarding the electronic device (100). Additionally, the memory (112) may store an operating system (O / S) for operating the electronic device (100). Furthermore, the memory (112) may store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. Additionally, the memory (112) may include semiconductor memory such as flash memory or magnetic storage media such as a hard disk.

[0128] Specifically, various software modules for operating an electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (112), and the processor (114) may control the operation of the electronic device (100) by executing the various software modules stored in the memory (112). That is, the memory (112) is accessed by the processor (114), and reading / writing / modifying / deleting / updating of data by the processor (114) may be performed.

[0129] Meanwhile, in the present disclosure, the term memory (112) may be used to include memory (112), ROM (not shown), RAM (not shown) within the processor (114), or a memory card (not shown) (e.g., micro SD card, memory stick) mounted in the electronic device (100).

[0130] The user interface (115) may include various types of input devices. For example, the user interface (115) may include a physical button. In this case, the physical button may include a function key, a directional key (e.g., a four-way key), or a dial button. According to one embodiment, the physical button may be implemented as a plurality of keys. According to another embodiment, the physical button may be implemented as a single key. Here, when the physical button is implemented as a single key, the electronic device (100) may receive user input in which a single key is pressed for a threshold time or longer. When user input in which a single key is pressed for a threshold time or longer is received, the processor (114) may perform a function corresponding to the user input. For example, the processor (114) may provide a lighting function based on the user input.

[0131] Additionally, the user interface (115) can receive user input using a non-contact method. When receiving user input through a contact method, physical force must be transmitted to the electronic device. Therefore, a method for controlling the electronic device regardless of physical force may be required. Specifically, the user interface (115) can receive user gestures and perform actions corresponding to the received user gestures. Here, the user interface (115) can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0132] Additionally, the user interface (115) can receive user input using a touch method. For example, the user interface (115) can receive user input through a touch sensor. According to one embodiment, the touch method can be implemented in a non-contact manner. For example, the touch sensor can determine whether the user's body has approached within a threshold distance. Here, the touch sensor can identify user input even when the user does not touch the touch sensor. Meanwhile, according to another embodiment, the touch sensor can identify user input when the user touches the touch sensor.

[0133] Meanwhile, the electronic device (100) may receive user input in various ways other than the user interface described above. In one embodiment, the electronic device (100) may receive user input through an external remote control device. Here, the external remote control device may be a remote control device corresponding to the electronic device (100) (e.g., a control device dedicated to the electronic device) or a user's portable communication device (e.g., a smartphone or a wearable device). Here, the user's portable communication device may store an application for controlling the electronic device. The portable communication device may acquire user input through the stored application and transmit the acquired user input to the electronic device (100). The electronic device (100) may receive user input from the portable communication device and perform an operation corresponding to the user's control command.

[0134] Meanwhile, the electronic device (100) can receive user input using voice recognition. According to one embodiment, the electronic device (100) can receive user voice through a microphone included in the electronic device. According to another embodiment, the electronic device (100) can receive user voice from a microphone or an external device. Specifically, the external device can acquire user voice through the microphone of the external device and transmit the acquired user voice to the electronic device (100). The user voice transmitted from the external device may be audio data or digital data converted from audio data (e.g., audio data converted into the frequency domain). Here, the electronic device (100) can perform an operation corresponding to the received user voice. Specifically, the electronic device (100) can receive audio data corresponding to the user voice through the microphone. And, the electronic device (100) can convert the received audio data into digital data. Additionally, the electronic device (100) can convert the converted digital data into text data using a STT (Speech To Text) function. According to one embodiment, the STT (Speech To Text) function can be performed directly in the electronic device (100), and

[0135] According to another embodiment, the Speech To Text (STT) function may be performed on an external server. The electronic device (100) may transmit digital data to an external server. The external server may convert the digital data into text data and obtain control command data based on the converted text data. The external server may transmit the control command data (which may also include text data) to the electronic device (100). The electronic device (100) may perform an action corresponding to the user's voice based on the obtained control command data.

[0136] Meanwhile, the electronic device (100) may provide a voice recognition function using one assistance (or an artificial intelligence assistant, e.g., Bixby™), but this is merely one embodiment and may provide a voice recognition function through multiple assistances. At this time, the electronic device (100) may provide a voice recognition function by selecting one of the multiple assistances based on a trigger word corresponding to the assistance or a specific key on the remote control.

[0137] Meanwhile, the electronic device (100) can receive user input using screen interaction. Screen interaction refers to a function in which the electronic device identifies whether a predetermined event occurs through an image projected onto a screen (or projection surface) and obtains user input based on the predetermined event. Here, the predetermined event may refer to an event in which a predetermined object is identified at a specific location (e.g., a location where a UI for receiving user input is projected). Here, the predetermined object may include at least one of a part of the user's body (e.g., a finger), a pointer, or a laser pointer. When the electronic device (100) identifies a predetermined object at a location corresponding to the projected UI, it may identify that user input for selecting the projected UI has been received. For example, the electronic device (100) may project a guide image to display the UI on the screen. And, the electronic device (100) may identify whether the user selects the projected UI. Specifically, the electronic device (100) can identify that a user has selected the projected UI when a predetermined event is identified at the location of the projected UI. Here, the projected UI may include at least one item. Here, the electronic device (100) can perform spatial analysis to identify whether the predetermined event is at the location of the projected UI. Here, the electronic device (100) can perform spatial analysis through a sensor (e.g., image sensor, infrared sensor, depth camera, distance sensor, etc.). By performing spatial analysis, the electronic device (100) can identify whether the predetermined event occurs at a specific location (the location where the UI is projected). And, if it is identified that the predetermined event occurs at a specific location (the location where the UI is projected), the electronic device (100) can identify that user input for selecting the UI corresponding to the specific location has been received.

[0138] The input / output interface (116) is configured to input or output at least one of an audio signal and a video signal. The input / output interface (116) can receive at least one of the audio and video signals from an external device and can output control commands to the external device.

[0139] Meanwhile, in one embodiment of the present disclosure, the input / output interface (116) may be implemented as at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). According to one embodiment, the wired input / output interface may be implemented as an interface that inputs and outputs only audio signals and an interface that inputs and outputs only video signals, or as a single interface that inputs and outputs both audio and video signals.

[0140] Additionally, the electronic device (100) can receive data through a wired input / output interface, but this is merely one embodiment, and it can also receive power through a wired input / output interface. For example, the electronic device (100) can receive power from an external battery via a USB C-type or from an outlet via a power adapter. As another example, the electronic device can receive power from an external device (e.g., a laptop or a monitor) via a DP.

[0141] Meanwhile, in one embodiment of the present disclosure, the input / output interface (116) may be implemented as a wireless input / output interface that performs communication using at least one of the communication methods of Wi-Fi, Wi-Fi Direct, Bluetooth, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution). Depending on the implementation example, the wireless input / output interface may be implemented as an interface that inputs and outputs only audio signals and an interface that inputs and outputs only video signals, or as a single interface that inputs and outputs both audio signals and video signals.

[0142] Additionally, the audio signal can be implemented to be received through a wired input / output interface, and the video signal to be received through a wireless input / output interface. Alternatively, the audio signal can be implemented to be received through a wireless input / output interface, and the video signal to be received through a wired input / output interface.

[0143] The audio output unit (117) is configured to output an audio signal. In particular, the audio output unit (117) may include an audio output mixer, an audio signal processor, and a sound output module. The audio output mixer can synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer can synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from an external source) into at least one analog audio signal. The sound output module may include a speaker or an output terminal. According to one embodiment, the sound output module may include a plurality of speakers, in which case the sound output module may be placed inside the main body, and sound radiated by covering at least a part of the diaphragm of the sound output module may pass through a waveguide and be transmitted to the outside of the main body. The sound output module may include a plurality of sound output units, and by symmetrically arranging the plurality of sound output units on the exterior of the main body, sound can be radiated in all directions, that is, in all 360 degrees.

[0144] The power supply unit (118) can receive power from an external source and supply power to various components of the electronic device (100). The power supply unit (118) according to one embodiment of the present disclosure can receive power through various methods. In one embodiment, the power supply unit (118) can receive power using a connector (130) as shown in FIG. 1. In addition, the power supply unit (118) can receive power using a 220V DC power cord. However, it is not limited thereto, and the electronic device can receive power using a USB power cord or a wireless charging method.

[0145] Additionally, the power supply unit (118) may receive power using an internal battery or an external battery. In one embodiment of the present disclosure, the power supply unit (118) may receive power through an internal battery. For example, the power supply unit (118) may charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and receive power through the charged internal battery. In addition, the power supply unit (118) according to one embodiment of the present disclosure may receive power through an external battery. For example, when a connection between an electronic device and an external battery is made through various wired communication methods such as a USB power cord, a USB C-Type power cord, or a socket, the power supply unit (118) may receive power through the external battery. That is, the power supply unit (118) may receive power directly from the external battery, or charge the internal battery through the external battery and receive power from the charged internal battery.

[0146] The power supply unit (118) according to the present disclosure can receive power using at least one of the plurality of power supply methods described above.

[0147] Meanwhile, regarding power consumption, the electronic device (100) may have power consumption less than or equal to a preset value (e.g., 43W) due to reasons such as the socket type and other standards. At this time, the electronic device (100) may vary power consumption to reduce power consumption when using a battery. That is, the electronic device (100) may vary power consumption based on the power supply method and power usage.

[0148] Meanwhile, an electronic device (100) according to one embodiment of the present disclosure can provide various smart functions.

[0149] Specifically, the electronic device (100) is connected to a mobile terminal device for controlling the electronic device (100), and the screen output from the electronic device (100) can be controlled through user input received from the mobile terminal device. For example, the mobile terminal device may be implemented as a smartphone including a touch display, and the electronic device (100) receives and outputs screen data provided by the mobile terminal device from the mobile terminal device, and the screen output from the electronic device (100) can be controlled according to user input received from the mobile terminal device.

[0150] The electronic device (100) can connect with a mobile terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC, and share content or music provided by the mobile terminal device.

[0151] Additionally, the mobile terminal device and the electronic device (100) can be connected in various connection methods. In one embodiment, the mobile terminal device may search for the electronic device (100) to perform a wireless connection, or the electronic device (100) may search for the mobile terminal device to perform a wireless connection. Additionally, the electronic device (100) can output content provided by the mobile terminal device.

[0152] In one embodiment, when a specific content or music is being output from a mobile terminal device, the mobile terminal device is placed near an electronic device, and a preset gesture is detected through the display of the mobile terminal device (e.g., motion tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0153] In one embodiment, when specific content or music is being output from a mobile terminal device, if the mobile terminal device comes closer to the electronic device (100) at a distance less than a preset distance (e.g., non-contact tap view) or if the mobile terminal device comes into contact with the electronic device (100) twice at short intervals (e.g., contact tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0154] In the above-described embodiment, it was explained that a screen identical to the screen provided by the mobile terminal device is provided by the electronic device (100), but the present disclosure is not limited thereto. That is, when a connection is established between the mobile terminal device and the electronic device (100), a first screen provided by the mobile terminal device may be output at the mobile terminal device, and a second screen provided by the mobile terminal device that is different from the first screen may be output at the electronic device (100). For example, the first screen may be a screen provided by a first application installed on the mobile terminal device, and the second screen may be a screen provided by a second application installed on the mobile terminal device. For example, the first screen and the second screen may be different screens provided by a single application installed on the mobile terminal device. In addition, for example, the first screen may be a screen that includes a UI in the form of a remote control for controlling the second screen.

[0155] The electronic device (100) according to the present disclosure may output a standby screen. For example, the electronic device (100) may output a standby screen when the electronic device (100) is not connected to an external device or when there is no input received from an external device for a preset period of time. The conditions for the electronic device (100) to output a standby screen are not limited to the above-described examples, and a standby screen may be output under various conditions.

[0156] The electronic device (100) may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device (100) may obtain an unstructured object by extracting only the shape of a specific object from data received from an external device, and may output a standby screen including the obtained unstructured object.

[0157] FIG. 3 is a perspective view illustrating the appearance of an electronic device (100) according to other embodiments of the present disclosure.

[0158] Referring to FIG. 3, the electronic device (100) may include a support (or a “handle”) (108a).

[0159] In various embodiments, the support (108a) may be a handle or a ring provided for a user to grasp or move the electronic device (100), or the support (108a) may be a stand that supports the main body (105) when the main body (105) is lying on its side.

[0160] As shown in FIG. 3, the support member (108a) may be connected to the outer surface of the main body (105) by a hinge structure so as to be attached or detached, and may be selectively detached and fixed from the outer surface of the main body (105) as needed by the user. The number, shape, or arrangement structure of the support member (108a) may be implemented in various ways without restriction. Although not shown in the drawings, the support member (108a) may be embedded inside the main body (105) so that the user can take it out and use it as needed, or the support member (108a) may be implemented as a separate accessory so that it can be attached to and detached from the electronic device (100).

[0161] The support member (108a) may include a first support surface (108a-1) and a second support surface (108a-2). The first support surface (108a-1) may be a surface facing the outside direction of the main body (105) when the support member (108a) is separated from the outer surface of the main body (105), and the second support surface (108a-2) may be a surface facing the inside direction of the main body (105) when the support member (108a) is separated from the outer surface of the main body (105).

[0162] The first support surface (108a-1) extends from the bottom of the main body (105) to the top of the main body (105) and can be moved away from the main body (105), and the first support surface (108a-1) may have a flat or uniformly curved shape. The first support surface (108a-1) can support the main body (105) when the electronic device (100) is mounted so that the outer surface of the main body (105) touches the bottom surface, that is, when the projection lens (110) is positioned to face the front direction. In an embodiment including two or more supports (108a), the projection angle of the head (103) and the projection lens (110) can be adjusted by adjusting the spacing between the two supports (108a) or the angle at which the hinges are open.

[0163] The second support surface (108a-2) is a surface that comes into contact with the user or the external mounting structure when the support (108a) is supported by the user or the external mounting structure, and may have a shape corresponding to the grip structure of the user's hand or the external mounting structure so as not to slip when supporting or moving the electronic device (100). The user can fix the head (103) by orienting the projection lens (110) toward the front, hold the support (108a), move the electronic device (100), and use the electronic device (100) like a flashlight.

[0164] The support groove (104) is provided in the main body (105) and is a groove structure capable of accommodating the support (108a) when it is not in use. As shown in FIG. 3, it can be implemented as a groove structure corresponding to the shape of the support (108a) on the outer surface of the main body (105). Through the support groove (104), the support (108a) can be stored on the outer surface of the main body (105) when it is not in use, and the outer surface of the main body (105) can be kept smooth.

[0165] Alternatively, the structure may have a support member (108a) stored inside the main body (105) and a support member (108a) that is pulled out of the main body (105) when the support member (108a) is needed. In this case, the support member groove (104) may be structured to be inserted into the main body (105) to accommodate the support member (108a), and may include a second support surface (108a-2) that is in close contact with the outer surface of the main body (105) or a door (not shown) that opens and closes a separate support member groove (104).

[0166] Although not shown in the drawing, the electronic device (100) may include various types of accessories that help with the use or storage of the electronic device (100). For example, the electronic device (100) may include a protective case (not shown) to protect the electronic device (100) and to allow for easy transport, or may include a tripod (not shown) to support or fix the main body (105) or a bracket (not shown) that is attached to the outer surface to fix the electronic device (100).

[0167] FIG. 4a is a perspective view illustrating the appearance of an electronic device (100) according to another embodiment of the present disclosure.

[0168] Referring to FIG. 4a, the electronic device (100) may include a support (or “handle”) (108b).

[0169] In various embodiments, the support (108b) may be a handle or a ring provided for a user to grasp or move the electronic device (100), or the support (108b) may be a stand that supports the main body (105) so that it can be directed at any angle while the main body (105) is lying on its side.

[0170] Specifically, the support member (108b) can be connected to the main body (105) at a predetermined point on the main body (105) (e.g., 2 / 3 to 3 / 4 of the height of the main body) as shown in FIG. 4a. When the support member (108) is rotated toward the main body, it can support the main body (105) so that it can face at any angle while lying on its side.

[0171] FIG. 4b is a perspective view illustrating the appearance of an electronic device (100) according to another embodiment of the present disclosure.

[0172] Referring to FIG. 4b, the electronic device (100) may include a support (or "base") (108c). In various embodiments, the support (108c) may include a base plate (108c-1) provided to support the electronic device (100) on the ground and two support members (108c-2) connecting the base plate (108-c) and the main body (105).

[0173] In one embodiment of the present disclosure, the heights of the two support members (108c-2) are the same, so that each of the cross-sections of the two support members (108c-2) can be joined or separated by a groove provided on one outer surface of the main body (105) and a hinge member (108c-3).

[0174] Two support members can be hinge-connected to the main body (105) at a preset point of the main body (105) (e.g., 1 / 3 to 2 / 4 of the height of the main body).

[0175] When the two support members and the main body are joined by the hinge member (108c-3), the main body (105) can be rotated around a virtual horizontal axis formed by the two hinge members (108c-3) so that the projection angle of the projection lens (110) can be adjusted.

[0176] Although FIG. 4b illustrates an embodiment in which two support members (108c-2) are connected to the main body (105), the present disclosure is not limited thereto, and as in FIG. 4c and FIG. 4d, one support member and the main body (105) may be connected by one hinge member.

[0177] FIG. 4c is a perspective view illustrating the appearance of an electronic device (100) according to another embodiment of the present disclosure.

[0178] FIG. 4d is a perspective view showing the electronic device (100) of FIG. 4c in a rotated state.

[0179] Referring to FIG. 4c and FIG. 4d, a support (108d) of various embodiments may include a base plate (108d-1) provided to support an electronic device (100) on the ground and a support member (108d-2) connecting the base plate (108-c) and the main body (105).

[0180] And, the cross-section of one support member (108d-2) can be joined or separated by a groove provided on one outer surface of the main body (105) and a hinge member (not shown).

[0181] When one support member (108d-2) and the main body (105) are joined by one hinge member (not shown), the main body (105) can be rotated around a virtual horizontal axis formed by one hinge member (not shown) as in FIG. 4d.

[0182] Meanwhile, the support shown in FIGS. 3, FIGS. 4a, FIGS. 4b, FIGS. 4c and FIGS. 4d is merely one example, and it goes without saying that the electronic device (100) can be equipped with a support in various positions or shapes.

[0183] Figure 5 is a flowchart illustrating the operation of outputting an image based on the movement information of the lens.

[0184] Referring to FIG. 5, the electronic device (100) can obtain distance information between the electronic device (100) and the projection surface (S505). Then, the electronic device (100) can obtain output size information of an image (S510). Here, the output size information of the image may refer to information related to the size at which the image is output. Here, the process of calculating the output size information of the image is described in FIG. 7.

[0185] And, the electronic device (100) can acquire projection surface information (S515). Here, the projection surface information may include at least one of the number of regions forming the projection surface, the size of the regions, or the curvature positions distinguishing the regions.

[0186] And, the electronic device (100) can obtain movement information of the projection lens (S520). And, the electronic device (100) can move the projection lens based on the obtained movement information. And, the electronic device (100) can output an image based on the moved projection lens (S525).

[0187] Figure 6 is a diagram illustrating the operation of acquiring distance information.

[0188] Referring to FIG. 6, the electronic device (100) can obtain distance information (d1) between the projection surface (601) and the electronic device (100). Specifically, the electronic device (100) can obtain distance information (d1) through a sensor unit (113). Here, the sensor unit (113) may include a distance sensor. And, the electronic device (100) can obtain distance information (d1) using a distance sensor. Here, the distance sensor may refer to various sensors that can be used to measure distance.

[0189] Here, the distance sensor may mean at least one of a light sensor using light, a sound sensor using sound, an image sensor using captured images, or a LiDAR sensor using radio waves.

[0190] Figure 7 is a diagram illustrating the operation of obtaining size information of an output image.

[0191] Referring to FIG. 7, the electronic device (100) can calculate the size of the output image. Specifically, the electronic device (100) can obtain a throw ratio using Equation (705). Here, the electronic device (100) may have the throw ratio stored in advance. Here, the throw ratio may vary depending on the setting state of the projection lens. For example, when the lens is in a first state, the throw ratio may correspond to 2, and when the lens is in a second state, the throw ratio may correspond to 1.5.

[0192] Additionally, the electronic device (100) can obtain the width of the output image based on Equation (710). Specifically, the electronic device (100) can obtain the width (w) of the output image based on the projection ratio and distance information. Here, the distance information may be the distance between the projection surface and the electronic device (100). Specifically, the electronic device (100) can obtain the width (w) of the output image based on the projection ratio and distance information (distance between the projection surface and the electronic device (100)).

[0193] Additionally, the electronic device (100) can compare the original aspect ratio (A:B) of the image and the aspect ratio (w:h) of the output image based on equation (720). Additionally, the electronic device (100) can obtain the vertical size (h) of the output image based on equation (725).

[0194] As a result, the electronic device (100) can obtain both the width (w) and height (h) of the output image based on projection ratio and distance information.

[0195] Figure 8 is a diagram illustrating the operation of identifying the bending position in the vertical direction.

[0196] Referring to FIG. 8, the electronic device (100) can analyze the projection surface in a horizontal direction. The electronic device (100) can identify the curvature positions (811, 812). The electronic device (100) can divide the projection surface into multiple regions (801, 802, 803) according to the identified curvature positions (811, 812). The electronic device (100) can identify the multiple regions (801, 802, 803) divided according to the curvature positions (811, 812). Here, the curvature positions may be described as boundary lines, curve lines, curve regions, etc.

[0197] For example, the electronic device (100) can distinguish between a first region (801) and a third region (803) based on a bending position (811). Also, the electronic device (100) can distinguish between a first region (801) and a second region (802) based on a bending position (812).

[0198] Meanwhile, the electronic device (100) can analyze (or scan) the projection surface from left to right. Additionally, the electronic device (100) can analyze (or scan) the projection surface from right to left.

[0199] FIG. 9 is a diagram illustrating the operation of identifying the bending position in the horizontal direction.

[0200] Referring to FIG. 9, the electronic device (100) can analyze the projection surface in a vertical direction. The electronic device (100) can identify the bending positions (911, 912). The electronic device (100) can divide the projection surface into multiple regions (901, 902, 903) according to the identified bending positions (911, 912). The electronic device (100) can identify the multiple regions (901, 902, 903) divided according to the bending positions (911, 912).

[0201] For example, the electronic device (100) can distinguish a first region (901) and a second region (902) based on a bending position (911). Also, the electronic device (100) can distinguish a first region (901) and a third region (903) based on a bending position (912).

[0202] Meanwhile, the electronic device (100) can analyze (or scan) the projection surface from the lower side to the upper side. Additionally, the electronic device (100) can analyze (or scan) the projection surface from the upper side to the lower side.

[0203] Figure 10 is a diagram illustrating the operation of analyzing a projection plane.

[0204] Referring to FIG. 10, the electronic device (100) can analyze the projection surface of the space in which the electronic device (100) is placed. Here, the electronic device (100) can analyze the projection surface from left to right (1011). And, the electronic device (100) can analyze the projection surface from right to left (1012). And, the electronic device (100) can identify vertical curvature by analyzing the projection surface from left to right (1011) and from right to left (1012).

[0205] Here, the electronic device (100) can analyze the projection surface from the lower side to the upper side (1013) after identifying the vertical curvature. Then, the electronic device (100) can analyze the projection surface from the upper side to the lower side (1014). Then, the electronic device (100) can identify the horizontal curvature by analyzing the projection surface from the lower side to the upper side (1013) and from the upper side to the lower side (1014).

[0206] And, the electronic device (100) can identify the first region (1001) and the second region (1002) by analyzing the projection surface in the up, down, left, and right directions.

[0207] FIG. 11 is a flowchart illustrating an operation to identify one of a plurality of regions included in a projection surface as an output region according to one embodiment.

[0208] Referring to FIG. 11, the electronic device (100) can obtain distance information, image output size information, and projection surface information (S1105). Then, the electronic device (100) can obtain curvature information of the projection surface (S1110). Here, the curvature information of the projection surface may include at least one of whether curvature is included, the curvature position, or the curvature length. Here, the curvature may be described as a boundary line, a curve line, or a curve area, etc.

[0209] And, the electronic device (100) can determine whether a bending position has been identified based on bending information (S1115). If a bending position has not been identified on the projection surface (S1115-N), the electronic device (100) can output an image on the projection surface (S1120). If a bending position has been identified on the projection surface (S1115-Y), the electronic device (100) can divide the projection surface into multiple regions based on the bending position (S1125).

[0210] Meanwhile, the electronic device (100) can obtain the size of each of the multiple regions (S1130). Then, the electronic device (100) can identify the region with the largest size among the multiple regions as the output region (S1135). Then, the electronic device (100) can output an image to the output region (S1140).

[0211] FIG. 12 is a diagram illustrating the operation of dividing a projection plane into multiple regions.

[0212] Referring to FIG. 12, the electronic device (100) can analyze the projection surface. The electronic device (100) can identify a curved position (1211) included in the projection surface. Here, the curved position may be described as a curved line, a boundary line, a boundary area, or a curved area. Based on the curved position (1211), the electronic device (100) can divide the projection surface into a first area (1201) and a second area (1202).

[0213] FIG. 13 is a diagram illustrating the operation of identifying one of a plurality of regions as an output region.

[0214] Referring to FIG. 13, the electronic device (100) can identify either of the first region (1201) and the second region (1202), which are separated based on the bending position (1211) of FIG. 12, as an output region.

[0215] Here, the electronic device (100) can identify the size of each of the plurality of regions. And, among the plurality of regions, the region with the larger size (or area) can be identified as the output region. For example, the electronic device (100) can acquire the size of the first region (1201) as 20 m^2 and the size of the second region (1202) as 10 m^2. And, the electronic device (100) can identify the first region (1201), which has a larger size, as the output region (1301). The electronic device (100) can output an image to the output region (1301).

[0216] FIG. 14 is a diagram illustrating the operation of identifying an area excluding an object from a projection plane as an output area.

[0217] Referring to FIG. 14, the electronic device (100) can identify objects included in the projection surface when identifying the output area. Here, the objects may refer to predetermined objects that interfere with image output, such as picture frames, furniture, and home appliances.

[0218] Here, the predetermined object may refer to an obstacle that distorts the output image. Accordingly, the electronic device (100) can identify an object (1402) located on the projection surface and exclude the area where the object (1402) is located to identify the output area (1401). Then, the electronic device (100) can output an image to the output area (1401).

[0219] FIG. 15 is a flowchart illustrating an operation to identify one of a plurality of regions included in a projection surface as an output region according to another embodiment.

[0220] Referring to FIG. 15, the electronic device (100) can obtain distance information, image output size information, and projection surface information (S1505). Then, the electronic device (100) can obtain curvature information of the projection surface (S1510). Here, the curvature information of the projection surface may include at least one of whether curvature is included, the curvature position, or the curvature length. Here, the curvature may be described as a boundary line, a curve line, or a curve area, etc.

[0221] And, the electronic device (100) can determine whether a bending position has been identified based on bending information (S1515). If a bending position has not been identified on the projection surface (S1515-N), the electronic device (100) can output an image on the projection surface (S1520). If a bending position has been identified on the projection surface (S1515-Y), the electronic device (100) can divide the projection surface into multiple regions based on the bending position (S1525).

[0222] Meanwhile, the electronic device (100) can identify the size of the image displayed in each of the multiple regions (S1530). Specifically, the image output to the projection surface can be output overlapping the multiple regions. Here, the electronic device (100) can obtain the size of the image output to each of the multiple regions.

[0223] And, the electronic device (100) can identify the area where the image is output larger among the plurality of areas as the output area (S1535). And, the electronic device (100) can output the image to the output area (S1540). A specific explanation related to this is described in FIG. 16.

[0224] FIG. 16 is a diagram illustrating the operation of identifying the size of the area where an image is output in each of a plurality of areas.

[0225] Referring to FIG. 16, the electronic device (100) can divide the projection surface into a first area (1601) and a second area (1602). The electronic device (100) can output an image (1610) to the first area (1601) and the second area (1602). Here, the electronic device (100) can determine either the first area (1601) or the second area (1602) as the output area.

[0226] Here, the electronic device (100) can identify the size of the image (1610) output to each of the first area (1601) and the second area (1602). The image (1610) may be output across the first area (1601) and the second area (1602). Here, the electronic device (100) can capture the output image (1610) through the sensor unit (113). Here, the sensor unit (113) may be an image sensor. The electronic device (100) can analyze the captured image (1610) to identify the first part (1610-1) of the image (1610) output to the first area (1601) and the second part (1610-2) of the image (1610) output to the second area (1602). And, the electronic device (100) can obtain the size of the first part (1610-1) and the size of the second part (1610-2).

[0227] And, the electronic device (100) can identify the area to which the larger part belongs as the output area. For example, assume that the size of the first part (1610-1) is 10 m^2 and the size of the second part (1610-2) is 3 m^2. The electronic device (100) can determine the first area (1601) to which the larger part (1610-1) belongs as the output area. And, the electronic device (100) can output an image only to the first area (1601).

[0228] Figure 17 is a flowchart illustrating the operation of changing the size of an image based on the size of the output area.

[0229] Referring to FIG. 17, the electronic device (100) can obtain distance information, image output size information, and projection surface information (S1705). Then, the electronic device (100) can identify an output area on the projection surface (S1710). Then, the electronic device (100) can change the image size based on the size of the output area (S1715). Then, the electronic device (100) can output the changed image to the output area (S1720).

[0230] Figure 18 is a flowchart illustrating the operation of comparing the output size of an image and the size of the output area.

[0231] Referring to FIG. 18, the electronic device (100) can obtain distance information, image output size information, and projection surface information (S1805). Then, the electronic device (100) can identify an output area on the projection surface and obtain the size of the output area (S1810).

[0232] And, the electronic device (100) can identify whether the output size of the image and the size of the output area are the same (S1815). Here, if the output size of the image is the same as the size of the output area (S1815-Y), the electronic device (100) can output the image to the output area (S1820).

[0233] If the output size of the image is not equal to the size of the output area (S1815-N), the electronic device (100) can identify whether the output size of the image is greater than or equal to the size of the output area (S1825). Here, if the output size of the image is greater than or equal to the size of the output area (S1825-Y), the electronic device (100) can perform downscaling to reduce the size of the image (S1830). Then, the electronic device (100) can output the scaled image to the output area (S1835).

[0234] Meanwhile, if the output size of the image is less than the size of the output area (S1825-N), the electronic device (100) can perform upscaling to enlarge the size of the image (S1840). Then, the electronic device (100) can output the scaled image to the output area (S1835).

[0235] FIG. 19 is a drawing for explaining the operation of reducing the size of an image and outputting it according to one embodiment.

[0236] Referring to FIG. 19, the electronic device (100) can distinguish between a first region (1901) and a second region (1902) by analyzing the projection surface. Then, the electronic device (100) can determine the first region (1901) among the two regions as the output region.

[0237] When an uncorrected image is output as is, similar to FIG. 16, the image may be output across a first area (1901) and a second area (1902). The electronic device (100) may correct the image based on the size of the area (1910) where the image is output when the image is not corrected.

[0238] Specifically, the electronic device (100) can identify an area (1910-1) existing in a first area (1901) and an area (1910-2) existing in a second area (1902) in an area (1910) where an uncorrected image is output. Then, the electronic device (100) can decide to output an image only to the area (1910-1) existing in the first area (1901), which is the output area. Here, the area (1910-1) may be a detailed output area.

[0239] The size of the detailed output area (1910-1) may be smaller than the size of the uncorrected image. Accordingly, the electronic device (100) can obtain a corrected image (1920) by changing the size of the image based on the size of the detailed output area (1910-1). Here, the electronic device (100) may perform downscaling to change the size of the image to be smaller. According to one embodiment, the aspect ratio of the image may be maintained when the electronic device (100) performs the downscaling operation. According to another embodiment, the aspect ratio of the image may not be maintained when the electronic device (100) performs the downscaling operation.

[0240] And, the electronic device (100) can output a corrected image (1920) in area (1910-1).

[0241] FIG. 20 is a drawing for explaining an embodiment in which an image is displayed in all of a plurality of regions connected in the horizontal direction.

[0242] Referring to FIG. 20, the electronic device (100) can divide the projection surface into a first area (2001) and a second area (2002). The electronic device (100) can output an image (2010) onto the projection surface. The size of the image (2010) may be larger than the size of the first area (2001). Therefore, the image (2010) may be output across both the first area (2001) and the second area (2002).

[0243] For example, the image (2010) may include content such as “MOVIE START.” Here, the “MOVIE” portion may be displayed in the first area (2001) and the “START” portion may be displayed in the second area (2002). If the image (2010) is displayed across the first area (2001) and the second area (2002), the image (2010) may be distorted.

[0244] FIG. 21 is a drawing for explaining the operation of reducing the size of an image and outputting it according to another embodiment.

[0245] Referring to FIG. 21, the electronic device (100) may divide the projection surface into a first area (2101) and a second area (2102). Here, the first area (2101) and the second area (2102) may correspond to the first area (2001) and the second area (2002) of FIG. 20. Also, the area (2110) may mean an area where the uncorrected image (2010) of FIG. 20 can be output.

[0246] The electronic device (100) can determine a first area (2101) as an output area and obtain the size of the output area. Then, the electronic device (100) can obtain a corrected image (2120) by changing the size of the image based on the size of the first area (2101). Then, the electronic device (100) can output the corrected image (2120) to the first area (2101).

[0247] FIG. 22 is a diagram illustrating the operation of expanding the size of an image for output.

[0248] Referring to FIG. 22, the electronic device (100) can divide the projection surface into a first area (2201) and a second area (2202). The electronic device (100) can determine the first area (2201) as an output area and obtain the size of the first area (2201). The electronic device (100) can change the size of the image based on the size of the first area (2201).

[0249] For example, it is assumed that the size of the first area (2201) is larger than the size of the image. Here, the area (2220) may be an area where the image before correction is displayed. Here, the size of the area (2220) where the image before correction is displayed may be smaller than the size of the first area (2201). To provide the largest possible screen to the viewer, the electronic device (100) may enlarge the size of the image.

[0250] Here, the electronic device (100) can perform an upscaling operation to enlarge the size of the image. And, the electronic device (100) can obtain a corrected image (2230) through the upscaling operation. And, the electronic device (100) can output the corrected image (2230) to the first area (2201).

[0251] Meanwhile, according to another embodiment, the area (2220) may be an area where an image output based on movement information is output. For example, the electronic device (100) may move the image (1610) to the left so that the image (1610) of FIG. 16 is output to the output area. Here, the area (2220) of FIG. 22 may be an area where the image (1610) of FIG. 16 is moved to the left and output. The operation of moving and outputting the image (1610) is described in FIG. 23 to FIG. 26.

[0252] FIG. 23 is a flowchart illustrating the operation of outputting an image based on the movement information of a projection lens.

[0253] Referring to FIG. 23, the electronic device (100) can obtain distance information, image output size information, and projection surface information (S2305). Then, the electronic device (100) can identify an output area on the projection surface and obtain the size of the output area (S2310). Then, the electronic device (100) can obtain movement information based on the image output size and the size of the output area (S2315). Here, the movement information may refer to information related to the movement of the projection lens (110) included in the projection unit (111). Then, the electronic device (100) can output an image based on the movement information (S2320). Specifically, the electronic device (100) can move the projection lens (110) based on the movement information and output an image through the moved projection lens (110).

[0254] FIG. 24 is a drawing for explaining the operation of changing the position where an image is output according to one embodiment.

[0255] Referring to FIG. 24, the electronic device (100) can identify a first region (2401) and a second region (2402) by analyzing the projection surface. Here, as in the embodiment of FIG. 16, there may be a situation where an image (1610) is output across multiple regions. The electronic device (100) can determine one of the multiple regions as the output region so that the image is not output across multiple regions. For example, it is assumed that the first region (2401) is determined as the output region among the first region (2401) or the second region (2402).

[0256] The electronic device (100) can change the output position of the image (2420) so that the image (2420) is output only to the first area (2401). Here, the image (2420) may be an image output with a changed position. The image (2420) may be an image moved by a distance (d2) calculated to the left.

[0257] Here, the location (or calculated distance) where the image (2420) is displayed can be determined based on the size of the output area and the output size of the image (2420). Here, the electronic device (100) can output the final image (2420) by additionally considering the output area and the location information where the image (2420) is displayed.

[0258] Specifically, the electronic device (100) can determine the final output area of ​​the image (2420) based on the position and size of the output area (2401) before the image (2420) is moved. And, the electronic device (100) can output the image (2420) to the output area.

[0259] FIG. 25 is a drawing for explaining an embodiment in which an image is displayed in all of multiple areas connected in the vertical direction.

[0260] Referring to FIG. 25, the electronic device (100) can identify a first area (2501), a second area (2502), and a third area (2503) by analyzing the projection surface. Here, an image (2510) can be output across the first area (2501) and the third area (2503). Here, the first area (2501) may be an area corresponding to the front with respect to the output direction of the electronic device (100), and the third area (2503) may be an area corresponding to the bottom surface of the electronic device (100).

[0261] When an image (2510) is displayed across the first area (2501) and the third area (2503), the image may be distorted.

[0262] FIG. 26 is a drawing illustrating an operation to change the position where an image is output according to another embodiment.

[0263] Referring to FIG. 26, the electronic device (100) can divide the projection surface into a first area (2601), a second area (2602), and a third area (2603). As shown in FIG. 25, if the output position of the image (2620) is not changed, the image (2620) can be displayed across the first area (2601) and the third area (2603).

[0264] Here, the electronic device (100) can output the image (2620) by moving it upward. Here, the electronic device (100) can output the image (2620) by moving it by a calculated distance (d3).

[0265] Here, the location (or calculated distance) where the image (2620) is displayed can be determined based on the size of the output area and the output size of the image (2620). Here, the electronic device (100) can output the final image (2620) by additionally considering the output area and the location information where the image (2620) is displayed.

[0266] Specifically, the electronic device (100) can determine the final output area of ​​the image (2620) based on the position and size of the output area (2601) before the image (2620) is moved. And, the electronic device (100) can output the image (2620) to the output area.

[0267] FIG. 27 is a flowchart illustrating the operation of outputting an image by considering the movement limit value of the projection lens.

[0268] Referring to FIG. 27, the electronic device (100) can obtain distance information, image output size information, and projection surface information (S2705). Then, the electronic device (100) can identify an output area on the projection surface and obtain the size of the output area (S2710). Then, the electronic device (100) can obtain movement information of the projection lens (110) based on the image output size and the size of the output area (S2715).

[0269] And, the electronic device (100) can move the projection lens (110) based on movement information (S2720). Here, the movement information of the projection lens (110) may include at least one of the direction of movement and the distance of movement. Here, the electronic device (100) can identify whether the distance of movement of the projection lens (110) is greater than or equal to a movement threshold value (S2725).

[0270] Here, if the travel distance of the projection lens (110) is less than the travel limit value (S2725-N), the electronic device (100) can output an image to the output area identified in step S2710.

[0271] If the moving distance of the projection lens (110) is greater than or equal to the moving limit value (S2725-Y), the electronic device (100) can move the projection lens (110) to the moving distance (distance up to the moving limit value) and then output an image to the output area (S2735). Specifically, the electronic device (100) can move the projection lens (110) to a moving limit value that is shorter than the moving distance. Then, after moving the projection lens (110) to the maximum extent, the electronic device (100) can output an image through the moved projection lens (110).

[0272] And, the electronic device (100) can output a UI to guide the position of the electronic device (100) (S2740). In a situation where the projection lens (110) can no longer be physically moved, there may be a need for the electronic device (100) to move directly. Therefore, the electronic device (100) can guide the movement of the electronic device (100) through the UI.

[0273] The user can move the electronic device (100) through the output UI.

[0274] Figure 28 is a diagram illustrating a UI displayed when the movement limit value of the projection lens is exceeded.

[0275] Referring to FIG. 28, the electronic device (100) can analyze the projection surface and divide it into a first area (2801) and a second area (2802). Then, the electronic device (100) can move the image to the left and output it, similar to the embodiment of FIG. 24. Here, in moving the image to the left and outputting it, the projection lens (110) can be moved to the left. However, in a situation where the distance moved is greater than the movement limit value, the projection lens (110) may not be able to move physically any further.

[0276] Here, the electronic device (100) can output an image (2820) after moving the projection lens (110) to a movement limit value. Here, the image (2820) may be an image output when the projection lens (110) is moved to a physical movement limit value rather than a calculated movement distance (d2). Thus, the image (2820) may still be output across the first region (2801) and the second region (2802).

[0277] Here, the electronic device (100) can output a guide UI (2840). Here, the guide UI (2840) may include at least one of information indicating that the projection lens (110) can no longer move, the direction of movement of the electronic device (100), the distance of movement of the electronic device (100), and information requesting the electronic device (100) to move.

[0278] When a user moves the electronic device (100) through the guide UI (2840), the electronic device (100) can output an image that has been moved by a calculated distance (d2), and the output image can be displayed without spanning multiple areas.

[0279] FIG. 29 is a flowchart illustrating a method for controlling an electronic device according to one embodiment of the present disclosure.

[0280] Referring to FIG. 29, a control method for an electronic device (100) including a projection lens (110) for outputting an image to a projection surface includes the steps of: obtaining distance information from the electronic device (100) to the projection surface (S2905); obtaining output size information of the image based on the distance information to the projection surface (S2910); obtaining projection surface information corresponding to the curvature of the projection surface (S2915); obtaining movement information of the projection lens (110) based on the output size information of the image and the projection surface information (S2920); and outputting an image based on the movement information (S2925).

[0281] Meanwhile, the movement information may include at least one of the movement direction and the movement distance, and the control method may further include the step of moving the projection lens (110) based on the movement direction and the movement distance.

[0282] Meanwhile, the control method may further include the step of identifying the curvature position of the projection surface, the step of dividing the projection surface into a first area and a second area based on the curvature position, and the step of identifying either the first area or the second area as an output area, and the step of outputting an image (S2925) may output an image to the identified output area.

[0283] Meanwhile, the step of identifying either the first area or the second area as an output area may involve obtaining the size of the first area and the size of the second area, and identifying the area with the larger size between the first area and the second area as the output area.

[0284] Meanwhile, the step of identifying either the first area or the second area as an output area may identify the first area as an output area if the size of the first part output in the first area among the areas where the image is output is larger than the size of the second part output in the second area among the areas where the image is output.

[0285] Meanwhile, the control method may further include the step of obtaining the size of an output area and the step of changing the size of an image based on the size of the output area, and the step of outputting an image (S2925) may output the changed image to the output area.

[0286] Meanwhile, the step of changing the image size can change the image size while maintaining the image's aspect ratio.

[0287] Meanwhile, the control method may further include the step of obtaining the size of an output area, the step of enlarging the size of the image if the size of the output area is larger than the output size of the image, and the step of reducing the size of the image if the size of the output area is smaller than the output size of the image.

[0288] Meanwhile, the step of acquiring movement information (S2920) may acquire movement information based on a movement limit value corresponding to the projection lens (110), and the control method may further include the step of outputting a UI (User Interface) to guide the position of the electronic device (100) if the movement distance included in the movement information is greater than the movement limit value.

[0289] Meanwhile, the step of acquiring movement information (S2920) can identify whether an image is output to both the first area and the second area based on a captured image acquired through an image sensor if the projection surface includes the first area and the second area, and if an image is output to both the first area and the second area, movement information of the projection lens (110) can be acquired.

[0290] Meanwhile, a control method for an electronic device such as that of FIG. 29 can be executed on an electronic device having the configuration of FIG. 2a or FIG. 2b, and can also be executed on an electronic device having other configurations.

[0291] Meanwhile, the methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0292] In addition, the methods according to the various embodiments of the present disclosure described above can be implemented by software upgrades or hardware upgrades alone for existing electronic devices.

[0293] In addition, the various embodiments of the present disclosure described above may also be performed through an embedded server equipped in an electronic device, or through an external server among at least one of the electronic device and the display device.

[0294] Meanwhile, according to the exemplary embodiments of the present disclosure, the various embodiments described above may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0295] Additionally, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a storage medium such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0296] Additionally, each component (e.g., module or program) according to the various embodiments described above may be composed of a single or multiple entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be further included in the various embodiments. Generally or additionally, some components (e.g., module or program) may be integrated into a single entity to perform the functions performed by each of the respective components prior to integration in the same or similar manner. The operations performed by the module, program, or other components according to the various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations added.

[0297] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure. Explanation of the symbols

[0298] 100: Electronic device 111: Projection section 112: Memory 113: Sensor section 114: Processor

Claims

Claim 1 An electronic device comprising: a memory for storing an image; a sensor unit including at least one sensor; a projection unit including a projection lens for outputting the image onto a projection surface; and a processor that obtains distance information from the electronic device to the projection surface through the sensor unit, obtains output size information of the image based on the distance information to the projection surface obtained through the sensor unit, obtains projection surface information corresponding to the curvature of the projection surface through the sensor unit, obtains movement information of the projection lens based on the output size information of the image and the projection surface information, and controls the projection unit to output the image based on the movement information; wherein the processor identifies the curvature position of the projection surface, divides the projection surface into a first area and a second area based on the curvature position, identifies either the first area or the second area as an output area based on the size associated with the divided first area and the second area, and controls the projection unit to output the image to the identified output area. Claim 2 An electronic device according to claim 1, wherein the sensor unit includes a distance sensor, the movement information includes at least one of a movement direction and a movement distance, and the processor controls the projection unit so that the projection lens moves based on the movement direction and the movement distance. Claim 3 delete Claim 4 An electronic device according to claim 1, wherein the processor obtains the size of the first region and the size of the second region, and identifies the region with the larger size between the first region and the second region as the output region. Claim 5 An electronic device according to claim 1, wherein the processor identifies the first area as the output area if the size of the first part output in the first area among the areas where the image is output is larger than the size of the second part output in the second area among the areas where the image is output. Claim 6 An electronic device according to claim 1, wherein the processor obtains the size of the output area, changes the size of the image while maintaining the aspect ratio of the image based on the size of the output area, and controls the projection unit to output the changed image to the output area. Claim 7 delete Claim 8 An electronic device according to claim 1, wherein the processor obtains the size of the output area, enlarges the size of the image if the size of the output area is larger than the output size of the image, and reduces the size of the image if the size of the output area is smaller than the output size of the image. Claim 9 An electronic device according to claim 1, wherein the processor acquires movement information based on a movement limit value corresponding to the projection lens, and controls the projection unit to output a UI (User Interface) for guiding the position of the electronic device if the movement distance included in the movement information is greater than the movement limit value. Claim 10 An electronic device according to claim 1, wherein the sensor unit includes an image sensor, and the processor identifies whether the image is output to both the first area and the second area based on an image captured through the image sensor when the projection surface includes a first area and a second area, and acquires movement information of the projection lens when the image is output to both the first area and the second area. Claim 11 A control method for an electronic device including a projection lens for outputting an image to a projection surface, comprising: a step of obtaining distance information from the electronic device to the projection surface; a step of obtaining output size information of the image based on the distance information to the projection surface; a step of obtaining projection surface information corresponding to the curvature of the projection surface; a step of obtaining movement information of the projection lens based on the output size information of the image and the projection surface information; and a step of outputting the image based on the movement information; wherein the control method further comprises: a step of identifying the curvature position of the projection surface; a step of dividing the projection surface into a first area and a second area based on the curvature position; and a step of identifying either the first area or the second area as an output area based on the size associated with the divided first area and the second area; and wherein the step of outputting the image outputs the image to the identified output area. Claim 12 In claim 11, the movement information comprises at least one of a movement direction and a movement distance, and the control method further comprises the step of moving the projection lens based on the movement direction and the movement distance. Claim 13 delete Claim 14 ◈Claim 14 was abandoned upon payment of the registration fee.◈ In claim 11, the step of identifying either the first area or the second area as an output area comprises obtaining the size of the first area and the size of the second area, and identifying the area of ​​the larger size between the first area and the second area as the output area, a control method. Claim 15 ◈Claim 15 was abandoned upon payment of the registration fee.◈ In claim 11, the step of identifying either the first area or the second area as an output area is a control method in which, if the size of the first part output in the first area among the areas where the image is output is larger than the size of the second part output in the second area among the areas where the image is output, the first area is identified as the output area. Claim 16 ◈Claim 16 was abandoned upon payment of the registration fee.◈ The control method according to Claim 11 further comprises the step of obtaining the size of the output area; and the step of changing the size of the image while maintaining the aspect ratio of the image based on the size of the output area; wherein the step of outputting the image is to output the changed image to the output area. Claim 17 delete Claim 18 ◈Claim 18 was abandoned upon payment of the registration fee.◈ A control method according to Claim 11, further comprising: a step of obtaining the size of the output area; a step of enlarging the size of the image if the size of the output area is larger than the output size of the image; and a step of reducing the size of the image if the size of the output area is smaller than the output size of the image. Claim 19 ◈Claim 19 was abandoned upon payment of the registration fee.◈ In claim 11, the step of acquiring the movement information acquires the movement information based on a movement limit value corresponding to the projection lens, and the control method further comprises the step of outputting a UI (User Interface) for guiding the position of the electronic device if the movement distance included in the movement information is greater than the movement limit value. Claim 20 ◈Claim 20 was abandoned upon payment of the registration fee.◈ In claim 11, the step of acquiring the movement information comprises, if the projection surface includes a first area and a second area, identifying whether the image is output to both the first area and the second area based on a captured image acquired through an image sensor, and if the image is output to both the first area and the second area, acquiring the movement information of the projection lens.

Images