Electronic apparatus and controlling method thereof

Abstract

An electronic device is disclosed. The device includes an electronic memory, a sensor unit, a projection unit for outputting an image to a projection surface, and a processor for acquiring a first image including content from the memory, acquiring tilt information of the electronic device through the sensor unit, identifying a first area for displaying the first image and a second area where the first image is not displayed based on the tilt information, changing the size of the first image based on the size of the first area, controlling the projection unit to output the first image with the changed size on the first area, and controlling the projection unit to output a second image including additional information on the second area based on the tilt information and the size of the second area.

Description

Technology Field

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device and a method for controlling the same that outputs an image and additional information together on a projection surface. Background Technology

[0002] When a projector outputs an image to a projection surface, the output image may not be rectangular due to the projector's physical tilt. Additionally, the output image may be rotated clockwise or counterclockwise relative to the viewing surface.

[0003] If an image output from a projector is not displayed in a rectangular shape or is displayed in a rotated state, the user may see a distorted image. To correct the distorted image, the projector can perform keystone correction. Keystone correction is an operation that corrects the image so that it is displayed as an undistorted rectangular image.

[0004] When an image is modified through keystone correction, the output area of ​​the image may differ. For example, before keystone correction, the image was output in an area of ​​size 1, but after keystone correction, the image may be output in an area of ​​size 2. If the first size is larger than the second size, the size of the output area may be reduced through keystone correction.

[0005] To avoid changing the size of the output area, the projector must change the output area. However, to change the output area, the project's projection settings may need to be modified. Changing the projection settings may result in issues such as changes in image resolution or a decrease in sharpness.

[0006] Therefore, in order to output an image with keystone correction performed without changing the outputtable area, the size of the output area may be reduced. When the size of the output area is reduced, a remainder area may occur. Specifically, the area within the outputtable area excluding the area where the keystone-corrected image is displayed can be identified as the remainder area.

[0007] Here, since no image is displayed in the remaining identified area, utilizing the remaining area may be problematic. The problem to be solved

[0008] The present disclosure is designed to improve upon the aforementioned problems, and the purpose of the present disclosure is to provide an electronic device and a control method thereof that identify a first area for outputting a first image containing content and a second area for outputting a second image containing additional information based on tilt information of an electronic device, and output a second image to a second area where the first image is not displayed. means of solving the problem

[0009] An electronic device according to the present embodiment for achieving the above-described purpose includes a memory, a sensor unit, a projection unit for outputting an image to a projection surface, and a processor for acquiring a first image including content from the memory, acquiring tilt information of the electronic device through the sensor unit, identifying a first area for displaying the first image and a second area where the first image is not displayed based on the tilt information, changing the size of the first image based on the size of the first area, controlling the projection unit to output the first image with the changed size on the first area, and controlling the projection unit to output a second image including additional information on the second area based on the tilt information and the size of the second area.

[0010] Meanwhile, the processor can rotate the first image based on the tilt information, correct the first image by changing the width and height of the first image based on the width and height of the first area, and control the projection unit to output the corrected first image corresponding to the first area.

[0011] Meanwhile, the processor can rotate the second image based on the tilt information, correct the second image by changing the size of the second image based on the size of the second area, and control the projection unit to output the corrected second image corresponding to the second area.

[0012] Meanwhile, the above-mentioned tilt information may include a tilt direction, and the processor may correct the first image and the second image by rotating them in the reverse direction of the tilt direction, and the tilt direction may be clockwise or counterclockwise relative to the projection surface.

[0013] Meanwhile, the sensor unit may include at least one of a tilt sensor that senses the tilt of the electronic device or an image sensor that captures an image, and the processor may obtain the tilt direction based on the sensing data obtained from the sensor unit.

[0014] Meanwhile, if there are multiple second regions, the processor can obtain the area of ​​the multiple second regions and control the projection unit to output the second image to the region having the largest area among the multiple second regions.

[0015] Meanwhile, the processor can identify an output area where an image can be output through the projection unit, identify a first area where the corrected first image is output, and identify an area within the output area excluding the first area as the second area.

[0016] Meanwhile, the processor can control the projection unit to output the background color of the second area as a predetermined color.

[0017] Meanwhile, the sensor unit may include an image sensor that captures an image, and the processor may identify the color of the projection surface based on the image captured through the image sensor, and may identify the predetermined color based on the identified color of the projection surface.

[0018] Meanwhile, the processor can control the projection unit to output a guide UI for rotating the tilt information and the second image.

[0019] A control method for an electronic device that outputs an image on a projection surface according to one embodiment of the present disclosure comprises the steps of: acquiring a first image containing content; acquiring tilt information of the electronic device; identifying a first area for displaying the first image and a second area in which the first image is not displayed based on the tilt information; changing the size of the first image based on the size of the first area; outputting the first image with changed size on the first area; and outputting a second image containing additional information on the second area based on the tilt information and the size of the second area.

[0020] Meanwhile, the step of changing the size of the first image may rotate the first image based on the tilt information, correct the first image by changing the width and height of the first image based on the width and height of the first area, and the step of outputting the first image may output the corrected first image corresponding to the first area.

[0021] Meanwhile, the control method may further include a step of rotating the second image based on the tilt information and correcting the second image by changing the size of the second image based on the size of the second area, and the step of outputting the second image may output the corrected second image corresponding to the second area.

[0022] Meanwhile, the above-mentioned tilt information may include a tilt direction, and the control method may further include a step of correcting by rotating the first image and the second image in the reverse direction of the above-mentioned tilt direction, and the above-mentioned tilt direction may be clockwise or counterclockwise relative to the projection surface.

[0023] Meanwhile, the sensor unit of the electronic device may include at least one of a tilt sensor that senses the tilt of the electronic device or an image sensor that captures an image, and the step of acquiring the tilt information may acquire the tilt direction based on the sensing data acquired from the sensor unit.

[0024] Meanwhile, in the step of outputting the second image, if there are multiple second regions, the area of ​​the multiple second regions can be obtained, and the second image can be output to the region having the largest area among the multiple second regions.

[0025] Meanwhile, the step of identifying the first region and the second region can identify an outputtable area where an image can be output, identify the first region where the corrected first image is output, and identify the area excluding the first region from the outputtable area as the second region.

[0026] Meanwhile, the above control method may further include the step of outputting the background color of the second area as a predetermined color.

[0027] Meanwhile, the sensor unit of the electronic device may include an image sensor that captures an image, and the step of outputting the background color of the second area as a predetermined color may identify the color of the projection surface based on the image captured through the image sensor, and identify the predetermined color based on the identified color of the projection surface.

[0028] Meanwhile, the above control method can output a guide UI for rotating the tilt information and the second image. Brief explanation of the drawing

[0029] FIG. 1 is a perspective view illustrating the appearance of an electronic device according to one embodiment of the present disclosure. FIG. 2a is a block diagram illustrating an electronic device according to one embodiment of the present disclosure. FIG. 2b is a block diagram illustrating the specific configuration of FIG. 2a. FIG. 3 is a perspective view illustrating the appearance of an electronic device according to other embodiments of the present disclosure. FIG. 4a is a perspective view illustrating the appearance of an electronic device according to another embodiment of the present disclosure. FIG. 4b is a perspective view illustrating the appearance of an electronic device according to another embodiment of the present disclosure. FIG. 4c is a perspective view illustrating the appearance of an electronic device according to another embodiment of the present disclosure. FIG. 4d is a perspective view showing the electronic device (100) of FIG. 4c in a rotated state. Figure 5 is a diagram illustrating the operation of outputting an image to a projection surface. FIG. 6 is a diagram illustrating the operation of acquiring slope information according to one embodiment. FIG. 7 is a flowchart illustrating the operation of outputting a first image and a second image to different areas. FIG. 8 is a flowchart illustrating the operation of changing the first image. FIG. 9 is a diagram illustrating the operation of rotating the first image. FIG. 10 is a diagram illustrating the operation of changing the size of a first rotated image. Figure 11 is a drawing for explaining the second region. FIG. 12 is a flowchart illustrating the operation of changing the second image. FIG. 13 is a drawing for explaining the operation of outputting a second image according to one embodiment. FIG. 14 is a drawing for explaining the operation of outputting a second image according to another embodiment. FIG. 15 is a drawing for explaining the operation of outputting a second image according to another embodiment. FIG. 16 is a flowchart illustrating the operation of changing multiple second images. FIG. 17 is a diagram illustrating the operation of outputting a plurality of second images according to one embodiment. FIG. 18 is a drawing for explaining the operation of outputting a plurality of second images according to another embodiment. FIG. 19 is a flowchart illustrating the operation of combining the first image and the second image into respective layers. FIG. 20 is a diagram illustrating the operation of combining a first image and a second image into respective layers. FIG. 21 is a flowchart illustrating the operation of identifying the background color of a second region by identifying the color of the projection surface. FIG. 22 is a diagram illustrating the operation of identifying the background color of a second area by identifying the color of the projection surface. FIG. 23 is a drawing illustrating a User Interface (UI) for guiding a change of a second image according to one embodiment. FIG. 24 is a drawing illustrating a User Interface (UI) for guiding a change of a second image according to another embodiment. FIG. 25 is a flowchart illustrating a method for controlling an electronic device according to one embodiment. Specific details for implementing the invention

[0030] The present disclosure will be described in detail below with reference to the attached drawings.

[0031] The terms used in the embodiments of this disclosure have been selected to be as widely used as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant explanatory section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0032] In this specification, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, operations, or components such as parts) and do not exclude the presence of additional features.

[0033] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0034] Expressions such as "first," "second," "first," or "second" used in this specification may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0035] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0036] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "consisting of" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0037] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0038] In this specification, the term "user" may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0039] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.

[0040] FIG. 1 is a perspective view illustrating the appearance of an electronic device (100) according to one embodiment of the present disclosure.

[0041] Referring to FIG. 1, the electronic device (100) may include a head (103), a body (105), a projection lens (110), a connector (130), or a cover (107).

[0042] The electronic device (100) can be a device of various forms. In particular, the electronic device (100) may be a projector device that projects an enlarged image onto a wall or screen, and the projector device may be an LCD projector or a DLP (digital light processing) projector using a DMD (digital micromirror device).

[0043] Additionally, the electronic device (100) may be a home or industrial display device, or a lighting device used in daily life, or a sound device including a sound module, or may be implemented as a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a wearable device, or a home appliance. Meanwhile, the electronic device (100) according to one embodiment of the present disclosure is not limited to the devices described above, and the electronic device (100) may be implemented as an electronic device (100) having two or more functions of the devices described above. For example, the electronic device (100) may be used as a display device, a lighting device, or a sound device by turning off the projector function and turning on the lighting function or speaker function according to the operation of the processor, and may be used as an AI speaker by including a microphone or a communication device.

[0044] The main body (105) is a housing that forms the exterior and can support or protect components of an electronic device (100) placed inside the main body (105) (e.g., configurations shown in FIG. 2a and FIG. 2b). The shape of the main body (105) may have a structure close to a cylinder as shown in FIG. 1. However, the shape of the main body (105) is not limited thereto, and according to various embodiments of the present disclosure, the main body (105) may be implemented in various geometric shapes such as a column, a cone, or a sphere having a polygonal cross-section.

[0045] The size of the main body (105) may be such that a user can hold or move it with one hand, may be implemented in a super-compact size for easy portability, and may be implemented in a size that can be mounted on a table or combined with a lighting device.

[0046] The material of the main body (105) may be made of a matte metal or synthetic resin so that the user's fingerprints or dust do not adhere to it, or, the exterior of the main body (105) may be made of a smooth glossy finish.

[0047] A friction area may be formed in a portion of the exterior of the main body (105) so that a user can grip and move it. Alternatively, the main body (105) may be provided with a folded gripping portion or support (108a, see FIG. 3) that a user can grip in at least a portion of the area.

[0048] A projection lens (110) is formed on one side of the main body (105) to project light that has passed through a lens array to the outside of the main body (105). In various embodiments, the projection lens (110) may be an optical lens with a low-dispersion coating to reduce chromatic aberration. The projection lens (110) may be a convex lens or a condensing lens, and in one embodiment, the projection lens (110) may adjust the focus by adjusting the positions of a plurality of sub-lenses.

[0049] The head (103) is provided to be coupled to one side of the main body (105) to support and protect the projection lens (110). The head (103) can be coupled to the main body (105) so as to be swivelable within a preset angle range relative to one side of the main body (105).

[0050] The head (103) can be swiveled automatically or manually by a user or processor to freely adjust the projection angle of the projection lens (110). Alternatively, although not shown in the drawing, the head (103) may be coupled to the main body (105) and may include a neck extending from the main body (105), so that the head (103) may be tilted or tilted to adjust the projection angle of the projection lens (110).

[0051] The electronic device (100) can project light or an image to a desired location by adjusting the direction of the head (103) and the emission angle of the projection lens (110) while the position and angle of the main body (105) are fixed. Additionally, the head (103) may include a handle that can be grasped after being rotated in a desired direction by the user.

[0052] A plurality of openings may be formed on the outer surface of the main body (105). Audio output from the audio output unit may be output to the outside of the main body (105) of the electronic device (100) through the plurality of openings. The audio output unit may include a speaker, and the speaker may be used for general purposes such as multimedia playback, recording playback, voice output, etc.

[0053] According to one embodiment of the present disclosure, a heat dissipation fan (not shown) may be provided inside the main body (105), and when the heat dissipation fan (not shown) is driven, air or heat inside the main body (105) can be discharged through a plurality of openings. Therefore, the electronic device (100) can discharge heat generated by the operation of the electronic device (100) to the outside and prevent the electronic device (100) from overheating.

[0054] The connector (130) can connect the electronic device (100) to an external device to transmit and receive electrical signals or receive power from an external source. According to one embodiment of the present disclosure, the connector (130) can be physically connected to an external device. In this case, the connector (130) may include an input / output interface and may communicate with the external device via wired or wireless means or receive power. For example, the connector (130) may include an HDMI connection terminal, a USB connection terminal, an SD card receiving slot, an audio connection terminal, or a power outlet, or may include a Bluetooth, Wi-Fi, or wireless charging connection module that is wirelessly connected to an external device.

[0055] Additionally, the connector (130) may have a socket structure connected to an external lighting device and may receive power by being connected to a socket receiving groove of the external lighting device. The size and specifications of the socket structure connector (130) can be implemented in various ways considering the receiving structure of the external device that can be coupled. For example, according to the international standard E26, the diameter of the joint portion of the connector (130) may be implemented as 26 mm, in which case the electronic device (100) can be coupled to an external lighting device such as a stand by replacing a conventionally used light bulb. Meanwhile, when coupled to a socket located on the existing ceiling, the electronic device (100) has a structure that projects from top to bottom, and if the electronic device (100) does not rotate due to the socket coupling, the screen also cannot rotate. Accordingly, even when power is supplied through a socket connection, the electronic device (100) can rotate. The electronic device (100) is socket-connected to a stand on the ceiling, and the head (103) swivels on one side of the main body (105) to adjust the projection angle, thereby allowing the screen to be projected to a desired position or the screen to be rotated.

[0056] The connector (130) may include a coupling sensor, and the coupling sensor may sense whether the connector (130) and an external device are coupled, the coupling state, or the coupling target and transmit this to a processor, and the processor may control the operation of the electronic device (100) based on the received detection value.

[0057] The cover (107) can be attached to and detached from the main body (105) and can protect the connector (130) so that the connector (130) is not always exposed to the outside. The shape of the cover (107) may have a shape that is continuous with the main body (105) as shown in FIG. 1, or it may be implemented to correspond to the shape of the connector (130). The cover (107) can support an electronic device (100), and the electronic device (100) can be attached to the cover (107) and used by being attached to or mounted on an external stand.

[0058] In various embodiments of the electronic device (100), a battery may be provided inside the cover (107). The battery may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0059] Although not illustrated in the drawings, the electronic device (100) may include a camera module, and the camera module may capture still images and video. According to one embodiment, the camera module may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0060] Although not shown in the drawing, the electronic device (100) may include a protective case (not shown) to protect the electronic device (100) and to allow for easy transport, or may include a stand (not shown) that supports or fixes the main body (105), or a bracket (not shown) that can be attached to a wall or partition.

[0061] Additionally, the electronic device (100) can be connected to various external devices using a socket structure to provide various functions. In one embodiment, the electronic device (100) can be connected to an external camera device using a socket structure. The electronic device (100) can provide images stored in the connected camera device or images currently being captured using a projection unit (111). In another embodiment, the electronic device (100) can be connected to a battery module using a socket structure to receive power. Meanwhile, although the electronic device (100) can be connected to an external device using a socket structure, this is merely one embodiment, and it can be connected to an external device using another interface (e.g., USB, etc.).

[0062] FIG. 2a is a block diagram illustrating an electronic device according to one embodiment of the present disclosure.

[0063] Referring to FIG. 2a, the electronic device (100) may include a projection unit (111), a memory (112), a sensor unit (113), and a processor (114).

[0064] The projection unit (111) can perform the function of outputting an image to a projection surface. A specific description related to the projection unit (111) is provided in FIG. 2b. Here, although described as a projection unit, the electronic device (100) can project an image in various ways. Here, the projection unit (111) may include a projection lens (110). Here, the projection surface may be a part of the physical space where the image is output or a separate screen.

[0065] The memory (112) can store the first image and the second image output to the projection surface. A specific description of the memory (112) is described in FIG. 2b.

[0066] The sensor unit (113) may include at least one sensor. Specifically, the sensor unit (113) may include at least one of a tilt sensor that senses the tilt of the electronic device (100) and an image sensor that captures an image. Here, the tilt sensor may be an accelerometer or a gyroscope, and the image sensor may refer to a camera or a depth camera. In addition, the sensor unit (113) may include various sensors other than the tilt sensor or the image sensor. For example, the sensor unit (113) may include an illuminance sensor or a distance sensor. In addition, the sensor unit (113) may include a LiDAR sensor.

[0067] The processor (114) can perform overall control operations of the electronic device (100). Specifically, the processor (114) functions to control the overall operation of the electronic device (100).

[0068] The processor (114) may include a projection unit (111). Here, the projection unit (111) can output an image to a projection surface.

[0069] Meanwhile, the processor (114) can obtain a first image containing content from memory (112), obtain tilt information of the electronic device (100) through the sensor unit (113), identify a first area for displaying the first image and a second area where the first image is not displayed based on the tilt information, change the size of the first image based on the size of the first area, control the projection unit (111) to output the first image with the changed size on the first area, and control the projection unit (111) to output a second image containing additional information on the second area based on the tilt information and the size of the second area.

[0070] Here, the processor (114) can obtain a first image stored in memory (112). Here, the first image may refer to an image corresponding to user input and may be an image containing content. For example, when user input for outputting the first content is received, the processor (114) can obtain a first image corresponding to the first content from memory (112).

[0071] Here, the processor (114) can acquire a second image stored in memory (112). Here, the second image may be an image containing additional information. Here, the additional information may include at least one of time, weather, advertising information, or information corresponding to the first image.

[0072] Here, the information corresponding to the first image may include at least one of the content name corresponding to the first image, the content playback time corresponding to the first image, and the content subtitle information corresponding to the first image.

[0073] Here, the processor (114) can sense tilt information of the electronic device (100) through the sensor unit (113). Here, the sensor unit (113) may refer to a tilt sensor. Here, the sensor unit (113) may include at least one sensor among an accelerometer or a gyroscope. The processor (114) can obtain tilt information of the electronic device (100) based on the sensing data obtained through the sensor unit (113).

[0074] Here, the processor (114) may receive user input for outputting a first image containing content. When user input is received, the processor (114) may identify a first area to output the first image. Here, the first area may refer to an area corrected based on tilt information. If the first image is output as is without a separate correction operation, the output first image may be output in a tilted state by the amount that the electronic device (100) is tilted. An explanation related to this is described in FIG. 5.

[0075] Here, the processor (114) can rotate the first image based on tilt information. And, the processor (114) can identify the area where the rotated first image is to be output most significantly within the outputtable area as the first area. Here, the outputtable area may not change despite the rotation of the first image. This is because if the outputtable area does not change, the clarity of the image can also be maintained.

[0076] Here, according to one embodiment, the size ratio of the rotated first image may be maintained when identifying the area where the rotated first image is to be output largest within the outputtable area. For example, if the first image is rectangular, the processor (114) may identify the first area while maintaining the aspect ratio of the rotated first image. For another example, if the first image is circular, the processor (114) may identify the first area while maintaining the curvature of the rotated first image. A specific description related to this is provided in FIG. 14.

[0077] Here, according to another embodiment, when identifying the area where the rotated first image is to be output largest in the output-possible area, the size ratio of the rotated first image may not be maintained (or may be changed). For example, if the first image is rectangular, the processor (114) may identify the first area without maintaining (or changing) the aspect ratio of the rotated first image. For another example, if the first image is circular, the processor (114) may identify the first area without maintaining (or changing) the curvature of the rotated first image. A specific description related to this is provided in FIG. 15.

[0078] Additionally, the processor (114) may identify an area in the outputtable region where the first image is not output as a second area. Here, the second area may be an area included in the remaining area (or residual area, or unused area, or gray area) excluding the first area among the outputtable regions. Here, the processor (114) may rotate the second image based on tilt information. And, the processor (114) may identify an area in the remaining region where the rotated second image will be output most significantly as the second area.

[0079] Here, according to one embodiment, the size ratio of the rotated second image may be maintained when identifying the area where the rotated second image is to be displayed largest within the outputtable area. Here, according to another embodiment, the size ratio of the rotated second image may not be maintained (or may be changed) when identifying the area where the rotated second image is to be displayed largest within the outputtable area. Specific examples related to this are the same as those for the first image, so a redundant description is omitted.

[0080] Here, the processor (114) can change the size of the rotated first image based on the size of the identified first area. And, the processor (114) can control the projection unit (111) to output the changed first image to the first area.

[0081] Here, the processor (114) can change the size of the rotated second image based on the size of the identified second area. And, the processor (114) can control the projection unit (111) to output the changed second image to the second area.

[0082] Meanwhile, the processor (114) can rotate the first image based on tilt information, correct the first image by changing the width and height of the first image based on the width and height of the first area, and control the projection unit (111) to output the corrected first image corresponding to the first area.

[0083] Here, the first image may be rectangular in shape. However, the object (main content) included in the first image may be of various shapes.

[0084] For example, the size of the first image before correction may be 1920 x 1080. However, there is a risk that the first image before correction will be output in a tilted state due to the tilt of the electronic device (100).

[0085] Accordingly, the processor (114) can output a first image by rotating it by the amount by which the electronic device (100) is tilted. Here, for the clarity of the image, the processor (114) may not change the outputtable area. Since rotating the first image may cause it to go beyond the outputtable area, the processor (114) may output the rotated first image by reducing its size. Here, the processor (114) can identify the first area where the reduced-size first image is output. Here, the processor (114) can obtain the width and height of the first area. Then, the processor (114) can change the width and height of the rotated first image based on the obtained width and height of the first area. For example, the size of the changed first image may be 1600 x 900. According to one embodiment, when identifying the first area, the ratio of width to height may be maintained at 16:9. However, according to another embodiment, the ratio of width to height may be changed when identifying the first area.

[0086] Here, the processor (114) can control the projection unit (111) to output a corrected first image corresponding to the size of the first area to the first area.

[0087] Meanwhile, the processor (114) can rotate the second image based on tilt information, correct the second image by changing the size of the second image based on the size of the second area, and control the projection unit (111) to output the corrected second image corresponding to the second area.

[0088] Here, the second image may be rectangular in shape. However, the objects (additional information) included in the second image may be of various shapes.

[0089] Here, the processor (114) can rotate the second image based on tilt information. The processor (114) can identify the area where the second image can be output to the maximum in the remaining area as the second area. The processor (114) can correct the rotated second image based on the size of the second area. Since the rest of the description is identical to the correction operation of the first image, a redundant description is omitted.

[0090] Meanwhile, the tilt information may include at least one of a tilt direction or a tilt angle. Here, the tilt direction may be clockwise or counterclockwise relative to the projection plane, and the tilt angle may be an angle between the horizontal plane and the horizontal axis of the electronic device (100).

[0091] According to one embodiment, the tilt information may include a tilt direction. Here, the processor (114) may correct the first image and the second image by rotating them in the reverse direction of the tilt direction.

[0092] According to another embodiment, the tilt information may include a tilt angle. Here, the processor (114) may correct the first image and the second image by rotating them by the tilt angle.

[0093] According to another embodiment, the tilt information may include both the tilt direction and the tilt angle. Here, the processor (114) may correct the first image and the second image by rotating them in the reverse direction of the tilt direction by the tilt angle.

[0094] Here, the processor (114) can obtain tilt information of the electronic device (100) through the sensor unit (113). It is assumed that the tilt information is tilted by 5 degrees counterclockwise relative to the projection surface. If the image is not rotated, the first image and the second image can be output to the projection surface tilted by 5 degrees counterclockwise relative to the projection surface.

[0095] Accordingly, the processor (114) can rotate the first image and the second image by the tilt angle of the electronic device (100) in the reverse direction (clockwise) of the counterclockwise tilt direction of the electronic device (100). An explanation regarding the tilt information is described in FIG. 6.

[0096] Meanwhile, the sensor unit (113) may include at least one of a tilt sensor that senses the tilt of the electronic device (100) or an image sensor that captures an image, and the processor (114) may obtain at least one of a tilt direction or a tilt angle based on the sensing data obtained from the sensor unit (113).

[0097] According to one embodiment, the sensor unit (113) may include a tilt sensor. Here, the tilt sensor may be a sensor that senses the tilt of the electronic device (100). For example, the tilt sensor may be an accelerometer or a gyroscope.

[0098] According to another embodiment, the sensor unit (113) may include an image sensor. Here, the image sensor may be a sensor that captures the front of the electronic device (100). The processor (114) may control the projection unit (111) to output an image (guide image) to a projection surface and may acquire an image captured through the image sensor. Here, the processor (114) may analyze the captured image to identify the output image (guide image) and the boundary line of the projection surface. Then, the processor (114) may acquire tilt information of the electronic device (100) by comparing the angle between the output image and the boundary line of the projection surface. If the boundary line of the projection surface and the output image (guide image) are parallel, the processor (114) may determine that the electronic device (100) is not tilted. However, if the boundary line of the projection surface and the output image (guide image) are not parallel, the processor (114) can determine that the electronic device (100) is tilted.

[0099] Here, the processor (114) can acquire sensing data through the sensor unit (113) and can acquire the tilt direction and tilt angle based on the acquired sensing data.

[0100] Meanwhile, if there are multiple second regions, the processor (114) can obtain the area of ​​multiple second regions and control the projection unit (111) to output a second image to the area having the largest area among the multiple second regions.

[0101] Here, the processor (114) can identify a second area among the outputtable areas where the corrected (changed) first image is not output. Here, the second area may refer to the remaining area. If it is identified that there are multiple second areas, the processor (114) can obtain the area of ​​each of the multiple second areas. Then, it can identify the area having the largest area among the multiple second areas. Then, the processor (114) can control the projection unit (111) to output the second image to the identified area. The second image must be output to the area with the largest area so that the second image can be output at the largest size.

[0102] Meanwhile, the processor (114) can identify an output area where an image can be output through the projection unit (111), can identify a first area where a corrected first image is output, and can identify an area excluding the first area from the output area as a second area.

[0103] Here, the second area may refer to the remaining area in the outputtable area where the first image is not output. Here, the processor (114) may output the second image at the location (area) within the second area where the second image can be output at the largest size.

[0104] Meanwhile, a detailed explanation regarding the operation of outputting the second area and the second image is described in FIGS. 11 to 18.

[0105] Meanwhile, the processor (114) can control the projection unit (111) to output the background color of the second area as a predetermined color.

[0106] Here, the second area may be an area where the first image corresponding to the user input is not displayed, and may be an area where additional information is displayed. Accordingly, the second area may be displayed in a color that does not interfere with the output of the first image as much as possible. Specifically, the background color of the second area may refer to a predetermined color that does not interfere with the output of the first image.

[0107] Here, the background color of the second region may be at least one of white, black, and gray.

[0108] Meanwhile, according to another embodiment, the processor (114) may determine the background color of the second area to be transparent. Here, if the background color of the second area is transparent, the processor (114) may not output any image to the background of the second area. Specifically, the processor (114) may output a second image and may not output any image other than the second image in relation to the second area. Meanwhile, if the background color of the second area is displayed as transparent, only the second image may be displayed without the user being able to perceive the second area.

[0109] Meanwhile, the sensor unit (113) may include an image sensor that captures an image, and the processor (114) may identify the color of the projection surface based on the image captured through the image sensor, and may change (or modify) the background color based on the identified color of the projection surface. Specifically, if the background color is a predetermined first color (basic color), the processor (114) may change the background color from the first color to a second color different from the first color based on the identified projection surface. For example, it is assumed that the projection surface is identified as white and the basic color of the background color is black. The processor (114) may change the background color from black to white so that the background color corresponds to the color (white) of the projection surface.

[0110] Meanwhile, the processor (114) can obtain an image by capturing the projection surface through an image sensor. The processor (114) can identify the color of the projection surface based on the captured image. The processor (114) can determine the identified color of the projection surface as the background color of the second area. The processor (114) can control the projection unit (111) so that the determined background color of the second area is output. A detailed explanation related to this is provided later in FIGS. 21 and 22.

[0111] Meanwhile, the processor (114) can control the projection unit (111) to output tilt information and a guide UI for rotating the second image.

[0112] Here, the processor (114) can output tilt information to the projection surface. In addition, the projection unit (111) can be controlled to output a UI to guide the rotation of the second image to the projection surface in addition to the tilt information. A detailed explanation related to this will be provided later in FIG. 23.

[0113] Meanwhile, the processor (114) can control the projection unit (111) to output a UI to the projection surface to guide the first image, which has already been rotated, to be further rotated. A detailed explanation regarding this is provided later in FIG. 24.

[0114] Meanwhile, if the second image contains data, the processor (114) may output only the second image to the second area without displaying the first image. For example, if the second image contains data of a predetermined format, the processor (114) may output only the second image to the second area without displaying the first image.

[0115] Meanwhile, the processor (114) can additionally identify areas where output is possible but the first image and the second image are not output. There may be areas that correspond to outputable areas but where images are not output depending on image resolution or lens settings. The processor (114) can identify areas where images are not output among the outputable areas. Here, the processor (114) can control the projection unit (111) so that the areas where images are not output among the outputable areas are displayed in black or gray. Additionally, the processor (114) can control the projection unit (111) so that the color of the areas where images are not output among the outputable areas matches the color of the projection surface. Additionally, the processor (114) can control the projection unit (111) to output a UI (user setting UI) for the user to directly change the color of the area.

[0116] The electronic device (100) according to the present embodiment can display additional information in the remaining area where the first image is not displayed (or output). Therefore, even if the size of the image is reduced through correction, additional information can be displayed in the remaining area to utilize space efficiently. Here, the image can be rotated using tilt information to distinguish between a first area for outputting a first image containing content and a second area for outputting additional information.

[0117] In addition, the processor (114) can control the first area and the second area separately, thereby simplifying the overall processing process or reducing the load.

[0118] Additionally, the electronic device (100) may not change the outputtable area despite the rotation of the first image. If the outputtable area is not changed, the clarity of the image may be maintained.

[0119] Additionally, since the electronic device (100) can use slope information to identify the remaining area, additional information can be output without distortion.

[0120] FIG. 2b is a block diagram illustrating the specific configuration of FIG. 2a.

[0121] Referring to FIG. 2b, the electronic device (100) may include at least one of a projection unit (111), a memory (112), a sensor unit (113), a processor (114), a user interface (115), an input / output interface (116), an audio output unit (117), or a power supply unit (118). Here, the description of the parts described in FIG. 2a regarding the projection unit (111), memory (112), sensor unit (113), and processor (114) is omitted. Meanwhile, the configuration shown in FIG. 2b is merely one embodiment, and some configurations may be omitted and new configurations may be added.

[0122] The projection unit (111) is configured to project an image outward. According to one embodiment of the present disclosure, the projection unit (111) can be implemented using various projection methods (e.g., a cathode-ray tube (CRT) method, a liquid crystal display (LCD) method, a digital light processing (DLP) method, a laser method, etc.). For example, the CRT method is basically the same principle as a CRT monitor. The CRT method magnifies the image using a lens in front of the cathode-ray tube (CRT) to display an image on a screen. Depending on the number of cathode-ray tubes, it is divided into a single-tube type and a three-tube type, and in the case of the three-tube type, the red, green, and blue cathode-ray tubes can be implemented separately.

[0123] As another example, the LCD method displays an image by transmitting light from a light source through a liquid crystal. LCD methods are divided into single-panel and three-panel types. In the case of the three-panel type, light from a light source is separated into Red, Green, and Blue by a dichroic mirror (a mirror that reflects only specific colors of light and allows the rest to pass through), then passes through the liquid crystal, and finally converges back into one place.

[0124] As another example, the DLP method is a technique that displays images using a DMD (Digital Micromirror Device) chip. The projection unit of the DLP method may include a light source, a color wheel, a DMD chip, and a projection lens. Light emitted from the light source can acquire color as it passes through a rotating color wheel. The light passing through the color wheel is input into the DMD chip. The DMD chip contains numerous micro-mirrors and reflects the light input into it. The projection lens performs the function of magnifying the light reflected from the DMD chip to the size of the image.

[0125] As another example, the laser method includes DPSS (Diode Pumped Solid State) lasers and galvanometers. Lasers that output various colors utilize a laser formed by installing three DPSS lasers for each RGB color and superimposing their optical axes using special mirrors. The galvanometer includes mirrors and high-output motors to move the mirrors at high speeds. For example, a galvanometer can rotate the mirror at a maximum speed of 40 KHz / sec. The galvanometer is mounted according to the scanning direction; since projectors generally perform planar scanning, the galvanometer can also be positioned along the x and y axes.

[0126] Meanwhile, the projection unit (111) may include various types of light sources. For example, the projection unit (111) may include at least one light source among a lamp, an LED, and a laser.

[0127] The projection unit (111) can output images with a 4:3 aspect ratio, a 5:4 aspect ratio, or a 16:9 wide aspect ratio depending on the use of the electronic device (100) or the user's settings, and can output images with various resolutions such as WVGA (854*480), SVGA (800*600), XGA (1024*768), WXGA (1280*720), WXGA (1280*800), SXGA (1280*1024), UXGA (1600*1200), and Full HD (1920*1080) depending on the aspect ratio.

[0128] Meanwhile, the projection unit (111) can perform various functions to adjust the output image under the control of the processor (114). For example, the projection unit (111) can perform functions such as zoom, keystone, quick corner (4-corner) keystone, lens shift, etc.

[0129] Specifically, the projection unit (111) can enlarge or reduce the image depending on the distance from the screen (projection distance). That is, a zoom function can be performed depending on the distance from the screen. At this time, the zoom function may include a hardware method that adjusts the screen size by moving a lens and a software method that adjusts the screen size by cropping the image. Meanwhile, when the zoom function is performed, the focus of the image needs to be adjusted. For example, the focus adjustment method includes a manual focus method and an electric method. A manual focus method refers to a method of manually adjusting the focus, and an electric method refers to a method in which the projector automatically adjusts the focus using a motor built into it when the zoom function is performed. When performing the zoom function, the projection unit (111) may provide a digital zoom function through software and may provide an optical zoom function that performs the zoom function by moving the lens through a driving unit.

[0130] Additionally, the projection unit (111) can perform a keystone function. If the height is not correct for front projection, the screen may be distorted upward or downward. The keystone function refers to a function that corrects the distorted screen. For example, if distortion occurs in the left-right direction of the screen, it can be corrected using horizontal keystone, and if distortion occurs in the up-down direction, it can be corrected using vertical keystone. The quick corner (4-corner) keystone function is a function that corrects the screen when the central area of ​​the screen is normal but the corner areas are unbalanced. The lens shift function is a function that moves the screen as is when the screen is off the screen.

[0131] Meanwhile, the projection unit (111) can automatically provide zoom / keystone / focus functions by analyzing the surrounding environment and projection environment without user input. Specifically, the projection unit (111) can automatically provide zoom / keystone / focus functions based on the distance between the electronic device (100) and the screen detected through sensors (depth camera, distance sensor, infrared sensor, illuminance sensor, etc.), information about the space where the electronic device (100) is currently located, information about the amount of ambient light, etc.

[0132] Additionally, the projection unit (111) can provide a lighting function using a light source. In particular, the projection unit (111) can provide a lighting function by outputting a light source using an LED. According to one embodiment, the projection unit (111) may include a single LED, and according to another embodiment, the electronic device may include a plurality of LEDs. Meanwhile, the projection unit (111) may output a light source using a surface-emitting LED according to an implementation example. Here, the surface-emitting LED may refer to an LED having a structure in which an optical sheet is placed on the upper side of the LED so that the light source is evenly distributed and output. Specifically, when a light source is output through the LED, the light source can be evenly distributed through the optical sheet, and the light source distributed through the optical sheet can be incident on the display panel.

[0133] Meanwhile, the projection unit (111) can provide a dimming function to the user to adjust the intensity of the light source. Specifically, when user input to adjust the intensity of the light source is received from the user through the user interface (240) (e.g., a touch display button or a dial), the projection unit (111) can control the LED to output the intensity of the light source corresponding to the received user input.

[0134] Additionally, the projection unit (111) can provide a dimming function based on content analyzed by the processor (114) without user input. Specifically, the projection unit (111) can control an LED to output the intensity of a light source based on information about the currently provided content (e.g., content type, content brightness, etc.).

[0135] Meanwhile, the projection unit (111) can control the color temperature by the control of the processor (114). Here, the processor (114) can control the color temperature based on the content. Specifically, when the content is identified as being output, the processor (114) can obtain frame-by-frame color information of the content determined to be output. Then, the processor (114) can control the color temperature based on the obtained frame-by-frame color information. Here, the processor (114) can obtain at least one main color of the frame based on the frame-by-frame color information. Then, the processor (114) can adjust the color temperature based on at least one obtained main color. For example, the color temperature that the processor (114) can adjust can be classified as a warm type or a cold type. Here, it is assumed that the frame to be output (hereinafter output frame) contains a scene where a fire has occurred. The processor (114) can identify (or obtain) that the main color is red based on the color information included in the current output frame. And, the processor (114) can identify a color temperature corresponding to the identified primary color (red). Here, the color temperature corresponding to red may be a warm type. Meanwhile, the processor (114) may use an artificial intelligence model to obtain color information of the frame or the primary color. According to one embodiment, the artificial intelligence model may be stored in an electronic device (100) (e.g., memory (112)). According to another embodiment, the artificial intelligence model may be stored in an external server capable of communicating with the electronic device (100).

[0136] Meanwhile, the electronic device (100) can control lighting functions by linking with an external device. Specifically, the electronic device (100) can receive lighting information from an external device. Here, the lighting information may include at least one of brightness information or color temperature information set by the external device. Here, the external device may refer to a device connected to the same network as the electronic device (100) (e.g., an IoT device included in the same home / company network) or a device that is not on the same network as the electronic device (100) but can communicate with the electronic device (e.g., a remote control server). For example, assume that an external lighting device (IoT device) included in the same network as the electronic device (100) is outputting red light at a brightness of 50. The external lighting device (IoT device) can transmit lighting information (e.g., information indicating that it is outputting red light at a brightness of 50) to the electronic device (100) directly or indirectly. Here, the electronic device (100) can control the output of the light source based on the lighting information received from the external lighting device. For example, if the lighting information received from an external lighting device includes information that outputs red light at a brightness of 50, the electronic device (100) can output red light at a brightness of 50.

[0137] Meanwhile, the electronic device (100) can control the lighting function based on biometric information. Specifically, the processor (114) can acquire the user's biometric information. Here, the biometric information may include at least one of the user's body temperature, heart rate, blood pressure, respiration, and electrocardiogram. Here, the biometric information may include various information in addition to the information described above. As an example, the electronic device may include a sensor for measuring biometric information. The processor (114) can acquire the user's biometric information through the sensor and control the output of the light source based on the acquired biometric information. As another example, the processor (114) can receive biometric information from an external device through an input / output interface (116). Here, the external device may refer to the user's portable communication device (e.g., a smartphone or a wearable device). The processor (114) can acquire the user's biometric information from the external device and control the output of the light source based on the acquired biometric information. Meanwhile, according to an embodiment, the electronic device can identify whether the user is sleeping, and if the user is identified as sleeping (or preparing to sleep), the processor (114) can control the output of the light source based on the user's biometric information.

[0138] The memory (112) may store at least one instruction regarding the electronic device (100). Additionally, the memory (112) may store an operating system (O / S) for operating the electronic device (100). Furthermore, the memory (112) may store various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure. Additionally, the memory (112) may include semiconductor memory such as flash memory or magnetic storage media such as a hard disk.

[0139] Specifically, various software modules for operating an electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (112), and the processor (114) may control the operation of the electronic device (100) by executing the various software modules stored in the memory (112). That is, the memory (112) is accessed by the processor (114), and reading / writing / modifying / deleting / updating of data by the processor (114) may be performed.

[0140] Meanwhile, in the present disclosure, the term memory (112) may be used to include memory (112), ROM (not shown), RAM (not shown) within the processor (114), or a memory card (not shown) (e.g., micro SD card, memory stick) mounted in the electronic device (100).

[0141] The user interface (115) may include various types of input devices. For example, the user interface (115) may include a physical button. In this case, the physical button may include a function key, a directional key (e.g., a four-way key), or a dial button. According to one embodiment, the physical button may be implemented as a plurality of keys. According to another embodiment, the physical button may be implemented as a single key. Here, when the physical button is implemented as a single key, the electronic device (100) may receive user input in which a single key is pressed for a threshold time or longer. When user input in which a single key is pressed for a threshold time or longer is received, the processor (114) may perform a function corresponding to the user input. For example, the processor (114) may provide a lighting function based on the user input.

[0142] Additionally, the user interface (115) can receive user input using a non-contact method. When receiving user input through a contact method, physical force must be transmitted to the electronic device. Therefore, a method for controlling the electronic device regardless of physical force may be required. Specifically, the user interface (115) can receive user gestures and perform actions corresponding to the received user gestures. Here, the user interface (115) can receive user gestures through a sensor (e.g., an image sensor or an infrared sensor).

[0143] Additionally, the user interface (115) can receive user input using a touch method. For example, the user interface (115) can receive user input through a touch sensor. According to one embodiment, the touch method can be implemented in a non-contact manner. For example, the touch sensor can determine whether the user's body has approached within a threshold distance. Here, the touch sensor can identify user input even when the user does not touch the touch sensor. Meanwhile, according to another embodiment, the touch sensor can identify user input when the user touches the touch sensor.

[0144] Meanwhile, the electronic device (100) may receive user input in various ways other than the user interface described above. In one embodiment, the electronic device (100) may receive user input through an external remote control device. Here, the external remote control device may be a remote control device corresponding to the electronic device (100) (e.g., a control device dedicated to the electronic device) or a user's portable communication device (e.g., a smartphone or a wearable device). Here, the user's portable communication device may store an application for controlling the electronic device. The portable communication device may acquire user input through the stored application and transmit the acquired user input to the electronic device (100). The electronic device (100) may receive user input from the portable communication device and perform an operation corresponding to the user's control command.

[0145] Meanwhile, the electronic device (100) can receive user input using voice recognition. According to one embodiment, the electronic device (100) can receive user voice through a microphone included in the electronic device. According to another embodiment, the electronic device (100) can receive user voice from a microphone or an external device. Specifically, the external device can acquire user voice through the microphone of the external device and transmit the acquired user voice to the electronic device (100). The user voice transmitted from the external device may be audio data or digital data converted from audio data (e.g., audio data converted into the frequency domain). Here, the electronic device (100) can perform an operation corresponding to the received user voice. Specifically, the electronic device (100) can receive audio data corresponding to the user voice through the microphone. And, the electronic device (100) can convert the received audio data into digital data. Additionally, the electronic device (100) can convert the converted digital data into text data using a STT (Speech To Text) function. According to one embodiment, the STT (Speech To Text) function can be performed directly in the electronic device (100), and

[0146] According to another embodiment, the Speech To Text (STT) function may be performed on an external server. The electronic device (100) may transmit digital data to an external server. The external server may convert the digital data into text data and obtain control command data based on the converted text data. The external server may transmit the control command data (which may also include text data) to the electronic device (100). The electronic device (100) may perform an action corresponding to the user's voice based on the obtained control command data.

[0147] Meanwhile, the electronic device (100) is an assistant (or artificial intelligence assistant, e.g., Bixby). TM Voice recognition functions can be provided using (etc.), but this is merely one example, and voice recognition functions can be provided through multiple assistances. At this time, the electronic device (100) can provide voice recognition functions by selecting one of the multiple assistances based on a trigger word corresponding to the assistance or a specific key present on the remote control.

[0148] Meanwhile, the electronic device (100) can receive user input using screen interaction. Screen interaction refers to a function in which the electronic device identifies whether a predetermined event occurs through an image projected onto a screen (or projection surface) and obtains user input based on the predetermined event. Here, the predetermined event may refer to an event in which a predetermined object is identified at a specific location (e.g., a location where a UI for receiving user input is projected). Here, the predetermined object may include at least one of a part of the user's body (e.g., a finger), a pointer, or a laser pointer. When the electronic device (100) identifies a predetermined object at a location corresponding to the projected UI, it may identify that user input for selecting the projected UI has been received. For example, the electronic device (100) may project a guide image to display the UI on the screen. And, the electronic device (100) may identify whether the user selects the projected UI. Specifically, the electronic device (100) can identify that a user has selected the projected UI when a predetermined event is identified at the location of the projected UI. Here, the projected UI may include at least one item. Here, the electronic device (100) can perform spatial analysis to identify whether the predetermined event is at the location of the projected UI. Here, the electronic device (100) can perform spatial analysis through a sensor (e.g., image sensor, infrared sensor, depth camera, distance sensor, etc.). By performing spatial analysis, the electronic device (100) can identify whether the predetermined event occurs at a specific location (the location where the UI is projected). And, if it is identified that the predetermined event occurs at a specific location (the location where the UI is projected), the electronic device (100) can identify that user input for selecting the UI corresponding to the specific location has been received.

[0149] The input / output interface (116) is configured to input or output at least one of an audio signal and a video signal. The input / output interface (116) can receive at least one of the audio and video signals from an external device and can output control commands to the external device.

[0150] Meanwhile, in one embodiment of the present disclosure, the input / output interface (116) may be implemented as at least one wired input / output interface among HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), USB C-type, DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). According to one embodiment, the wired input / output interface may be implemented as an interface that inputs and outputs only audio signals and an interface that inputs and outputs only video signals, or as a single interface that inputs and outputs both audio and video signals.

[0151] Additionally, the electronic device (100) can receive data through a wired input / output interface, but this is merely one embodiment, and it can also receive power through a wired input / output interface. For example, the electronic device (100) can receive power from an external battery via a USB C-type or from an outlet via a power adapter. As another example, the electronic device can receive power from an external device (e.g., a laptop or a monitor) via a DP.

[0152] Meanwhile, in one embodiment of the present disclosure, the input / output interface (116) may be implemented as a wireless input / output interface that performs communication using at least one of the communication methods of Wi-Fi, Wi-Fi Direct, Bluetooth, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution). Depending on the implementation example, the wireless input / output interface may be implemented as an interface that inputs and outputs only audio signals and an interface that inputs and outputs only video signals, or as a single interface that inputs and outputs both audio signals and video signals.

[0153] Additionally, the audio signal can be implemented to be received through a wired input / output interface, and the video signal to be received through a wireless input / output interface. Alternatively, the audio signal can be implemented to be received through a wireless input / output interface, and the video signal to be received through a wired input / output interface.

[0154] The audio output unit (117) is configured to output an audio signal. In particular, the audio output unit (117) may include an audio output mixer, an audio signal processor, and a sound output module. The audio output mixer can synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer can synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from an external source) into at least one analog audio signal. The sound output module may include a speaker or an output terminal. According to one embodiment, the sound output module may include a plurality of speakers, in which case the sound output module may be placed inside the main body, and sound radiated by covering at least a part of the diaphragm of the sound output module may pass through a waveguide and be transmitted to the outside of the main body. The sound output module may include a plurality of sound output units, and by symmetrically arranging the plurality of sound output units on the exterior of the main body, sound can be radiated in all directions, that is, in all 360 degrees.

[0155] The power supply unit (118) can receive power from an external source and supply power to various components of the electronic device (100). The power supply unit (118) according to one embodiment of the present disclosure can receive power through various methods. In one embodiment, the power supply unit (118) can receive power using a connector (130) as shown in FIG. 1. In addition, the power supply unit (118) can receive power using a 220V DC power cord. However, it is not limited thereto, and the electronic device can receive power using a USB power cord or a wireless charging method.

[0156] Additionally, the power supply unit (118) may receive power using an internal battery or an external battery. In one embodiment of the present disclosure, the power supply unit (118) may receive power through an internal battery. For example, the power supply unit (118) may charge the power of the internal battery using at least one of a 220V DC power cord, a USB power cord, and a USB C-Type power cord, and receive power through the charged internal battery. In addition, the power supply unit (118) according to one embodiment of the present disclosure may receive power through an external battery. For example, when a connection between an electronic device and an external battery is made through various wired communication methods such as a USB power cord, a USB C-Type power cord, or a socket, the power supply unit (118) may receive power through the external battery. That is, the power supply unit (118) may receive power directly from the external battery, or charge the internal battery through the external battery and receive power from the charged internal battery.

[0157] The power supply unit (118) according to the present disclosure can receive power using at least one of the plurality of power supply methods described above.

[0158] Meanwhile, regarding power consumption, the electronic device (100) may have power consumption less than or equal to a preset value (e.g., 43W) due to reasons such as the socket type and other standards. At this time, the electronic device (100) may vary power consumption to reduce power consumption when using a battery. That is, the electronic device (100) may vary power consumption based on the power supply method and power usage.

[0159] Meanwhile, an electronic device (100) according to one embodiment of the present disclosure can provide various smart functions.

[0160] Specifically, the electronic device (100) is connected to a mobile terminal device for controlling the electronic device (100), and the screen output from the electronic device (100) can be controlled through user input received from the mobile terminal device. For example, the mobile terminal device may be implemented as a smartphone including a touch display, and the electronic device (100) receives and outputs screen data provided by the mobile terminal device from the mobile terminal device, and the screen output from the electronic device (100) can be controlled according to user input received from the mobile terminal device.

[0161] The electronic device (100) can connect with a mobile terminal device through various communication methods such as Miracast, Airplay, wireless DEX, and Remote PC, and share content or music provided by the mobile terminal device.

[0162] Additionally, the mobile terminal device and the electronic device (100) can be connected in various connection methods. In one embodiment, the mobile terminal device may search for the electronic device (100) to perform a wireless connection, or the electronic device (100) may search for the mobile terminal device to perform a wireless connection. Additionally, the electronic device (100) can output content provided by the mobile terminal device.

[0163] In one embodiment, when a specific content or music is being output from a mobile terminal device, the mobile terminal device is placed near an electronic device, and a preset gesture is detected through the display of the mobile terminal device (e.g., motion tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0164] In one embodiment, when specific content or music is being output from a mobile terminal device, if the mobile terminal device comes closer to the electronic device (100) at a distance less than a preset distance (e.g., non-contact tap view) or if the mobile terminal device comes into contact with the electronic device (100) twice at short intervals (e.g., contact tap view), the electronic device (100) can output the content or music being output from the mobile terminal device.

[0165] In the above-described embodiment, it was explained that a screen identical to the screen provided by the mobile terminal device is provided by the electronic device (100), but the present disclosure is not limited thereto. That is, when a connection is established between the mobile terminal device and the electronic device (100), a first screen provided by the mobile terminal device may be output at the mobile terminal device, and a second screen provided by the mobile terminal device that is different from the first screen may be output at the electronic device (100). For example, the first screen may be a screen provided by a first application installed on the mobile terminal device, and the second screen may be a screen provided by a second application installed on the mobile terminal device. For example, the first screen and the second screen may be different screens provided by a single application installed on the mobile terminal device. In addition, for example, the first screen may be a screen that includes a UI in the form of a remote control for controlling the second screen.

[0166] The electronic device (100) according to the present disclosure may output a standby screen. For example, the electronic device (100) may output a standby screen when the electronic device (100) is not connected to an external device or when there is no input received from an external device for a preset period of time. The conditions for the electronic device (100) to output a standby screen are not limited to the above-described examples, and a standby screen may be output under various conditions.

[0167] The electronic device (100) may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. For example, the electronic device (100) may obtain an unstructured object by extracting only the shape of a specific object from data received from an external device, and may output a standby screen including the obtained unstructured object.

[0168] FIG. 3 is a perspective view illustrating the appearance of an electronic device (100) according to other embodiments of the present disclosure.

[0169] Referring to FIG. 3, the electronic device (100) may include a support (or a “handle”) (108a).

[0170] In various embodiments, the support (108a) may be a handle or a ring provided for a user to grasp or move the electronic device (100), or the support (108a) may be a stand that supports the main body (105) when the main body (105) is lying on its side.

[0171] As shown in FIG. 3, the support member (108a) may be connected to the outer surface of the main body (105) by a hinge structure so as to be attached or detached, and may be selectively detached and fixed from the outer surface of the main body (105) as needed by the user. The number, shape, or arrangement structure of the support member (108a) may be implemented in various ways without restriction. Although not shown in the drawings, the support member (108a) may be embedded inside the main body (105) so that the user can take it out and use it as needed, or the support member (108a) may be implemented as a separate accessory so that it can be attached to and detached from the electronic device (100).

[0172] The support member (108a) may include a first support surface (108a-1) and a second support surface (108a-2). The first support surface (108a-1) may be a surface facing the outside direction of the main body (105) when the support member (108a) is separated from the outer surface of the main body (105), and the second support surface (108a-2) may be a surface facing the inside direction of the main body (105) when the support member (108a) is separated from the outer surface of the main body (105).

[0173] The first support surface (108a-1) extends from the bottom of the main body (105) to the top of the main body (105) and can be moved away from the main body (105), and the first support surface (108a-1) may have a flat or uniformly curved shape. The first support surface (108a-1) can support the main body (105) when the electronic device (100) is mounted so that the outer surface of the main body (105) touches the bottom surface, that is, when the projection lens (110) is positioned to face the front direction. In an embodiment including two or more supports (108a), the projection angle of the head (103) and the projection lens (110) can be adjusted by adjusting the spacing between the two supports (108a) or the angle at which the hinges are open.

[0174] The second support surface (108a-2) is a surface that comes into contact with the user or the external mounting structure when the support (108a) is supported by the user or the external mounting structure, and may have a shape corresponding to the grip structure of the user's hand or the external mounting structure so as not to slip when supporting or moving the electronic device (100). The user can fix the head (103) by orienting the projection lens (110) toward the front, hold the support (108a), move the electronic device (100), and use the electronic device (100) like a flashlight.

[0175] The support groove (104) is provided in the main body (105) and is a groove structure capable of accommodating the support (108a) when it is not in use. As shown in FIG. 3, it can be implemented as a groove structure corresponding to the shape of the support (108a) on the outer surface of the main body (105). Through the support groove (104), the support (108a) can be stored on the outer surface of the main body (105) when it is not in use, and the outer surface of the main body (105) can be kept smooth.

[0176] Alternatively, the structure may have a support member (108a) stored inside the main body (105) and a support member (108a) that is pulled out of the main body (105) when the support member (108a) is needed. In this case, the support member groove (104) may be structured to be inserted into the main body (105) to accommodate the support member (108a), and may include a second support surface (108a-2) that is in close contact with the outer surface of the main body (105) or a door (not shown) that opens and closes a separate support member groove (104).

[0177] Although not shown in the drawing, the electronic device (100) may include various types of accessories that help with the use or storage of the electronic device (100). For example, the electronic device (100) may include a protective case (not shown) to protect the electronic device (100) and to allow for easy transport, or may include a tripod (not shown) to support or fix the main body (105) or a bracket (not shown) that is attached to the outer surface to fix the electronic device (100).

[0178] FIG. 4a is a perspective view illustrating the appearance of an electronic device (100) according to another embodiment of the present disclosure.

[0179] Referring to FIG. 4a, the electronic device (100) may include a support (or “handle”) (108b).

[0180] In various embodiments, the support (108b) may be a handle or a ring provided for a user to grasp or move the electronic device (100), or the support (108b) may be a stand that supports the main body (105) so that it can be directed at any angle while the main body (105) is lying on its side.

[0181] Specifically, the support member (108b) can be connected to the main body (105) at a predetermined point of the main body (105) (e.g., 2 / 3 to 3 / 4 of the height of the main body) as shown in FIG. 4a. When the support member (108) is rotated toward the main body, it can support the main body (105) so that it can face at any angle while lying on its side.

[0182] FIG. 4b is a perspective view illustrating the appearance of an electronic device (100) according to another embodiment of the present disclosure.

[0183] Referring to FIG. 4b, the electronic device (100) may include a support (or "base") (108c). In various embodiments, the support (108c) may include a base plate (108c-1) provided to support the electronic device (100) on the ground and two support members (108c-2) connecting the base plate (108-c) and the main body (105).

[0184] In one embodiment of the present disclosure, the heights of the two support members (108c-2) are the same, so that each of the cross-sections of the two support members (108c-2) can be joined or separated by a groove provided on one outer surface of the main body (105) and a hinge member (108c-3).

[0185] Two support members can be hinge-connected to the main body (105) at a preset point of the main body (105) (e.g., 1 / 3 to 2 / 4 of the height of the main body).

[0186] When the two support members and the main body are joined by the hinge member (108c-3), the main body (105) can be rotated around a virtual horizontal axis formed by the two hinge members (108c-3) so that the projection angle of the projection lens (110) can be adjusted.

[0187] Although FIG. 4b illustrates an embodiment in which two support members (108c-2) are connected to the main body (105), the present disclosure is not limited thereto, and as in FIG. 4c and FIG. 4d, one support member and the main body (105) may be connected by one hinge member.

[0188] FIG. 4c is a perspective view illustrating the appearance of an electronic device (100) according to another embodiment of the present disclosure.

[0189] FIG. 4d is a perspective view showing the electronic device (100) of FIG. 4c in a rotated state.

[0190] Referring to FIG. 4c and FIG. 4d, a support (108d) of various embodiments may include a base plate (108d-1) provided to support an electronic device (100) on the ground and a support member (108d-2) connecting the base plate (108-c) and the main body (105).

[0191] And, the cross-section of one support member (108d-2) can be joined or separated by a groove provided on one outer surface of the main body (105) and a hinge member (not shown).

[0192] When one support member (108d-2) and the main body (105) are joined by one hinge member (not shown), the main body (105) can be rotated around a virtual horizontal axis formed by one hinge member (not shown) as in FIG. 4d.

[0193] Meanwhile, the support shown in FIGS. 3, FIGS. 4a, FIGS. 4b, FIGS. 4c and FIGS. 4d is merely one example, and it goes without saying that the electronic device (100) can be equipped with a support in various positions or shapes.

[0194] Figure 5 is a diagram illustrating the operation of outputting an image to a projection surface.

[0195] Referring to FIG. 5, the electronic device (100) can output a first image (501) to a projection surface (500) through a projection unit (111). The electronic device (100) can output the first image (501) to an output-possible area (500-0) among the entire area of ​​the projection surface (500).

[0196] Here, the projection surface (500) may refer to the entire area of ​​physical space where the electronic device (100) can output an image. Here, the projection surface (500) may include at least one surface. For example, the projection surface (500) may consist of a single plane. For another example, the projection surface (500) may include at least two surfaces, and there may be a boundary between the surfaces.

[0197] Here, the output-possible area (500-0) may refer to an area of ​​the entire projection surface (500) where an image is likely to be output by the electronic device (100). The electronic device (100) may be controlled so that the size of the image is output differently depending on the output setting of the projection unit (111). For example, the electronic device (100) may output an image with low clarity but enlarged image size. Conversely, the electronic device (100) may output an image with high clarity but reduced image size.

[0198] According to one embodiment, the outputtable area (500-0) may refer to an area where the size of the image can be physically enlarged to the maximum extent to be outputtable.

[0199] According to another embodiment, the outputtable area (500-0) may refer to an area where the size of the image can be enlarged to the maximum while maintaining the clarity of the image within a predetermined range. Since clarity may decrease if the size of the image is enlarged too much, the electronic device (100) may limit the enlargement of the image by taking into account the clarity of the image. Accordingly, the electronic device (100) may limit the size of the outputtable area (500-0) by taking into account the clarity of the image. Here, the outputtable area (500-0) may be determined based on at least one of the physical characteristic information of the projection unit (111) (e.g., lens magnification), the size of the projection surface (500), the distance to the projection surface (500), or the resolution information of the image.

[0200] Meanwhile, the first image (501) output on the projection surface (500) may be displayed in a tilted state. If the electronic device (100) is tilted, the first image (501) may also be output in a tilted state. Therefore, the electronic device (100) needs to correct (or change) the first image (501) and output it. To correct the first image (501), the electronic device (100) may obtain tilt information of the electronic device (100).

[0201] FIG. 6 is a diagram illustrating the operation of acquiring slope information according to one embodiment.

[0202] Referring to FIG. 6, the electronic device (100) can sense tilt information of the electronic device (100). Here, the electronic device (100) can acquire sensing data related to the tilt through the sensor unit (113) and can acquire tilt information of the electronic device (100) based on the acquired sensing data. Here, the sensor unit (113) may include a tilt sensor.

[0203] Here, the tilt sensor that senses the tilt may include an accelerometer or a gyroscope. The accelerometer or gyroscope can acquire sensing data indicating how much the electronic device (100) is tilted.

[0204] Specifically, it is assumed that the electronic device (100) is located on the bottom surface (600). The electronic device (100) can identify a horizontal plane (601) of the electronic device (100) that is parallel to the bottom surface (600) using a sensor unit (113). Additionally, the electronic device (100) can identify an absolute horizontal plane (602). Here, the absolute horizontal plane (602) may refer to a plane that is perpendicular to the direction of the gravitational acceleration of an object (603), regardless of the inclination of the electronic device (100).

[0205] Here, the electronic device (100) can identify an angle (A) between the horizontal plane (601) of the electronic device (100) and the absolute horizontal plane (602). And, the electronic device (100) can obtain the identified angle (A) as tilt information of the electronic device (100).

[0206] FIG. 7 is a flowchart illustrating the operation of outputting a first image and a second image to different areas.

[0207] Referring to FIG. 7, the electronic device (100) can obtain tilt information through a tilt sensor (S705). An explanation related to this was described in FIG. 6.

[0208] And, the electronic device (100) can identify a first area for displaying (or outputting) a first image and a second area for displaying (or outputting) a second image based on tilt information (S710).

[0209] Here, the electronic device (100) can change (or correct) the first image based on the first area (S715). Specifically, the electronic device (100) can rotate and change the size of the first image based on the size of the first area. The image change operation may include at least one of the operation of rotating the image or the operation of changing the size of the image. Then, the electronic device (100) can output the changed first image to a projection surface (S720).

[0210] Here, the electronic device (100) can change (or correct) the second image based on the second area (S725). Specifically, the electronic device (100) can rotate and change the size of the second image based on the size of the second area. The image change operation may include at least one of the operation of rotating the image or the operation of changing the size of the image. Then, the electronic device (100) can output the changed second image to a projection surface (S730).

[0211] FIG. 8 is a flowchart illustrating the operation of changing the first image.

[0212] Referring to FIG. 8, the electronic device (100) can identify an output area (S805). Here, the output area may refer to an area where an image output through a projection unit (111) included in the electronic device (100) can be output. Accordingly, the output area may vary depending on the physical characteristics of the projection unit (111). For example, the size of the output area may vary depending on the magnification information of the projection unit (111).

[0213] Meanwhile, even if an image is output, the clarity of the image may decrease due to the image size being enlarged too much. Here, if the clarity of the image decreases, the output area in which the image is output may become meaningless. Therefore, the electronic device (100) can identify the output area so that the clarity of the image can be output within a critical range by considering the physical characteristics of the projection unit (111).

[0214] Here, the electronic device (100) can obtain slope information (S810). An explanation regarding slope information is described in FIG. 6.

[0215] Here, the electronic device (100) can rotate the first image based on the acquired tilt information (S815). Specifically, the electronic device (100) can rotate the first image so that the first image is displayed without tilting. For example, if the electronic device (100) is tilted 5 degrees counterclockwise from the reference point of looking at the projection plane, the electronic device (100) can rotate the first image 5 degrees clockwise from the reference point of looking at the projection plane.

[0216] And, the electronic device (100) can identify a first area in which the first image rotated in the output area is displayed as large as possible (S820). Even if the first image is rotated, the electronic device (100) may not rotate. Therefore, the output area may still remain fixed. If the first image is rotated without changing its size, the first image may not be output in the output area. Therefore, the electronic device (100) may need to change the size of the first image to output it. Here, the electronic device (100) can identify an area in which the first image rotated in the output area can be displayed as large as possible as the first area.

[0217] Additionally, the electronic device (100) can change the first image based on the identified first region. Specifically, the electronic device (100) can change the size of the rotated first image based on the size of the first region. For example, if the first image is a rectangular image, the electronic device (100) can change the width and height of the rotated first image based on the width and height of the identified first region. For another example, if the first image is a circular image, the electronic device (100) can change the radius of the rotated first image based on the radius of the identified first region.

[0218] And, the electronic device (100) can output a modified first image (S830). Here, the modified first image may refer to an image in which rotation and resizing operations have been performed.

[0219] FIG. 9 is a diagram illustrating the operation of rotating the first image.

[0220] Referring to FIG. 9, it is assumed that the electronic device (100) is tilted 5 degrees counterclockwise from the reference point of looking at the projection plane.

[0221] Here, when the electronic device (100) outputs the first image (901) without rotating it, the first image (901) may be output tilted by 5 degrees counterclockwise from the reference point of looking at the projection plane.

[0222] Here, the electronic device (100) can rotate the first image (901) based on tilt information. The tilt information may include a tilt direction and a tilt angle. Here, the electronic device (100) can rotate the first image (901) by a tilt angle (5 degrees) in a clockwise direction relative to the projection plane, which is opposite to the tilt direction (counterclockwise relative to the projection plane).

[0223] Here, the electronic device (100) can output a rotated first image (911). Here, the angle between the horizontal plane (905) of the first image (901) output before rotation and the horizontal plane (915) of the first image (911) output after rotation may be 5 degrees.

[0224] FIG. 10 is a diagram illustrating the operation of changing the size of a first rotated image.

[0225] Referring to FIG. 10, the electronic device (100) can perform an operation to change the size of an image after performing an image rotation operation. Specifically, the electronic device (100) can rotate a first image (1001) based on tilt information. Then, the electronic device (100) can acquire the rotated first image (1011). Then, the electronic device (100) can change the size of the rotated first image (1011) so that the rotated first image (1011) can be displayed as large as possible in the output area. Here, the electronic device (100) can change the size while maintaining the aspect ratio of the rotated first image (1011).

[0226] Here, the electronic device (100) can identify a first area (1000-1) in which the rotated first image (1011) can be displayed as large as possible in the output area. And, the electronic device (100) can change the size of the rotated first image (1011) based on the identified first area (1000-1).

[0227] Here, the electronic device (100) can obtain a modified first image (1021) by changing the size of the rotated first image (1011). Then, the electronic device (100) can output the modified first image (1021) to the first area (1000-1).

[0228] Figure 11 is a drawing for explaining the second region.

[0229] Referring to FIG. 11, the electronic device (100) can modify the first image (1101) so that the first image (1101) can be output horizontally. The modified first image (1121) can be displayed in the first area (1100-1). Here, the operation of identifying the first area was described in FIG. 10.

[0230] Meanwhile, the electronic device (100) can identify a second region (1100-2-1, 1100-2-2, 1100-2-3, 1100-2-4) excluding the first region (1100-1) in the output-capable area. Here, the second region (1100-2-1, 1100-2-2, 1100-2-3, 1100-2-4) may be multiple. However, according to another embodiment, the second region may consist of a single region.

[0231] Here, the second area may refer to an area among the outputtable areas where the modified first image (1121) is not output.

[0232] FIG. 12 is a flowchart illustrating the operation of changing the second image.

[0233] Referring to FIG. 12, the electronic device (100) can rotate the second image based on tilt information (S1205). If the electronic device (100) is tilted, the second image can be output tilted just like the first image. Therefore, the electronic device (100) may need to rotate the second image.

[0234] Specifically, the electronic device (100) can identify the remaining area excluding the first area in the outputtable area (S1210). Then, the electronic device (100) can identify a second area in the remaining area where the rotated second image is to be displayed most prominently (S1215). The electronic device (100) needs to determine where to display the second image among the areas other than the first area for displaying the first image. The electronic device (100) can identify a second area in the remaining area where the second image is to be displayed most prominently.

[0235] Here, the electronic device (100) can change the size of the rotated second image based on the size of the second area (S1220). For example, if the second image is rectangular, the electronic device (100) can change the width and height of the second image based on the width and height of the second area. For another example, if the second image is circular, the electronic device (100) can change the radius of the second image based on the radius of the second area.

[0236] Here, the electronic device (100) can output a modified second image to a second area (S1225). Here, the modified second image may be an image in which both rotation and resizing operations have been performed. Thus, although the output second image is smaller in size than the second image before modification, the output second image may be displayed as large as possible within the remaining area.

[0237] FIG. 13 is a drawing for explaining the operation of outputting a second image according to one embodiment.

[0238] Referring to FIG. 13, the electronic device (100) can change the first image (1301) to obtain the changed first image (1321). Then, the electronic device (100) can output the changed first image (1321) to the first area (1300-1).

[0239] Additionally, the electronic device (100) can obtain a modified second image (1322) by modifying the second image. Then, the electronic device (100) can output the modified second image (1322) to a second area (1300-2). Here, the second area (1300-2) may refer to an area that can display the second image most significantly among the remaining areas excluding the area where the first image is displayed.

[0240] In the first area (1300-1), the first image (1321) is displayed, and the first image may not be displayed in the remaining area. Accordingly, the electronic device (100) can display additional information using the remaining area. In the embodiment of FIG. 13, the electronic device (100) can output a second image (1322) in a second area (1300-2) where additional information can be displayed as large as possible in the remaining area.

[0241] FIG. 14 is a drawing for explaining the operation of outputting a second image according to another embodiment.

[0242] Referring to FIG. 14, the electronic device (100) can obtain a rotated first image (1411) by rotating the first image (1401) based on tilt information. The electronic device (100) can identify a first area in which the rotated first image (1411) is displayed most significantly in the output area. Here, the electronic device (100) can identify the first area based on the size of the rotated first image (1411). Specifically, the electronic device (100) can identify the first area while maintaining the size ratio of the rotated first image (1411).

[0243] Since the rotated first image (1411) is outside the outputtable area, the electronic device (100) can reduce the size of the rotated first image (1411). Here, the electronic device (100) can identify a first area where the rotated first image (1411) can be output at its maximum size while maintaining the size ratio of the rotated first image (1411). For example, if the first image is rectangular, the electronic device (100) can identify the first area while maintaining the width and height ratio of the first image. For another example, if the first image is circular, the electronic device (100) can identify the first area while maintaining the curvature of the first image.

[0244] And, the electronic device (100) can obtain a modified first image (1421) by changing the size of the rotated first image (1411) based on the identified first area. And, the electronic device (100) can output the modified first image (1421) to the first area.

[0245] And, the electronic device (100) can identify the remaining area excluding the first area in the outputtable area. And, the electronic device (100) can identify a second area in the remaining area where the rotated second image can be displayed most significantly. And, the electronic device (100) can change the rotated second image based on the size of the second area. And, the electronic device (100) can output the changed second image (1422) to the second area. Here, the electronic device (100) can maintain the size ratio of the second image (e.g., width-to-height ratio) when identifying the second area. According to another embodiment, the electronic device (100) may not maintain the size ratio of the second image when identifying the second area.

[0246] FIG. 15 is a drawing for explaining the operation of outputting a second image according to another embodiment.

[0247] Referring to FIG. 15, the electronic device (100) can obtain a rotated first image (1511) by rotating the first image (1501) based on tilt information. The electronic device (100) can identify a first area in which the rotated first image (1511) is displayed most significantly in the output area. Here, the electronic device (100) can identify the first area based on the size of the rotated first image (1511). Specifically, the electronic device (100) can identify the first area without maintaining the size ratio of the rotated first image (1511).

[0248] Since the rotated first image (1511) is outside the outputtable area, the electronic device (100) can reduce the size of the rotated first image (1511). Here, the electronic device (100) can identify a first area where the rotated first image (1511) can be output at its maximum size without maintaining the size ratio of the rotated first image (1511). For example, if the first image is rectangular, the electronic device (100) can identify the first area without maintaining the width and height ratio of the first image. For another example, if the first image is circular, the electronic device (100) can identify the first area without maintaining the curvature of the first image.

[0249] And, the electronic device (100) can obtain a modified first image (1521) by changing the size of the rotated first image (1511) based on the identified first area. And, the electronic device (100) can output the modified first image (1521) to the first area.

[0250] And, the electronic device (100) can identify the remaining area excluding the first area in the outputtable area. And, the electronic device (100) can identify a second area in the remaining area where the rotated second image can be displayed most significantly. And, the electronic device (100) can change the rotated second image based on the size of the second area. And, the electronic device (100) can output the changed second image (1522) to the second area. Here, the electronic device (100) can maintain the size ratio of the second image (e.g., width-to-height ratio) when identifying the second area. According to another embodiment, the electronic device (100) may not maintain the size ratio of the second image when identifying the second area.

[0251] FIG. 16 is a flowchart illustrating the operation of changing multiple second images.

[0252] Referring to FIG. 16, the electronic device (100) can output a plurality of second images to a projection surface. Specifically, the electronic device (100) can rotate a plurality of first images based on tilt information (S1605). For example, if the electronic device (100) is tilted 5 degrees counterclockwise from the reference point for viewing the projection surface, the electronic device (100) can rotate each of the plurality of second images 5 degrees clockwise (from the reference point for viewing the projection surface).

[0253] Here, the electronic device (100) can identify the remaining area excluding the first area in the outputable area (S1610). The operation of identifying the remaining area is described in FIG. 11. Although the operation S1610 is described as being performed after step S1605, according to other embodiments, the operation S1610 may be performed before step S1605.

[0254] Here, the electronic device (100) can identify a plurality of second regions for each of the plurality of rotated second images to be displayed most prominently in the remaining region (at least one remaining region) (S1615). The electronic device (100) can display all of the plurality of second images in the remaining region. Here, the size of the region for displaying the plurality of second images may be different from the size of the region for displaying a single second image.

[0255] For example, in an embodiment displaying one second image, it is assumed that the size of the second region is 10. In an embodiment displaying two second images, the size of any one of the two second regions may be smaller than 10.

[0256] The electronic device (100) can identify multiple second regions to display all of the multiple second images. Specifically, the electronic device (100) can identify second regions for each of the multiple second images to be displayed at their maximum size.

[0257] And, the electronic device (100) can change the size of a plurality of rotated second images based on the size of a plurality of second regions (S1620). For example, if the second image is rectangular, the width and height of the second images can be changed based on the width and height of the second regions. For another example, if the second image is circular, the radius of the second images can be changed based on the radius of the second regions.

[0258] And, the electronic device (100) can output a plurality of modified second images to a plurality of second regions (S1625).

[0259] FIG. 17 is a diagram illustrating the operation of outputting a plurality of second images according to one embodiment.

[0260] Referring to FIG. 17, the electronic device (100) can obtain a modified first image (1721) by modifying (rotating and resizing) the first image (1701). Then, the electronic device (100) can output the modified first image (1721) to a first area.

[0261] Here, the electronic device (100) can identify multiple remaining areas among the outputtable areas that are not the first area. If multiple remaining areas (1700-2-1, 1700-2-2, 1700-2-3, 1700-2-4) are identified, the electronic device (100) can output multiple second images to different remaining areas.

[0262] And, the electronic device (100) can output a plurality of second images (1722-1, 1722-2) to each of the plurality of second regions. For example, the electronic device (100) can output the second image (1722-1) to the second region (1700-2-1) and output the second image (1722-2) to the second region (1700-2-4).

[0263] The second image (1722-1) may include time information and may be displayed in any one of the remaining areas (1700-2-1, 1700-2-2, 1700-2-3, 1700-2-4), specifically in area (1700-2-1). Additionally, the second image (1722-2) may include advertisement information and may be displayed in any one of the remaining areas (1700-2-2, 1700-2-2, 1700-2-3, 1700-2-4), specifically in area (1700-2-2). Here, the area (1700-2-4) where the second image (1722-2) is displayed may be different from the area (1700-2-1) where the second image (1722-1) is displayed.

[0264] FIG. 18 is a drawing for explaining the operation of outputting a plurality of second images according to another embodiment.

[0265] Referring to FIG. 18, the electronic device (100) can obtain a modified first image (1821) by modifying (rotating and resizing) the first image (1801). Then, the electronic device (100) can output the modified first image (1821) to a first area.

[0266] Here, the electronic device (100) can identify multiple areas other than the first area among the outputtable areas. Even if multiple areas (1800-2-1, 1800-2-2, 1800-2-3, 1800-2-4) are identified, the electronic device (100) can display all of the multiple second images in one of the remaining areas.

[0267] Specifically, the electronic device (100) can display a plurality of second images (1822-1, 1822-2) all in one remaining area (1800-2-1). Here, the size of the area where the second image (1822-1) is displayed may be smaller than the size of the area where the second image (1722-1) of FIG. 17 is displayed.

[0268] FIG. 19 is a flowchart illustrating the operation of combining the first image and the second image into respective layers.

[0269] Referring to FIG. 19, the electronic device (100) can obtain tilt information (S1905). Then, the electronic device (100) can identify a first area for displaying a first image and a second area for displaying a second image based on the tilt information (S1910). Then, the electronic device (100) can obtain a modified first image corresponding to the first area and a modified second image corresponding to the second area (S1915). Here, the modified first image and the modified second image may refer to images in which both rotation and size changes have been performed.

[0270] Here, the electronic device (100) can create a combined layer by combining a first layer containing a modified first image and a second layer containing a modified second image (S1920). Specifically, the electronic device (100) can obtain a first layer containing a modified first image and a second layer containing a second image. Then, the electronic device (100) can obtain a combined layer by combining the obtained first layer and the obtained second layer.

[0271] Here, the electronic device (100) can output the acquired combined layer (S1925). Here, the combined layer is a single layer and may be a layer that includes both the first image and the second image.

[0272] FIG. 20 is a diagram illustrating the operation of combining a first image and a second image into respective layers.

[0273] Referring to FIG. 20, the electronic device (100) can combine a first image and a second image into one layer and output them.

[0274] Specifically, the electronic device (100) can obtain a first layer (2021) containing a modified first image. And, the electronic device (100) can obtain a second layer (2022) containing a modified second image.

[0275] And, the electronic device (100) can combine the first layer (2021) and the second layer (2022) to obtain a combined layer (2023). And, the electronic device (100) can output the obtained combined layer (2023) to a projection surface.

[0276] FIG. 21 is a flowchart illustrating the operation of identifying the background color of a second region by identifying the color of the projection surface.

[0277] Referring to FIG. 21, the electronic device (100) can obtain tilt information (S2105). Then, the electronic device (100) can identify a first area for displaying a first image and a second area for displaying a second image based on the tilt information (S2110).

[0278] Here, the electronic device (100) can acquire a projection surface image (S2115). Specifically, the electronic device (100) may include an image sensor and can acquire a projection surface image by capturing the projection surface through the image sensor.

[0279] Here, the electronic device (100) can identify the color of the projection surface based on the projection surface image (S2120). And, the electronic device (100) can output the identified color of the projection surface as the background color of the second area (S2125).

[0280] Meanwhile, if the color of the projection surface is not a single color but has a certain pattern, the electronic device (100) can identify the pattern of the projection surface and output a pattern identical to the identified pattern of the projection surface as the background pattern of the second area.

[0281] FIG. 22 is a diagram illustrating the operation of identifying the background color of a second area by identifying the color of the projection surface.

[0282] Referring to FIG. 22, the electronic device (100) can obtain a modified first image (2221) by modifying a first image (2201). Then, the electronic device (100) can output the modified first image (2221) to a first area. Then, the electronic device (100) can identify the remaining areas (2200-2-1, 2200-2-2, 2200-2-3, 2200-2-4) excluding the first area in the output area. Then, the electronic device (100) can identify a second area to output a second image in the remaining area. Then, the electronic device (100) can output the modified second image to the second area.

[0283] Meanwhile, the electronic device (100) can capture the projection surface (2200) using an image sensor. Here, the electronic device (100) can acquire an image of the projection surface. Then, the electronic device (100) can identify the color of the projection surface (2200) based on the image of the projection surface. Then, the electronic device (100) can determine the identified color of the projection surface (2200) as the background color of the remaining areas (2200-2-1, 2200-2-2, 2200-2-3, 2200-2-4). Specifically, the electronic device (100) can output the background color of the remaining areas (2200-2-1, 2200-2-2, 2200-2-3, 2200-2-4) as the color of the identified projection surface (2200).

[0284] If, unlike the embodiment of FIG. 22, only the first image and the second image are changed and output, the area where the first image and the second image are not output and the projection surface (2200) may appear unnatural. This is because the output area itself is tilted.

[0285] However, according to the embodiment of FIG. 22, the color of the projection surface (2200) and the color of the remaining areas (2200-2-1, 2200-2-2, 2200-2-3, 2200-2-4) can be matched, so the first image and the second image can be naturally highlighted. In addition, even though the electronic device (100) is tilted, the first image and the second image that are not tilted can be naturally output.

[0286] FIG. 23 is a drawing illustrating a User Interface (UI) for guiding a change of a second image according to one embodiment.

[0287] Referring to FIG. 23, the electronic device (100) may display a UI to guide the change of a second image in an output area (2300-1). Here, the output area (2300-1) may be rotated clockwise or counterclockwise based on the projection plane, depending on the tilt of the electronic device (100).

[0288] Here, the electronic device (100) may display a UI (2305) containing tilt information of the electronic device (100). Here, the tilt information may include at least one of a tilt direction or a tilt angle. The user may recognize the tilt of the electronic device (100) through the UI (2305).

[0289] Meanwhile, the electronic device (100) may output a UI (2310) to guide whether to rotate and output the second image. Here, the UI (2310) may include information requesting user input to rotate the second image (or additional information). Additionally, the UI (2310) may include information corresponding to the direction and angle of rotation of the second image (e.g., 15 degrees clockwise). Here, when user input selecting a position corresponding to the UI (2310) is identified through a selection cursor (2315), the electronic device (100) may rotate and display the second image (by 15 degrees clockwise).

[0290] Meanwhile, the UI (2305, 2310) can be output in a rotated state based on tilt information as shown in FIG. 23. Meanwhile, as another example, the UI (2305, 2310) can be output in an unrotated state.

[0291] FIG. 24 is a drawing illustrating a User Interface (UI) for guiding a change of a second image according to another embodiment.

[0292] Referring to FIG. 24, the electronic device (100) can output a first image (2421) modified based on tilt information to a first area. Additionally, the electronic device (100) can output a UI (2401, 2402) to guide the output first image (2321) to be further rotated.

[0293] Here, the UI (2401, 2402) may include a tilt direction and a tilt angle and may display an icon (2402, 2404) associated with the tilt direction. Here, the icon (2402) may have a different shape depending on the tilt direction.

[0294] For example, the UI (2401) may include text information that rotates 5 degrees counterclockwise and may include an icon (2402) corresponding to the counterclockwise direction. And, the UI (2403) may include text information that rotates 5 degrees clockwise and may include an icon (2404) corresponding to the clockwise direction. Here, the icon (2402) and the icon (2404) may have different shapes depending on the direction of tilt.

[0295] Meanwhile, the length of the icons (2402, 2404) may vary depending on the angle of inclination. The electronic device (100) can output a longer length of the icons (2402, 2404) as the angle of inclination increases.

[0296] Meanwhile, the electronic device (100) can identify user input through the cursor (2405). For example, when the electronic device (100) receives user input in which the cursor (2405) selects the UI (2401), the electronic device (100) can perform an action corresponding to the UI (2401) (rotating the output image 5 degrees counterclockwise).

[0297] Here, when user input for additionally rotating the first image (2421) is received, the electronic device (100) can identify a new first region to which the first image (2421) is additionally rotated and output. Then, the electronic device (100) can output the additionally rotated first image to the new first region.

[0298] FIG. 25 is a flowchart illustrating a method for controlling an electronic device according to one embodiment.

[0299] Referring to FIG. 25, a control method for an electronic device (100) that outputs an image on a projection surface includes the steps of: acquiring a first image containing content (S2505); acquiring tilt information of the electronic device (100) (S2510); identifying a first area for displaying the first image and a second area where the first image is not displayed based on the tilt information (S2515); changing the size of the first image based on the size of the first area (S2520); outputting the first image with changed size on the first area (S2525); and outputting a second image containing additional information on the second area based on the tilt information and the size of the second area (S2530).

[0300] Meanwhile, the step of changing the size of the first image (S2520) can rotate the first image based on tilt information, correct the first image by changing the width and height of the first image based on the width and height of the first area, and the step of outputting the first image (S2525) can output the corrected first image corresponding to the first area.

[0301] Meanwhile, the control method may further include a step of correcting the second image by rotating the second image based on tilt information and changing the size of the second image based on the size of the second area, and the step of outputting the second image (S2530) may output a corrected second image corresponding to the second area.

[0302] Meanwhile, the tilt information may include a tilt direction, and the control method may further include a step of correcting by rotating the first image and the second image in the reverse direction of the tilt direction, and the tilt direction may be clockwise or counterclockwise based on the perspective of looking at the projection plane.

[0303] Meanwhile, the sensor unit (113) of the electronic device (100) may include at least one of a tilt sensor that senses the tilt of the electronic device (100) or an image sensor that captures an image, and the step (S2510) of acquiring tilt information may acquire the tilt direction based on the sensing data acquired from the sensor unit (113).

[0304] Meanwhile, in the step of outputting the second image (S2530), if there are multiple second regions, the area of ​​the multiple second regions can be obtained, and the second image can be output to the region having the largest area among the multiple second regions.

[0305] Meanwhile, the step of identifying a first region and a second region (S2515) can identify an outputtable region where an image can be output, can identify a first region where a corrected first image is output, and can identify a region excluding the first region from the outputtable region as a second region.

[0306] Meanwhile, the control method may further include a step of outputting the background color of the second area as a predetermined color.

[0307] Meanwhile, the sensor unit (113) of the electronic device (100) may include an image sensor that captures an image, and the step of outputting the background color of the second area as a predetermined color may identify the color of the projection surface based on the image captured through the image sensor, and identify the predetermined color based on the identified color of the projection surface.

[0308] Meanwhile, the control method can output tilt information and a guide UI for rotating the second image.

[0309] Meanwhile, a control method for an electronic device such as that of FIG. 25 can be executed on an electronic device having the configuration of FIG. 2a or FIG. 2b, and can also be executed on an electronic device having other configurations.

[0310] Meanwhile, the methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0311] In addition, the methods according to the various embodiments of the present disclosure described above can be implemented by software upgrades or hardware upgrades alone for existing electronic devices.

[0312] In addition, the various embodiments of the present disclosure described above may also be performed through an embedded server equipped in an electronic device, or through an external server among at least one of the electronic device and the display device.

[0313] Meanwhile, according to the exemplary embodiments of the present disclosure, the various embodiments described above may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0314] Additionally, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a storage medium such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0315] Additionally, each component (e.g., module or program) according to the various embodiments described above may be composed of a single or multiple entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be further included in the various embodiments. Generally or additionally, some components (e.g., module or program) may be integrated into a single entity to perform the functions performed by each of the respective components prior to integration in the same or similar manner. The operations performed by the module, program, or other components according to the various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations added.

[0316] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure. Explanation of the symbols

[0317] 100: Electronic device 111: Projection section 112: Memory 113: Sensor section 114: Processor

Claims

Claim 1 An electronic device comprising: a memory; a sensor unit; a projection unit for outputting an image to a projection surface; and a processor for acquiring a first image containing content from the memory, acquiring tilt information of the electronic device through the sensor unit, identifying a first area for displaying the first image and a second area for not displaying the first image based on the tilt information corresponding to the tilt correction of the electronic device, changing the size of the first image based on the size of the first area, controlling the projection unit to output the first image with the changed size on the first area, and controlling the projection unit to output a second image containing additional information on the second area based on the tilt information and the size of the second area. Claim 2 An electronic device according to claim 1, wherein the processor rotates the first image based on the tilt information, corrects the first image by changing the width and height of the first image based on the width and height of the first area, and controls the projection unit to output the corrected first image corresponding to the first area. Claim 3 An electronic device according to claim 1, wherein the processor controls the projection unit to rotate the second image based on the tilt information, correct the second image by changing the size of the second image based on the size of the second area, and output the corrected second image corresponding to the second area. Claim 4 An electronic device according to claim 1, wherein the tilt information includes a tilt direction, the processor corrects the first image and the second image by rotating them in the reverse direction of the tilt direction, and the tilt direction is clockwise or counterclockwise relative to the projection plane. Claim 5 In paragraph 4, the sensor unit comprises at least one of a tilt sensor that senses the tilt of the electronic device or an image sensor that captures an image, and the processor obtains the tilt direction based on sensing data obtained from the sensor unit, the electronic device. Claim 6 An electronic device according to paragraph 2, wherein the processor, if there are multiple second regions, obtains the area of ​​the multiple second regions and controls the projection unit to output the second image to the region having the largest area among the multiple second regions. Claim 7 An electronic device according to paragraph 2, wherein the processor identifies an outputtable area in which an image can be output through the projection unit, identifies the first area in which the corrected first image is output, and identifies the area excluding the first area from the outputtable area as the second area. Claim 8 An electronic device according to claim 1, wherein the processor controls the projection unit to output the background color of the second region as a predetermined color. Claim 9 An electronic device according to claim 8, wherein the sensor unit includes an image sensor that captures an image, and the processor identifies the color of the projection surface based on the image captured through the image sensor, and identifies the predetermined color based on the identified color of the projection surface. Claim 10 An electronic device according to claim 1, wherein the processor controls the projection unit to output the tilt information and a guide UI for rotating the second image. Claim 11 A control method for an electronic device that outputs an image on a projection surface, comprising: a step of acquiring a first image containing content; a step of acquiring tilt information of the electronic device; a step of identifying a first area for displaying the first image and a second area where the first image is not displayed based on the tilt information corresponding to the tilt correction of the electronic device; a step of changing the size of the first image based on the size of the first area; a step of outputting the first image with changed size on the first area; and a step of outputting a second image containing additional information on the second area based on the tilt information and the size of the second area. Claim 12 In claim 11, the step of changing the size of the first image is to rotate the first image based on the tilt information, correct the first image by changing the width and height of the first image based on the width and height of the first area, and the step of outputting the first image is to output the corrected first image corresponding to the first area. Claim 13 In claim 11, the control method further comprises the step of rotating the second image based on the tilt information and correcting the second image by changing the size of the second image based on the size of the second area; and the step of outputting the second image is to output the corrected second image corresponding to the second area. Claim 14 In claim 11, the tilt information includes a tilt direction, and the control method further includes the step of correcting by rotating the first image and the second image in the reverse direction of the tilt direction; and the tilt direction is clockwise or counterclockwise with respect to looking at the projection plane. Claim 15 In claim 14, the sensor unit of the electronic device comprises at least one of a tilt sensor that senses the tilt of the electronic device or an image sensor that captures an image, and the step of acquiring the tilt information is to acquire the tilt direction based on the sensing data acquired from the sensor unit, a control method. Claim 16 In claim 12, the step of outputting the second image comprises, if there are multiple second regions, obtaining the area of ​​the multiple second regions and outputting the second image to the region having the largest area among the multiple second regions. Claim 17 A control method according to claim 12, wherein the step of identifying the first region and the second region comprises identifying an outputtable region in which an image can be output, identifying the first region in which the corrected first image is output, and identifying the region excluding the first region from the outputtable region as the second region. Claim 18 In claim 11, the control method further comprises the step of outputting the background color of the second area as a predetermined color. Claim 19 In claim 18, the sensor portion of the electronic device comprises an image sensor that captures an image, and the step of outputting the background color of the second region as a predetermined color is a control method comprising identifying the color of the projection surface based on the image captured through the image sensor, and identifying the predetermined color based on the identified color of the projection surface. Claim 20 In claim 11, the control method outputs a guide UI for rotating the tilt information and the second image.

Images