Electronic device for providing image content in combination with external electronic device for projecting image and control method therefor

Abstract

An electronic device providing image content in conjunction with an external electronic device for projecting an image is provided. The electronic device includes a communication interface, a display, a memory, and at least one processor connected to the communication interface, the display, and the memory and for controlling the electronic device. The at least one processor: obtains information related to a projection surface on which an image is projected by an external electronic device; dividing the input image into a first region and a second region based on the information related to the projection surface and the information related to the electronic device; controlling the display to display a portion of the image based on information related to the first region of the image; and controlling the communication interface to transmit information related to the second region of the image to the external electronic device.

Description

Technical Field

[0001] The present disclosure relates to an electronic device that provides image content in combination with an external electronic device and a control method thereof, and more particularly, the present disclosure relates to an electronic device that provides image content in combination with an external electronic device for projecting an image and a control method thereof. Background Art

[0002] In recent years, the quality of content has been continuously improved, and the demand for providing content on a large screen even at home is increasing. In response to these demands, the size of the display set up at home has also become larger to provide a large screen.

[0003] Meanwhile, as the displays of electronic devices become larger, content can be provided on a large screen. However, due to problems in the process of manufacturing the display and the increase in the cost of purchasing the electronic device, the size of the screen set in the display of the electronic device is limited. In addition, since the display of the electronic device has been installed in the home, the installation and use environment is limited. In addition, it is necessary to provide content on screens of various sizes according to the type of content, the environment at home, and the needs of family members. Summary of the invention

[0004] Technical Solution

[0005] According to an embodiment of the present disclosure, a first electronic device that provides image content in combination with a second electronic device that projects an image includes a communication interface, a display, a memory, and at least one processor, wherein the at least one processor is connected to the communication interface, the display, and the memory, and is configured to control the first electronic device. The at least one processor is configured to obtain information about a projection surface onto which the second electronic device projects an image. The at least one processor is configured to divide an input image into a first area and a second area based on information about the projection surface and information about the first electronic device. The at least one processor is configured to control the display to display a portion of the image based on information about the first area in the image, and to control the communication interface to send information about the second area in the image to the second electronic device.

[0006] According to an embodiment of the present disclosure, a method for controlling a first electronic device to provide image content in combination with a second electronic device that projects an image includes: obtaining information related to a projection surface onto which the second electronic device projects an image; dividing an input image into a first area and a second area based on information related to the projection surface and information related to the first electronic device; and displaying a portion of the image based on information related to the first area in the image, and sending information related to the second area in the image to the second electronic device.

[0007] According to an embodiment of the present disclosure, in a computer-readable recording medium configured to store a program, the program is used to execute a control method for a first electronic device to provide image content in combination with a second electronic device that projects an image, the control method comprising: obtaining information related to a projection surface onto which the second electronic device projects an image; dividing an input image into a first area and a second area based on information related to the projection surface and information related to the first electronic device; and displaying a portion of the image based on information related to the first area in the image, and sending information related to the second area in the image to the second electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is a diagram showing a system including a first electronic device that displays an image and a second electronic device that projects an image according to an embodiment;

[0009] Figure 2 is a block diagram showing a configuration of a first electronic device according to an embodiment;

[0010] Figure 3 is a block diagram showing a configuration of a first electronic device for providing content in conjunction with a second electronic device according to an embodiment;

[0011] Figure 4 is a diagram for describing a method of receiving an image captured by a second electronic device to obtain information related to a projection surface according to an embodiment;

[0012] Figure 5 and Figure 6 is a diagram for describing a method of receiving information about a distance between a second electronic device and a projection surface from a second electronic device to obtain information about the projection surface according to an embodiment;

[0013] Figure 7 is a diagram for describing a method for providing a sound field effect according to expansion of a picture according to an embodiment;

[0014] Figure 8 is a flowchart for describing a method of controlling brightness of an image displayed by a first electronic device and an image projected by a second electronic device according to an embodiment;

[0015] Fig. 9 is a flowchart for describing a method of controlling an output timing of an image displayed by a first electronic device and a projection timing of an image projected by a second electronic device according to an embodiment;

[0016] Fig.10 is a flowchart for describing a control method for providing image content in combination with a second electronic device that projects an image according to an embodiment;

[0017] Fig.11 and Fig.12 is a diagram for describing an example of extending a screen in width and height directions according to an embodiment;

[0018] Fig.13 is a diagram for illustrating an example in which a first electronic device according to an embodiment is located on a side area of ​​a projection surface;

[0019] Fig.14 is a diagram for describing an example of displaying a region of interest in an image of content according to an embodiment;

[0020] Fig.15 is a diagram for describing a system including a first electronic device and a plurality of second electronic devices according to an embodiment;

[0021] Fig.16 is a sequence diagram for describing an example in which a first electronic device that displays an image and a second electronic device that projects an image provide content according to an embodiment;

[0022] Fig.17 is a sequence diagram for describing an example in which a first electronic device that displays an image and a second electronic device that projects an image provide content through a control device according to an embodiment; and

[0023] Fig.18 is a block diagram specifically showing the configuration of the second electronic device according to the embodiment. DETAILED DESCRIPTION

[0024] Various modifications may be made to the embodiments of the present disclosure, and various types of embodiments may exist. Accordingly, specific embodiments will be shown in the drawings, and these embodiments will be described in detail in the specific embodiments. However, it should be noted that the various embodiments are not intended to limit the scope of the present disclosure to specific embodiments, but should be interpreted as including all modifications, equivalents and / or substitutions of the embodiments of the present disclosure. At the same time, with respect to the detailed description of the drawings, similar components may be designated by similar reference numerals.

[0025] If it is determined that a detailed description of related known functions or features may unnecessarily obscure the gist of the present disclosure in describing the present disclosure, the detailed description will be omitted.

[0026] In addition, the following embodiments can be modified in various forms, and the scope of the technical spirit of the present disclosure is not limited to the following embodiments. Instead, these embodiments are provided to make the present disclosure more complete and comprehensive, and to fully convey the technical ideas of the present disclosure to those skilled in the art.

[0027] The terms used in the present disclosure are only used to describe specific embodiments and are not intended to limit the scope of the present disclosure.In addition, a singular expression includes a plural expression unless it is clearly defined differently in the context.

[0028] In the present disclosure, expressions such as “having”, “may have”, “including” and “may include” indicate the existence of such characteristics (for example, elements such as number, function, operation and component) and do not exclude the existence of additional characteristics.

[0029] In the present disclosure, the expression "A or B", "at least one of A and / or B", or "one or more of A and / or B", etc. may include all possible combinations of the listed items. For example, "A or B", "at least one of A and B", or "at least one of A or B" may refer to all of the following: (1) including at least one A, (2) including at least one B, or (3) including all of at least one A and at least one B.

[0030] In addition, the expressions "1st", "2nd", "first", "second", etc. used in the present disclosure can describe various elements without regard to any order and / or importance. In addition, such expressions are only used to distinguish one element from another element and are not intended to limit these elements.

[0031] Meanwhile, descriptions in the present disclosure regarding an element (e.g., a first element) being “(operably or communicatively) coupled to” / “(operably or communicatively) coupled to” or “connected to” another element (e.g., the second element) should be interpreted as including both the case where the one element is directly coupled to the other element and the case where the one element is coupled to the other element via other elements (e.g., a third element).

[0032] In contrast, description that one element (eg, a first element) is “directly coupled” or “directly connected” to another element (eg, a second element) may be interpreted as indicating that other elements (eg, a third element) do not exist between the one element and the other element.

[0033] In addition, the expression "configured to (set to)" used in the present disclosure may be used interchangeably with other expressions such as "suitable for", "capable of", "designed to", "suitable for", "manufactured to", and "capable of", depending on the situation. At the same time, the term "configured to (or set to)" does not necessarily mean "specially designed to" in terms of hardware.

[0034] On the contrary, in some cases, the expression "a device configured to..." may mean that the device is "capable" of performing an operation together with another device or component. For example, the phrase "a processor configured to perform A, B, and C" may mean a general-purpose processor (e.g., a CPU or an application processor) that can perform corresponding operations by executing one or more software programs stored in a storage device.

[0035] In the embodiments of the present disclosure, a "module" or "component" may perform at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. In addition, in addition to a "module" or "component" that needs to be implemented as specific hardware, multiple "modules" or "components" may be integrated into at least one module and implemented as at least one processor.

[0036] Meanwhile, each element and region in the drawings are schematically shown. Therefore, the technical spirit of the present disclosure is not limited by the relative sizes or intervals shown in the drawings.

[0037] Hereinafter, various embodiments of the present disclosure are described in detail based on the accompanying drawings. Figure 1 1 is a diagram showing a system including a first electronic device that displays an image and a second electronic device that projects an image according to an embodiment. According to an embodiment of the present disclosure, the first electronic device 100 may include a display, and may be a display device such as a TV that provides an image through the display. The second electronic device 200 may be an image projection device such as a projector that projects an image on a wall or a screen. In addition, the first electronic device 100 may operate as a main device, and the second electronic device 200 may operate as a sub-device. However, the present disclosure is not limited thereto.

[0038] The first electronic device 100 may be installed on a wall at home and display an image. The second electronic device 200 may project an image on the wall where the first electronic device 100 is installed. Figure 1 As shown, the first electronic device 100 may be located at an area of ​​an image projected by the second electronic device 200 .

[0039] The first electronic device 100 obtains information about a projection surface onto which the second electronic device 200 projects an image. Further, the first electronic device 100 divides the input image of the content into a first area and a second area based on the information about the projection surface and the information about the first electronic device 100. Still further, the first electronic device 100 displays a portion of the image based on the information about the first area in the image, and transmits information about the second area to the second electronic device 200. The second electronic device 200 may display another portion of the image based on the information about the second area.

[0040] In addition, based on the information about the projection surface and the information about the position of the second electronic device 200, the first electronic device 100 can not only split the image of the content but also split the audio of the content. A portion of the split audio can be output through the first electronic device 100, and another portion of the audio can be output through the second electronic device 200.

[0041] As a result, the first electronic device 100 can provide a content in conjunction with the second electronic device 200 that projects an image, such as Figure 1 shown.

[0042] Figure 2 1 is a block diagram showing a configuration of a first electronic device 100 according to an embodiment. Figure 2 As shown, the first electronic device 100 includes a display 110, a speaker 120, a communication interface 130, an input interface 140, a memory 150 and at least one processor 160. However, Figure 2 The illustrated configuration of the first electronic device 100 is merely one of examples, wherein, obviously, other configurations may be added thereto or part of the configuration may be omitted.

[0043] The display 110 can display various information. Specifically, when displaying content in combination with the second electronic device 200 that projects an image, the display 110 can display a portion of the image of the content. In addition, the display 110 can display a picture of a preset color or a picture changed to a preset panel to synchronize with the combined second electronic device.

[0044] Meanwhile, the display 110 may be implemented as a liquid crystal display panel (LCD), an organic light emitting diode (OLED), etc. Also, in some cases, the display 110 may be implemented as a flexible display, a transparent display, etc. However, the display 110 according to the present disclosure is not limited to a specific type.

[0045] The speaker 120 may output various voice messages and audio. Specifically, the speaker 120 may output audio of content obtained based on information related to the first electronic device 100 and the second electronic device 200 when providing content in conjunction with the second electronic device 200.

[0046] The communication interface 130 may include at least one circuit and may perform communication with various types of second electronic devices 200. The communication interface 130 may include at least one of a Bluetooth low energy module, a Wi-Fi communication module, a cellular communication module, a third generation (3G) mobile communication module, a fourth generation (4G) mobile communication module, a 4G long term evolution (LTE) communication module, or a fifth generation (5G) mobile communication module.

[0047] Specifically, the communication interface 130 may receive information related to the second electronic device 200 and information related to the projection surface from the second electronic device 200 when providing content in conjunction with the second electronic device 200 .

[0048] Meanwhile, the aforementioned embodiment describes that the communication connection with the external device is performed through the wireless communication module, but it is obvious that the communication connection with the external device may also be performed through the wired communication module.

[0049] The memory 150 may store an operating system (OS) for controlling the overall operation of the components of the first electronic device 100, and instructions or data related to the components of the first electronic device 100. Specifically, the memory 150 may include a projection surface information obtaining module 310, a content obtaining module 320, an AV signal separation module 330, an image analysis module 340, an image segmentation module 350, an audio conversion module 360, an audio post-processing module 370, an AV signal synthesis and distribution module 380, a content output module 390, and a content transmission module 395 to provide content in conjunction with the second electronic device 200, such as. Figure 3 Specifically, if the function for providing content in combination with the second electronic device is implemented, the various modules for providing content in combination with the second electronic device stored in the non-volatile memory can load data for performing various operations onto the volatile memory. Here, loading means an operation of calling the data stored in the non-volatile memory to the volatile memory and storing the data so that the at least one processor 160 can access the data.

[0050] Meanwhile, the memory 150 may be implemented as a nonvolatile memory (eg, a hard disk, a solid state drive (SSD), a flash memory), a volatile memory (which may also include a memory within at least one processor 160 ), or the like.

[0051] At least one processor 160 may control the first electronic device 100 according to at least one instruction stored in the memory 150. Specifically, the at least one processor 160 obtains information about the projection surface onto which the second electronic device projects the image. Further, the at least one processor 160 divides the input image into a first area and a second area based on the information about the projection surface and the information about the first electronic device 100. Further, based on the information about the first area of ​​the image, the at least one processor 160 controls the display 110 to display a portion of the image, and controls the communication interface 130 to send information about the second area of ​​the image to the second electronic device.

[0052] Specifically, the at least one processor 160 may receive an image of the projection surface captured by a camera included in the second electronic device through the communication interface 130. Further, the at least one processor 160 may identify the area on the projection surface where the first electronic device 100 is located based on the obtained image related to the projection surface. Further, the at least one processor 160 is configured to identify an area in the obtained image corresponding to the area on the projection surface where the first electronic device 100 is located as a first area, and identify other areas in the obtained image except the first area as a second area.

[0053] In addition, the at least one processor 160 may receive information related to the distance between the second electronic device and the projection surface through a distance sensor included in the second electronic device. Further, the at least one processor 160 may obtain information related to the size and position of the projection surface based on the information related to the distance between the second electronic device and the projection surface. Further, the at least one processor 160 may segment the input image into the first area and the second area based on the information related to the size and position of the projection surface.

[0054] The at least one processor 160 may convert the channel of the audio corresponding to the input image into a channel corresponding to the output specifications of the second electronic device and the first electronic device 100. Further, the at least one processor 160 may map the audio to the converted channel based on information related to the position of the second electronic device. Here, the at least one processor 160 may analyze the image projected onto the projection surface, and may post-process the audio according to the converted channel.

[0055] The at least one processor 160 may control the display 110 to display a picture of a preset color in the first electronic device, and control the communication interface 130 to send a control command for projecting a picture of a preset color to the second electronic device 200. Further, the at least one processor 160 may receive an image capturing the picture of the preset color displayed by the first electronic device 100 and the picture of the preset color projected by the second electronic device 200 from the second electronic device 200 through the communication interface 130. Further, the at least one processor 160 may control the brightness of at least one of the picture output by the first electronic device 100 or the picture projected by the second electronic device 200 based on the image received from the second electronic device 200.

[0056] At least one processor 160 may control the display 110 to display a screen changed to a pattern preset in the first electronic device 100, and control the communication interface 130 to send a control command for projecting the screen changed to the preset pattern to the second electronic device 200. Further, the at least one processor 160 may receive an image capturing the screen changed to the preset pattern displayed by the first electronic device 100 and the screen changed to the preset pattern projected by the second electronic device from the second electronic device 200 through the communication interface 130. Further, the at least one processor 160 may control at least one of the image output timing of the first electronic device 100 or the image projection timing of the second electronic device 200 based on the image received from the second electronic device 200, so as to adjust the image output timing of the first electronic device 100 to match the image projection timing of the second electronic device 200.

[0057] The at least one processor 160 may determine whether to segment the image into the first region and the second region based on flag information indicating whether to segment the image included in metadata of the input image.

[0058] In addition, the at least one processor 160 may operate in one of a first mode that displays an input image in the first electronic device 100 and a second mode that splits and displays the input image through the first electronic device and the second electronic device.

[0059] Specifically, at least one processor 160 may load data stored in the non-volatile memory for executing various operations shown in each module (at least one of the projection surface information obtaining module 310, the content obtaining module 320, the AV signal separation module 330, the image analysis module 340, the image segmentation module 350, the audio conversion module 360, the audio post-processing module 370, the AV signal synthesis and distribution module 380, the content output module 390 or the content transmission module 395) to the volatile memory. Figure 3 A method in which at least one processor 160 provides content in conjunction with a second electronic device through a plurality of components is described in detail. Figure 3 is a block diagram illustrating a configuration of a first electronic device for providing content in conjunction with a second electronic device according to an embodiment.

[0060] The projection surface information obtaining module 310 may obtain information related to the projection surface based on information received from the second electronic device 200. Further, the projection surface information obtaining module 310 may identify an area where the first electronic device 100 is located on the projection surface and other areas except the area of ​​the first electronic device 100.

[0061] Specifically, the projection surface information obtaining module 310 may receive an image capturing the projection surface of the first electronic device 100 from the second electronic device 200. Further, the projection surface information obtaining module 310 may identify the area occupied by the display of the first electronic device 100 on the projection surface based on the obtained image related to the projection surface. Figure 4 As shown, the second electronic device 200 can obtain an image by capturing the projection surface including the first electronic device 100. Further, the second electronic device 200 can send the obtained image to the first electronic device 100. The first electronic device 100 can identify the area 410 where the first electronic device 100 is located on the projection surface, and other areas 420 other than the area of ​​the first electronic device 100 based on the received image.

[0062] Meanwhile, in the aforementioned embodiment, it is described that an image capturing the projection surface including the first electronic device 100 is received from the second electronic device 200. However, this is only one of the examples. An image capturing the projection surface including the first electronic device 100 may be received by a mobile terminal (e.g., a smart phone) having a camera. Specifically, if the first electronic device 100 and the second electronic device 200 are combined with an external mobile terminal, information (including the captured image) related to the projection surface projected by the second electronic device 200 may be received by using an application installed in the mobile terminal.

[0063] In addition, the projection surface information obtaining module 310 may receive information related to the distance between the second electronic device 200 and the projection surface obtained via the distance sensor included in the second electronic device 200 from the second electronic device 200 through the communication interface 130. Further, the projection surface information obtaining module 310 may obtain information related to the size and position of the projection surface based on the information related to the second electronic device 200 and the projection surface and the information related to the first electronic device 100. Here, information related to the size and position of the projection surface according to the distance between the second electronic device 200 and the projection surface may be pre-stored. In addition, the area where the first electronic device 100 is located on the projection surface may be fixed to a preset position (e.g., a center area, etc.).

[0064] For example, Figure 5 As shown, if the distance between the second electronic device 200 and the projection surface is d 1 , the projection surface information obtaining module 310 can identify the distance d between the second electronic device 200 and the projection surface based on the pre-stored information. 1The size and position of the corresponding first projection surface. Further, the projection surface information obtaining module 310 can identify the area 510 where the first electronic device 100 is located, and other areas 520 except the area of ​​the first electronic device 100 based on the size and position of the first projection surface. Specifically, the projection surface information obtaining module 310 can identify the area 510 where the first electronic device 100 is located, and other areas 520 except the area of ​​the first electronic device 100 based on the size and position of the first projection surface and the pre-stored size and position of the first electronic device 100. Figure 6 As shown, if the distance between the second electronic device 200 and the projection surface is greater than d 1 D 2 , the projection surface information obtaining module 310 can identify the distance d between the second electronic device 200 and the projection surface based on the pre-stored information. 2 The size and position of the corresponding second projection surface. Further, the projection surface information obtaining module 310 can identify the area 610 where the first electronic device 100 is located and other areas 620 except the area of ​​the first electronic device 100 based on the size and position of the second projection surface.

[0065] In addition, the projection surface information obtaining module 310 can store information related to the first electronic device 100 (for example, information related to display size, information related to resolution, information related to speakers, etc.) and information related to the second electronic device 200 (for example, information related to speakers, etc.).

[0066] The content acquisition module 320 can obtain various contents. For example, the content acquisition module 320 can obtain contents through the communication interface 130. In addition, the content acquisition module 320 can obtain contents from the second electronic device through a wired input / output (I / O) interface (e.g., an HDMI terminal, etc.). The content acquisition module 320 can obtain contents stored in the first electronic device 100. Here, the contents may include image signals and audio signals.

[0067] The AV signal separation module 330 may separate an image signal and an audio signal included in the content. Further, the AV signal separation module 330 may input the image signal to the image analysis module 340 and may input the audio signal to the audio conversion module 360.

[0068] The image analysis module 340 can analyze the image signal input through the AV signal separation module 330. Here, the image analysis module 340 can determine the expansion rate, the cropping area, and the information related to the position of the main object in the image signal based on the information related to the first electronic device 100 and the information related to the projection surface. Specifically, the image analysis module 340 can determine the expansion rate of the input image based on the aspect ratio and size of the projection surface. For example, if the size of the display is 55 inches and the size of the projection surface is 110 inches, the image analysis module 340 can determine a double expansion rate. In addition, if it is necessary to display the main object in the image in the first electronic device 100, the image analysis module 340 can analyze the image signal to determine the information related to the position of the main object and determine the cropping area of ​​the image obtained by moving the display area of ​​the main object to the first electronic device 100.

[0069] The image segmentation module 350 can segment the image based on the analysis result obtained by the image analysis module 340 and the information related to the projection surface. Specifically, the image segmentation module 350 can segment the image processed by the image analysis module 340 into a first area and a second area. Here, the first area can correspond to the area where the first electronic device 100 is located and identified by the projection surface information acquisition module 310. The second area can correspond to other areas other than the area of ​​the first electronic device 100 identified by the projection surface information acquisition module 310 (that is, other areas other than the first area). That is, the image segmentation module 350 can segment the image processed by the image analysis module 340 into an image of the first area to be displayed by the first electronic device 100 and an image of the second area projected by the second electronic device 200. Accordingly, the image segmentation module 350 can obtain a first image signal for outputting an image related to the first area and a second image signal for outputting an image related to the second area.

[0070] Here, the image segmentation module 350 may determine information (e.g., brightness, color, contrast, etc.) related to the image to be displayed by the first electronic device 100, and determine information (e.g., brightness, color, contrast, etc.) related to the image to be projected by the second electronic device 200. Specifically, the image segmentation module 350 may determine to project light having a preset brightness (e.g., black) for a first area (i.e., an area where the first electronic device 100 is located) of the image projected by the second electronic device 200 to minimize interference in viewing the image displayed by the first electronic device 100.

[0071] In addition, the image segmentation module 350 may perform image processing for at least one boundary area of ​​the divided first area and the second area to avoid displaying the boundary of the first area and the second area distinctly. For example, the image segmentation module 350 may process at least one of the first area or the second area to display the average pixels of the first area and the second area on at least one boundary area of ​​the first area and the second area. In addition, the image segmentation module 350 may process the boundary area of ​​the second area so that its brightness gradually increases as it approaches the first area. That is, generally, the brightness of the first electronic device 100 is higher than that of the second electronic device 200, and thus, the image segmentation module 350 may process the boundary area of ​​the second area so that its brightness gradually increases as it approaches the first area (or the first electronic device 100). In addition, the image segmentation module 350 may process the boundary area of ​​the second area to expand it in the direction of the first area so that the second area overlaps with the first area.

[0072] The audio conversion module 360 ​​can convert the channels of the audio signal of the content into channels corresponding to the output specifications of the second electronic device 200 and the first electronic device 100. Specifically, if it can be configured so that the channels of the audio signal of the content are 2.1 channels, and the output specifications of the second electronic device 200 and the first electronic device 100 are 5.1 channels, the audio conversion module 360 ​​can increase the audio signal from 2.1 channels to 5.1 channels. Correspondingly, the second electronic device 200 and the first electronic device 100 can output 5.1-channel audio. Otherwise, if the channels of the audio signal of the content are 5.1 channels, and the output specifications of the second electronic device 200 and the first electronic device 100 are 2.1 channels, the audio conversion module 360 ​​can reduce the audio signal from 5.1 channels to 2.1 channels.

[0073] In addition, the audio conversion module 360 ​​can map the audio signal to the converted channel based on the information related to the position of the second electronic device 200. For example, if the second electronic device 200 outputs an audio signal corresponding to a woofer channel among multiple channels, the audio conversion module 360 ​​can process the audio signal of the woofer channel according to the position of the second electronic device 200.

[0074] The audio post-processing module 370 may analyze the image projected on the projection surface to perform post-processing on the audio signal according to the converted channels. Specifically, the audio post-processing module 370 may analyze the image projected on the projection surface to perform post-processing on the audio according to the converted channels so as to provide the effect of the sound field according to the expansion of the image. For example, Figure 7As shown, if an image is displayed on the display 110 of the first electronic device 100, audio (e.g., gunshot) may be generated at the first point 710 in the upper left portion of the display 110. Here, if the image is extended to the projection surface projected by the second electronic device 200, and audio is continuously generated at the first point 710, the audio heard is generated at the center of the screen instead of the upper left portion. Therefore, there may be a difference between the image and the audio. Therefore, the audio post-processing module 370 may perform post-processing on the audio signal by channel based on the analysis result (e.g., expansion rate, etc.) of the image projected on the projection surface, so that the audio is generated at the second point 720 in the upper left portion of the projection surface instead of the first point 710.

[0075] The audio post-processing module 370 may obtain a first audio signal to be output by the first electronic device 100 and a second audio signal to be output by the second electronic device 200 based on a result of the post-processing.

[0076] The AV signal synthesis and distribution module 380 may synthesize the first image signal and the second image signal obtained by the image segmentation module 350 with the first audio signal and the second audio signal obtained by the audio post-processing module 370. Specifically, the AV signal synthesis and distribution module 380 may synthesize the first image signal and the first audio signal into the first content to be provided by the first electronic device 100, and may synthesize the second image signal and the second audio signal into the second content to be provided by the second electronic device 200.

[0077] Here, the AV signal synthesis and distribution module 380 can synchronize the first image signal and the second image signal and the first audio signal and the second audio signal, and can correct the first image signal and the second image signal and the first audio signal and the second audio signal according to the output difference (e.g., resolution, gain value, etc.) between the first electronic device 100 and the second electronic device 200.

[0078] The content output module 390 may output the first content output from the AV signal synthesis and distribution module 380. Specifically, the content output module 390 may display a portion of an image by displaying a first image signal of the first content via the display 110, and may output a first audio signal of the first content through the speaker 120.

[0079] The content transmission module 395 may transmit the second content output from the AV signal synthesis and distribution module 380 to the second electronic device 200. Here, the second electronic device 200 may project a second image signal of the second content on the projection surface to project another part of the image, and may output a second audio signal of the second content through a speaker.

[0080] Specifically, the first electronic device 100 according to an embodiment of the present disclosure may enter a synchronization mode for synchronizing an image displayed by the first electronic device 100 and an image projected by the second electronic device 200 before the first electronic device 100 provides content in combination with the second electronic device 200. Figure 8 and Fig. 9 Give a description.

[0081] Figure 8 is a flowchart for describing a method of controlling brightness of an image displayed by a first electronic device and an image projected by a second electronic device according to an embodiment.

[0082] First, the first electronic device 100 may display a picture of a preset color in the first electronic device 100, and may send a control command for projecting a picture of a preset color to the second electronic device 200 (S810). Here, the picture of the preset color displayed by the first electronic device 100 and the picture of the preset color projected by the second electronic device 200 may be a white picture. However, this is only one of the examples, and it may be a picture of other colors (e.g., yellow, etc.).

[0083] The first electronic device 100 may receive an image capturing a picture of a preset color displayed by the first electronic device 100 and a picture of a preset color projected by the second electronic device 200 from the second electronic device 200 (S820). Specifically, the second electronic device 200 may capture a projection surface including a picture of a preset color projected by the second electronic device 200 and a picture of a preset color displayed by the first electronic device 100. Further, the second electronic device 200 may transmit the captured image to the first electronic device 100.

[0084] The first electronic device 100 may control the brightness of at least one of the screen output by the first electronic device 100 or the screen projected by the second electronic device 200 based on the image received from the second electronic device 200 (S830). Specifically, the screen of the preset color displayed by the first electronic device 100 and the screen of the preset color projected by the second electronic device 200 may have different brightnesses according to the specifications of the display of the first electronic device 100, the specifications of the projection part of the second electronic device 200, the external environment (e.g., the indoor lighting environment), etc. Therefore, the first electronic device 100 may obtain the brightness ratio (or brightness difference value) of the screen output by the first electronic device 100 and the screen projected by the second electronic device 200 included in the image. The first electronic device 100 may control the brightness of at least one of the screen output by the first electronic device 100 or the screen projected by the second electronic device 200 based on the obtained brightness ratio (or brightness difference value). For example, if the brightness of the picture output by the first electronic device 100 is 1.25 times brighter than the picture projected by the second electronic device 200, the first electronic device 100 can send a control command to the second electronic device 200 to reduce the brightness of the picture output by the first electronic device 100 by 20% or to increase the brightness of the picture projected by the second electronic device 200 by 25%.

[0085] Thereby, the user can equally recognize the brightness of the screen displayed by the first electronic device 100 and the brightness of the screen projected by the second electronic device 200 .

[0086] Fig. 9 is a flowchart for describing a method of controlling an output timing of an image displayed by a first electronic device and a projection timing of an image projected by a second electronic device according to an embodiment.

[0087] First, the first electronic device 100 may display a screen changed to a pattern preset in the first electronic device 100, and may send a control command for projecting the screen changed to the preset pattern to the second electronic device 200 (S910). Here, the screen changed to the preset pattern may be a screen to which the sides of a triangle are added one by one, but the present disclosure is not limited thereto.

[0088] The first electronic device 100 may receive an image capturing a screen displayed by the first electronic device 100 and a screen projected by the second electronic device 200 and a screen changed to a preset pattern from the second electronic device 200 (S920). Specifically, the second electronic device 200 may capture a projection surface including a screen changed to a preset pattern projected by the second electronic device 200 and a screen changed to a preset pattern displayed by the first electronic device 100. Further, the second electronic device 200 may send the captured image to the first electronic device 100.

[0089] The first electronic device 100 may control at least one of the image output timing of the first electronic device 100 or the image projection timing of the second electronic device 200 based on the image received from the second electronic device 200 (S930). Specifically, due to the communication environment, etc., the pattern in the picture changed to the preset pattern displayed by the first electronic device 100 and the picture changed to the preset pattern projected by the second electronic device 200 may change at different timings. Therefore, the first electronic device 100 may confirm whether the pattern in the picture output by the first electronic device 100 and the picture projected by the second electronic device 200 included in the image are changed equally. If the pattern is not changed equally, the first electronic device 100 may identify the time difference between the time when the pattern in the picture output by the first electronic device 100 included in the image changes and the time when the pattern in the picture projected by the second electronic device 200 changes. The first electronic device 100 may control at least one of the image output timing of the picture output by the first electronic device 100 or the image projection timing of the picture projected by the second electronic device 200 based on the obtained time difference. For example, if the picture output by the first electronic device 100 is 1 second faster than the picture projected by the second electronic device 200, the first electronic device 100 may control the image output timing of the picture output by the first electronic device 100 to be 1 second slower.

[0090] Fig.10 is a flowchart for describing a control method for providing image content in combination with a second electronic device that projects an image according to an embodiment.

[0091] First, the first electronic device 100 obtains information about the projection surface on which the second electronic device 200 projects an image (S1010). Specifically, the first electronic device 100 may obtain an image about the projection surface captured by a camera included in the second electronic device 200, and may identify the area on the projection surface where the first electronic device 100 is located based on the obtained image about the projection surface. Otherwise, the first electronic device 100 may obtain information about the distance between the second electronic device 200 and the projection surface through a distance sensor included in the second electronic device 200, and may obtain information about the size and position of the projection surface based on the information about the distance between the second electronic device 200 and the projection surface.

[0092] Further, the first electronic device 100 divides the input image into a first area and a second area based on the information related to the projection surface and the information related to the first electronic device 100 (S1020). Specifically, the first electronic device 100 may identify an area of ​​the obtained image corresponding to the area where the first electronic device 100 is located on the projection surface as the first area, and may identify other areas of the obtained image except the first area as the second area. Otherwise, the first electronic device 100 may divide the input image into the first area and the second area based on the information related to the size and position of the projection surface.

[0093] The first electronic device 100 displays a portion of the image based on the information about the first area of ​​the image, and transmits the information about the second area of ​​the image to the second electronic device 200 (S1030).

[0094] In addition, the first electronic device 100 may convert the channels of the audio corresponding to the input image into channels corresponding to the output specifications of the second electronic device 200 and the first electronic device 100. Further, the first electronic device 100 may map the audio to the converted channels based on information about the position of the second electronic device 200. Still further, the first electronic device 100 may analyze the image projected on the projection surface to perform post-processing on the audio according to the converted channels.

[0095] In addition, the first electronic device 100 may display a screen of a preset color in the first electronic device 100, and may send a control command for projecting the screen of the preset color to the second electronic device 200. Further, the first electronic device 100 may receive an image capturing the screen of the preset color displayed by the first electronic device 100 and the screen of the preset color projected by the second electronic device 200 from the second electronic device 200. Further, the first electronic device 100 may control the brightness of at least one of the screen output by the first electronic device 100 or the screen projected by the second electronic device 200 based on the image received from the second electronic device 200.

[0096] In addition, the first electronic device 100 may display a screen changed to a preset pattern in the first electronic device 100, and may send a control command for projecting the screen changed to the preset pattern to the second electronic device 200. Further, the first electronic device 100 may receive an image capturing the screen changed to the preset pattern displayed by the first electronic device 100 and the screen changed to the preset pattern projected by the second electronic device 200 from the second electronic device 200. Further, the first electronic device 100 may control at least one of the image output timing of the first electronic device 100 or the image projection timing of the second electronic device 200 based on the image received from the second electronic device 200.

[0097] Meanwhile, the first electronic device 100 according to an embodiment of the present disclosure may provide various modes by using the second electronic device that projects an image.

[0098] Specifically, the first electronic device 100 may operate in a first mode (eg, focus mode) for controlling the second electronic device 200 that projects an image onto a background area outside the first electronic device 100 to project an image having a specific color or pattern.

[0099] Otherwise, the first electronic device 100 may operate in a second mode (e.g., an extended mode) for controlling the first electronic device 100 to display a portion of an image and the second electronic device 200 to project another portion of the image so that a viewer viewing the content can view the content on a large screen, such as Figures 1 to 10 Described in .

[0100] Otherwise, if the first electronic device 100 is used with an external audio device (e.g., a sound bar), the first electronic device 100 can operate in a third mode (e.g., a sound enhancement mode) for enabling the first electronic device 100 and the second electronic device 200 to split and play the image of the content, and play the audio of the content in combination with the external audio device.

[0101] Meanwhile, the content disclosed in the aforementioned embodiment may include metadata including flag information indicating whether the image is segmented. Accordingly, the first electronic device 100 may determine whether to segment the image into the first region and the second region based on the flag information. That is, the first electronic device 100 may determine whether to segment the image by scene based on the flag information. For example, if the first scene of the content includes flag information indicating image segmentation, the first electronic device 100 may segment the image and audio in the first scene of the content, and then may provide the content together with the second electronic device 200. If the second part of the content includes flag information indicating that the image is retained, the first electronic device 100 may provide the content through the first electronic device 100 in the second scene of the content. As described above, the content provider may determine whether to expand and provide the image by the scene included in the content, thereby providing the content through various screen sizes according to the characteristics of the scene type to provide more vivid content.

[0102] Meanwhile, in the aforementioned embodiment, it is described that the first electronic device 100 can maintain the ratio of the image to be displayed and expand its size, wherein the first electronic device 100 displays a portion of the image and the second electronic device 200 projects another portion of the image. However, this is only one of the examples. The first electronic device 100 can maintain the original state of the image to be displayed, and the second electronic device 200 can project an additional image in which the image is expanded left and right or up and down. For the above content, refer to Fig.11 and Fig.12 Give a description.

[0103] Fig.11 and Fig.12 is a diagram for describing an example of expanding a screen in width and height directions according to an embodiment.

[0104] The first electronic device 100 may display the image 1110 of the content in the original scale, such as Fig.11 Thereafter, if the metadata of the content includes flag information for performing image expansion in the horizontal direction, the first electronic device 100 may obtain an additional image of the content and may send information related to the obtained additional image to the second electronic device 200. The second electronic device 200 may project the additional image 1120 around the left and right sides of the first electronic device 100, as shown in FIG. Fig.11 Here, the image and the additional image may provide one screen, and the one screen may be expanded in the horizontal direction compared to the existing image 1110 .

[0105] The first electronic device 100 may display the image 1210 of the content in the original scale, such as Fig.12 As shown in (a). Thereafter, if the metadata of the content includes flag information for image expansion in the vertical direction, the first electronic device 100 can obtain an additional image of the content, and can send information related to the obtained additional image to the second electronic device 200. The second electronic device 200 can project the additional image 1220 around the top of the first electronic device 100. Here, the image and the additional image can be one screen, and the one screen can be expanded in the vertical direction compared to the existing image 1210. Here, whether the second electronic device 200 projects the image in the horizontal direction of the image or in the vertical direction of the image is determined based on the type of scene or the flag information.

[0106] As described above, the first electronic device 100 maintains the ratio of the image to be provided and expands the screen, and thus can provide the viewer with more vivid content based on more expanded images.

[0107] Meanwhile, the aforementioned embodiment describes that the second electronic device 200 projects a portion of the content. However, this is only one of the examples, and the second electronic device 200 may project an image or information related to the content provided by the first electronic device 100. Specifically, the first electronic device 100 may identify the content provided by the first electronic device 100. Here, the first electronic device 100 may identify the currently provided content by using an artificial intelligence (AI) model for identifying scenes. The first electronic device 100 may send information related to the identified content to an external server, and may obtain information or images related to the obtained content. Further, the first electronic device 100 may send a control command so that the second electronic device 200 projects information or images related to the obtained content. Accordingly, the second electronic device 200 may project information related to the content currently provided by the first electronic device 100 or related images (e.g., advertising images, etc.).

[0108] That is, the first electronic device 100 may not directly transmit additional information such as metadata to the second electronic device 200, but may recognize content and control the second electronic device 200 to provide information or images related to the obtained content based on the recognized information.

[0109] Meanwhile, the aforementioned embodiment describes that the area where the first electronic device 100 is located is the central area of ​​the projection surface. However, this is only one of the examples, and the first electronic device 100 may be located at various areas of the projection surface. For example, the area 1310 where the first electronic device is located may be located on the side area of ​​the projection surface, such as Fig.13 Here, the first electronic device 100 may identify the area occupied by the display of the first electronic device 100 on the projection surface based on the image obtained related to the projection surface. For example, the second electronic device 200 may capture the projection surface including the first electronic device 100 located at the side area of ​​the projection surface to obtain Fig.13 Further, the second electronic device 200 may send the obtained image to the first electronic device 100. The first electronic device 100 may identify the area 1310 where the first electronic device 100 is located on the projection surface and other areas 1320 other than the area of ​​the first electronic device 100 based on the received image.

[0110] Meanwhile, the aforementioned embodiment describes that the first electronic device 100 displays a portion of the image of the content according to the area where the first electronic device 100 is located. However, this is only one of the examples, and the first electronic device 100 may display the area of ​​interest in the image of the content. Specifically, the first electronic device 100 may determine the area of ​​interest (the area where the main object or person is located) in the input image of the content. Further, the first electronic device 100 may segment the image of the content based on the area where the first electronic device 100 is located and other areas other than the area of ​​the first electronic device 100, and the area of ​​interest in the image of the content. That is, the first electronic device 100 may display the area of ​​interest in the image of the content on the area where the first electronic device 100 is located, and may send information related to other areas other than the area of ​​interest to the second electronic device 200. For example, the first electronic device 100 may display the area of ​​interest in the content (e.g., the area where the sun is located) 1410, and the second electronic device 200 may project other areas other than the area of ​​interest 1420 based on information related to other areas other than the area of ​​interest, such as Fig.14 Here, the first electronic device 100 may control the size of the image of the content according to the position of the region of interest, or may crop a partial region of the image of the content.

[0111] Meanwhile, the aforementioned embodiment describes that the first electronic device 100 divides the input image of the content into a first area to be displayed by the first electronic device 100 and a second area to be displayed by the second electronic device 200. However, this is only one of the examples, and the first electronic device 100 may divide the input image of the content into three or more areas. For example, the first electronic device 100 may divide the image of the content into a first area 1510 to be displayed by the first electronic device 100, a second area 1520-1 to be displayed by the second electronic device 200-1, and a third area 1520-2 to be displayed by the second electronic device 200-2, as shown in FIG. Fig.15 As shown. Meanwhile, the aforementioned embodiment describes dividing the input image of the content into three or more areas by using at least one first electronic device 100 and at least one second electronic device. However, this is only one of the examples, and the image of the content may be divided into three or more areas by using a portable terminal (e.g., a smartphone, a laptop, a tablet computer, etc.). For example, the first electronic device 100 may divide the image of the content into a first area to be displayed by the first electronic device 100, a second area to be displayed by the second electronic device 200, and a third area to be displayed by a portable terminal device (e.g., a smartphone, etc.).

[0112] Meanwhile, the aforementioned embodiment describes that the first electronic device 100 is a master device, in which it divides the input image into a first area and a second area based on information about the projection surface on which the second electronic device 200 projects the image and information about the first electronic device 100, displays a portion of the image based on information about the first area of ​​the image, and sends information about the second area of ​​the image to the second electronic device 200. However, the above is only one of the examples, and the second electronic device 200 can operate as a master device. That is, Figures 1 to 15 The main body of the operations described in the embodiment may be implemented as the second electronic device 200 instead of the first electronic device 100.

[0113] Fig.16 is a sequence diagram for describing an example in which a first electronic device that displays an image and a second electronic device that projects an image provide content according to an embodiment.

[0114] First, the first electronic device 100 may send information related to the first electronic device 100 to the second electronic device 200 (S1610). Here, the information related to the first electronic device 100 may include information related to the display of the first electronic device 100 (e.g., size, resolution, scanning rate, etc.), and identification information of the first electronic device 100 (e.g., product name, etc.).

[0115] The second electronic device 200 may capture a projection surface (S1620). Here, the projection surface may include an area where the first electronic device 100 is located, and the second electronic device 200 may capture the projection surface including the area where the first electronic device 100 is located to obtain an image.

[0116] The second electronic device 200 may divide the input image into the first area and the second area (S1630). Specifically, the second electronic device 200 may divide the input image into the first area and the second area based on information related to the projection surface obtained from capturing the image of the projection surface and information related to the first electronic device 100.

[0117] The second electronic device 200 may transmit information related to the first area to the first electronic device 100 (S1640). In addition, the first electronic device 100 may display a portion of the input image based on the information related to the first area (S1650).

[0118] While the first electronic device 100 displays a portion of the input image based on the information related to the first area, the second electronic device 200 may project another portion of the image based on the information related to the second area (S1660).

[0119] also, Figures 1 to 15The subject of the operation described in the description may be implemented as an external control device (eg, a set-top box or a smart phone) or the like, instead of the first electronic device 100 or the second electronic device 200 .

[0120] Fig.17 is a sequence diagram for describing an example in which a first electronic device that displays an image and a second electronic device that projects an image provide content through a control device according to an embodiment.

[0121] First, the first electronic device 100 may send information related to the first electronic device 100 to the control device 1700 (S1710). Here, the information related to the first electronic device 100 may include information related to the display of the first electronic device 100 (e.g., size, resolution, scanning rate, etc.), and identification information of the first electronic device 100 (e.g., product name, etc.).

[0122] The second electronic device 200 may send information related to the second electronic device 200 to the control device 1700 (S1720). Here, the information related to the second electronic device 200 may include information related to the projection part of the second electronic device 200 (e.g., size, resolution, brightness, etc.), and identification information of the second electronic device 200 (e.g., product name, etc.).

[0123] The control device 1700 may obtain information related to the projection surface (S1730). For example, the control device 1700 may obtain information related to the projection surface based on an image of the projection surface captured by the control device 1700 or the second electronic device 200, and may obtain information related to the projection surface based on information related to the distance between the first electronic device 100 and the second electronic device 200 obtained by the second electronic device 200.

[0124] The control device 1700 may divide the input image into the first area and the second area (S1740). Specifically, the control device 1700 may divide the input image into the first area and the second area based on the information related to the projection surface as described above.

[0125] The control device 1700 may transmit the information related to the first region to the first electronic device 100 (S1750). In addition, the first electronic device 100 may display a portion of the input image based on the information related to the first region (S1760).

[0126] The control device 1700 may transmit information related to the second area to the second electronic device 200 (S1770). While the first electronic device 100 displays a portion of the input image based on the information related to the first area, the second electronic device 200 may project another portion of the image based on the information related to the second area (S1780).

[0127] Fig.18 2 is a block diagram specifically showing the configuration of the second electronic device 200 according to the embodiment. Fig.18 , the second electronic device 200 may include at least one of a processor 211, a projection part 212, a memory 213, a communication interface 214, an operation interface 215, an I / O interface 216, a speaker 217, a microphone 218, a power supply part 219, a driving part 220 or a sensor part 221. At the same time, Fig.18 The configuration shown in is only one of various examples, wherein part of the configuration may be omitted and new configuration may be added.

[0128] At least one processor 211 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) for processing digital signals. However, it is not limited thereto, and may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a graphics processing unit (GPU), or a communication processor (CP), or an advanced reduced instruction set computer (RISC) machine (ARM) processor, or may be defined based on relative terms. In addition, at least one processor 211 may be implemented as a system on chip (SoC) or a large-scale integration (LSI) in which a processing algorithm is embedded and may be implemented in the form of a field programmable gate array (FPGA). In addition, at least one processor 211 may perform various functions by executing computer executable instructions stored in the memory 213.

[0129] The projection part 212 is configured to project an image outward. According to one of the various examples of the present disclosure, the projection part 212 can be implemented by various projection methods (e.g., a cathode ray tube (CRT) method, a liquid crystal display (LCD) method, a digital light processing (DLP) method, a laser method, etc.). As an example, the CRT method is substantially the same as the principle of a CRT monitor. The CRT method displays an image on a screen by expanding the image using a lens in front of a cathode ray tube (CRT). According to the number of cathode ray tubes, it is divided into a 1-tube type and a 3-tube type. In the case of a 3-tube type, it can be implemented by dividing the cathode ray tubes into red, green and blue cathode ray tubes, respectively.

[0130] As another example, the LCD method is a method of displaying an image by transmitting light generated from a light source to liquid crystal. The LCD method is divided into a single panel type and a 3-panel type, wherein, in the case of the 3-panel type, light generated from a light source is divided into red light, green light, and blue light on a dichroic mirror (a reflector that reflects light having a specific color and passes other light), and then transmitted to the liquid crystal. Thereafter, the light can be gathered at one point again.

[0131] As another example, the DLP method is a method of displaying an image by using a digital micromirror device (DMD) chip. The projection part of the DLP method may include a light source, a color wheel, a DMD chip, a projection lens, etc. The light output from the light source may have a color when passing through a rotating color wheel. The light passing through the color wheel is input to the DMD chip. The DMD chip includes a plurality of micromirrors and reflects the light input to the DMD chip. The projection lens may play a role in expanding the light reflected from the DMD chip to the image size.

[0132] As another example, the laser method includes a diode pumped solid-state (DPSS) laser and a galvanometer. A laser that outputs various colors uses a laser whose optical axes overlap by using a specific mirror after installing three DPSS lasers according to RGB colors. The galvanometer includes a mirror and a motor with high output power, and moves the mirror quickly. For example, the galvanometer can rotate the mirror at a maximum of 40 KHz / sec. The galvanometer is installed according to the scanning direction, wherein the projector generally performs flat-panel scanning, and therefore, the galvanometer can also be arranged to be divided into the x-axis and the y-axis.

[0133] Meanwhile, the projection part 212 may include various types of light sources. For example, the projection part 212 may include at least one light source of a lamp, an LED, or a laser.

[0134] The projection part 212 may output images of 4:3 aspect ratio, 5:4 aspect ratio, 16:9 aspect ratio according to the use of the second electronic device 200, the user's setting, etc. According to the aspect ratio, it may output images of various resolutions such as WVGA (854×480), SVGA (800×600), XGA (1024×768), WXGA (1280×720), WXGA (1280×800), SXGA (1280×1024), UXGA (1600×1200), and full HD (1920×1080).

[0135] Meanwhile, the projection part 212 may perform various functions for controlling an output image by controlling at least one processor 211. For example, the projection part 212 may perform functions such as zoom, keystone correction, fast angle (4-angle) keystone correction, and lens shift.

[0136] Specifically, the projection part 212 can expand or reduce the image according to the distance from the screen (projection distance). That is, the zoom function can be performed according to the distance from the screen. Here, the zoom function may include a hardware method of moving the lens to control the size of the picture, and a software method of controlling the size of the picture by cropping the image, etc. At the same time, if the zoom function is performed, it is necessary to control the focus of the image. For example, the method of controlling the focus includes a manual focus method, an electric method, etc. The manual focus method refers to a method of manually adjusting the focus, and the electric method refers to a method in which the projector automatically adjusts the focus by using an embedded motor if the zoom function is performed. If the zoom function is performed, the projection part 212 can provide a digital zoom function through software, and can provide an optical zoom function that performs the zoom function by moving the lens using the drive part 220.

[0137] In addition, the projection part 212 can perform a keystone correction function. If the height is not suitable for front projection, the picture may be distorted upward or downward. The keystone correction function refers to a function of correcting a distorted picture. For example, if distortion occurs in the left and right directions of the picture, it can be corrected by using horizontal keystone correction, and if distortion occurs in the upper and lower directions, it can be corrected by using vertical keystone correction. The fast corner (4-corner) keystone correction function is a function of correcting the picture if the center area of ​​the picture is normal but its corner areas are unbalanced. The lens shift function is a function of shifting the picture as it is if the picture deviates from the screen.

[0138] At the same time, the projection part 212 can provide zoom / keystone correction / focusing functions by automatically analyzing the surrounding environment and the projection environment without user input. Specifically, the projection part 212 can automatically provide zoom / keystone correction / focusing functions based on the distance between the second electronic device 200 and the screen sensed by a sensor (depth camera, distance sensor, infrared sensor, illuminance sensor, etc.), information about the space where the second electronic device 200 is currently located, information about the amount of light in the surrounding environment, etc.

[0139] In addition, the projection part 212 can provide a lighting function by using a light source. Specifically, the projection part 212 can provide a lighting function by outputting a light source using an LED. According to one of the various examples, the projection part 212 may include an LED. According to another example, the second electronic device 200 may include a plurality of LEDs. Meanwhile, according to an embodiment, the projection part 212 can output a light source by using a surface-emitting LED. Here, the surface-emitting LED may refer to an LED having a structure in which an optical sheet is arranged on the upper side of the LED so that the light source is uniformly dispersed and output. Specifically, if the light source is output by an LED, the light source can be uniformly dispersed over the entire optical sheet, and the light source dispersed over the entire optical sheet can enter the display panel.

[0140] At the same time, the projection part 212 can provide the user with a dimming function for controlling the intensity of the light source. Specifically, if a user input for controlling the intensity of the light source is received from the user through the operation interface 215 (for example, touching a display button or a dial), the projection part 212 can control the LED to output the intensity of the light source corresponding to the received user input.

[0141] In addition, the projection part 212 can provide a dimming function without user input based on the content analyzed by the at least one processor 211. Specifically, the projection part 212 can control the intensity of the LED output light source based on information related to the currently provided content (e.g., the type of content, the brightness of the content, etc.).

[0142] Meanwhile, the projection part 212 can control the color temperature by controlling at least one processor 211. Here, at least one processor 211 can control the color temperature based on the content. Specifically, if at least one processor 211 identifies the output content, it can obtain the color information of each frame of the content determined to be output. Further, at least one processor 211 can control the color temperature based on the color information of each frame obtained. Here, at least one processor 211 can obtain at least one or more main colors of the frame based on the color information of each frame. Further, at least one processor 211 can control the color temperature based on the at least one or more main colors obtained. For example, the color temperature that can be controlled by at least one processor 211 can be divided into a warm color type or a cold color type. Here, it is assumed that the frame to be output (hereinafter, referred to as the output frame) includes a scene of a fire. At least one processor 211 can identify (or obtain) that the main color is red based on the color information included in the current output frame. Further, at least one processor 211 can identify the color temperature corresponding to the identified main color (red). Here, the color temperature corresponding to red can be a warm color type. At the same time, at least one processor 211 may use the AI ​​model to obtain color information or a dominant color of the frame. According to one of various examples, the AI ​​model may be stored in the second electronic device 200 (eg, the memory 213). According to another example, the AI ​​model may be stored in an external server that can communicate with the second electronic device 200.

[0143] The memory 213 may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) and a RAM included in the at least one processor 211, or may be implemented as a memory separate from the at least one processor 211. In this case, the memory 213 may be implemented in the form of a memory embedded in the second electronic device 200 according to data storage purposes, or may be implemented in the form of a memory attachable to / detachable from the second electronic device 200. For example, data for driving the second electronic device 200 is stored in a memory embedded in the second electronic device 200, and data for an extended function of the second electronic device 200 may be stored in a memory attachable to / detachable from the second electronic device 200.

[0144] Meanwhile, the memory embedded in the second electronic device 200 may be implemented as at least one of a volatile memory (e.g., a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), etc.) or a nonvolatile memory (e.g., a one-time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., a NAND flash memory, a NOR flash memory, etc.), a hard disk drive, or a solid-state drive (SSD)). The memory attachable to / detachable from the second electronic device 200 may be implemented in the form of a memory card (e.g., a compact flash (CF), a secure digital (SD), a micro secure digital (micro-SD), a mini secure digital (mini-SD), an extreme digital (xD), a multimedia card (MMC), an external memory connectable to a USB port (e.g., a USB memory), etc.).

[0145] The memory 213 may store at least one instruction for the second electronic device 200. In addition, the memory 213 may store an operating system (O / S) for driving the second electronic device 200. In addition, the memory 213 may store various software programs or applications for operating the second electronic device 200 according to various embodiments of the present disclosure. Further, the memory 213 may include a semiconductor memory (e.g., a flash memory) or a magnetic storage medium (e.g., a hard disk).

[0146] Specifically, the memory 213 may store various software modules for operating the second electronic device 200, and the at least one processor 211 may implement the various software modules stored in the memory 213 to control the operation of the second electronic device 200 according to various embodiments of the present disclosure. That is, the memory 213 is accessed by the at least one processor 211, and data reading / recording / correction / deletion / update, etc. may be performed by the at least one processor 211.

[0147] Meanwhile, the term memory 213 of the present disclosure may be used to mean a storage device, a ROM (not shown) within at least one processor 211, a RAM (not shown), or a memory card (not shown) (e.g., a micro SD card, a memory stick) installed in the second electronic device 200.

[0148] The communication interface 214 is configured to perform communication with various types of external devices according to various types of communication methods. The communication interface 214 may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0149] The wireless communication module may be a module that wirelessly communicates with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0150] The Wi-Fi module and the Bluetooth module can perform communication in the Wi-Fi method and the Bluetooth method, respectively. In the case of using the Wi-Fi module or the Bluetooth module, it can send / receive various information after performing communication connection by first sending / receiving various connection information such as a service set identifier (SSID) and a session key and using the various connection information.

[0151] The infrared communication module performs communication according to an Infrared Data Association (IrDA) technology that wirelessly transmits data within a short distance by using infrared rays between visible light and millimeter waves.

[0152] Other modules may include at least one communication chip that performs communication according to various wireless communication standards (e.g., zigbee, third generation (3G), third generation partnership project (3GPP), long term evolution (LTE), advanced LTE (LTE-A), fourth generation (4G), and fifth generation (5G)).

[0153] The wired communication module may be a module that communicates with an external device by wire. For example, the wired communication module may include at least one of a local area network (LAN) module, an Ethernet module, a twisted pair, a coaxial cable, an optical fiber cable, or an ultra-wideband (UWB) module.

[0154] The operation interface 215 may include various types of input devices. For example, the operation interface 215 may include a physical button. Here, the physical button may include a function key, an arrow key (e.g., a four-arrow key), or a dial button. According to one of the various examples, the physical button may be implemented as a plurality of keys. According to another example, the physical button may be implemented as one key. Here, if the physical button is implemented as one key, the second electronic device 200 may receive a user input that the one key is pressed for a critical time or longer. If a user input that the one key is pressed for a critical time or longer is received, the at least one processor 211 may perform a function corresponding to the user input. For example, the at least one processor 211 may provide a lighting function based on the user input.

[0155] In addition, the operation interface 215 can receive user input by using a non-contact method. When receiving user input by a non-contact method, physical force must be transmitted to the second electronic device 200. Therefore, a method for controlling the second electronic device 200 regardless of physical force may be required. Specifically, the operation interface 215 can receive a user gesture, and can perform an operation corresponding to the received user gesture. Here, the operation interface 215 can receive the user's gesture through a sensor (e.g., an image sensor or an infrared sensor).

[0156] In addition, the operation interface 215 can receive user input by using a touch method. For example, the operation interface 215 can receive user input through a touch sensor. According to one of the various examples, the touch method can be implemented in a non-contact manner. For example, the touch sensor can determine whether the user's body is close to it within a critical distance. Here, the touch sensor can recognize the user input even if the user does not touch the touch sensor. At the same time, the touch sensor can recognize the user input that the user touches the touch sensor.

[0157] Meanwhile, the second electronic device 200 may receive user input through various methods other than the operation interface 215. As one of various examples, the second electronic device 200 may receive user input through an external remote control device. Here, the external remote control device may be a remote control device corresponding to the second electronic device 200 (e.g., a dedicated control device of the second electronic device 200), or a portable communication device of the user (e.g., a smart phone or a wearable device). Here, the portable communication device of the user may store an application for controlling the second electronic device 200. The portable communication device may obtain user input through the stored application, and may send the obtained user input to the second electronic device 200. The second electronic device 200 may receive user input from the portable communication device, and may perform an operation corresponding to the user's control command.

[0158] Meanwhile, the second electronic device 200 may receive user input by using voice recognition. According to one of various examples, the second electronic device 200 may receive user voice through a microphone included in the second electronic device 200. According to another example, the second electronic device 200 may receive user voice from a microphone or an external device. Specifically, the external device may obtain user voice through a microphone of the external device, and may send the obtained user voice to the second electronic device 200. The user voice sent from the external device may be audio data, or digital data converted from audio data (e.g., audio data converted to a frequency domain, etc.). Here, the second electronic device 200 may perform an operation corresponding to the received user voice. Specifically, the second electronic device 200 may receive audio data corresponding to the user voice through a microphone. Further, the second electronic device 200 may convert the received audio data into digital data. Further, the second electronic device 200 may convert the converted digital data into text data by using a speech-to-text (STT) function. According to one of various examples, the STT function may be directly executed in the second electronic device 200.

[0159] According to another example, the STT function may be performed in an external server. The second electronic device 200 may send digital data to the external server. The external server may convert the digital data into text data, and may obtain control command data based on the converted text data. The external server may send the control command data (here, text data may be included) to the second electronic device 200. The second electronic device 200 may perform an operation corresponding to the user's voice based on the obtained control command data.

[0160] At the same time, the second electronic device 200 can use an assistant (or AI secretary (e.g., Bixby TM ) and the like) to provide a voice recognition function. However, this is only one of various examples, and the voice recognition function may be provided by multiple assistants. Here, the second electronic device 200 may select one of the multiple assistants based on a specific key present in the trigger word or a remote controller corresponding to the assistant to provide the voice recognition function.

[0161] Meanwhile, the second electronic device 200 may receive user input by using screen interaction. Screen interaction may refer to a function in which the second electronic device 200 recognizes whether a predetermined event occurs through an image projected onto a screen (or projection surface) and obtains user input based on the predetermined event. Here, the predetermined event may refer to an event in which a predetermined object is recognized at a specific location (e.g., a location where a UI for receiving user input is projected). Here, the predetermined object may include at least one of a part of the user's body (e.g., a finger), a pointer, or a laser pointer. If a predetermined object is recognized at a location corresponding to the projected UI, the second electronic device 200 may recognize that a user input for selecting the projected UI is received. For example, the second electronic device 200 may project a guide image to display a UI on the screen. Further, the second electronic device 200 may recognize whether the user selects the projected UI. Specifically, if a predetermined event is recognized at the location of the projected UI, the second electronic device 200 may recognize that the user selects the projected UI. Here, the projected UI may include one or more items. Here, the second electronic device 200 may perform a spatial analysis for identifying whether a predetermined event exists at the location of the projected UI. Here, the second electronic device 200 may perform spatial analysis through a sensor (e.g., an image sensor, an infrared sensor, a depth sensor, a distance sensor, etc.). The second electronic device 200 may identify whether a predetermined event occurs at a specific location (the location where the UI is projected) by performing spatial analysis. Further, if it is identified that a predetermined event occurs at a specific location (the location where the UI is projected), the second electronic device 200 may identify that a user input for selecting a UI corresponding to the specific location is received.

[0162] The I / O interface 216 is configured to input / output at least one of an audio signal or an image signal. The I / O interface 216 may receive at least one of an audio signal or an image signal from an external device, and may output a control command from the external device.

[0163] According to an embodiment, the I / O interface 216 may be implemented as an interface that inputs / outputs only audio signals and an interface that inputs / outputs only image signals, or may be implemented as one interface that inputs / outputs all audio signals and image signals.

[0164] Meanwhile, according to one of various examples of the present disclosure, the I / O interface 216 may be implemented as at least one or more wired I / O interfaces among a High Definition Multimedia Interface (HDMI), a Mobile High Definition Link (MHL), a Universal Serial Bus (USB), a Type-C USB, a DisplayPort (DP), Thunderbolt, a Video Graphics Array (VGA) port, an RGB port, a D-SUB, a connector, or a Digital Video Interface (DVI). According to one of various examples, the wired I / O interface may be implemented as an interface for inputting / outputting only audio signals, and an interface for inputting / outputting only image signals, or may be implemented as one interface for inputting / outputting all audio signals and image signals.

[0165] In addition, the second electronic device 200 can receive data through the wired I / O interface. However, this is only one of various examples, and power can be provided through the wired I / O interface. For example, the second electronic device 200 can receive power from an external battery through a Type-C USB, or can receive power from a power outlet through a power adapter. As another example, the second electronic device 200 can receive power from an external device (e.g., a laptop, a monitor, etc.) through DP.

[0166] At the same time, the audio signal can be implemented to be received through a wired I / O interface, and the image signal can be implemented to be received through a wireless I / O interface (or communication interface). In addition, the audio signal can be received through a wireless I / O interface (or communication interface), and the image signal can be implemented to be received through a wired I / O interface.

[0167] The speaker 217 is configured to output an audio signal. Specifically, the speaker 217 may include an audio output mixer, an audio signal processor, and a sound output module. The audio output mixer may synthesize a plurality of audio signals to be output into at least one audio signal. For example, the audio output mixer may synthesize an analog audio signal and another analog audio signal (e.g., an analog audio signal received from the outside) into at least one analog audio signal. The sound output module may include a speaker or an output terminal. According to one of various examples, the sound output module may include a plurality of speakers. In this case, the sound output module may be disposed in the main body. The sound emitted while covering at least a portion of the diaphragm of the sound output module may be transmitted through a waveguide and transmitted to the outside of the main body. The sound output module may include a plurality of sound output units, and the plurality of sound output units may be arranged symmetrically relative to the appearance of the main body. As a result, the sound may be emitted in all directions (i.e., in all directions of 360°).

[0168] Microphone 218 is configured to receive user voice or other sounds and convert it into audio data. Microphone 218 can receive user voice in an active state. For example, microphone 218 can be formed to be integrated with the upper side, front, side, etc. of second electronic device 200. Microphone 218 may include various configurations, for example, a microphone for collecting user voice in analog form, an amplifier circuit for amplifying the collected user voice, an A / D conversion circuit for sampling the amplified user voice to convert it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0169] The power supply part 219 can receive power from the outside and can supply power to various configurations of the second electronic device 200. According to one of the various examples of the present disclosure, the power supply part 219 can receive power by various methods. As one of the various examples, the power supply part 219 can receive power by using the connector 230. In addition, the power supply part 219 can receive power by using a 220V DC power line. However, the present disclosure is not limited thereto, and the second electronic device 200 can receive power by using a USB power line, or can receive power by using a wireless charging method.

[0170] In addition, the power supply part 219 can receive power by using an internal battery or an external battery. According to one of the various examples of the present disclosure, the power supply part 219 can receive power through the internal battery. As an example, the power supply part 219 can charge the internal battery by using at least one of a 220V DC power line, a USB power line, or a Type-C USB power line, and can receive power through the charged internal battery. In addition, according to one of the various examples of the present disclosure, the power supply part 219 can receive power through an external battery. As an example, if the connection between the second electronic device 200 and the external battery is performed by various wired communication methods (e.g., a USB power line, a Type-C USB power line, and a socket slot), the power supply part 219 can receive power through an external battery. That is, the power supply part 219 can receive power directly from the external battery, or the internal battery can be charged by the external battery to receive power from the charged internal battery.

[0171] According to the present disclosure, the power supply part 219 may receive power by using at least one of the aforementioned various power supply methods.

[0172] Meanwhile, regarding power consumption, the second electronic device 200 may have to have a power consumption of a preset value (e.g., 43W) or lower due to the form of the socket, other standards, etc. Here, the second electronic device 200 may change the power consumption to reduce the power consumption when using a battery. That is, the second electronic device 200 may change the power consumption based on the power supply method, power consumption, etc.

[0173] The driving portion 220 may drive at least one hardware configuration included in the second electronic device 200. The driving portion 220 may generate a physical force and may transmit it to the at least one hardware configuration included in the second electronic device 200.

[0174] Here, the driving portion 220 may generate a driving force for moving a hardware configuration included in the second electronic device 200 (eg, moving the second electronic device 200 ) or for a rotation operation of the configuration (eg, rotating a projection lens).

[0175] The driving part 220 may control the projection direction (or projection angle) of the projection part 222. In addition, the driving part 220 may move the position of the second electronic device 200. Here, the driving part 220 may control the moving member 209 for moving the second electronic device 200. For example, the driving part 220 may control the moving member 209 by using a motor.

[0176] The sensor part 221 may include at least one sensor. Specifically, the sensor part 221 may include at least one of a tilt sensor that senses the tilt of the second electronic device 200 or an image sensor that captures an image. Here, the tilt sensor may be an acceleration sensor or a gyroscope sensor, and the image sensor may represent a camera or a depth camera. At the same time, the tilt sensor may be described as a motion sensor. In addition, the sensor part 221 may include various sensors other than the tilt sensor or the image sensor. For example, the sensor part 221 may include an illumination sensor or a distance sensor. The distance sensor may include a time of flight (ToF) sensor. In addition, the sensor part 221 may include a LIDAR sensor.

[0177] At the same time, the second electronic device 200 can control the lighting function in combination with the external device. Specifically, the second electronic device 200 can receive lighting information from the external device. Here, the lighting information can include at least one of information related to brightness or information related to color temperature set from the external device. Here, the external device can represent a device connected to the same network as the second electronic device 200 (for example, an IoT device included in the same home / company network), or a device that is not connected to the same network as the second electronic device 200 but can communicate with the second electronic device 200 (for example, a remote control server). For example, it is assumed that an external lighting device (IoT device) included in the same network as the network of the second electronic device 200 outputs red lighting with a brightness of 50. The external lighting device (IoT device) can directly or indirectly send lighting information (for example, information indicating that red lighting is output at a brightness of 50) to the second electronic device 200. Here, the second electronic device 200 can control the output power of the light source based on the lighting information received from the external lighting device. For example, if the lighting information received from the external lighting device includes information that red lighting is output at a brightness of 50, the second electronic device 200 can output red lighting at a brightness of 50.

[0178] At the same time, the second electronic device 200 can control the lighting function based on the biometric data. Specifically, at least one processor 211 can obtain the biometric data of the user. Here, the biometric data may include at least one of the user's body temperature, heart rate, blood pressure, respiration, or electrocardiogram. Here, the biometric data may include various information in addition to the aforementioned information. As an example, the second electronic device 200 may include a sensor for measuring biometric data. At least one processor 211 may obtain the biometric data of the user through the sensor, and may control the output of the light source based on the obtained biometric data. As another example, at least one processor 211 may receive biometric data from an external device through the I / O interface 216. Here, the external device may represent a portable communication device of the user (e.g., a smartphone or a wearable device). At least one processor 211 may obtain the biometric data of the user from the external device, and may control the output of the light source based on the obtained biometric data. At the same time, according to an embodiment, the second electronic device 200 may identify whether the user is sleeping, and if it is identified that the user is sleeping (or preparing to sleep), the at least one processor 211 may control the output of the light source based on the biometric data of the user.

[0179] Meanwhile, according to one of various examples of the present disclosure, the second electronic device 200 may provide various smart functions.

[0180] Specifically, the second electronic device 200 may be connected to a portable terminal device for controlling the second electronic device 200 to control the screen output from the second electronic device 200 by a user input input from the portable terminal device. As an embodiment, the portable terminal device may be implemented as a smart phone including a touch display, and the second electronic device 200 may receive and output screen data provided by the portable terminal device from the portable terminal device, and may control the screen output from the second electronic device 200 according to the user input input from the portable terminal device.

[0181] The second electronic device 200 may perform connection with the portable terminal device through various communication methods (eg, Miracast, Airplay, Wireless DEX, and Remote PC method) to share content or music provided by the portable terminal device.

[0182] Further, the connection between the portable terminal device and the second electronic device 200 may be performed in various connection methods. As one of various examples, a wireless connection may be performed by searching for the second electronic device 200 in the portable terminal device, or a wireless connection may be performed by searching for the portable terminal device in the second electronic device 200. Further, the second electronic device 200 may output content provided from the portable terminal device.

[0183] As one of various examples, after positioning a portable terminal device in a state where specific content or music is output from portable terminal devices around the second electronic device 200, if a preset gesture (e.g., an action click view) is sensed by the display of the portable terminal device, the second electronic device 200 can output the content or music output from the portable terminal device.

[0184] As one of various examples, in a state where specific content or music is output from a portable terminal device, if the portable terminal device approaches the second electronic device 200 within a preset distance or shorter (e.g., a contactless click view) or the portable terminal device contacts the second electronic device 200 twice within a short interval (e.g., a contact click view), the second electronic device 200 can output the content or music output from the portable terminal device.

[0185] In the aforementioned example, the same screen as that provided by the portable terminal device is provided in the second electronic device 200, but the present disclosure is not limited thereto. That is, a connection between the portable terminal device and the second electronic device 200 is established, the portable terminal device outputs a first screen provided by the portable terminal device, and the second electronic device 200 can output a second screen different from the first screen provided by the portable terminal device. As an example, the first screen may be a screen provided by a first application installed in the portable terminal device, and the second screen may be a screen provided by a second application installed in the portable terminal device. As an example, the first screen and the second screen may be different screens provided by an application installed in the portable terminal device. In addition, as an example, the first screen may be a screen including a UI in the form of a remote controller for controlling the second screen.

[0186] According to the present disclosure, the second electronic device 200 may output a standby screen. As an example, if the connection between the second electronic device 200 and the external device is not performed or there is no input received from the external device within a preset time, the second electronic device 200 may output a standby screen. The conditions under which the second electronic device 200 outputs the standby screen are not limited to the above examples, and the standby screen may be output according to various conditions.

[0187] The second electronic device 200 may output a standby screen in the form of a blue screen, but the present disclosure is not limited thereto. As an example, the second electronic device 200 may extract only the form of a specific object from data received from an external device to obtain an atypical object, and may output a standby screen including the obtained atypical object.

[0188] Meanwhile, the second electronic device 200 may further include a display (not shown).

[0189] The display (not shown) may be implemented as a display having various forms, for example, a liquid crystal display (LCD), an organic light emitting diode (OLED) display, and a plasma display panel (PDP). The display (not shown) may include a driving circuit, a backlight unit, and the like that may be implemented in the form of an amorphous silicon thin film transistor (a-si TFT), a low temperature polycrystalline silicon (LTPS) TFT, an organic TFT (OTFT), and the like. Meanwhile, the display (not shown) may be implemented as a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display), and the like. In addition, according to one of the various examples of the present disclosure, the display (not shown) may include not only a display panel that outputs an image, but also a frame that accommodates the display panel. Specifically, according to one of the various examples of the present disclosure, the frame may include a touch sensor (not shown) for sensing user interaction.

[0190] Meanwhile, the second electronic device 200 may further include a shutter portion (not shown).

[0191] The shutter portion (not shown) may include at least one of a shutter, a fixing member, a guide rail, or a body.

[0192] Here, the shutter may block light output from the projection part 212. Here, the fixing member may fix the position of the shutter. Here, the guide rail may be a path for moving the shutter and the fixing member. Here, the main body may be an assembly including the shutter and the fixing member.

[0193] at the same time, Figures 1 to 15 The main body of the operation described in can be implemented as Fig.18 The second electronic device 200 described in the embodiment rather than the first electronic device 100.

[0194] Meanwhile, the method according to one of the various examples of the present disclosure may be configured to be included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded through an application store (e.g., Play Store TM ) online distribution (e.g., download or upload), or distribution (e.g., download or upload) directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be at least temporarily stored in a machine-readable storage medium (e.g., a server of a manufacturer, a server of an application store, and a memory of a relay server), or may be temporarily generated.

[0195] The method according to one of the various examples of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium (e.g., a computer). The machine refers to a device that calls instructions stored in a storage medium and can operate according to the called instructions, and may include an electronic device according to the disclosed example (e.g., a television).

[0196] Meanwhile, the machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, a "non-transitory storage medium" is a tangible device and only means that a signal (e.g., electromagnetic wave) is not included. The term does not distinguish between a case where data is semi-permanently stored in a storage medium and a case where data is temporarily stored in a storage medium. As an example, a "non-transitory storage medium" may include a buffer that temporarily stores data.

[0197] If the instruction is executed by a processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include a code generated or implemented by a compiler or an interpreter.

[0198] Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the above-mentioned specific embodiments, and various modifications may be made by a person skilled in the art without departing from the subject matter of the present disclosure as claimed in the claims, and such modifications should not be construed as departing from the technical spirit or prospects of the present disclosure.

Claims

1. A first electronic device providing image content in combination with a second electronic device projecting an image, comprising: Communication interface; monitor; Memory; as well as at least one processor connected to the communication interface, the display and the memory and configured to control the first electronic device, Wherein, the at least one processor is configured to: obtaining information related to a projection surface onto which the second electronic device projects an image; dividing the input image into a first area and a second area based on the information about the projection surface and the information about the first electronic device; and The display is controlled to display a portion of the image based on the information related to the first area in the image, and the communication interface is controlled to send the information related to the second area in the image to the second electronic device.

2. The first electronic device according to claim 1, wherein: The at least one processor is configured to: receiving, through the communication interface, an image related to the projection surface captured by a camera included in the second electronic device; as well as An area on the projection surface where the first electronic device is located is identified based on the obtained image related to the projection surface.

3. The first electronic device according to claim 2, wherein: The at least one processor is configured to: identify an area of ​​the obtained image corresponding to an area where the first electronic device is located on the projection surface as the first area, and identify other areas of the obtained image except the first area as the second area.

4. The first electronic device according to claim 1, wherein: The at least one processor is configured to: receiving, through the communication interface, information related to the distance between the second electronic device and the projection surface obtained via a distance sensor included in the second electronic device; obtaining information related to the size and position of the projection surface based on information related to the distance between the second electronic device and the projection surface; as well as The input image is segmented into the first region and the second region based on information about the size and position of the projection surface.

5. The first electronic device according to claim 1, wherein: The at least one processor is configured to: converting the channels of the audio corresponding to the input image into channels corresponding to the output specifications of the second electronic device and the first electronic device; and The audio is mapped to converted channels based on information related to the location of the second electronic device.

6. The first electronic device according to claim 5, wherein: The at least one processor is configured to analyze an image projected onto the projection surface and perform post-processing on the audio per converted channel.

7. The first electronic device according to claim 1, wherein: The at least one processor is configured to: Controlling the display to display a picture of a preset color in the first electronic device, and controlling the communication interface to send a control command for projecting the picture of the preset color to the second electronic device; receiving, from the second electronic device through the communication interface, an image capturing the picture of the preset color displayed by the first electronic device and the picture of the preset color projected by the second electronic device; as well as Based on the image received from the second electronic device, the brightness of at least one of a picture output by the first electronic device or a picture projected by the second electronic device is controlled.

8. The first electronic device according to claim 1, wherein: The at least one processor is configured to: Controlling the display to display a picture changed to a pattern preset in the first electronic device, and controlling the communication interface to send a control command for projecting the picture changed to the preset pattern to the second electronic device; receiving, from the second electronic device through the communication interface, an image capturing the screen displayed by the first electronic device and changed to the preset pattern and the screen projected by the second electronic device and changed to the preset pattern; as well as At least one of an image output timing of the first electronic device or an image projection timing of the second electronic device is controlled based on the image received from the second electronic device.

9. The first electronic device according to claim 1, wherein: The input image includes flag information indicating whether to segment the image in metadata; and Wherein, the at least one processor is configured to: Based on the flag information, it is determined whether to divide the image into the first area and the second area.

10. The first electronic device according to claim 1, wherein: The first electronic device is configured to operate in one of a first mode in which the input image is displayed in the first electronic device and a second mode in which the input image is split and displayed by the first electronic device and the second electronic device.

11. A method for controlling a first electronic device to provide image content in combination with a second electronic device that projects an image, comprising: obtaining information related to a projection surface onto which the second electronic device projects an image; segmenting an input image into a first area and a second area based on information related to the projection surface and information related to the first electronic device; as well as Based on the information about the first area in the image, a portion of the image is displayed, and the information about the second area in the image is transmitted to the second electronic device.

12. The method according to claim 11, wherein: The obtaining is obtaining an image related to the projection surface taken by a camera included in the second electronic device; and The controlling further comprises: identifying the area on the projection surface where the first electronic device is located based on the obtained image related to the projection surface.

13. The method according to claim 12, wherein: The segmentation is to identify a region of the obtained image corresponding to a region where the first electronic device is located on the projection surface as the first region, and to identify other regions of the obtained image except the first region as the second region.

14. The method according to claim 11, wherein: The acquisition is: obtaining information related to the distance between the second electronic device and the projection surface through a distance sensor included in the second electronic device; and obtaining information about the size and position of the projection surface based on information about the distance between the second electronic device and the projection surface; and The segmentation is to segment the input image into the first area and the second area based on information related to the size and position of the projection surface.

15. The method according to claim 11, comprising: converting the audio channel corresponding to the input image into the audio channel corresponding to the output specifications of the second electronic device and the first electronic device; as well as The audio is mapped to converted channels based on information related to the location of the second electronic device.

Images