Image output apparatus including plurality of projection sections and method of controlling same

Abstract

An image output apparatus includes: a communication interface including circuitry; a first projector; a second projector; a first driver configured to adjust a first projection position of the first projector; a second driver configured to adjust a second projection position of the second projector; and at least one processor configured to: identify contextual information of an input image received through the communication interface; identifying a screen layout from among a plurality of screen layouts based on the contextual information; controlling the first driver according to the screen layout such that the first projector projects the first image to the first projection position; and controlling the second driver according to the screen layout such that the second projector projects the second image to the second projection position.

Description

Technical Field

[0001] The present disclosure relates to an image output device and a control method thereof, and more particularly, to an image output device that outputs an image by using a plurality of movable projection parts and a control method thereof. Background Art

[0002] Recently, various forms of display devices have been developed and distributed.

[0003] In various image display environments, there may be an increase in cases where a plurality of display devices may be used instead of one display device, such as, but not limited to, a plurality of projector devices and the like.

[0004] The situation where multiple projector devices can be used can provide various effects and / or advantages, such as but not limited to increasing the size of the image, increasing the maximum output brightness of the image, etc. However, it may be difficult for the user to directly adjust the projection positions of the multiple projector devices. Alternatively or additionally, it may be difficult for the user to directly determine the appropriate projection position according to each characteristic and context of the image.

[0005] Therefore, in a dual-projection environment using a plurality of projectors, there is a need for an image output device and a control method thereof that can automatically adjust a projection position in consideration of characteristics of an image. Summary of the invention

[0006] Technical Solutions

[0007] According to aspects of the present disclosure, an image output device includes: a communication interface including a circuit; a first projector; a second projector; a first driver configured to adjust a first projection position of the first projector; a second driver configured to adjust a second projection position of the second projector; and at least one processor configured to: identify context information of an input image received through the communication interface; identify a screen layout from a plurality of screen layouts based on the context information; control the first driver according to the screen layout so that the first projector projects a first image to the first projection position; and control the second driver according to the screen layout so that the second projector projects a second image to the second projection position.

[0008] According to aspects of the present disclosure, a control method for an image output device includes: identifying context information of an input image; selecting a screen layout from a plurality of screen layouts based on the context information; controlling a first driver of the image output device according to the screen layout so that a first projector of the image output device projects a first image to a first projection position; and controlling a second driver of the image output device according to the screen layout so that a second projector of the image output device projects a second image to a second projection position.

[0009] According to aspects of the present disclosure, a computer-readable recording medium includes a program for executing a control method for an image output device, the control method including: identifying context information of an input image; selecting a screen layout from a plurality of screen layouts based on the context information; controlling a first driver of the image output device according to the screen layout so that a first projector of the image output device projects a first image to a first projection position; and controlling a second driver of the image output device according to the screen layout so that a second projector of the image output device projects a second image to a second projection position.

[0010] Additional aspects are set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings.

[0012] Figure 1 is a diagram showing a configuration of an image output device according to an embodiment of the present disclosure.

[0013] Figure 2 is a block diagram showing a configuration of an image output device according to an embodiment of the present disclosure.

[0014] Figure 3 is a flowchart illustrating a control method of an image output device recognizing a screen layout and a rotation parameter according to an embodiment of the present disclosure.

[0015] Figure 4 is a diagram illustrating the operation of a driving portion according to an embodiment of the present disclosure.

[0016] Figure 5 is a diagram showing an array screen layout according to an embodiment of the present disclosure.

[0017] Figure 6 is a diagram showing an array screen layout according to an embodiment of the present disclosure.

[0018] Figure 7 is a diagram illustrating an overlay screen layout according to an embodiment of the present disclosure.

[0019] Figure 8 is a diagram illustrating a partial overlay screen layout according to an embodiment of the present disclosure.

[0020] Fig. 9 is a diagram illustrating the operation of a driving portion according to an embodiment of the present disclosure.

[0021] Fig.10 is a diagram illustrating calibration of multiple projection parts according to an embodiment of the present disclosure.

[0022] Fig.11 is a flowchart illustrating a control method of an image output device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] First, terms used in the specification are briefly described, and then the present disclosure is described in detail.

[0024] Taking into account the functions described in the present disclosure, currently widely used general terms are selected as terms used in the embodiments of the present disclosure as much as possible. However, the terms may vary depending on the intention of those skilled in the art, previous court decisions, or the emergence of new technologies, etc. In addition, in certain cases, there may be terms arbitrarily specified by the applicant, and in this case, the meaning of the terms is described in detail in the relevant description in the present disclosure. Therefore, the terms used in the present disclosure should be defined based on the meaning of the terms and the overall content of the present disclosure rather than just based on the names of the terms.

[0025] In addition, various modifications may be made to the embodiments of the present disclosure, and various types of embodiments may exist. Therefore, specific embodiments may be shown in the drawings, and embodiments may be described in the detailed description. However, it should be noted that the various embodiments are not intended to limit the scope of the present disclosure to specific embodiments, but should be interpreted as including all modifications, equivalents or substitutions of the embodiments included within the scope of the ideas and techniques disclosed herein. At the same time, when describing an embodiment, the detailed description may be omitted if it is determined that the detailed description of the relevant known technology may unnecessarily obscure the subject matter of the present disclosure.

[0026] In addition, various elements can be described using terms such as "first", "second", etc., but these terms are not intended to limit these elements. These terms are only used to distinguish one element from another element. As used herein, each phrase such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" can include any one or all possible combinations of the items listed together in a corresponding phrase. As used herein, terms such as "1st" and "2nd" or "first" and "second" can be used to simply distinguish the corresponding component from other components, and do not limit the component in other aspects (e.g., importance or order). It should be understood that if an element (e.g., a first element) is "coupled", "coupled to" another element, "connected" or "connected to" another element by using or not using the term "operably" or "communicatively", it means that the element can be directly (e.g., wired), wirelessly or via a third element coupled to the other element.

[0027] Throughout this disclosure, references to "one embodiment," "an embodiment," "an example embodiment," or similar language may indicate that a particular feature, structure, or characteristic described in connection with the indicated embodiment is included in at least one embodiment of the present solution. Thus, throughout this disclosure, the phrases "in one embodiment," "in an embodiment," "in an example embodiment," and similar language may, but do not necessarily, all refer to the same embodiment.

[0028] In addition, unless otherwise limited in the context, singular expressions include plural expressions. In addition, in the present disclosure, terms such as "including" and "consisting of" should be interpreted as indicating the presence of such characteristics, quantities, steps, operations, elements, components or combinations thereof described in the specification, but do not preclude the possibility of the presence or addition of one or more other characteristics, quantities, steps, operations, elements, components or combinations thereof.

[0029] In addition, in the present disclosure, a "module" or "component" performs at least one function or operation and can be implemented as hardware or software, or a combination of hardware and software. In addition, in addition to the "module" or "component" that needs to be implemented as specific hardware, multiple "modules" or multiple "components" can be integrated into at least one module and implemented as at least one processor (not shown).

[0030] It should be understood that the specific order or hierarchy of the blocks in the disclosed process / flow diagram is an illustration of an exemplary method. It should be understood that the specific order or hierarchy of the blocks in the process / flow diagram can be rearranged based on design preferences. In addition, some blocks can be combined or omitted. The attached claims present the elements of each block in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

[0031] Hereinafter, embodiments of the present disclosure are described with reference to the accompanying drawings so that a person of ordinary skill in the art to which the present disclosure belongs can implement the present disclosure. However, it should be noted that the present disclosure may be implemented in various different forms and may not be limited to the embodiments described herein. In addition, in the accompanying drawings, components that are not necessary for clearly illustrating the present disclosure may have been omitted. In addition, throughout this specification, similar components have been represented by similar reference numerals.

[0032] Figure 1 is a diagram showing a configuration of an image output device according to an embodiment.

[0033] refer to Figure 1 , the image output device 100 may include at least one of various types of devices that output images.

[0034] For example, the image output device 100 may be implemented as a projector device that magnifies and / or projects an image onto a wall and / or a screen. That is, the projector device may include, but is not limited to, a liquid crystal display (LCD) projector, a digital light processing (DLP) type processor using a digital micromirror device (DMD), and the like.

[0035] like Figure 1 As shown, the image output device 100 may include a plurality of projection parts or projectors (e.g., a first projection part or projector 120-1, a second projection part or projector 120-2) configured to project an image. In an embodiment, the features and / or specifications of each of the first projection part 120-1 and the second projection part 120-2 may be substantially similar and / or may be the same. For example, the brightness unit (e.g., American National Standards Institute (ANSI) lumen unit, light emitting diode (LED) lumen unit, etc.), contrast, resolution, etc. of each of the first projection part 120-1 and the second projection part 120-2 may be substantially similar and / or may be the same. Alternatively or additionally, the features and / or specifications of each of the first projection part 120-1 and the second projection part 120-2 may be different.

[0036] According to an embodiment, each of the plurality of projection parts or projectors 120-1, 120-2 may be implemented as a projector device (e.g., a projector display) configured to project an image. However, the present disclosure is not limited thereto. For example, the plurality of projection parts 120-1, 120-2 may be implemented as at least one of various forms of display devices, such as, but not limited to, a television (TV), a video wall, a large display (LFD), a digital signage, a digital information display (DID), etc.

[0037] Alternatively or additionally, the display device may include various forms of displays, such as but not limited to LCD, organic light emitting diode (OLED), liquid crystal on silicon (LCoS), DLP, quantum dot (QD) display panel, quantum dot light emitting diode (QLED), micro LED (μLED), mini LED, etc.

[0038] In some embodiments, a dual projection system may be implemented by using the image output device 100 including a plurality of projection parts 120-1, 120-2. However, the present disclosure may not be limited thereto.

[0039] In an alternative or additional embodiment, a dual projection system may be implemented by using the image output device 100 and another image output device 100 ′ that perform communication with each other. In such an embodiment, each of the image output device 100 and another image output device 100 ′ may include at least one projection portion 120 .

[0040] Alternatively or additionally, the image output device 100 may include a display device for home use and / or industrial use. In some embodiments, the image output device 100 may include a lighting device and / or an acoustic device that can be used to perform common daily tasks, the acoustic device including an acoustic module. For another example, the image output device 100 may be implemented as a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a wearable device, a household appliance, etc.

[0041] The image output device 100 may not be limited to the aforementioned devices. That is, the image output device 100 may be implemented as an image output device 100 equipped with two or more functions of the aforementioned devices. For example, in the example image output device 100, according to the manipulation of the processor, the projector function may be turned off and the lighting function and / or the speaker function may be turned on, so that the image output device 100 may be used as a display device, a lighting device, and / or an acoustic device. Alternatively or additionally, the image output device 100 may include a microphone and / or a communication device, so that the image output device 100 may be used as an artificial intelligence (AI) speaker.

[0042] According to an embodiment, the first projection part 120 - 1 and the second projection part 120 - 2 may be combined and may provide one image.

[0043] For example, an image (e.g., a first image) output by the first projection part 120-1 of the image output device 100 and an image (e.g., a second image) output by the second projection part 120-2 may be arranged to constitute one image. For example, any one of the first image and / or the second image may be located on the left, and the other may be located on the right. Alternatively or additionally, any one of the first image and / or the second image may be located on the upper side (e.g., the top), and the other may be located on the lower side (e.g., the bottom). Hereinafter, such an image arrangement may be referred to as an array screen layout.

[0044] In the above array screen layout, one image may be constructed according to the arrangement of images output by each of the first projection part 120-1 and the second projection part 120-2. Therefore, the size of the resulting image and / or the resolution of the resulting image may be increased.

[0045] Alternatively or additionally, when the first image output by the first projection part 120-1 and the second image output by the second projection part 120-2 are superimposed on each other, one image may be constituted. Hereinafter, such an image arrangement may be referred to as a superimposed screen layout.

[0046] That is, in the above-mentioned superimposed screen layout, one image can be formed by superimposing the first image output by the first projection part 120-1 and the second image output by the second projection part 120-2. Therefore, the brightness (eg, brightness) of the resulting image can be increased.

[0047] In an embodiment, the image output apparatus 100 may identify context information of the image. Alternatively or additionally, the image output apparatus 100 may identify (and / or select) a screen layout from a plurality of screen layouts based on the identified context information.

[0048] For example, the image output device 100 may identify context information of the image and identify the array screen layout based on the identified context information. In this example, the image output device 100 may adjust the projection position of the first projection part 120-1 and the projection position of the second projection part 120-2 according to the array screen layout.

[0049] For another example, the image output device 100 may identify context information of the image and identify the overlay screen layout based on the identified context information. In this example, the image output device 100 may adjust the projection position of the first projection part 120-1 and the projection position of the second projection part 120-2 according to the overlay screen layout.

[0050] In an embodiment, the image output device 100 can adjust the projection position of the first projection part 120-1 by controlling the first driving part or the first driver 110-1. Alternatively or additionally, the image output device 100 can adjust the projection position of the second projection part 120-2 by controlling the second driving part or the second driver 110-2.

[0051] Figure 2 is a block diagram showing a configuration of an image output device according to an embodiment.

[0052] refer to Figure 2 , the image output device 100 may include a driving portion or driver 110 , a projection portion 120 , a communication interface 130 , and at least one processor 140 .

[0053] The driving part 110 according to the embodiment may include a first driving part 110-1 and a second driving part 110-2. In the embodiment, each of the first driving part 110-1 and the second driving part 110-2 may include at least one motor.

[0054] For example, each of the first driving part 110-1 and the second driving part 110-2 may include a pan, tilt, zoom (PTZ) motor. The PTZ motor may refer to a motor that can rotate in a panning direction (e.g., horizontal direction, left and right direction) and a motor that can rotate in a tilting direction (e.g., vertical direction, up and down direction).

[0055] According to an embodiment, the processor 140 may rotate the PTZ motor of the first driving part 110-1 in at least one of four directions (e.g., up, down, left, and right) and adjust a projection position (hereinafter, referred to as a first projection position) of the first projection part 120-1 coupled to the first driving part 110-1.

[0056] Alternatively or additionally, the processor 140 may cause the PTZ motor of the second driving part 110-2 to rotate in at least one of four directions (e.g., up, down, left, and right) and adjust the projection position of the second projection part 120-2 coupled to the second driving part 110-2 (hereinafter, referred to as the second projection position).

[0057] In an embodiment, the projection part 120 may include a first projection part 120-1 and a second projection part 120-2. Alternatively or additionally, each of the first projection part 120-1 and the second projection part 120-2 may output an image to a different projection surface and / or the same projection surface.

[0058] In an alternative or additional embodiment, each of the first projection part 120 - 1 and the second projection part 120 - 2 may include a projection lens.

[0059] The projection lens may be formed on one surface of the body of the image output device 100. The projection lens may be formed so that light passing through the lens array is projected to the outside of the body. The projection lens according to various embodiments may include a low dispersion coating optical lens for reducing chromatic aberration. Alternatively or additionally, the projection lens may be a convex lens or a condenser lens. In an embodiment, the projection lens may adjust the focus by adjusting the positions of the plurality of sub-lenses.

[0060] Each of the first projection part 120 - 1 and the second projection part 120 - 2 may perform a function of outputting an image on a projection surface.

[0061] The projection surface may be part of the physical space where the image is output, and / or may be a separate screen.

[0062] Figure 2 The number and / or arrangement of the components of the projection part 120 shown may not be limited to the aforementioned examples. That is, the image output device 100 may output an image on a projection surface by using various methods. For example, the projection part 120 may include three or more projection parts. Hereinafter, the position of the projection surface may be generally referred to as the projection position of the projection part 120 to describe the explanation.

[0063] The communication interface 130 may perform communication with various forms of external devices (eg, an image providing device, a display device, an external server, etc.) That is, the communication interface 130 may transmit and / or receive various forms of data and / or information.

[0064] For example, the communication interface 130 may receive various forms of data, information, commands, etc. from an external device through a communication method / communication protocol, and the external device may include but is not limited to an image providing device (e.g., a source device), an external storage medium (e.g., a universal serial bus (USB) memory), an external server (e.g., a cloud server and an online file storage system), etc., and the communication method / communication protocol may be, for example, but not limited to, an access point (AP)-based wireless network (e.g., Wireless Fidelity (Wi-Fi), a wireless local area network (LAN)), Bluetooth™, Zigbee, a wired / wireless LAN, a wide area network (WAN), Ethernet, the Institute of Electrical and Electronics Engineers (IEEE) 1394 (FireWire), a High-Definition Multimedia Interface (HDMI), a USB, a Thunderbolt™ interface, a Mobile High-Definition Link (MHL), an Audio Engineering Society / European Broadcasting Union (AES / EBU) interface, an optical interface, a coaxial interface, etc.

[0065] In an embodiment, the communication interface 130 may receive an image from an image providing device.

[0066] The processor 140 may be electrically connected to a memory (not shown). The processor 140 may control the overall operation of the image output apparatus 100.

[0067] According to an embodiment, the processor 140 may be implemented as a digital signal processor (DSP), a microprocessor, and / or a time controller (TCON) for processing digital signals. However, the present disclosure is not limited thereto. For example, the processor 140 may include, but is not limited to, one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), an advanced reduced instruction set computer (RISC) machine (ARM) processor, and an AI processor, or may be defined by these terms. Alternatively or additionally, the processor 140 may be implemented as a system on chip (SoC) and / or a large scale integration (LSI) having a processing algorithm stored therein, and / or implemented in the form of a field programmable gate array (FPGA).

[0068] In an embodiment, the processor 140 may perform various functions by executing computer executable instructions stored in the memory. For example, the processor 140 may analyze an input image received through the communication interface 130 and identify context information of the input image.

[0069] Alternatively or additionally, the processor 140 may identify any one of a plurality of screen layouts based on the identified context information.

[0070] In an optional or additional embodiment, based on the identified screen layout, the processor 140 can control the first driving part 110-1 so that the first projection part 120-1 can project the image to the first projection position, and control the second driving part 110-2 so that the second projection part 120-2 can project the image to the second projection position.

[0071] Figure 3 is a flowchart illustrating a control method of an image output device recognizing a screen layout and a rotation parameter according to an embodiment.

[0072] According to an embodiment, in operation S310, the processor 140 may perform calibration of the first projection part 120-1 (eg, projection 1) and / or the second projection part 120-2 (eg, projection 2).

[0073] For example, the processor 140 may control the first projection part 120-1 to output the first pattern image to the first projection position. Alternatively or additionally, the processor 140 may control the second projection part 120-2 to output the second pattern image to the second projection position.

[0074] In an embodiment, the image output device 100 may include a sensor, which may be arranged toward the front surface of the image output device 100. The sensor may detect the first pattern image output by the first projection part 120-1 and / or the second pattern image output by the second projection part 120-2. For example, the sensor may include at least one camera.

[0075] According to an embodiment, the processor 140 may perform calibration of the first projection part 120-1 (eg, Projection 1) and / or the second projection part 120-2 (eg, Projection 2) based on the first pattern image and / or the second pattern image detected by the sensor, respectively.

[0076] Alternatively or additionally, the processor 140 may perform processing operations on the first pattern image and / or the second pattern image, such as but not limited to lens shift, color matching, edge blending, keystone correction, leveling correction (eg, horizontal correction), focus correction, etc.

[0077] For example, the processor 140 may perform color matching so that the color, brightness, etc. of the first pattern image and the second pattern image may be substantially similar and / or may be identical.

[0078] For another example, the processor 140 may perform edge blending so that a boundary line in a portion where the first pattern image and the second pattern image overlap is not prominent, and the first pattern image and the second pattern image are naturally (eg, seamlessly) connected.

[0079] For another example, if the first and second pattern images are in a trapezoidal form due to the tilt of the image output device 100 , the processor 140 may perform trapezoidal correction so that the first and second pattern images may become rectangular and / or square forms.

[0080] For another example, the processor 140 may perform the leveling correction by rotating the first pattern image and / or the second pattern image by a specific angle so that each of the first pattern image and / or the second pattern image may become horizontal.

[0081] As another example, the processor 140 may perform focus correction so that each of the first pattern image and the second pattern image may be in focus.

[0082] The first pattern image and the second pattern image may represent predetermined images respectively output by the first projection part 120-1 and the second projection part 120-2 according to the control of the processor 140 in an operation stage (e.g., a driving stage, a startup stage, a setting stage, a calibration execution stage, etc.) of the image output device 100.

[0083] Obviously, the first pattern image and the second pattern image may be images including patterns different from each other, images including objects different from each other, images having colors different from each other, and / or images having brightness levels different from each other.

[0084] In operation S320 , the processor 140 may analyze the input image and recognize context information of the input image.

[0085] The context information of the input image may include at least one of size information, resolution information, ratio information, brightness information, depth map information, object map information, red / blue / green (RGB) histogram, color histogram, saliency map information (e.g., saliency mask), and peak highlight map information of the input image.

[0086] For example, a depth map may represent an image channel including information related to the distance of each region and / or each pixel within the input image from the observation viewpoint.

[0087] The object map may represent an image channel indicating the form and / or shape of a plurality of objects within the input image, predefined objects, dominant objects having a priority greater than or equal to a threshold, and the like.

[0088] The saliency map information may represent an image channel indicating regions within the input image where pixel values ​​change significantly. Alternatively or additionally, the saliency map information may represent an image channel that may distinguish at least one object within the input image by separating the distinguished object from a background.

[0089] The peak highlight map information may represent an image channel that may include high contrast information and / or may increase the gap between the brightest and darkest areas within the input image. Alternatively or additionally, the peak highlight map may indicate at least one object within the input image by separating the indicated object from a background.

[0090] like Figure 3 As shown, in operations S330, S340, and S350, the processor 140 may identify any one of a plurality of screen layouts based on context information.

[0091] According to an embodiment, in operation S360, based on the identified screen layout, the processor 140 may identify a rotation parameter of the first driving part 110-1 for adjusting a first projection position to which the first projection part 120-1 can project an image, and / or the processor 140 may identify a rotation parameter of the second driving part 110-2 for adjusting a second projection position to which the second projection part 120-2 can project an image.

[0092] In operation S370, the processor 140 may adjust the first projection position of the first driving part 110-1 based on the rotation parameter of the first driving part 110-1. In operation S380, the processor 140 may adjust the second projection position based on the rotation parameter of the second driving part 110-2.

[0093] refer to Figure 4 To describe the rotation parameters according to the embodiment.

[0094] Figure 4 : is a diagram showing the operation of a driving portion according to the embodiment.

[0095] refer to Figure 4 , the image output device 100 may include a first projection part 120-1 and a first driving part 110-1. The first driving part 110-1 may be coupled to the first projection part 120-1, and may adjust the first projection position of the first projection part 120-1. In an embodiment, the first driving part 110-1 may include a PTZ motor. According to an embodiment, the PTZ motor may include a motor that can rotate in a translation direction (e.g., a horizontal direction, a left-right direction) and a motor that can rotate in a tilt direction (e.g., a vertical direction, an up-down direction).

[0096] Alternatively or additionally, the image output device 100 may include a second projection part 120-2 and a second driving part 110-2. The second driving part 110-2 may be coupled to the second projection part 120-2 and may adjust the second projection position of the second projection part 120-2. In an embodiment, the second driving part 110-2 may include a PTZ motor.

[0097] According to an embodiment, the processor 140 may identify a rotation parameter of the first driving part 110 - 1 for adjusting the first projection position and a rotation parameter of the second driving part 110 - 2 for adjusting the second projection position according to the identified screen layout.

[0098] For example, the rotation parameters may include a rotation parameter related to a translation direction (e.g., a horizontal direction) and / or a rotation parameter related to a tilt direction (e.g., a vertical direction). The rotation parameter of the translation direction may include a rotation direction (e.g., left side, right side, and / or stop) and a rotation angle (e.g., -180° to +180° based on the front surface of the image output device 100) in the translation direction. The rotation parameter of the tilt direction may include a rotation direction (e.g., upper (top) side, lower (bottom) side, or stop) and a rotation angle (e.g., -180° to +180° based on the front surface of the image output device 100) in the tilt direction.

[0099] In an embodiment, the processor 140 may rotate the PTZ motor of the first driving part 110-1 in at least one of four directions (e.g., up, down, left, and right) based on the rotation parameter of the first driving part 110-1, thereby adjusting the first projection position of the first projection part. Alternatively or additionally, the processor 140 may rotate the PTZ motor of the second driving part 110-2 in at least one of four directions (e.g., up, down, left, and right) based on the rotation parameter of the second driving part 110-2, thereby adjusting the second projection position of the second projection part.

[0100] Figure 5 and Figure 6 is a diagram showing an array screen layout according to various embodiments. Figure 5 An example of a horizontally arranged array screen layout among the array screen layouts may be shown. Figure 6 An example of a vertically arranged array screen layout among the array screen layouts may be shown.

[0101] refer to Figure 3 and Figure 5 ,exist Figure 3 In operation S330 of the image processing apparatus, the processor 140 may identify an array screen layout from among a plurality of screen layouts based on context information of the input image (operation S340).

[0102] For example, the processor 140 may identify an array screen layout from among a plurality of screen layouts to output the input image without distortion based on at least one of size information, ratio information, and resolution information of the input image (operation S340 ).

[0103] In operation S360, the processor 140 may identify a rotation parameter of the first driving part 110-1 according to the array screen layout identified in operation S340, so that the first projection part 120-1 projects the first part (screen 1) 10-1 (e.g., the first image part) of the input image to the first projection position. Alternatively or additionally, the processor 140 may identify a rotation parameter of the second driving part 110-2 according to the array screen layout identified in operation S340, so that the second projection part 120-2 projects the second part (screen 2) 10-2 (e.g., the second image part) of the input image to the second projection position.

[0104] In an embodiment, the processor 140 may control the rotation of the first driving portion 110-1 according to the rotation parameter of the first driving portion 110-1. Figure 5 As shown by the dotted line in FIG. 1 , the processor 140 can adjust the first projection position of the first projection part 120 - 1 to the left side by rotating the first driving part 110 - 1 to the left side.

[0105] In an optional or additional embodiment, the processor 140 may control the rotation of the second driving portion 110-2 according to the rotation parameter of the second driving portion 110-2. Figure 5 As shown by the dotted line in FIG. 1 , the processor 140 can adjust the second projection position of the second projection part 120 - 2 to the right side by rotating the second driving part 110 - 2 to the right side.

[0106] For example, in the array screen layout, the first projection part 120-1 may output the first part (screen 1) 10-1 (e.g., the first image part) of the input image, and the second projection part 120-2 may output the second part (screen 2) 10-2 (e.g., the second image part) of the input image adjacent to the first part (screen 1) 10-1. Therefore, the image output device 100 may output one image in which the first part 10-1 and the second part 10-2 are combined (e.g., the output image in operation S370).

[0107] That is, the array screen layout may mean a screen layout in which the first projection position of the first projection part 120 - 1 and the second projection position of the second projection part 120 - 2 are arranged at positions adjacent to each other.

[0108] refer to Figure 3 and Figure 6, the processor 140 may identify the rotation parameter of the first driving part 110-1 according to the array screen layout identified in operation S340, so that the first projection part 120-1 projects the first part (screen 1) 10-1 (e.g., the first image part) of the input image to the first projection position. Alternatively or additionally, the processor 140 may identify the rotation parameter of the second driving part 110-2 according to the array screen layout identified in operation S340, so that the second projection part 120-2 projects the second part (screen 2) 10-2 (e.g., the second image part) of the input image to the second projection position.

[0109] In an embodiment, the processor 140 may control the rotation of the first driving portion 110-1 according to the rotation parameter of the first driving portion 110-1. Figure 6 As shown by the dotted line in FIG. 1 , the processor 140 can adjust the first projection position of the first projection part 120 - 1 to the upper (top) side by rotating the first driving part 110 - 1 to the right side and / or the upper (top) side by a specific angle.

[0110] In an optional or additional embodiment, the processor 140 may control the rotation of the second driving portion 110-2 according to the rotation parameter of the second driving portion 110-2. Figure 6 As shown by the dotted line in FIG. 1 , the processor 140 can adjust the second projection position of the second projection part 120 - 2 to the lower (bottom) side by rotating the second driving part 110 - 2 to the left side and / or the lower (bottom) side by a specific angle.

[0111] That is, in the array screen layout, the first projection part 120-1 can output the first part 10-1 (e.g., the first image part) of the input image to the upper (top) side, and the second projection part 120-2 can output the second part 10-2 (e.g., the second image part) of the input image to the lower side. Therefore, the image output device 100 can output one image in which the first part 10-1 and the second part 10-2 are combined (e.g., the output image in operation S370).

[0112] Figure 7 is a diagram showing an overlay screen layout according to an embodiment.

[0113] refer to Figure 3 and Figure 7 ,exist Figure 3 In operation S330 of the image processing, the processor 140 may identify an overlay screen layout from among the plurality of screen layouts based on context information of the input image (operation S350).

[0114] For example, the processor 140 may identify an overlay screen layout from among a plurality of screen layouts to output the input image without distortion based on at least one of brightness information, depth map information, object map information, RGB histogram, color histogram, saliency map information (e.g., saliency mask), and peak highlight map of the input image to maintain and / or increase the contrast, depth, and / or dynamic range of the input image (operation S350).

[0115] In an embodiment, if the maximum brightness of the input image is greater than the maximum brightness that can be output by each of the first projection part 120-1 and the second projection part 120-2, the processor 140 may identify the overlay screen layout from among the plurality of screen layouts.

[0116] In an optional or additional embodiment, if multiple objects included in the input image are identified in at least one of the depth map, object map, or saliency map information (e.g., a saliency mask) of the input image, the processor 140 may identify an overlay screen layout to increase the brightness of close objects (e.g., objects located at a relatively close distance from the observation viewpoint) and / or reduce the brightness of distant objects (e.g., objects located at a relatively long distance from the observation viewpoint).

[0117] In operation S360, the processor 140 may identify a rotation parameter of the first driving part 110-1 according to the superimposed screen layout identified in operation S350, so that the first projection part 120-1 projects the first image (screen 1) 10-1 of the input image to the first projection position. Alternatively or additionally, the processor 140 may identify a rotation parameter of the second driving part 110-2 according to the superimposed screen layout identified in operation S350, so that the second projection part 120-2 projects the second image (screen 2) 10-2 of the input image to the second projection position.

[0118] In an embodiment, the processor 140 may control the rotation of the first driving portion 110-1 according to the rotation parameter of the first driving portion 110-1. Figure 7 As shown by the dotted line in FIG. 1 , the processor 140 can adjust the first projection position of the first projection part 120 - 1 to the right side by rotating the first driving part 110 - 1 to the right side.

[0119] In an optional or additional embodiment, the processor 140 may control the rotation of the second driving portion 110-2 according to the rotation parameter of the second driving portion 110-2. Figure 7 As shown by the dotted line in FIG. 1 , the processor 140 can adjust the second projection position of the second projection part 120 - 2 to the left side by rotating the second driving part 110 - 2 to the left side.

[0120] That is, in the overlay screen layout, the first projection position of the first projection part 120 - 1 and the second projection position of the second projection part 120 - 2 may be substantially similar and / or may be the same position.

[0121] For example, in the overlapping screen layout, the first projection part 120-1 may output the first image (screen 1) 10-1, and the second projection part 120-2 may output the second image (screen 2) 10-2. Therefore, the image output device 100 may output an image in which the first image overlaps the second image (eg, the output image in operation S380).

[0122] In an embodiment, the first image (screen 1) 10-1 output by the first projection part 120-1 and the second image (screen 2) 10-2 output by the second projection part 120-2 may be substantially similar and / or may be the same image. Alternatively or additionally, the first image (screen 1) 10-1 and the second image (screen 2) 10-2 may be different images.

[0123] In an embodiment, when an overlay screen layout is identified, the processor 140 may apply a first tone mapping curve to the input image to obtain a first image (screen 1) 10-1, the first tone mapping curve being configured to expand the dynamic range (DR) of the input image. For example, applying the first tone mapping curve may result in an increase in the brightness of a relatively bright (e.g., high grayscale, high brightness) region among a plurality of regions included in the input image. Alternatively or additionally, applying the first tone mapping curve may result in a decrease in the brightness of a relatively dark (e.g., low grayscale, low brightness) region among a plurality of regions included in the input image. In an optional or additional embodiment, the processor 140 may apply a second tone mapping curve to the input image to obtain a second image (screen 2) 10-2. In some embodiments, the first tone mapping curve and the second tone mapping curve may be substantially similar and / or may be the same mapping curve. Alternatively or additionally, the first tone mapping curve and the second tone mapping curve may be different.

[0124] In an embodiment, the processor 140 may control the first projection part 120-1 to output the first image (screen 1) 10-1, and may control the second projection part 120-2 to output the second image (screen 2) 10-2. The image output device 100 may output an image in which the first image (screen 1) 10-1 and the second image (screen 2) 10-2 overlap (e.g., an image whose DR is extended in operation S380).

[0125] Figure 8 is a diagram showing a partial overlay screen layout according to an embodiment.

[0126] refer to Figure 3 and Figure 8 ,exist Figure 3 In operation S330 of the image processing, the processor 140 may identify a partial overlay screen layout from among the plurality of screen layouts based on context information of the input image (operation S350).

[0127] For example, the processor 140 may identify a partial overlay screen layout from among multiple screen layouts to emphasize a specific object among multiple objects included in an input image (and / or increase visibility of a specific object among multiple objects included in the input image) based on at least one of depth map information, object map information, RGB histogram, color histogram, saliency map information (e.g., saliency mask), or peak highlight map (operation S350).

[0128] In an embodiment, if a character object controlled according to user manipulation and / or a main object that can be interacted with according to user manipulation is identified from among a plurality of objects included in the input image based on the depth map information and the object map information, the processor 140 may identify an overlay screen layout from among a plurality of screen layouts. Alternatively or additionally, if the input image is game content, the processor 140 may identify an overlay screen layout from among a plurality of screen layouts.

[0129] An object that can be interacted with according to a user manipulation may be referred to as a main object, and an object that cannot be interacted with (eg, a background included in the input image, etc.) among a plurality of objects included in the input image may be referred to as a sub object.

[0130] In an optional or additional embodiment, if a plurality of objects included in the input image are identified in at least one of a depth map, an object map, or saliency map information (e.g., a saliency mask) of the input image, the processor 140 may identify a partial overlay screen layout to further emphasize close objects (e.g., objects located at a relatively close distance from the observation viewpoint) compared to remaining objects (e.g., objects located at a relatively long distance from the observation viewpoint).

[0131] In operation S360, the processor 140 may identify a rotation parameter of the first driving part 110-1 based on the identified partial superimposed screen layout so that the first projection part 120-1 projects the first part (screen 1) 10-1 (e.g., the first image part) of the input image to the first projection position. Alternatively or additionally, the processor 140 may identify a rotation parameter of the second driving part 110-2 based on the identified partial superimposed screen layout so that the second projection part 120-2 projects the second part (screen 2) 10-2 (e.g., the second image part) of the input image to the second projection position.

[0132] In an embodiment, when a partial overlay screen layout is identified among a plurality of screen layouts based on context information of an input image, the processor 140 may identify a first portion 10-1 (e.g., a first region, a first image portion) including a specific object among a plurality of objects included in the input image. Alternatively or additionally, the processor 140 may identify a second portion 10-2 (e.g., a second region, a second image portion) including the remaining objects based on the partial overlay screen layout.

[0133] For example, the first portion 10 - 1 may include a specific object (eg, a character object, a main object, etc.), and the second portion 10 - 2 may include the remaining objects (eg, a background, a side object, etc.) among a plurality of objects included in the input image.

[0134] According to an embodiment, the processor 140 can control the rotation of the first driving part 110-1 so that the first projection part 120-1 projects the first part 10-1 to the first projection position, and can control the rotation of the second driving part 110-2 so that the second projection part 120-2 projects the second part 10-2 to the second projection position.

[0135] For example, if the first part 10-1 is a character object and the second part 10-2 is a background, the processor 140 may rotate the first driving part 110-1 according to the rotation parameter of the first driving part 110-1 and may not rotate the second driving part 110-2.

[0136] That is to say, Figure 8 As shown, the processor 140 can control the second driving part 110-2 (for example, fix the second driving part 110-2) so that the projection position of the second part 10-2 is maintained to project the background, and control the first driving part 110-1 (for example, rotate the first driving part 110-1 in real time) so that the projection position of the first part 10-1 moves within the second projection position according to the movement of the character object in the input image.

[0137] although Figure 8 A case where the first projection part 120 - 1 projects the first part 10 - 1 including a specific object and the second projection part 120 - 2 projects the second part 10 - 2 including the remaining objects is illustrated, but the present disclosure may not be limited thereto.

[0138] For example, Figure 8 As shown, it is obvious that according to the control of the processor 140, the first projection part 120-1 can project the first part 10-1 including the remaining objects (e.g., background), and the second projection part 120-2 can project the second part 10-2 including a specific object (e.g., character object).

[0139] Alternatively or additionally, the processor 140 may control the first projection part 120-1 and the second projection part 120-2 to project each of the first part 10-1 and the second part 10-2 by using an edge blending function.

[0140] For example, Figure 5 and Figure 6 As shown, in the array screen layout, the processor 140 can perform edge blending so that the first part 10-1 and the second part 10-2 can be naturally (e.g., seamlessly) connected and become one image. That is, the edge blending function can be performed so that no blank area or empty area is generated between the first part 10-1 and the second part 10-2, and / or no overlapping area is generated between the first part 10-1 and the second part 10-2.

[0141] In some embodiments, the processor 140 may adjust the brightness, projection position, etc. of each of the first part 10 - 1 and the second part 10 - 2 , and provide an image according to a seamless connection of the first part 10 - 1 and the second part 10 - 2 .

[0142] For example, in an area where the first part 10-1 and the second part 10-2 contact each other, the brightness of each of the first part 10-1 and the second part 10-2 may overlap. Therefore, there may be a problem that the border line is prominent (e.g., brighter than other areas of the first part 10-1 and the second part 10-2). Therefore, in an embodiment, the processor 140 may adjust the brightness of the area where the first part 10-1 and the second part 10-2 contact each other (e.g., reduce the brightness). Thus, the processor 140 can provide an image so that even if the brightness of each of the first part 10-1 and the second part 10-2 overlaps, the brightness of the border line is substantially similar to and / or may be the same as the brightness of the remaining areas (e.g., the remaining areas except the area where the first part 10-1 and the second part 10-2 contact each other) (e.g., the brightness difference may be within a threshold).

[0143] For example, Figure 7 or Figure 8 As shown, in the superimposed screen layout, the first projection part 120-1 can output the first image (screen 1) 10-1, and the second projection part 120-2 can output the second image (screen 2) 10-2. Therefore, the processor 140 can perform edge blending so that the first image (screen 1) 10-1 and the second image (screen 2) 10-2 overlap and become one image (for example, so that the first image (screen 1) 10-1 and the second image (screen 2) 10-2 are not aligned with each other).

[0144] In an embodiment, the processor 140 may adjust the brightness, projection position, etc. of the first image (screen 1) 10-1 and the second image (screen 2) 10-2 so as to provide an image according to the (seamless) overlap of the first image (screen 1) 10-1 and the second image (screen 2) 10-2. For example, in an area where the first image (screen 1) 10-1 and the second image (screen 2) 10-2 overlap, the brightness of each of the first image (screen 1) 10-1 and the second image (screen 2) 10-2 may overlap, and thus the brightness of the area may be emphasized. As a result, a problem of providing a distorted image may occur.

[0145] According to an embodiment, the processor 140 may adjust the brightness of an area where the first image (screen 1) 10-1 and the second image (screen 2) 10-2 overlap (e.g., reduce the brightness), and provide an image so that even if the second image (screen 2) 10-2 overlaps within the first image (screen 1) 10-1, the brightness of the overlapping area is substantially similar and / or the same as the brightness of the remaining area (e.g., the remaining area except the area where the second image (screen 2) 10-2 overlaps within the first image (screen 1) 10-1) (e.g., the brightness difference is within a threshold).

[0146] Fig. 9 : is a diagram showing the operation of a driving portion according to the embodiment.

[0147] In an embodiment, each of the first driving part 110 - 1 and the second driving part 110 - 2 may rotate in at least one of four directions (eg, up, down, left, and right). However, the present disclosure may not be limited thereto.

[0148] For example, Fig. 9 As shown, the processor 140 may control each of the first driving portion 110 - 1 and the second driving portion 110 - 2 to move forward and / or backward by a specific distance.

[0149] That is, the processor 140 may control the first driving part 110-1 to move backward (e.g., away from the projected image) so as to reduce the size of the first image (screen 1) 10-1 projected by the first projection part 120-1 (e.g., make it smaller). Alternatively or additionally, the processor 140 may control the first driving part 110-1 to move forward (e.g., toward the projected image) so as to enlarge the size of the first image (screen 1) 10-1 (e.g., make it larger).

[0150] Alternatively or additionally, the processor 140 may control the second driving portion 110-2 to move backward (e.g., away from the projected image) so as to reduce the size of the second image (screen 2) 10-2 projected by the second projection portion 120-2 (e.g., make it smaller). Alternatively or additionally, the processor 140 may control the second driving portion 110-2 to move forward (e.g., toward the projected image) so as to enlarge the size of the second image (screen 2) 10-2 (e.g., make it larger).

[0151] although Fig. 9 A case of a partially overlapping screen layout in which each of the first driving part 110 - 1 and the second driving part 110 - 2 may move forward and / or backward is illustrated, but the present disclosure may not be limited thereto.

[0152] For example, in the case of an array screen layout, the processor 140 can control each of the first driving part 110-1 and the second driving part 110-2 to move forward and / or backward independently so as to control the size of each of the first part 10-1 (e.g., the first image part) and the second part 10-2 (e.g., the second image part).

[0153] For another example, in the case of a superimposed screen layout, the processor 140 may control each of the first driving portion 110-1 and the second driving portion 110-2 to independently move forward and / or backward so as to control the size of each of the first image (screen 1) 10-1 and the second image (screen 2) 10-2.

[0154] Fig.10 is a diagram illustrating calibration of a plurality of projection parts according to an embodiment.

[0155] refer to Figure 3 and Fig.10 In operation S310, the processor 140 may perform calibration of the first projection part 120-1 (Projection 1) and the second projection part 120-2 (Projection 2).

[0156] For example, the processor 140 may control the first projection part 120-1 to output the first pattern image 20-1 to the first projection position. Alternatively or additionally, the processor 140 may control the second projection part 120-2 to output the second pattern image 20-2 to the second projection position.

[0157] According to an embodiment, the image output device 100 may include a sensor (not shown). The image output device 100 may detect the first pattern image 20-1 output by the first projection part 120-1 and the second pattern image 20-2 output by the second projection part 120-2 through the sensor.

[0158] In an embodiment, the processor 140 may detect a first projection position corresponding to the first projection part 120-1 based on the first pattern image 20-1 detected by the sensor. Alternatively or additionally, the processor 140 may detect a second projection position corresponding to the second projection part 120-2 based on the second pattern image 20-2 detected by the sensor.

[0159] In an optional or additional embodiment, the processor 140 may perform calibration of the first projection portion 120-1 (projection 1) and the second projection portion 120-2 (projection 2) based on the first pattern image 20-1 and the second pattern image 20-2 detected by the sensor, respectively. For example, the processor 140 may perform processing operations on the first pattern image and / or the second pattern image, such as but not limited to lens shift, color matching, edge blending, keystone correction, leveling correction (e.g., horizontal correction), focus correction, etc.

[0160] According to an embodiment, the processor 140 may re-perform the calibration in operation S310 according to the screen layout identified in operation S330. That is, after identifying the screen layout corresponding to the context information, the processor 140 may perform the calibration operation as described with reference to operation S310 as part of operation S330.

[0161] For example, if an array screen layout is identified in operation S330, the processor 140 may re-execute operation S310 and rotate (and / or move forward and / or backward) each of the first driving part 110-1 and the second driving part 110-2 so as to adjust each of the first projection position and the second projection position, respectively, to correspond to the array screen layout.

[0162] In this example, the processor 140 can detect the first pattern image 20-1 projected by the first projection part 120-1 and the second pattern image 20-2 projected by the second projection part 120-2 through a sensor, and identify the rotation parameters of the first driving part 110-1 and the rotation parameters of the second driving part 110-2 based on the first position information of the detected first pattern image 20-1 and the second position information of the detected second pattern image 20-2.

[0163] In addition, the processor 140 may adjust the first projection position by rotating the first driving part 110-1 according to the rotation parameter of the first driving part 110-1, and / or adjust the second projection position by rotating the second driving part 110-2 according to the rotation parameter of the second driving part 110-2.

[0164] although Fig.10 An array screen layout for performing calibration is shown, but the present disclosure may not be limited thereto.

[0165] For another example, if an overlay screen layout (and / or a partial overlay screen layout) is identified in operation S330, the processor 140 may re-execute operation S310 and rotate (and / or move forward and / or backward) each of the first driving portion 110-1 and the second driving portion 110-2 so as to adjust each of the first projection position and the second projection position, respectively, to correspond to the overlay screen layout.

[0166] In an embodiment, the processor 140 may set any one of the first projection part 120-1 and the second projection part 120-2 as a main projection part, and may set the other projection part as a slave projection part.

[0167] For example, the image output device 100 may compare the identification information (e.g., specification information) of each of the first projection part 120-1 and the second projection part 120-2, and set one projection part as the main projection part and the other projection part as the slave projection part based on the comparison result. For example, the processor 140 may compare the first brightness of the first projection part 120-1 with the second brightness of the second projection part 120-2, and set the projection part that can output an image with relatively higher brightness as the main projection part, and set the other projection part as the slave projection part. The identification information may indicate the features and / or specifications (e.g., brightness (e.g., ANSI-lumens), contrast, resolution, etc.) of the components constituting the device. However, the present disclosure may not be limited thereto.

[0168] For example, the processor 140 may randomly set any one of the first projection part 120-1 or the second projection part 120-2 as a main projection part, and set the other projection part as a slave projection part.

[0169] In an embodiment, if the first projection part 120-1 is set as the main projection part and the second projection part 120-2 is set as the slave projection part, in the partial overlay screen layout, the processor 140 can control the first projection part 120-1 to project a background, and can control the second projection part 120-2 to project an image including a specific object.

[0170] However, the present disclosure may not be limited thereto. For example, if the first projection part 120-1 is set as the main projection part and the second projection part 120-2 is set as the slave projection part, in the partial overlay screen layout, the processor 140 may control the first projection part 120-1 to project an image including a specific object, and may control the second projection part 120-2 to project a background.

[0171] Fig.11is a flowchart illustrating a control method of an image output device according to an embodiment.

[0172] According to an embodiment, in the control method of the image output apparatus 100 , an input image may be analyzed and context information of the input image may be recognized (operation S1110 ).

[0173] In operation S1120, any one of a plurality of screen layouts may be identified based on the identified context information.

[0174] According to the recognized screen layout, the first driving part may be controlled so that the first projection part provided on the image output device 100 projects the image to the first projection position, and the second driving part may be controlled so that the second projection part provided on the image output device 100 projects the image to the second projection position (operation S1130).

[0175] In an embodiment, each of the first driving part and the second driving part may include a PTZ motor. In such an embodiment, operation S1130 may include the following steps: according to the identified screen layout, identifying a rotation parameter of the first driving part for adjusting the first projection position and a rotation parameter of the second driving part for adjusting the second projection position; adjusting the first projection position by rotating the PTZ motor of the first driving part in at least one direction among four directions based on the rotation parameter of the first driving part; and adjusting the second projection position by rotating the PTZ motor of the second driving part in at least one direction among four directions based on the rotation parameter of the second driving part.

[0176] In an embodiment, the plurality of screen layouts may include an array screen layout, wherein the first projection position of the first projection part and the second projection position of the second projection part are arranged to be adjacent to each other. In such an embodiment, operation S1130 may further include the following steps: based on identifying the array screen layout from among the plurality of screen layouts according to the identified context information, according to the identified array screen layout, controlling the first driving part so that the first projection part projects the first part of the input image to the first projection position, and controlling the second driving part so that the second projection part projects the second part of the input image to the second projection position.

[0177] In an embodiment, the plurality of screen layouts may include an overlay screen layout, wherein the first projection position of the first projection part and the second projection position of the second projection part may be substantially similar and / or may be the same position. In such an embodiment, operation S1130 may include the following steps: based on identifying the overlay screen layout from among the plurality of screen layouts according to the identified context information, according to the identified overlay screen layout, controlling the first driving part so that the first projection part projects the input image to the first projection position, and controlling the second driving part so that the second projection part projects the input image to the same position as the first projection position.

[0178] According to an embodiment, the control method may further include the following steps: applying a first tone mapping curve to an input image and obtaining a first image whose brightness is adjusted; applying a second tone mapping curve to the input image and obtaining a second image whose brightness is adjusted; controlling the first projection part to output the first image; and controlling the second projection part to output the second image.

[0179] According to an embodiment, the plurality of screen layouts may include a partially overlapping screen layout, wherein the first projection position of the first projection part may be overlapped in an area within the second projection position of the second projection part. In such an embodiment, the control method may further include the following steps: based on identifying the partially overlapping screen layout among the plurality of screen layouts according to the identified context information, identifying, according to the partially overlapping screen layout, a first portion including a specific object among the plurality of objects included in the input image and a second portion including the remaining objects. In such an embodiment, operation S1130 may further include the following steps: controlling the first driving part so that the first projection part projects the first portion of the input image to the first projection position, and controlling the second driving part so that the second projection part projects the second portion of the input image to the second projection position.

[0180] In an embodiment, operation S1130 may further include the steps of controlling the second driving part so that the projection position of the second part is maintained, and controlling the first driving part so that the projection position of the first part moves within the second projection position according to the movement of the specific object.

[0181] Alternatively or additionally, the specific object included in the first part may include at least one of a character object controlled by a user manipulation and / or a main object that can interact according to the user manipulation.The second part may be a background included in the input image.

[0182] According to an embodiment, the context information of the input image may include at least one of resolution information, brightness information, depth map information, object map information, and peak highlight map information of the input image.

[0183] According to an embodiment, the control method may further include the following steps: controlling the first projection part to output the first pattern image to the first projection position; controlling the second projection part to output the second pattern image to the second projection position; identifying the first position information of the first pattern image output by the first projection part and the second position information of the second pattern image output by the second projection part through a sensor provided on the image output device; and identifying the rotation parameters of the first driving part and the rotation parameters of the second driving part based on the identified screen layout, the first position information and the second position information to adjust the first projection position and the second projection position.

[0184] Obviously, various embodiments of the present disclosure may be applied not only to image devices but also to various electronic devices that can output images.

[0185] The various embodiments described above can be implemented in a recording medium that can be read by a computer and / or a device similar to a computer by using software, hardware or a combination thereof. In some cases, the embodiments described in this disclosure can be implemented as a processor itself. According to software implementation, the embodiments such as processes and functions described in this disclosure can be implemented as separate software modules. Each software module can perform one or more functions and operations described in this disclosure.

[0186] Computer instructions for executing the processing operations of the electronic device according to various embodiments of the present disclosure may be stored in a non-transitory computer-readable medium. When the computer instructions stored in such a non-transitory computer-readable medium are executed by a processor of a specific machine, the processing operations of the image output device 100 according to various embodiments performed by the specific machine may be executed.

[0187] The non-transitory computer-readable medium may refer to a medium that stores data semi-permanently and can be read by a machine, but does not refer to a medium that stores data for a short period of time, such as a register, a cache, and a memory. As specific examples of the non-transitory computer-readable medium, there may be a compact disc (CD), a digital versatile disc (DVD), a hard disk, a Blu-ray disc, a USB, a memory card, a ROM, and the like.

[0188] Although the embodiments of the present disclosure have been shown and described, the present disclosure is not limited to the foregoing embodiments. For example, it is apparent that various modifications may be made by a person of ordinary skill in the art to which the present disclosure belongs without departing from the scope of the present disclosure as claimed in the appended claims. In addition, it is intended that these modifications should not be interpreted independently of the technical ideas or prospects of the present disclosure.

Claims

1. An image output device, comprising: A communications interface including circuitry; First Projector; Second projector; a first driver configured to adjust a first projection position of the first projector; a second driver configured to adjust a second projection position of the second projector; as well as At least one processor configured to: identifying contextual information of an input image received via the communication interface; identifying a screen layout from a plurality of screen layouts based on the context information; controlling the first driver according to the screen layout so that the first projector projects the first image to the first projection position; as well as The second driver is controlled according to the screen layout so that the second projector projects the second image to the second projection position.

2. The image output device according to claim 1, wherein: The first driver includes a first pan, tilt, zoom motor, i.e., a first PTZ motor, and the second driver includes a second PTZ motor, and Wherein, the at least one processor is further configured to: identifying, according to the screen layout, a first rotation parameter of the first driver for adjusting the first projection position and a second rotation parameter of the second driver for adjusting the second projection position; adjusting the first driver by rotating the first PTZ motor of the first driver in at least one first direction among four directions based on the first rotation parameter so that the first projector projects to the first projection position; and The second driver is adjusted by rotating the second PTZ motor of the second driver in at least one second direction among the four directions based on the second rotation parameter so that the second projector projects to the second projection position.

3. The image output device according to claim 2, wherein: The plurality of screen layouts include an array screen layout, wherein the first projection position of the first projector and the second projection position of the second projector are arranged adjacent to each other, and Wherein, the at least one processor is further configured to: Based on the array screen layout being the screen layout, the first driver is controlled so that the first projector projects a first portion of the input image to the first projection position, and the second driver is controlled so that the second projector projects a second portion of the input image to the second projection position.

4. The image output device according to claim 2, wherein: The plurality of screen layouts include an overlay screen layout, wherein the first projection position of the first projector matches the second projection position of the second projector, and Wherein, the at least one processor is further configured to: Based on the superimposed screen layout being the screen layout, the first driver is controlled so that the first projector projects the input image to the first projection position, and the second driver is controlled so that the second projector projects the input image to the second projection position matching the first projection position.

5. The image output device according to claim 4, wherein: The at least one processor is further configured to: Applying a first tone mapping curve to the input image and obtaining a first adjusted image with adjusted brightness; Applying a second tone mapping curve to the input image and obtaining a second adjusted image with adjusted brightness; controlling the first projector to output the first adjusted image; as well as The second projector is controlled to output the second adjusted image.

6. The image output device according to claim 1, wherein: The plurality of screen layouts include a partially overlapping screen layout, wherein the first projection position of the first projector is overlapped in an overlapping area within the second projection position of the second projector, and Wherein, the at least one processor is further configured to: identifying, based on the partial overlay screen layout being the screen layout, a first portion and a second portion of the input image, the first portion including a first object among a plurality of objects included in the input image, and the second portion including the remaining objects among the plurality of objects; controlling the first driver so that the first projector projects the first portion of the input image to the first projection position; and The second driver is controlled so that the second projector projects the second portion of the input image to the second projection position.

7. The image output device according to claim 6, wherein: The at least one processor is further configured to: controlling the second driver so that the second projection position of the second part is maintained; and The first driver is controlled so that the first projection position of the first portion moves within the second projection position according to the movement of the first object.

8. The image output device according to claim 7, wherein: The first object includes at least one of a character object controlled by a user manipulation and a main object that interacts with the user according to the user manipulation, and The second part includes a background image of the input image.

9. The image output device according to claim 1, wherein: The context information of the input image includes at least one of resolution information, brightness information, depth map information, object map information, or peak highlight map information of the input image.

10. The image output device according to claim 1, further comprising: sensor, Wherein, the at least one processor is further configured to: Controlling the first projector to output a first pattern image to the first projection position; controlling the second projector to output the second pattern image to the second projection position; identifying, by the sensor, first position information of the first pattern image and second position information of the second pattern image; and A first rotation parameter of the first driver for adjusting the first projection position and a second rotation parameter of the second driver for adjusting the second projection position are identified based on the screen layout, the first position information, and the second position information.

11. A control method for an image output device, the control method comprising: Identify contextual information of the input image; selecting a screen layout from a plurality of screen layouts based on the context information; controlling a first driver of the image output device according to the screen layout so that a first projector of the image output device projects a first image to a first projection position; as well as A second driver of the image output device is controlled according to the screen layout so that a second projector of the image output device projects a second image to a second projection position.

12. The control method according to claim 11, further comprising: determining, according to the screen layout, a first rotation parameter of the first driver for adjusting the first projection position and a second rotation parameter of the second driver for adjusting the second projection position; adjusting the first driver by rotating a first pan, tilt, zoom motor (i.e., a first PTZ motor) of the first driver in at least one first direction among four directions based on the first rotation parameter so that the first projector projects to the first projection position; as well as The second driver is adjusted by rotating a second PTZ motor of the second driver in at least one second direction among the four directions based on the second rotation parameter so that the second projector projects to the second projection position.

13. The control method according to claim 12, wherein: The plurality of screen layouts include an array screen layout, wherein the first projection position of the first projector and the second projection position of the second projector are arranged adjacent to each other, Wherein, controlling the first driver comprises: based on the array screen layout being the screen layout, controlling the first driver so that the first projector projects the first part of the input image to the first projection position, and Wherein, controlling the second driver comprises: based on the array screen layout being the screen layout, controlling the second driver so that the second projector projects the second part of the input image to the second projection position.

14. The control method according to claim 12, wherein: The plurality of screen layouts include an overlay screen layout, wherein the first projection position of the first projector matches the second projection position of the second projector, Wherein, controlling the first driver comprises: based on the superimposed screen layout being the screen layout, controlling the first driver so that the first projector projects the input image to the first projection position, and Wherein, controlling the second driver includes: based on the superimposed screen layout being the screen layout, controlling the second driver so that the second projector projects the input image to the second projection position matching the first projection position.

15. The control method according to claim 14, further comprising: Applying a first tone mapping curve to the input image and obtaining a first adjusted image with adjusted brightness; Applying a second tone mapping curve to the input image and obtaining a second adjusted image with adjusted brightness; controlling the first projector to output the first adjusted image; as well as The second projector is controlled to output the second adjusted image.

Images