Projection device and operation method thereof

Abstract

A projection device according to an embodiment may comprise: a sensor unit that obtains a distance to a screen on which an image is projected; a first projection unit having a first angle of view; a second projection unit having a second angle of view; a memory that stores one or more instructions; and at least one processor that executes the one or more instructions, wherein the at least one processor executes the one or more instructions to: on the basis of the distance, obtain position and size information of a first region onto which a first image is projected by the first projection unit; black out a partial region of a second image projected by the second projection unit on the basis of the position and size information of the first region; control the first projection unit to project the first image; and control the second projection unit to project the second image in which the partial region is blacked out.

Description

Projection device and method of operation thereof

[0001] Various embodiments relate to a projection device for projecting an image and a method of operating the same.

[0002] A projection device is a device that projects images onto a screen or space. Projection devices may include projectors, devices that provide virtual reality (VR), augmented reality (AR), or mixed reality (MR). Projection devices are utilized in a variety of fields, such as for lectures or presentations in classrooms or conference rooms, and for projecting movies onto screens in movie theaters. Devices that provide VR, AR, or MR can provide the experience of watching a movie in a movie theater by displaying images on a screen (display) positioned near the user's eyes when the device is worn.

[0003] Recently, the use of projectors to create home theaters has become increasingly common, allowing users to enjoy movies or games on a large screen. When viewing video content using a projector, not only the content's high resolution and projection performance, but also the viewing environment is becoming increasingly important.

[0004] A projection device according to one embodiment may include a sensor unit that obtains a distance to a screen on which an image is projected.

[0005] A projection device according to one embodiment may include a first projection unit having a first angle of view and a second projection unit having a second angle of view.

[0006] A projection device according to one embodiment may include a memory storing one or more instructions and at least one processor executing the one or more instructions.

[0007] The at least one processor can obtain position and size information of a first area on which a first image is projected by the first projection unit based on the distance by executing the one or more instructions.

[0008] The at least one processor may, by executing the one or more instructions, black out a portion of the second image projected by the second projection unit based on the location and size information of the first area.

[0009] The at least one processor can control the first projection unit to project the first image by executing the one or more instructions, and control the second projection unit to project the second image in which a portion of the image is blacked out.

[0010] A method of operating a projection device according to one embodiment may include a step of obtaining a distance to a screen on which an image is projected.

[0011] A method of operating a projection device according to one embodiment may include a step of obtaining position and size information of a first area on which a first image is projected by a first projection unit having a first angle of view based on the distance.

[0012] A method of operating a projection device according to one embodiment may include a step of blackening a portion of a second image projected by a second projection unit having a second angle of view based on position and size information of the first area.

[0013] A method of operating a projection device according to one embodiment may include the steps of projecting a first image using the first projection unit, and projecting a second image in which a portion of the image is blackened using the second projection unit.

[0014] FIG. 1 is a diagram illustrating a projection environment according to one embodiment.

[0015] Figure 2 is a flowchart illustrating a method of operating a projection device according to one embodiment.

[0016] FIG. 3 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0017] FIG. 4 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0018] FIG. 5 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0019] FIG. 6 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0020] FIG. 7 is a drawing for explaining an operation in which a projection device according to one embodiment performs blur processing on a second image.

[0021] FIG. 8 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0022] Figure 9 is a flowchart illustrating a method of operating a projection device according to one embodiment.

[0023] FIG. 10 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0024] FIG. 11 is a drawing showing a method for projecting an image by a first projection device and a second projection device according to one embodiment.

[0025] FIG. 12 is a drawing showing a method for projecting an image by a first projection device and a second projection device according to one embodiment.

[0026] Fig. 13 is a block diagram showing the configuration of a projection device according to one embodiment.

[0027] The terms used in this specification will be briefly explained, and the present invention will be described in detail.

[0028] The terms used in this invention have been selected from widely used, current terms, taking into account their functions. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, in which case their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should not be defined simply as names, but rather based on their inherent meanings and the overall content of the invention.

[0029] When a part of the specification is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," etc., used throughout the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0030] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the present invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description have been omitted to clearly explain the present invention, and similar parts have been designated with similar reference numerals throughout the specification.

[0031] In the embodiments of this specification, the term "user" means a person who controls a system, function or operation, and may include a developer, administrator or installer.

[0032] Additionally, in the embodiments of the present specification, 'image' or 'picture' may represent a still image, a moving image composed of a plurality of consecutive still images (or frames), or a video.

[0033] FIG. 1 is a diagram illustrating a projection environment according to one embodiment.

[0034] Referring to FIG. 1, a projection device (100) according to one embodiment can project an image onto a screen (30). The screen (30) onto which the image is projected can be configured in various forms. When the projection device (100) is a projector, the screen (30) can refer to a physical space onto which the image is projected. For example, the screen (30) can include a wall or a screen made of fabric, but is not limited thereto.

[0035] If the projection device (100) is a device that provides VR, AR, or MR, the screen may refer to a display included in the projection device (100). For example, the device that provides VR, AR, or MR may be implemented in the form of a glasses-type wearable device that includes a head-mounted display (HMD) that can be mounted on the head, and may include a display. The display may be a transparent display or an opaque display. The device that provides VR, AR, or MR may output (display) image content to the display.

[0036] Hereinafter, for convenience of explanation, an example is illustrated and described in which the projection device (100) is a projector, but the same can be applied even when the projection device (100) is a device that provides VR, AR, or MR.

[0037] A projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The projection device (100) may project a first image (10) onto a screen (30) using the first projection unit (110), and may project a second image (20) onto the screen (30) using the second projection unit (120).

[0038] The first projection unit (110) and the second projection unit (120) may include projection lenses for projecting images. The second angle of view of the projection lens included in the second projection unit (120) may be larger than the first angle of view of the projection lens included in the first projection unit (110). Accordingly, the second area (50) in which the second image projected by the second projection unit (120) is displayed on the screen (30) may be larger than the first area (40) in which the first image projected by the first projection unit (110) is displayed on the screen (30).

[0039] In addition, the first projection unit (110) and the second projection unit (120) may include a digital micromirror device (DMD). The DMD may include small mirrors. Each mirror included in the DMD represents one pixel and can generate a digital image by controlling light according to an electronic signal. For example, each mirror reflects or blocks light, and when light is reflected, the corresponding pixel may appear bright, and when light is blocked, the corresponding pixel may appear dark. The generated digital image may be projected onto a screen through a lens. However, the present invention is not limited thereto, and the first projection unit (110) and the second projection unit (120) may be implemented in various forms.

[0040] The first image (10) projected by the first projection unit (110) according to one embodiment may include image content. The image content according to one embodiment may include various contents such as movies, TV programs, videos, motion pictures, online streaming services, and advertising content. However, the present invention is not limited thereto.

[0041] The second image (20) projected by the second projection unit (120) according to one embodiment may include a background image. The background image (20) according to one embodiment may include an image representing a movie theater, as illustrated in FIG. 1. However, the present invention is not limited thereto, and the background image may include an image representing the sea, the sky, a beach, a city, a mountain, the universe, etc.

[0042] In one embodiment, the first image may be a higher resolution image than the second image.

[0043] According to one embodiment, a projection device (100) can identify a first area (40) on which a first image (10) is projected by a first projection unit (110), and can black out a portion (60) of a second image (20) corresponding to the identified first area (40). The projection device (100) can project the second image (20) in which a portion (60) is blackened by using a second projection unit (120). Accordingly, a background image (second image) can be projected on a peripheral area of ​​image content (first image) projected on a screen (30).

[0044] As the background image (second image) is projected on the surrounding area of ​​the video content (first image), the user (viewer) can experience watching the video content in various environments depending on the background image.

[0045] Referring to the drawings below, operations of a projection device (100) according to one embodiment projecting image content (first image) and projecting a background image (second image) in a surrounding area of ​​the image content will be described in detail.

[0046] Figure 2 is a flowchart illustrating a method of operating a projection device according to one embodiment.

[0047] Referring to FIG. 2, a projection device (100) according to one embodiment can obtain distance information to a screen on which an image is to be projected (S210).

[0048] According to one embodiment, a projection device (100) can detect a distance between the projection device (100) and a screen (30) using a distance sensor. At this time, the distance between the projection device (100) and the screen (30) may include a distance between a projection lens included in a first projection unit and the screen (30).

[0049] A distance sensor according to one embodiment may include, but is not limited to, an ultrasonic distance sensor that measures distance using ultrasonic waves, an infrared distance sensor that measures distance using infrared waves, a laser distance sensor that measures distance using laser waves, etc.

[0050] According to one embodiment, a projection device (100) can obtain information on the position and size of a first area where a first image is projected by a first projection unit based on the distance between the projection device (100) and a screen (30) (S220).

[0051] For example, the projection device (100) can obtain information on the position and size of the first area on which the first image is projected, based on the distance (first distance) between the first projection lens included in the first projection unit and the screen and the first angle of view of the first projection lens. This will be described in detail later with reference to FIG. 3. For example, the projection device (100) can obtain coordinate information of four vertices of the first area and size information of the first area.

[0052] A projection device (100) according to one embodiment can black out a portion of a second image based on the location and size information of the first area (S230).

[0053] For example, the projection device (100) can obtain information on the position and size of a second area where a second image is projected based on the distance (second distance) between the second projection lens included in the second projection unit and the screen and the second angle of view of the second projection lens.

[0054] At this time, the second distance can be obtained based on the distance between the first projection lens and the second projection lens and the distance between the first projection lens and the screen obtained in step 210 (S210). For convenience of explanation, it is assumed below that the first distance and the second distance are the same.

[0055] A method for obtaining location and size information of a second area where a second image is projected will be described in detail later with reference to FIG. 3. For example, the projection device (100) can obtain coordinate information of four vertices of the second area and size information of the second area.

[0056] The projection device (100) can black out a portion of the second image to prevent the second image from being projected onto the first region. For example, the projection device (100) can identify a portion of the second image to be blacked out using coordinate information of four vertices of the second region and coordinate information of four vertices of the first region.

[0057] The projection device (100) can black out some areas identified as the first area among the second images.

[0058] Black processing according to one embodiment may include processing pixels in the corresponding area as black or processing pixel values ​​included in the corresponding area as '0'. Accordingly, when the projection device (100) projects the second image, the black processed area may not be displayed on the screen.

[0059] A projection device (100) according to one embodiment can project a first image and a second image in which some areas are blackened (S240).

[0060] For example, the projection device (100) may project a first image onto a screen using a first projection unit, and may project a second image with a portion of the image blacked out using a second projection unit. Accordingly, the final image projected onto the screen may include the first image and the second image displayed in the surrounding area of ​​the first image.

[0061] FIG. 3 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0062] Referring to FIG. 3, a projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The first projection unit (110) may project a first image (10), and the second projection unit (120) may project a second image (20). The first image (10) may include image content, and the second image (20) may include a background image.

[0063] For convenience of explanation, the distance between the first projection unit (110) and the screen (30) (first distance, L1) and the distance between the second projection unit (120) and the screen (30) (second distance, L2) are described as being the same.

[0064] The first distance (L1) may include the shortest distance between the first projection unit (110) and the screen (30), and the second distance (L2) may include the shortest distance between the second projection unit (120) and the screen (30).

[0065] According to one embodiment, the projection device (100) can obtain a first distance (L1) or a second distance (L2) using a distance sensor (310). For example, the projection device (100) can obtain the first distance or the second distance using ultrasound, infrared, or laser. However, the present invention is not limited thereto.

[0066] According to one embodiment, a projection device (100) can obtain information on the position and size of an area on which a first image is projected by a first projection unit (110) based on a first distance (L1). For example, the projection device (100) can obtain the size (D1) in the X-axis direction of a first area (320) on which a first image is projected on a screen by using the first distance (L1) and the angle of view (A1) of the first projection unit (110) according to the following mathematical expression 1.

[0067] [Mathematical Formula 1]

[0068] D1 = Tan(A1 / 2) / 2L1

[0069] Additionally, the projection device (100) can obtain the size of the Y-axis direction of the first area (320) on which the first image is projected on the screen in the same manner.

[0070] According to one embodiment, the projection device (100) can obtain coordinate information of four vertices of the first region (320) based on the position information of the first projection unit (110) (e.g., coordinate information of the center (C1) of the first projection unit (110)), the first distance (L1), the size (D1) of the first region (320) in the X-axis direction, and the size in the Y-axis direction. For example, the coordinate information of the four vertices of the first region (320) can include P0(x1, y1), P1(x2, y1), P2(x1, y2), and P3(x2, y2). However, the present invention is not limited thereto.

[0071] According to one embodiment, the projection device (100) can obtain information on the position and size of an area on which a second image is projected by the second projection unit (120) based on the second distance (L2). For example, the projection device (100) can obtain the size (D2) in the X-axis direction of the second area (330) on which the second image is projected on the screen (30) by using the second distance (L2) and the angle of view (A2) of the second projection unit (120) according to the following mathematical expression 2.

[0072] [Equation 2]

[0073] D2 = Tan(A2 / 2) / 2L2

[0074] Additionally, the projection device (100) can obtain the size of the second area (330) projected onto the screen in the Y-axis direction in the same manner.

[0075] According to one embodiment, the projection device (100) can obtain coordinate information of four vertices of the second region based on the position information of the second projection unit (120) (e.g., coordinate information of the center (C2) of the second projection unit (120)), the second distance (L2), the size of the second region in the X-axis direction, and the size of the second region in the Y-axis direction. For example, the coordinate information of the four vertices of the second region (330) can include P4 (x3, y3), P5 (x4, y3), P6 (x3, y4), and P7 (x4, y4). However, the present invention is not limited thereto.

[0076] According to one embodiment, a projection device (100) can identify a portion (340) to be blackened in a second image (20) based on coordinate information for a first area (320) and coordinate information for a second area (330). The projection device (100) can blacken a portion (340) corresponding to the first area (320) in the second image (20).

[0077] For example, when the second image (20) corresponds to a second area (330, an area having four vertices P4 (x3, y3), P5 (x4, y3), P6 (x3, y4), and P7 (x4, y4)), the projection device (100) can black out a portion of an area (340) corresponding to a first area (320, an area having four vertices P0 (x1, y1), P1 (x2, y1), P2 (x1, y2), and P3 (x2, y2)).

[0078] According to one embodiment, a projection device (100) may project a first image (10) using a first projection unit (110), and may project a second image (20) in which a portion (340) is blackened using a second projection unit (120). Accordingly, a third image (350) finally displayed on a screen (30) may include the first image (10) and a second image (20) displayed in a peripheral area of ​​the first image (10).

[0079] FIG. 4 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0080] Referring to FIG. 4, a projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The first projection unit (110) may project a first image (10), and the second projection unit (120) may project a second image (20). The first image (10) may include image content, and the second image (20) may include a background image.

[0081] According to one embodiment, the projection device (100) can obtain the distance (first distance, L1) between the first projection unit (110) and the screen (30) or the distance (second distance, L2) between the second projection unit (120) and the screen (30) using the distance sensor (310). The first distance (L1) and the second distance (L2) according to one embodiment may be the same. According to one embodiment, the projection device (100) can obtain the position and size information of the first area (320) on which the first image (10) is projected on the screen (30) and the position and size information of the second area (330) on which the second image (20) is projected using the method described in FIG. 3.

[0082] For example, the size in the X-axis direction of the first region (320) may be D1, and coordinate information of four vertices of the first region (320) may include P0(x1, y1), P1(x2, y1), P2(x1, y2), and P3(x2, y2). In addition, the size in the X-axis direction of the second region (330) may be D2, and coordinate information of four vertices of the second region (330) may include P4(x3, y3), P5(x4, y3), P6(x3, y4), and P7(x4, y4). However, the present invention is not limited thereto.

[0083] According to one embodiment, a projection device (100) can identify a portion of a second image (20) to be blackened based on coordinate information for a first area (320) and coordinate information for a second area (330). The projection device (100) can blacken a portion of a second image (20) corresponding to the first area (320) (340).

[0084] For example, when the second image (20) corresponds to a second area (330, an area having four vertices P4 (x3, y3), P5 (x4, y3), P6 (x3, y4), and P7 (x4, y4)), the projection device (100) can black out a portion of an area (340) corresponding to a first area (320, an area having four vertices P0 (x1, y1), P1 (x2, y1), P2 (x1, y2), and P3 (x2, y2)).

[0085] In addition, the projection device (100) according to one embodiment can black out a portion of the second image (20) so that the second image (20) projected on the screen (30) is symmetrical with respect to the first area (320) based on the position and size information of the first area (320) and the position and size information of the second area (330). For example, the projection device (100) can black out a portion of the second image (20) so that the first image (10) being projected is positioned at the center of the second image (20) being projected.

[0086] Referring to FIG. 4, due to the distance (distance in the X-axis direction) between the first projection unit (110) and the second projection unit (120), the first area (320) is not located at the center of the second area (330). Accordingly, the first image (10) projected on the screen (30) may be displayed offset to the left area of ​​the second image (20).

[0087] The projection device (100) can black out a portion of the right side (410) of the second image (20) so that the first image (10) being projected is positioned at the center of the second image (20) being projected. At this time, the portion of the right side (410) being blacked out can be determined based on the position and size information of the first area (320) (e.g., coordinate information of four vertices of the first area (320)) and the position and size information of the second area (330) (e.g., coordinate information of four vertices of the second area (330). However, the present invention is not limited thereto.

[0088] According to one embodiment, a projection device (100) may project a first image (10) using a first projection unit (110), and may project a second image (20) in which some areas (340, 410) are blacked out using a second projection unit (120). Accordingly, a third image (420) finally displayed on a screen (30) may include the first image (10) and the second image (20) displayed in a peripheral area of ​​the first image (10). The third image (420) may be displayed in an area remaining in the X-axis direction of the screen (30) except for an area D3 among an area D2. The center of the first image (10) included in the third image (420) according to one embodiment may coincide with the center of the second image (20). Alternatively, a vertical line passing through the center of the first image (10) included in the third image (420) may coincide with a vertical line passing through the center of the second image (20). Alternatively, a horizontal line passing through the center of the first image (10) included in the third image (420) may coincide with a horizontal line passing through the center of the second image (20). However, this is not limited thereto.

[0089] FIG. 5 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0090] Referring to FIG. 5, a projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The first projection unit (110) may project a first image (10), and the second projection unit (120) may project a second image (20). The first image (10) may include image content, and the second image (20) may include a background image.

[0091] According to one embodiment, a projection device (100) can obtain a distance (first distance, L1) between a first projection unit (110) and a screen (30) or a distance (second distance, L2) between a second projection unit (120) and the screen (30) using a distance sensor (310). According to one embodiment, the first distance (L1) and the second distance (L2) may be the same.

[0092] A projection device (100) according to one embodiment can obtain information on the position and size of a first area (510) on which a first image (10) is projected on a screen (30) and information on the position and size of a second area (520) on which a second image (20) is projected, using the method described in FIG. 3.

[0093] For example, the size in the Y-axis direction of the first region (510) may be D4, and coordinate information of four vertices of the first region (510) may include P0(x1, y1), P1(x2, y1), P2(x1, y2), and P3(x2, y2). In addition, the size in the Y-axis direction of the second region (520) may be D5, and coordinate information of four vertices of the second region (520) may include P4(x3, y3), P5(x4, y3), P6(x3, y4), and P7(x4, y4). However, the present invention is not limited thereto.

[0094] According to one embodiment, a projection device (100) can identify a portion of a second image (20) to be blackened based on coordinate information for a first area (510) and coordinate information for a second area (520). The projection device (100) can blacken a portion of a portion (530) corresponding to the first area (510) in the second image (20).

[0095] For example, when the second image (20) corresponds to a second area (520, an area having four vertices P4 (x3, y3), P5 (x4, y3), P6 (x3, y4), and P7 (x4, y4)), the projection device (100) can black out a portion of an area (530) corresponding to a first area (510, an area having four vertices P0 (x1, y1), P1 (x2, y1), P2 (x1, y2), and P3 (x2, y2)).

[0096] In addition, the projection device (100) according to one embodiment can black out a portion of the second image (20) so that the second image (20) projected on the screen (30) is symmetrical with respect to the first area (510) based on the position and size information of the first area (510) and the position and size information of the second area (520). For example, the projection device (100) can black out a portion of the second image (20) so that the first image (10) being projected is located at the center of the second image (20) being projected.

[0097] Referring to FIG. 5, due to the distance (distance in the Y-axis direction) between the first projection unit (110) and the second projection unit (120), the first area (510) is not located at the center of the second area (520). Accordingly, the first image (10) projected on the screen (30) may be displayed in an offset area above the second image (20).

[0098] The projection device (100) can black out a portion of the lower part (540) of the second image (20) so that the first image (10) being projected is positioned at the center of the second image (20) being projected. At this time, the portion of the lower part (540) being blacked out can be determined based on the position and size information of the first area (510) (e.g., coordinate information of four vertices of the first area (510)) and the position and size information of the second area (520) (e.g., coordinate information of four vertices of the second area (520)). However, the present invention is not limited thereto.

[0099] According to one embodiment, a projection device (100) may project a first image (10) using a first projection unit (110), and may project a second image (20) in which some areas (530, 540) are blacked out using a second projection unit (120). Accordingly, a third image (550) finally displayed on a screen (30) may include the first image (10) and a second image (20) displayed in a peripheral area of ​​the first image (10). The third image (550) may be displayed in an area remaining in the Y-axis direction of the screen (30) except for an area D6 among an area D5. The center of the first image (10) included in the third image (550) according to one embodiment may coincide with the center of the second image (20). Alternatively, a vertical line passing through the center of the first image (10) included in the third image (550) may coincide with a vertical line passing through the center of the second image (20). Alternatively, a horizontal line passing through the center of the first image (10) included in the third image (550) may coincide with a horizontal line passing through the center of the second image (20). However, this is not limited thereto.

[0100] FIG. 6 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0101] Referring to FIG. 6, a projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The first projection unit (110) may project a first image (10), and the second projection unit (120) may project a second image (20). The first image (10) may include image content, and the second image (20) may include a background image.

[0102] According to one embodiment, a projection device (100) can obtain a distance (first distance, L1) between a first projection unit (110) and a screen (30) and a distance (second distance, L2) between a second projection unit (120) and the screen (30) using a distance sensor (310). According to one embodiment, the first distance (L1) and the second distance (L2) may be the same.

[0103] The projection device (100) can obtain the position of the center of the first area (610) on which the first image (10) is projected on the screen (30) based on the position information of the first projection unit (110), the first distance (L1), and the size of the angle of view (A1) of the first projection unit (110). In addition, the projection device (100) can obtain the position of the center of the second area (620) on which the second image (20) is projected on the screen (30) based on the position information of the second projection unit (120), the second distance (L2), and the size of the angle of view (A2) of the second projection unit (120).

[0104] Due to the distance (L3) between the first projection unit (110) and the second projection unit (120) according to one embodiment, the center of the first area (610) and the center of the second area (620) may not coincide. The projection device (100) may adjust the projection direction of at least one of the first projection unit (110) and the second projection unit (120) so that the centers of the first area (610) and the second area (620) coincide.

[0105] Referring to Fig. 6, by adjusting the projection direction of the first projection unit (110), the center of the first area (610) can be adjusted to coincide with the center of the second area (620). However, the present invention is not limited thereto, and by adjusting the projection direction of the second projection unit (120), the center of the second area (620) can be adjusted to coincide with the center of the first area (610).

[0106] A projection device (100) according to one embodiment can obtain information on the position and size of a first area (610) on which a first image (10) is projected on a screen (30) and information on the position and size of a second area (620) on which a second image (20) is projected, using the method described in FIG. 3.

[0107] For example, the size in the X-axis direction of the first region (610) may be D1, and coordinate information of four vertices of the first region (610) may include P8 (x5, y5), P9 (x6, y5), P10 (x5, y6), and P11 (x6, y6). In addition, the size in the X-axis direction of the second region (620) may be D2, and coordinate information of four vertices of the second region (620) may include P4 (x3, y3), P5 (x4, y3), P6 (x3, y4), and P7 (x4, y4). However, the present invention is not limited thereto.

[0108] According to one embodiment, a projection device (100) can identify an area to be blackened in a second image (20) based on coordinate information of a first area (610) and coordinate information of a second area (620). The projection device (100) can blacken a portion of an area (630) corresponding to the first area (610) in the second image (20).

[0109] For example, when the second image (20) corresponds to a second area (620, an area having four vertices P4 (x3, y3), P5 (x4, y3), P6 (x3, y4), P7 (x4, y4)), the projection device (100) can black out a part of an area (630) corresponding to a first area (610, an area having four vertices P8 (x5, y5), P9 (x6, y5), P10 (x5, y6), P11 (x6, y6)).

[0110] According to one embodiment, a projection device (100) may project a first image (10) using a first projection unit (110), and may project a second image (20) in which a portion (630) is blackened using a second projection unit (120). Accordingly, a third image (640) finally displayed on a screen (30) may include the first image (10) and a second image (20) displayed in a peripheral area of ​​the first image (10).

[0111] FIG. 7 is a drawing for explaining an operation in which a projection device according to one embodiment performs blur processing on a second image.

[0112] Referring to FIG. 7, a projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The first projection unit (110) may project a first image (710), and the second projection unit (120) may project a second image (720).

[0113] A projection device (100) according to one embodiment can project a first image (710) and a second image (720) in which a portion (730) is blackened, using the method described in FIGS. 3 to 6.

[0114] The first image (710) may be video content and may have a higher resolution than the second image (720). The second image (720) may be a background image and may have a lower resolution than the first image (710). For example, the second image (720) may be an image representing the sea, the sky, a beach, a city, a mountain, space, etc., but is not limited thereto.

[0115] According to one embodiment, the projection device (100) can perform blur processing on the second image (720) to give the second image (720) a sense of perspective or three-dimensionality. Blur or blur processing means making the image blurry by reducing the sharpness of the image and applying a soft blur effect. The projection device (100) can blur the second image (720) by performing filtering. The projection device (100) can perform filtering on the second image (720) using various filters. For example, the projection device (100) can perform blur processing using a Gaussian filter (Gaussian blurring), blur processing using an average filter (average blurring), blur processing using a median filter (median blurring), etc. The above filters are only examples, and the projection device (100) according to one embodiment can perform blur processing on the second image (720) using various filters.

[0116] According to one embodiment, the projection device (100) may not perform blur processing or may reduce the intensity of blur for objects included in the second image (720) that are to be expressed as being close. In addition, the projection device (100) may increase the intensity of blur for objects included in the second image (720) that are to be expressed as being far away. However, the present invention is not limited thereto.

[0117] Alternatively, the projection device (100) according to one embodiment can be controlled to exhibit an out-of-focus effect in the projected second image. For example, the focus of the projection lens included in the second projection unit (120) can be adjusted to a blackened area, and the remaining area can be blurred. However, the present invention is not limited thereto.

[0118] According to one embodiment, a projection device (100) can enhance the three-dimensionality or perspective of a final image (740) to be projected, or highlight a first image (710) in the final image (740), by performing blur processing on a second image (720) or by providing an out-of-focus effect to the projected second image (720).

[0119] FIG. 8 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0120] Referring to FIG. 8, a projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The first projection unit (110) may project a first image (810), and the second projection unit (120) may project a second image (820).

[0121] According to one embodiment, the second image (820) may include a multi-view image. For example, the second image (820) may include first to third sub-images (831, 832, 833).

[0122] According to one embodiment, a projection device (100) can identify a portion (840) of a second image (820) corresponding to a first area on which a first image (810) is projected, using the method described in FIGS. 3 to 6. The projection device (100) can adjust the positions of the first to third sub-images (831, 832, 833) so that the first to third sub-images (831, 832, 833) are projected on the remaining areas of the second image (820) excluding the identified portion (840). However, the present invention is not limited thereto.

[0123] According to one embodiment, a projection device (100) can project a first image (810) using a first projection unit (110), and can project a second image (820) in which the positions of sub-images (831, 832, 833) are adjusted using a second projection unit (120). Accordingly, a third image (850) finally displayed on a screen can include the first image (810) and a second image (820) in which first to third sub-images are displayed in a surrounding area of ​​the first image (810).

[0124] Figure 9 is a flowchart illustrating a method of operating a projection device according to one embodiment.

[0125] Referring to FIG. 9, a projection device (100) according to one embodiment can project an indicator that can identify a first area where a first image is projected onto a screen (S910).

[0126] For example, the projection device (100) may project an indicator indicating the border of the first image. Alternatively, the projection device (100) may project an indicator indicating four corners of the first image. However, the present invention is not limited thereto, and the projection device (100) may project indicators of various forms.

[0127] According to one embodiment, a projection device (100) can identify a first area by recognizing a projected indicator through a camera, and obtain information on the location and size of the identified first area (S920).

[0128] The projection device (100) may include at least one camera. The projection device (100) may use the camera to capture images of the screen, thereby recognizing an indicator projected onto the screen. Based on the indicator, the projection device (100) may identify a first area and obtain information on the location and size of the identified first area.

[0129] A projection device (100) according to one embodiment can obtain location and size information of a second area where a second image is projected (S930).

[0130] For example, the projection device (100) can obtain information on the location and size of a second area where a second image is projected on the screen based on the distance between the second projection unit (120) and the screen and the angle of view of the second projection unit (120). This has been described in detail in FIG. 3, so a detailed description thereof will be omitted.

[0131] Alternatively, the projection device (100) may project a second indicator that can identify a second area where the second image is projected. For example, the projection device (100) may project an indicator indicating a border of the second image. Alternatively, the projection device (100) may project indicators indicating four corners of the second image. However, the present invention is not limited thereto, and the projection device (100) may project indicators of various forms. The projection device (100) may recognize the projected second indicator by photographing the screen using a camera. The projection device (100) may identify the second area based on the second indicator, and obtain information on the location and size of the identified second area.

[0132] A projection device (100) according to one embodiment can identify a portion of a second image to be processed as black based on information on the location and size of a first area and information on the location and size of a second area.

[0133] According to one embodiment, a projection device (100) can black out a portion of a second image corresponding to a first area (S940).

[0134] A projection device (100) according to one embodiment can project a first image and a second image with some areas processed as black (S950).

[0135] For example, the projection device (100) can project a first image using the first projection unit (110), and can project a second image with some areas processed as black using the second projection unit (120).

[0136] FIG. 10 is a drawing showing a method for a projection device according to one embodiment to project a first image and a second image.

[0137] Referring to FIG. 10, a projection device (100) according to one embodiment may include a first projection unit (110) and a second projection unit (120). The first projection unit (110) may project a first image (1010), and the second projection unit (120) may project a second image (1020).

[0138] In addition, the first projection unit (110) can project an indicator (1030) that can identify the first area where the first image (1010) is projected. For example, the first projection unit (110) can project an indicator (1030) that indicates the border of the first image (1010). Alternatively, the first projection unit (110) can project an indicator that indicates four corners of the first image. However, the present invention is not limited thereto, and the first projection unit (110) can project indicators of various forms.

[0139] A projection device (100) according to one embodiment may include at least one camera (1040). The projection device (100) may recognize a projected indicator (1030) by taking a picture of the screen using the camera (1040).

[0140] A projection device (100) according to one embodiment can identify a first area based on an indicator (1030) and obtain location and size information of the identified first area.

[0141] A projection device (100) according to one embodiment can obtain the position and size of a second area on which a second image (1020) is projected on a screen.

[0142] For example, the projection device (100) can obtain information on the location and size of the second area by using the distance between the second projection unit (120) and the screen and the angle of view of the second projection unit (120). This has been described in detail in FIG. 3, so a detailed description thereof will be omitted.

[0143] Alternatively, the second projection unit (120) according to one embodiment may project a second indicator that can identify a second area on which the second image (1020) is projected. For example, the second projection unit (120) may project an indicator indicating the border of the second image. Alternatively, the second projection unit (120) may project an indicator indicating four corners of the second image. However, the present invention is not limited thereto, and the second projection unit (120) may project indicators of various forms.

[0144] According to one embodiment, a projection device (110) can recognize a projected second indicator by taking a picture of the screen using a camera (1040).

[0145] A projection device (100) according to one embodiment can identify a second area based on a second indicator and obtain location and size information of the identified second area.

[0146] A projection device (100) according to one embodiment can identify a portion of a second image to be blackened based on information about the location and size of a first region and information about the location and size of a second region. The projection device (100) can blacken a portion of the second image corresponding to the first region.

[0147] According to one embodiment, a projection device (100) may project a first image (1010) using a first projection unit (110), and may project a second image (1020) with a portion of the image processed as black using a second projection unit (120). Accordingly, a third image (1050) finally displayed on the screen may include the first image (1010) and a second image (1020) displayed in a peripheral area of ​​the first image (1010).

[0148] FIG. 11 is a drawing showing a method for projecting an image by a first projection device and a second projection device according to one embodiment.

[0149] Referring to FIG. 11, a first projection device (1110) can project a first image (1130), and a second projection device (1120) can project a second image (1140).

[0150] The first image (1130) may include image content, and the second image (1140) may include a background image.

[0151] The first projection device (1110) may include a first projection lens for projecting a first image (1130), and the second projection device (1120) may include a second projection lens for projecting a second image (1140). The second angle of view of the second projection lens may be larger than the first angle of view of the first projection lens. For example, the second projection lens of the second projection device (1120) may include a convex lens, a wide-angle lens, or the like. However, the present invention is not limited thereto.

[0152] Accordingly, the angle of view of the second image (1140) projected by the second projection device (1120) may be larger than the angle of view of the first image (1130) projected by the first projection device (1110). For example, the second area on which the second image (1140) is projected may be larger than the first area on which the first image (1130) is projected on the screen.

[0153] As illustrated in FIG. 11, the second projection lens can be separated from the main body of the second projection device (1120). The second projection lens may be in the form of a lid that fits into the main body of the second projection device (1120). For example, a convex lens or a wide-angle lens may be fitted into the main body of the second projection device (1120). However, the present invention is not limited thereto.

[0154] According to one embodiment, the first image (1130) may be a higher resolution image than the second image (1140).

[0155] A first projection device (1110) according to one embodiment may include a distance sensor, and may detect a distance between the first projection device (1110) and a screen using the distance sensor. The first projection device (1110) may obtain information on the position and size of a first area on which a first image (1130) is projected, based on the distance (first distance) between the first projection device (1110) and the screen.

[0156] Additionally, the second projection device (1120) may include a distance sensor, and may use the distance sensor to detect the distance between the second projection device (1120) and the screen. The second projection device (1120) may obtain information on the location and size of the second area on which the second image is projected, based on the distance (second distance) between the second projection device (1120) and the screen.

[0157] The first projection device (1110) can perform wired or wireless communication with the second projection device (1120). For example, the first projection device (1110) can transmit information about the location and size of the first area to the second projection device (1120).

[0158] The second projection device (1120) can identify an area to be blackened in the second image (1140) based on information about the location and size of the first area received from the first projection device (1110) and the location and size of the second area acquired by the second projection device (1120). The second projection device (1120) can blacken a portion of the second image corresponding to the first area.

[0159] The second projection device (1120) can project a second image (1140) with some areas blacked out. Accordingly, the third image (1150) ultimately displayed on the screen can include the first image (1130) and the second image (1140) displayed in the surrounding area of ​​the first image (1130).

[0160] FIG. 12 is a drawing showing a method for projecting an image by a first projection device and a second projection device according to one embodiment.

[0161] Referring to FIG. 12, the first projection device (1210) can project a first image (1230), and the second projection device (1220) can project a second image (1240). In FIG. 12, the first projection device (1210) and the second projection device (1220) are illustrated as separate devices, but this is not limited to the first projection device and the second projection device, and can be implemented in a form in which a first projection unit and a second projection unit are included in a single device.

[0162] According to one embodiment, the first image (1230) may include video content. For example, the video content may include various types of content, such as movies, TV programs, videos, motion pictures, online streaming services, and advertising content. However, the present invention is not limited thereto.

[0163] According to one embodiment, the second image (1240) may be a panoramic image with a wide field of view. For example, the second image may include a 360-degree image. The 360-degree image may include an image with a 360-degree field of view. The 360-degree image may be generated based on multiple images captured in a 360-degree direction using at least one camera. Additionally, the second image (1240) may include an image representing the background.

[0164] As illustrated in FIG. 12, the second projection device (1220) can project the second image (1240) onto a screen (1260) configured with multiple surfaces (e.g., front, side, ceiling, floor, etc.). For example, the second projection device (1220) can project onto not only the front of the screen, but also the left side and right side. Alternatively, without limitation, the second projection device (1220) can project the second image (1240) onto the ceiling, floor, etc. of the screen.

[0165] According to one embodiment, a first projection device (1210) may include a first projection lens for projecting a first image (1230), and a second projection device (1220) may include a second projection lens for projecting a second image (1240). A second angle of view of the second projection lens may be larger than the first angle of view of the first projection lens. For example, the second projection lens of the second projection device (1220) may include a convex lens, a wide-angle lens, or the like.

[0166] According to one embodiment, the first image (1230) may be a higher resolution image than the second image (1240).

[0167] According to one embodiment, a first projection device (1210) may include a distance sensor, and may detect a distance between the first projection device (1210) and a screen using the distance sensor. The first projection device (1210) may obtain information on the position and size of a first area on which a first image (1230) is projected, based on the distance (first distance) between the first projection device (1210) and the screen.

[0168] Additionally, the second projection device (1220) may include a distance sensor, and may use the distance sensor to detect the distance between the second projection device (1220) and the screen. The second projection device (1220) may obtain information on the location and size of the second area on which the second image (1240) is projected, based on the distance (second distance) between the second projection device (1220) and the screen.

[0169] The first projection device (1210) can perform wired or wireless communication with the second projection device (1220). For example, the first projection device (1210) can transmit information about the location and size of the first area to the second projection device (1220).

[0170] The second projection device (1220) can identify a portion of the second image (1270) to be blackened based on information about the location and size of the first region received from the first projection device (1210) and the location and size of the second region acquired by the second projection device (1220). The second projection device (1220) can blacken a portion of the second image (1270) corresponding to the first region.

[0171] The second projection device (1220) can project a second image (1240) with a portion (1270) blacked out. Accordingly, the third image ultimately displayed on the screen can include the first image (1130) and the second image (1240) displayed in the surrounding area of ​​the first image (1230).

[0172] Fig. 13 is a block diagram showing the configuration of a projection device according to one embodiment.

[0173] Referring to FIG. 13, a projection device (100) according to one embodiment may include a sensor unit (130), a first projection unit (110), a second projection unit (120), a processor (140), a memory (150), and a communication unit (160).

[0174] According to one embodiment, the sensor unit (130) can detect the state around the projection device (100) and transmit the detected information to the processor (140). The sensor unit (130) can include a distance sensor, an image sensor, a depth sensor, an infrared sensor, etc. For example, the distance sensor can include the distance sensor (310) illustrated in FIGS. 3 to 6. However, the present invention is not limited thereto.

[0175] A distance sensor according to one embodiment can detect the distance to a surrounding object. For example, the distance sensor may include an ultrasonic distance sensor that measures distance using ultrasonic waves, an infrared distance sensor that measures distance using infrared waves, a laser distance sensor that measures distance using laser waves, etc. However, the present invention is not limited thereto.

[0176] An image sensor according to one embodiment can acquire image frames, such as still images or video images. For example, the image sensor can capture images outside the projection device (100). In this case, the images captured by the image sensor can be processed by the processor (120) or a separate image processor.

[0177] A depth sensor according to one embodiment can obtain depth information about one or more objects included in a space. The depth information can correspond to a distance from the depth sensor to a specific object, and the greater the distance from the depth sensor to the specific object, the greater the depth value. A depth sensor according to one embodiment can obtain depth information about an object in various ways, and for example, can obtain depth information using at least one of a time-of-flight (TOF) method, a stereo image method, and a structured light method.

[0178] A depth sensor according to one embodiment may include at least one camera, and may acquire depth information about a real space included in a FOV of a camera included in the depth sensor.

[0179] In addition, the sensor unit (130) may include, in addition to a distance sensor, an image sensor, a depth sensor, and an infrared sensor, an acceleration sensor, a position sensor, a temperature / humidity sensor, an illuminance sensor, a geomagnetic sensor, a gyroscope sensor, and a microphone, but is not limited thereto.

[0180] According to one embodiment, the first projection unit (110) and the second projection unit (120) may include a light source that generates light, a lens, and the like. For example, the first projection unit (110) may include a first projection lens, and the second projection unit (120) may include a second projection lens. The angle of view of the second projection lens may be larger than the angle of view of the first projection lens. Accordingly, the second area in which the second image projected by the second projection unit (120) is displayed on the screen may be larger than the first area in which the first image projected by the first projection unit (110) is displayed on the screen.

[0181] The first projection unit (110) and the second projection unit (120) may further include a driving unit for adjusting the direction, position, angle, etc. of the projection. The first projection unit (110) and the second projection unit (120) may perform image projection by driving a light source or adjusting the direction, position, angle, etc. of the projection according to a control signal received from the processor (140). For example, the first projection unit (110) may project a first image, and the second projection unit (120) may project a second image.

[0182] The first image projected by the first projection unit (110) according to one embodiment may include image content. The image content according to one embodiment may include various content such as movies, TV programs, videos, motion pictures, online streaming services, and advertising content. However, the present invention is not limited thereto.

[0183] The second image projected by the second projection unit (120) according to one embodiment may include a background image. The background image according to one embodiment may include an image representing a movie theater, the sea, the sky, a beach, a city, a mountain, space, etc., but is not limited thereto.

[0184] In one embodiment, the first image may be a higher resolution image than the second image.

[0185] According to one embodiment, a processor (140) controls the overall operation of the projection device (100) and the signal flow between internal components of the projection device (100), and performs the function of processing data.

[0186] The processor (140) may include single cores, dual cores, triple cores, quad cores, and multiples thereof. Furthermore, the processor (140) may include multiple processors. For example, the processor (140) may be implemented as a main processor (not shown) and a subprocessor (not shown).

[0187] Additionally, the processor (140) may include at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and a VPU (Video Processing Unit). Alternatively, according to an embodiment, the processor (140) may be implemented in the form of a SoC (System On Chip) that integrates at least one of a CPU, a GPU, and a VPU. Alternatively, the processor (140) may further include an NPU (Neural Processing Unit).

[0188] According to one embodiment, the memory (150) can store various data, programs or applications for driving and controlling the projection device (100).

[0189] Additionally, the program stored in the memory (150) may include one or more instructions. The program (one or more instructions) or application stored in the memory (150) may be executed by the processor (140).

[0190] According to one embodiment, the processor (140) can obtain a first image and a second image to be projected by executing one or more instructions stored in the memory (150). The first image and the second image according to one embodiment may be images previously stored in the memory (150) or images received from an external device via the communication unit (160). In addition, the first image and the second image may be images on which various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion are performed in the video processing unit.

[0191] According to one embodiment, a processor (140) can obtain distance information to a screen on which an image is to be projected by executing one or more instructions stored in a memory (150).

[0192] For example, the processor (140) can detect the distance between the projection device (100) and the screen using a distance sensor. At this time, the distance between the projection device (100) and the screen may include the distance between the first projection lens included in the first projection unit (110) and the screen.

[0193] According to one embodiment, the processor (140) may obtain information on the position and size of a first area on which a first image is projected by the first projection unit (110) based on the distance between the projection device (100) and the screen by executing one or more instructions stored in the memory (150). For example, the processor (140) may obtain information on the position and size of the first area on which the first image is projected based on the distance (first distance) between the first projection lens included in the first projection unit (110) and the screen and the first angle of view of the first projection lens. For example, the processor (140) may obtain coordinate information of four vertices of the first area and size information of the first area. Since this has been described in detail with reference to FIG. 3, a detailed description thereof will be omitted.

[0194] According to one embodiment, a processor (140) may execute one or more instructions stored in a memory (150) to black out a portion of a second image based on location and size information of the first area.

[0195] For example, the processor (140) can obtain information on the location and size of the second area where the second image is projected based on the distance (second distance) between the second projection lens included in the second projection unit (120) and the screen and the second angle of view of the second projection lens. For example, the processor (140) can obtain coordinate information of four vertices of the second area and size information of the second area. Since this has been described in detail with reference to FIG. 3, a detailed description thereof will be omitted.

[0196] According to one embodiment, the processor (140) may execute one or more instructions stored in the memory (150) to black out a portion of the second image so that the second image is not projected onto the first area. For example, by using coordinate information of four vertices of the second area and coordinate information of four vertices of the first area, a portion of the second image to be blacked out may be identified.

[0197] The processor (140) may black out a portion of the second image identified as the first region. Blacking, according to one embodiment, may include processing pixels in the corresponding region as black or processing pixel values ​​included in the corresponding region as '0'.

[0198] According to one embodiment, a processor (140) can project a first image and a second image with a portion of the image processed as black by executing one or more instructions stored in a memory (150).

[0199] For example, the processor (140) may project a first image onto a screen using the first projection unit (110), and may project a second image with a portion of the image blacked out using the second projection unit (120). Accordingly, the final image projected onto the screen may include the first image and the second image displayed in the surrounding area of ​​the first image.

[0200] According to one embodiment, the communication unit (160) can transmit and receive data or signals with an external device or server. For example, the communication unit (160) can include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, a LAN module, an Ethernet module, a wired communication module, etc. In this case, each communication module can be implemented in the form of at least one hardware chip.

[0201] The Wi-Fi module and Bluetooth module perform communication in the Wi-Fi and Bluetooth modes, respectively. When using the Wi-Fi module or Bluetooth module, various connection information such as the SSID and session key are first transmitted and received, and after establishing a communication connection using this, various information can be transmitted and received. The wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0202] According to one embodiment, the communication unit (160) can receive an image or image content to be projected from an external device.

[0203] Meanwhile, the block diagram of the projection device (100) illustrated in FIG. 13 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the projection device (100) actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0204] A projection device according to one embodiment may include a sensor unit that obtains a distance to a screen on which an image is projected.

[0205] A projection device according to one embodiment may include a first projection unit having a first angle of view and a second projection unit having a second angle of view.

[0206] A projection device according to one embodiment may include a memory storing one or more instructions and at least one processor executing the one or more instructions.

[0207] The at least one processor can obtain position and size information of a first area on which a first image is projected by the first projection unit based on the distance by executing the one or more instructions.

[0208] The at least one processor may, by executing the one or more instructions, black out a portion of the second image projected by the second projection unit based on the location and size information of the first area.

[0209] The at least one processor can control the first projection unit to project the first image by executing the one or more instructions, and control the second projection unit to project the second image in which a portion of the image is blacked out.

[0210] The second angle of view may be larger than the first angle of view.

[0211] The at least one processor can obtain location and size information of a second area on which a second image is projected by the second projection unit based on the distance by executing the one or more instructions.

[0212] The at least one processor may, by executing the one or more instructions, black out a portion of the second image corresponding to the first area based on the location and size information of the first area and the location and size information of the second area.

[0213] The at least one processor may, by executing the one or more instructions, black out a portion of the second image so that the second image projected onto the screen is symmetrical with respect to the first area based on the location and size information of the first area and the location and size information of the second area.

[0214] The resolution of the first image may be higher than the resolution of the second image.

[0215] The at least one processor can control the projection direction of at least one of the first projection unit and the second projection unit so that the first image is projected at the center of the second image based on the position information of the first area and the position information of the second area by executing the one or more instructions.

[0216] The at least one processor can control the second projection unit to blur the second image and project the blurred second image by executing the one or more instructions.

[0217] The at least one processor can control the second projection unit to project the second image by out-focusing it by executing the one or more instructions.

[0218] A projection device according to one embodiment may further include at least one camera.

[0219] The at least one processor can obtain location and size information of the first area based on an image captured from the at least one camera by executing the one or more instructions.

[0220] The second projection unit may include a wide-angle lens.

[0221] The second image may include a 360-degree image.

[0222] A method of operating a projection device according to one embodiment may include a step of obtaining a distance to a screen on which an image is projected.

[0223] A method of operating a projection device according to one embodiment may include a step of obtaining position and size information of a first area on which a first image is projected by a first projection unit having a first angle of view based on the distance.

[0224] A method of operating a projection device according to one embodiment may include a step of blackening a portion of a second image projected by a second projection unit having a second angle of view based on position and size information of the first area.

[0225] A method of operating a projection device according to one embodiment may include the steps of projecting a first image using the first projection unit, and projecting a second image in which a portion of the image is blackened using the second projection unit.

[0226] The second angle of view may be larger than the first angle of view.

[0227] The resolution of the first image may be higher than the resolution of the second image.

[0228] A method of operating a projection device according to one embodiment may further include a step of obtaining position and size information of a second area on which a second image is projected by the second projection unit based on the distance.

[0229] The step of blackening a portion of the second image may include a step of blackening a portion of the second image corresponding to the first area based on location and size information of the first area and location and size information of the second area.

[0230] The step of blackening a portion of the second image may include a step of blackening a portion of the second image so that the second image projected onto the screen is symmetrical with respect to the first area, based on information on the position and size of the first area and information on the position and size of the second area.

[0231] A method of operating a projection device according to one embodiment may further include a step of controlling a projection direction of at least one of the first projection unit and the second projection unit so that the first image is projected at the center of the second image based on position information of the first area and position information of the second area.

[0232] A method of operating a projection device according to one embodiment may further include a step of blurring the second image.

[0233] A method of operating a projection device according to one embodiment may further include a step of obtaining position and size information of the first area based on an image captured from at least one camera.

[0234] A projection device according to one embodiment can provide a user with a variety of viewing experiences by projecting various background images around image content.

[0235] According to one embodiment, a projection device can enhance the perspective and three-dimensionality of a projected image by blurring the background image or applying out-of-focus effects. Furthermore, the image content can be further highlighted. Consequently, the user's perception of the background image can be enhanced.

[0236] The method of operating a projection device according to one embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the medium may be those specially designed and configured for the present invention or may be those known to and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0237] Additionally, the method of operating a projection device according to the disclosed embodiments may be provided as a computer program product. The computer program product may be traded as a product between a seller and a buyer.

[0238] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable app) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a storage medium of a manufacturer's server, an electronic marketplace server, or a relay server that temporarily stores the software program.

[0239] In a system comprising a server and a client device, the computer program product may include a storage medium of the server or a storage medium of the client device. Alternatively, if a third device (e.g., a smartphone) exists that is communicatively connected to the server or the client device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include a software program itself that is transmitted from the server to the client device or the third device, or from the third device to the client device.

[0240] In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0241] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) may execute a computer program product stored on the server, thereby controlling a client device in communication with the server to perform a method according to the disclosed embodiments.

[0242] Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concept of the present invention defined in the following claims also fall within the scope of the present invention.

Claims

1. In the projection device (100), A sensor unit (130) that obtains the distance to the screen on which the image is projected; A first projection unit (110) having a first angle of view, and a second projection unit (120) having a second angle of view; A memory (150) storing one or more instructions; and At least one processor (140) for executing one or more of the above instructions, The at least one processor (140) executes the one or more instructions, Based on the above distance, information on the location and size of the first area where the first image is projected by the first projection unit (110) is obtained, Based on the location and size information of the first area, a part of the second image projected by the second projection unit (120) is blackened, A projection device that controls the first projection unit (110) to project the first image, and controls the second projection unit (120) to project the second image in which a portion of the image is blackened.

2. In paragraph 1, A projection device, wherein the second angle of view is larger than the first angle of view.

3. In paragraph 1 or 2, A projection device, wherein the resolution of the first image is higher than the resolution of the second image.

4. In any one of paragraphs 1 to 3, The at least one processor (140) executes the one or more instructions, Based on the above distance, information on the location and size of the second area where the second image is projected by the second projection unit is obtained, A projection device that blackens a portion of the second image corresponding to the first area based on information about the location and size of the first area and information about the location and size of the second area.

5. In paragraph 4, The at least one processor (140) executes the one or more instructions, A projection device that blackens a portion of the second image so that the second image projected on the screen is symmetrical with respect to the first area based on information about the position and size of the first area and information about the position and size of the second area.

6. In paragraph 4 or 5, The at least one processor (140) executes the one or more instructions, A projection device that controls the projection direction of at least one of the first projection unit and the second projection unit so that the first image is projected at the center of the second image based on the position information of the first area and the position information of the second area.

7. In any one of paragraphs 1 to 6, The at least one processor (140) executes the one or more instructions, A projection device that blurs the second image and controls the second projection unit to project the blurred second image.

8. In any one of paragraphs 1 to 7, The at least one processor (140) executes the one or more instructions, A projection device that controls the second projection unit to project the second image by out-focusing it.

9. In any one of paragraphs 1 to 8, The above projection device (100) is, Including at least one additional camera, The at least one processor (140) executes the one or more instructions, A projection device that obtains location and size information of the first area based on an image captured from at least one camera.

10. In any one of paragraphs 1 to 9, The second projection unit (120) is a projection device including a wide-angle lens.

11. In any one of paragraphs 1 to 10, The second image is a projection device including a 360-degree image.

12. In the method of operating the projection device, Step of obtaining the distance to the screen on which the image is projected (S210); Based on the above distance, a step (S220) of obtaining information on the position and size of a first area on which a first image is projected by a first projection unit having a first angle of view; Step (S230) of blackening a part of a second image projected by a second projection unit having a second angle of view based on the location and size information of the first area; and A method of operating a projection device, comprising the step (S240) of projecting a first image using the first projection unit, and projecting a second image with a portion of the image processed as black using the second projection unit.

13. In paragraph 12, A method of operating a projection device, wherein the second angle of view is larger than the first angle of view.

14. In paragraph 12 or 13, A method of operating a projection device, wherein the resolution of the first image is higher than the resolution of the second image.

15. One or more computer-readable recording media storing a program for performing any one of the methods of clauses 12 to 14.

Images