Projection device and operation method thereof

Abstract

A projection device comprises: a projector; at least one memory that stores one or more instructions; and at least one processor, wherein the one or more instructions, when executed by the at least one processor, cause the projection device to: acquire a first image; generate a blurred image on the basis of the first image; acquire a background image by performing image processing so that a vignetting effect appears in an edge area of the blurred image; and control the projector so as to project a second image that is a composite of the background image and the first image.

Description

Projection device and method of operation thereof

[0001] The present disclosure relates to a projection device and an operating method thereof.

[0002] A projection device projects an image onto a screen or space. A projection device may include a projector that projects an image, or a device that provides virtual reality (VR), augmented reality (AR), or mixed reality (MR). Projection devices are utilized in a variety of fields, such as classrooms or conference rooms, for lectures or presentations, and movie projections on screens in movie theaters. Devices that provide VR, AR, or MR can provide the experience of watching a movie in a movie theater by displaying images on a screen (display) positioned near the user's eyes when the device is worn.

[0003] Home theaters can be configured using devices that include projectors, and viewing video content on a large screen, such as watching movies or playing games, is becoming increasingly common. When viewing video content using a device that includes a projector, not only the high resolution and projection performance of the video content but also the viewing environment are beneficial.

[0004] When viewing video content using a device that includes a projector or that provides VR, AR, or MR, the boundary between the area where the video content is projected (the screen) and the rest of the screen may appear distinct. This can create a sense of disconnect between the space where the video content is projected and the real world where the user exists.

[0005] According to one aspect of the present disclosure, a projection device may include a projector, at least one memory storing one or more instructions, and at least one processor.

[0006] The one or more instructions, when executed by the at least one processor, may cause the projection device to acquire a first image.

[0007] The one or more instructions, when executed by the at least one processor, may cause the projection device to generate a blurred image based on the first image.

[0008] The one or more instructions, when executed by the at least one processor, may cause the projection device to obtain a background image by performing image processing so that a vignetting effect appears in an edge area of ​​the blurred image.

[0009] The one or more instructions, when executed by the at least one processor, may control the projector to project a second image that is a composite of the background image and the first image.

[0010] According to one aspect of the present disclosure, a method of operating a projection device may include a step of acquiring a first image.

[0011] The method of operating the projection device may include a step of generating a blurred image based on the first image.

[0012] The method of operating the above projection device may include a step of obtaining a background image by performing image processing so that a vignetting effect appears in an edge area of ​​the blurred image.

[0013] The method of operating the above projection device may include a step of projecting a second image that is a composite of the background image and the first image.

[0014] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0015] FIG. 1 is a diagram illustrating various projection environments according to one embodiment.

[0016] Figure 2 is a flowchart illustrating a method of operating a projection device according to one embodiment.

[0017] FIG. 3 is a flowchart illustrating a method for a projection device according to one embodiment to generate an image including a vignetting effect.

[0018] FIG. 4 is a drawing for reference in explaining a method for generating an image including a vignetting effect by a projection device according to one embodiment.

[0019] FIG. 5 is a drawing showing an example in which a projection device according to one embodiment performs image processing by applying different vignetting ratios.

[0020] FIG. 6 is a flowchart illustrating a method for a projection device according to one embodiment to generate an image including a vignetting effect.

[0021] FIG. 7 is a drawing for reference in explaining a method for generating an image including a vignetting effect by a projection device according to one embodiment.

[0022] FIG. 8 is a flowchart illustrating a method by which a projection device according to one embodiment generates an image including a vignetting effect.

[0023] FIG. 9 is a drawing for explaining an operation of a projection device according to one embodiment to set a background image.

[0024] FIG. 10 is a drawing for explaining an operation of generating a background original image based on an image to be projected by a projection device according to one embodiment.

[0025] FIG. 11 is a drawing for explaining an operation of a projection device according to one embodiment to generate a background image.

[0026] FIG. 12 is a drawing for explaining an operation of a projection device according to one embodiment to generate a background image.

[0027] Fig. 13 is a block diagram showing the configuration of a projection device according to one embodiment.

[0028] FIG. 14 is a drawing illustrating a display device that displays an image including a vignetting effect according to one embodiment.

[0029] Fig. 15 is a block diagram showing the configuration of a display device according to one embodiment.

[0030] The present disclosure is susceptible to various modifications and may have one or more embodiments. Embodiments of the present disclosure may be illustrated in the drawings and described in detail in the detailed description. However, it should be understood that the present disclosure is not limited to specific embodiments, but encompasses all modifications, variations, and alternatives according to the embodiments of the present disclosure. Like reference numerals will be assigned to like elements throughout the accompanying drawings.

[0031] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a,” “b,” “c,” “a and b,” “a and c,” “b and c,” or “all of a, b, and c.”

[0032] The terms used in this disclosure will be briefly explained, and the present invention will be described in detail.

[0033] The terms used in this disclosure have been selected from widely used, current terms, taking into account the functions of the present invention. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant invention. Therefore, the terms used in this disclosure should not be defined simply as names, but rather based on the meanings of the terms and the overall content of the present disclosure.

[0034] When a part of this disclosure is said to "include" a component, unless otherwise specifically stated, this does not exclude other components, but rather implies the inclusion of other components. Furthermore, terms such as "part," "module," and the like described herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.

[0035] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the present invention. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted for clarity of description, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.

[0036] The term "user" in this disclosure means a person who controls a system, function, or operation, and may include a developer, administrator, or installer.

[0037] Additionally, in the present disclosure, 'image' or 'picture' may refer to a still image, a moving image composed of a plurality of consecutive still images (or frames), or a video.

[0038] FIG. 1 is a diagram illustrating various projection environments according to one embodiment.

[0039] A projection device (100) according to one embodiment can project image content onto a screen. The screen onto which the image content is projected can be configured in various forms. If the projection device (100) is a device including a projector, the screen may refer to a physical space where the image content is projected. For example, the screen may include a wall or a screen made of fabric.

[0040] If the projection device (100) is a device that provides VR, AR, or MR, the screen may refer to a display included in the projection device (100). For example, the device that provides VR, AR, or MR may be implemented in the form of a glasses-type wearable device that includes a head-mounted display (HMD) that can be mounted on the head, and may include a display. The display may be a transparent display or an opaque display. The device that provides VR, AR, or MR may output (display) image content to the display.

[0041] Hereinafter, for convenience of explanation, an example is illustrated and described in which the projection device (100) is a device including a projector, but the same can be applied even when the projection device (100) is a device that provides VR, AR, or MR.

[0042] Referring to FIG. 1, when a projection device (100) according to one embodiment projects image content onto a screen, the edge of the screen or the edge (10) of the projected image content is clearly distinguished from the space where the image content is not projected. Accordingly, a viewer (user) viewing the projected image content may feel disconnected from the space where the image content is located and may feel as if the viewing experience is spatially disconnected.

[0043] A projection device (100) according to one embodiment can provide a vignetting effect (20) to the edge area of ​​the projected image content.

[0044] Vignetting can refer to dark shadows or blurring at the edges of a photo or video. This phenomenon is caused by the camera's lens system or optical elements, resulting in less light reaching the edges of the image than the center.

[0045] A projection device (100) according to one embodiment can provide a vignetting effect (20) by generating a shadow (shade) in an area at the edge of projected image content. When the vignetting effect (20) appears in the edge area of ​​projected image content, the sense of disconnection between the space where the image content is displayed and the space where the viewer exists can be minimized. Accordingly, the viewer can focus more on viewing the image content and have a connected viewing experience between the image content space and the real space.

[0046] Referring to the drawings below, operations of a projection device (100) according to one embodiment to process and project image content so that a vignetting effect appears in the edge area of ​​the image content will be described in detail.

[0047] Figure 2 is a flowchart illustrating a method of operating a projection device according to one embodiment.

[0048] Referring to FIG. 2, a projection device (100) according to one embodiment can obtain an image to be projected (S210).

[0049] According to one embodiment, the image may be an image previously stored in the projection device (100) or an image received from an external device. However, the present invention is not limited thereto. In addition, the image according to one embodiment may be an image on which various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion have been performed in the video processing unit.

[0050] A projection device (100) according to one embodiment can generate a blurred image based on an acquired image (S220).

[0051] For example, the projection device (100) can generate a blurred image by blurring the acquired image. Blur or blur processing means making the image blurry by reducing the sharpness of the image and applying a soft blur effect.

[0052] The projection device (100) can blur an image by performing filtering. The projection device (100) can perform filtering on an image using various filters. For example, the projection device (100) can perform blur processing using a Gaussian filter (Gaussian blurring), blur processing using an average filter (average blurring), blur processing using a median filter (median blurring), etc. The above filters are merely examples, and the projection device (100) according to an embodiment can perform blur processing using various filters.

[0053] Alternatively or additionally, the projection device (100) may acquire a background original image based on the image to be projected. For example, the projection device (100) may analyze the image to be projected to acquire information about the atmosphere, theme, etc. appearing in the image, and generate a background original image based on the acquired information. Alternatively or additionally, the projection device (100) may receive the background original image from an external device. The projection device (100) may generate a blurred image by performing blur processing on the background original image.

[0054] Alternatively or additionally, the projection device (100) may generate a blurred image by performing blur processing on another image associated with the image to be projected. For example, the other image associated with the image to be projected may include another image stored in the same area as the image to be projected, another image classified into the same group as the image to be projected according to a specific criterion, another image having the same or similar atmosphere as the image to be projected, another image exhibiting the same or similar theme as the image to be projected, etc. However, the present invention is not limited thereto.

[0055] A projection device (100) according to one embodiment can perform image processing to produce a background image by causing a vignetting effect to appear in the edge area of ​​a blurred image (S230).

[0056] According to one embodiment, a projection device (100) can generate a vignetting effect by generating a shadow (shade) in an area at the edge of a blurred image. At this time, the projection device (100) can apply a different vignetting ratio depending on the position of the edge area of ​​the blurred image. The vignetting ratio is a value indicating the degree of vignetting. A larger value increases the dark area, and a smaller value decreases the dark area. This will be described in detail with reference to FIG. 5.

[0057] According to one embodiment, a projection device (100) can apply a vignetting ratio to a blurred image differently over time. Accordingly, a vignetting effect appearing in the edge area of ​​a background image can vary over time.

[0058] A projection device (100) according to one embodiment can synthesize an image to be projected and a background image (S240).

[0059] For example, the projection device (100) can generate a final image by synthesizing the image to be projected onto the background image generated in step 230 (S230). The projection device (100) can generate the final image by scaling the background image or the image to be projected based on the size of the screen. At this time, the final image may be an image in which a vignetting effect appears in the area around the edge of the image to be projected.

[0060] A projection device (100) according to one embodiment can project a final image onto a screen or space (S250).

[0061] By projecting the final image with a vignetting effect around the edges of the image to be projected, the user or viewer can focus more on watching the image content and have a viewing experience that is connected to the image content space and the real space.

[0062] FIG. 3 is a flowchart illustrating a method for a projection device according to one embodiment to generate an image including a vignetting effect, and FIG. 4 is a drawing referenced in the description of FIG. 3.

[0063] Referring to FIGS. 3 and 4, a projection device (100) according to one embodiment can obtain an image (410) to be projected (S310).

[0064] According to one embodiment, a projection device (100) determines whether an image (410) includes a letter box (S320), and if so, removes the letter box from the image (410) (S330). A letter box may refer to a black bar appearing in the upper, lower, left, or right areas of an image.

[0065] According to one embodiment, a projection device (100) can add black padding (420) to the upper, lower, left, and right areas of an image (410) from which a letter box has been removed or an image that does not include a letter box (S340).

[0066] Padding refers to expanding the edges of an image by filling them with additional values. Black padding means setting the filled pixel values ​​to 0, and can be referred to as zero padding.

[0067] According to one embodiment, a projection device (100) can mask a central area of ​​an image (410) and perform blur processing to generate a blurred image (S350).

[0068] The projection device (100) can blur the image (410) by performing filtering. Blur processing using a filter has been described in detail in step 220 (S220) of FIG. 2, so a detailed description will be omitted.

[0069] When performing blur processing, by masking the central area of ​​the image (410), the masked area (430) does not need to undergo blur processing operations, thereby reducing the overall amount of computation. The size of the masked area (430) can be adjusted according to the size of the image (410).

[0070] The blur image (440) generated in step 350 (S350) of FIG. 3 may include a vignetting effect due to the black padding (420) added in step 340 (S340) of FIG. 3.

[0071] According to one embodiment, a projection device (100) can perform image processing to produce an additional vignetting effect in the edge area of ​​a blurred image (440) to generate a background image (450) (S360).

[0072] The projection device (100) can create a vignetting effect by generating a shadow (shade) in the area at the edge of the blurred image (440). At this time, the projection device (100) can apply a different vignetting ratio depending on the location of the edge area. This will be described with reference to FIG. 5.

[0073] FIG. 5 is a drawing showing an example in which a projection device according to one embodiment performs image processing by applying different vignetting ratios.

[0074] Referring to FIG. 5, the projection device (100) according to one embodiment can apply a different vignetting ratio depending on the position of the edge area of ​​the blurred image (510). For example, the projection device (100) can perform image processing by applying a function representing the vignetting ratio according to the position of each of the upper, lower, left, and right edge areas. The projection device (100) can perform vignetting by applying a first function (525) to the upper edge area (520) of the blurred image (510). At this time, the first function (525) can be a function in which the horizontal position of the upper edge area (520) is the x-axis and the vignetting ratio is the y-axis.

[0075] Additionally, the projection device (100) can perform vignetting by applying a second function (535) to the right edge area (530) of the blurred image (510). At this time, the second function (535) may be a function that uses the vertical position of the right edge area (530) as the x-axis and the vignetting ratio as the y-axis.

[0076] Additionally, the projection device (100) can perform vignetting by applying a third function (545) to the lower edge area (540) of the blurred image (510). At this time, the third function (545) may be a function that uses the horizontal position of the lower edge area (540) as the x-axis and the vignetting ratio as the y-axis.

[0077] Additionally, the projection device (100) can perform vignetting by applying a fourth function (555) to the left edge area (550) of the blurred image (510).

[0078] The vignetting ratio indicated in each of the first to fourth functions (525, 535, 545, 555) according to one embodiment may indicate the ratio of dark areas. For example, in a location where the vignetting ratio is high, the ratio of dark areas may be high (570), and in a location where the vignetting ratio is low, the ratio of dark areas may be low (560).

[0079] Additionally, each of the first to fourth functions (525 to 555) may be a function whose y value (vignetting ratio) changes over time. Accordingly, the vignetting effect of the projected image may change over time.

[0080] Referring again to FIGS. 3 and 4, a projection device (100) according to one embodiment can synthesize an image to be projected (410) and a background image (450) (S370).

[0081] The projection device (100) can scale the background image (450) or the image to be projected (410) based on the size of the screen to generate a final image (460). At this time, the final image (460) may be an image in which a vignetting effect appears in an area around the edge of the image to be projected (410).

[0082] A projection device (100) according to one embodiment can project a final image (460) including a vignetting effect onto a screen or space.

[0083] FIG. 6 is a flowchart illustrating a method for a projection device according to one embodiment to generate an image including a vignetting effect, and FIG. 7 is a drawing referenced in the description of FIG. 6.

[0084] Referring to FIGS. 6 and 7, a projection device (100) according to one embodiment can obtain an image (710) to be projected (S610).

[0085] According to one embodiment, a projection device (100) determines whether a letter box is included in an image (710) (S620), and if a letter box is included, the letter box can be removed from the image (710) (S630).

[0086] According to one embodiment, a projection device (100) can mask a middle area (720) of an image (710) from which a letter box has been removed or an image that does not include a letter box, and perform blur processing to generate a blurred image (730) (S640).

[0087] The projection device (100) can blur an image (710) by performing filtering. Blur processing using a filter has been described in detail in step 220 (S220) of FIG. 2, so a detailed description will be omitted.

[0088] When performing blur processing, by masking the central area of ​​the image (710), the masked area (720) does not need to undergo blur processing operations, thereby reducing the overall amount of computation. The size of the masked area (720) can be adjusted according to the size of the image (710).

[0089] According to one embodiment, a projection device (100) can perform image processing to produce a vignetting effect in the edge area of ​​a blurred image (730) to generate a background image (740) (S650).

[0090] The projection device (100) can create a vignetting effect by generating a shadow (shade) in the area at the edge of the blurred image (730). At this time, the projection device (100) can apply a different vignetting ratio depending on the location of the edge area. This has been described in detail with reference to FIG. 5, so a detailed description thereof will be omitted.

[0091] A projection device (100) according to one embodiment can synthesize an image to be projected (710) and a background image (740) (S660).

[0092] The projection device (100) can scale the background image (740) or the image to be projected (710) based on the size of the screen to generate a final image (750). At this time, the final image (750) may be an image in which a vignetting effect appears in an area around the edge of the image to be projected (710).

[0093] A projection device (100) according to one embodiment can project a final image (750) including a vignetting effect onto a screen or space.

[0094] FIG. 8 is a flowchart illustrating a method by which a projection device according to one embodiment generates an image including a vignetting effect.

[0095] Referring to FIG. 8, a projection device (100) according to one embodiment can obtain an image to be projected (S810).

[0096] According to one embodiment, a projection device (100) determines whether a letter box is included in an image (S820), and if a letter box is included, the letter box can be removed from the image (S830).

[0097] According to one embodiment, a projection device (100) can mask a central area of ​​an image from which a letter box has been removed or an image that does not include a letter box, and perform blur processing to generate a first blurred image (S840).

[0098] The projection device (100) can blur an image by performing filtering. Blur processing using a filter has been described in detail in step 220 (S220) of FIG. 2, so a detailed description thereof will be omitted.

[0099] By masking the central area of ​​an image during blur processing, the masked area does not require blur processing operations, reducing the overall computational effort. The size of the masked area can be adjusted according to the size of the image.

[0100] According to one embodiment, a projection device (100) can add black padding to the upper, lower, left, and right areas of a first blur image, and perform blur processing on the first blur image to which black padding has been added, thereby generating a second blur image (S850).

[0101] By masking the central area of ​​an image during blur processing, the masked area does not require blur processing operations, reducing the overall computational effort. The size of the masked area can be adjusted according to the size of the image.

[0102] The second blurred image generated by blur processing may include a vignetting effect due to black padding.

[0103] A projection device (100) according to one embodiment can perform image processing to create an additional vignetting effect in the edge area of ​​a second blurred image, thereby generating a background image (S860).

[0104] The projection device (100) can create a vignetting effect by generating a shadow (shade) in the edge area of ​​the second blurred image. At this time, the projection device (100) can apply a different vignetting ratio depending on the position of the edge area. This has been described in detail with reference to FIG. 5, so a detailed description thereof will be omitted.

[0105] A projection device (100) according to one embodiment can synthesize an image to be projected and a background image (S870).

[0106] The projection device (100) can scale a background image or an image to be projected based on the size of the screen to generate a final image. In this case, the final image may be an image in which a vignetting effect appears in an area around the edges of the image to be projected.

[0107] A projection device (100) according to one embodiment can project a final image including a vignetting effect onto a screen or space.

[0108] FIG. 9 is a drawing for explaining an operation of a projection device according to one embodiment to set a background image.

[0109] Referring to FIG. 9, a projection device (100) according to one embodiment can set a background original image to be blurred. The projection device (100) according to one embodiment can project a background image setting menu screen (910) onto a screen or space. The setting menu screen according to one embodiment can include menus for setting a background original image to be blurred.

[0110] A projection device (100) according to one embodiment can receive user input for selecting menus through a control device (900) and set a background original image based on the user input.

[0111] The setting menu screen (910) may include a first menu (920) that can set an image to be projected as a background original image. When the on / off button included in the first menu (920) is set to on, the projection device (100) can perform blur processing on the image to be projected to generate a blurred image.

[0112] Additionally, the setting menu screen (910) may include a second menu (930) that turns the automatic setting function on / off. When the automatic setting function is turned on, the projection device (100) analyzes the image to be projected, extracts the atmosphere or theme of the image to be projected, and generates or receives a background original image corresponding to the extracted atmosphere or theme from an external device. However, the present invention is not limited thereto.

[0113] Additionally, the settings menu screen (910) may include a third menu (940) that allows the user to set the mood or theme of the background original image. The user can directly set the mood or theme of the background original image using the third menu (940). When the mood or theme of the background original image is set by the user, the projection device (100) may generate a background original image corresponding to the set mood or theme, or receive it from an external device. However, the present invention is not limited thereto.

[0114] FIG. 10 is a drawing for explaining an operation of generating a background original image based on an image to be projected by a projection device according to one embodiment.

[0115] Referring to FIG. 10, a projection device (100) according to one embodiment may include an image analysis module (1020) that analyzes an image (1010) to be projected and obtains information about the atmosphere or theme of the image (1010). The image analysis module (1020) may include appropriate logic, circuits, interfaces, and / or codes that operate to analyze the image (1010) and obtain information about the atmosphere or theme of the image (1010).

[0116] The video analysis module (1020) can obtain information about the atmosphere of the video (1010), which represents the overall tone or feeling of the video (1010) related to the emotions and feelings conveyed to the viewer, by analyzing the color, lighting, tone, etc. of the video (1010). In addition, the video analysis module (1020) can obtain information about the theme of the video (1010), etc., by extracting information about objects included in the video (1010). However, the present invention is not limited thereto.

[0117] The image analysis module (1020) may include one or more neural networks. According to one embodiment, the image analysis module (1020) may obtain information about the mood or theme of the image (1010) using one or more neural networks. For example, the image analysis module (1020) may input the image (1010) into one or more neural networks, thereby outputting information about the mood or theme of the image (1010) as result data.

[0118] In order for these neural networks to accurately output output data corresponding to input data, the neural network must be trained according to the purpose. Here, 'training' can mean training the neural network so that it can discover or learn on its own how to input various data into the neural network, how to analyze the input data, how to classify the input data, and / or how to extract features to generate output data from the input data. Specifically, through the learning process, the neural network can learn the training data and optimize and set the weight values ​​within the neural network. Then, by learning the input data on its own through the neural network with the optimized weight values, it outputs the desired result.

[0119] For example, through training, the weight values ​​within one or more neural networks can be optimized so that they analyze an image and output information about the image's mood or theme. Accordingly, one or more trained neural networks can receive an image as input and output information about the image's mood or theme in various ways.

[0120] In addition, the projection device (100) according to one embodiment may include an image generation module (1030) that generates a background original image (1040) based on information obtained by analyzing the image (1010) (e.g., information about the atmosphere or theme of the image (1010).

[0121] The image generation module (1030) may include appropriate logic, circuitry, interfaces, and / or codes that operate to generate a background original image (1040) based on information obtained by analyzing the image (1010).

[0122] The image generation module (1030) may include one or more neural networks. According to one embodiment, the image generation module (1030) may generate a background original image (1040) using one or more neural networks. For example, the image generation module (1030) may input information obtained by analyzing the image (1919) (e.g., information about the mood or theme of the image (1010)) into one or more neural networks, thereby outputting a background original image (1040) as result data.

[0123] For example, through training, the weight values ​​within one or more neural networks can be optimized so that the neural networks can output a generated background original image based on information (e.g., information about the mood or theme of the image) acquired by analyzing the image. Accordingly, one or more neural networks that have completed training can receive information (e.g., information about the mood or theme of the image) acquired by analyzing the image and output the background original image in various ways. However, this is not limited thereto.

[0124] A projection device (100) according to one embodiment can perform blur processing on a background original image (1040) to generate a blurred image. The method for performing blur processing has been described in detail in step 220 (S220) of FIG. 2, so a detailed description thereof will be omitted.

[0125] In addition, the projection device (100) can generate a background image by performing image processing so that a vignetting effect appears in the edge area of ​​the blurred image. The projection device (100) can generate a vignetting effect by generating a shadow (shade) in the edge area of ​​the blurred image. This has been described in detail in step 230 (S230) of FIG. 2, so a detailed description thereof will be omitted.

[0126] FIG. 11 is a drawing for explaining an operation of a projection device according to one embodiment to generate a background image.

[0127] Referring to FIG. 11, the image to be projected may be an image included in a slide show (1100). The projection device (100) according to one embodiment may generate a background image using one of the other images included in the slide show (1100).

[0128] For example, when projecting a first image (1110) included in a slide show (1100), a first blurred image can be generated by performing blur processing on a second image (1120) included in the same slide show (1100). The projection device (100) can perform image processing so that a vignetting effect is included in the generated first blurred image, thereby generating a first background image. The projection device (100) can project an image obtained by synthesizing the first image (1110) with the first background image onto a screen or space.

[0129] In addition, when projecting a second image (1120) included in a slide show (1100), a second blurred image can be generated by performing blur processing on a third image (1130) included in the same slide show (1100). The projection device (100) can generate a second background image by performing image processing so that the generated second blurred image includes a vignetting effect. The projection device (100) can project an image obtained by synthesizing the second image (1120) with the second background image onto a space or screen.

[0130] FIG. 12 is a drawing for explaining an operation of a projection device according to one embodiment to generate a background image.

[0131] Referring to FIG. 12, a projection device (100) according to one embodiment can project video content (1200) including a plurality of frame images. The projection device (100) according to one embodiment can detect a frame image in which a scene changes among the plurality of frame images included in the video content (1200), and can generate a blur image using the frame image in which the scene changes.

[0132] A projection device (100) according to one embodiment can extract features from each of a plurality of frame images and detect scene changes based on differences between the extracted features. However, the present invention is not limited thereto.

[0133] For example, as illustrated in FIG. 12, the projection device (100) can detect a scene change in a first frame image (1210). The projection device (100) can generate a first blurred image (1215) by performing blur processing on the first frame image (1210). The projection device (100) can generate a first background image by performing image processing so that a vignetting effect is included in the generated first blurred image (1215). The projection device (100) can project an image obtained by synthesizing the first frame image (1210) with the first background image onto a screen or space.

[0134] In addition, the projection device (100) can perform image processing to include a vignetting effect in the first blur image (1215) when there is no scene change in the second frame image (1220) and the third frame image (1230), thereby generating the second background image and the third background image. The projection device (100) can project an image obtained by synthesizing the second frame image (1220) with the second background image and an image obtained by synthesizing the third frame image (1230) with the third background image onto a screen or space.

[0135] In addition, when a scene change is detected in the fourth frame image (1240), the projection device (100) can generate a second blurred image (1245) by performing blur processing on the fourth frame image (1240). The projection device (100) can generate a fourth background image by performing image processing so that the generated second blurred image (1245) includes a vignetting effect. The projection device (100) can project an image obtained by synthesizing the fourth frame image (1240) with the fourth background image onto a screen or space.

[0136] In addition, the projection device (100) can perform image processing to include a vignetting effect in the second blur image (1245) when there is no scene change in the fifth frame image (1250), thereby generating a fifth background image. The projection device (100) can project an image obtained by synthesizing the fifth frame image (1250) with the fifth background image onto a screen or space.

[0137] Fig. 13 is a block diagram showing the configuration of a projection device according to one embodiment.

[0138] Referring to FIG. 13, a projection device (100) according to one embodiment may include a communication unit (110), a processor (120), a memory (130), and a projector (140).

[0139] According to one embodiment, the communication unit (110) can transmit and receive data or signals with an external device or server. For example, the communication unit (110) can include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, a LAN module, an Ethernet module, a wired communication module, etc. In this case, each communication module can be implemented in the form of at least one hardware chip.

[0140] The Wi-Fi module and Bluetooth module perform communication in the Wi-Fi and Bluetooth modes, respectively. When using the Wi-Fi module or Bluetooth module, various connection information such as the SSID and session key are first transmitted and received, and after establishing a communication connection using this, various information can be transmitted and received. The wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0141] According to one embodiment, the communication unit (110) can receive an image or image content to be projected from an external device. Furthermore, according to one embodiment, the communication unit (110) can communicate with a control device. The communication unit (110) can receive a signal corresponding to a user input from the control device.

[0142] According to one embodiment, a processor (120) controls the overall operation of the projection device (100) and the signal flow between internal components of the projection device (100), and performs a function of processing data.

[0143] The processor (120) may include single cores, dual cores, triple cores, quad cores, and multiples thereof. Furthermore, the processor (120) may include one processor or multiple processors. For example, the processor (120) may be implemented as a main processor and a sub processor.

[0144] Additionally, the processor (120) may include at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and a VPU (Video Processing Unit). According to an embodiment, the processor (120) may be implemented in the form of a SoC (System On Chip) that integrates at least one of a CPU, a GPU, and a VPU. The processor (120) may further include an NPU (Neural Processing Unit).

[0145] The memory (130) may include one memory or a plurality of memories. According to one embodiment, the memory (130) may store various data, programs, or applications for driving and controlling the projection device (100).

[0146] Additionally, the program stored in the memory (130) may include one or more instructions. The program (one or more instructions) or application stored in the memory (130) may be executed by the processor (120).

[0147] According to one embodiment, the processor (120) can obtain an image to be projected by executing one or more instructions stored in the memory (130). The image according to one embodiment may be an image previously stored in the memory (130) or an image received from an external device via the communication unit (110). In addition, the image may be an image on which various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion are performed in the video processing unit.

[0148] According to one embodiment, the processor (120) may generate a blurred image based on an image by executing one or more instructions stored in the memory (130). For example, the processor (120) may generate a blurred image by blurring the image. Here, blurring or blurring refers to making the image blurry by reducing the sharpness of the image and applying a soft blurring effect.

[0149] The processor (120) according to one embodiment can blur an image by performing filtering. The processor (120) can perform filtering on an image using various filters. For example, the processor (120) can perform blur processing using a Gaussian filter (Gaussian blurring), blur processing using an average filter (average blurring), blur processing using a median filter (median blurring), etc. The above filters are merely examples, and the processor (120) according to one embodiment can perform blur processing using various filters.

[0150] The processor (120) can obtain an image to be blurred (e.g., a background original image) based on the image to be projected. For example, the processor (120) can analyze the image to be projected, obtain information about the atmosphere, theme, etc. appearing in the image, and generate a background original image based on the obtained information. The processor (120) can receive a background original image corresponding to the information obtained from an external device through the communication unit (110). The processor (120) can generate a blurred image by performing blur processing on the background original image.

[0151] The processor (120) can generate a blurred image by performing blur processing on another image associated with the image to be projected. For example, the other image associated with the image to be projected may include another image stored in the same area as the image to be projected, another image classified into the same group as the image to be projected according to a specific criterion, another image having the same or similar atmosphere as the image to be projected, another image exhibiting the same or similar theme as the image to be projected, etc. However, the present invention is not limited thereto.

[0152] According to one embodiment, the processor (120) can perform image processing to produce a background image by executing one or more instructions stored in the memory (130) to produce a vignetting effect at the edge of a blurred image.

[0153] According to one embodiment, the processor (120) can generate a vignetting effect by generating a shadow (shade) in an area at the edge of a blurred image. At this time, the processor (120) can apply a different vignetting ratio depending on the location of the edge area. The vignetting ratio is a value indicating the degree of vignetting. A larger value increases the dark area, and a smaller value decreases the dark area.

[0154] According to one embodiment, the processor (120) may apply a vignetting ratio to a blurred image differently over time. Accordingly, the vignetting effect appearing in the edge area of ​​the background image may vary over time.

[0155] According to one embodiment, the processor (120) may synthesize an image to be projected and a background image by executing one or more instructions stored in the memory (130). For example, the processor (120) may generate a final image by synthesizing the image to be projected with the generated background image. At this time, the processor (120) may generate the final image by scaling the background image or the image to be projected based on the size of the screen. The final image may be an image in which a vignetting effect appears in an area around the edge of the image to be projected.

[0156] The processor (120) can control the projector (140) to project a final image synthesized from the background image and the image to be projected onto a screen or space.

[0157] A projector (140) according to one embodiment may include a light source that generates light, a lens, etc., and may further include a driving unit that adjusts the direction, position, angle, etc. of projection. The projector (140) may perform projection of a final image by driving the light source or adjusting the direction, position, angle, etc. of projection according to a control signal received from the processor (120).

[0158] By providing a vignetting effect around the edges of a projected image according to one embodiment, a user or viewer watching the image can focus more on watching the image and have a viewing experience in which the space where the image is projected and the real space are connected.

[0159] The block diagram of the projection device (100) illustrated in FIG. 13 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the projection device (100) actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0160] FIG. 14 is a drawing illustrating a display device that displays an image including a vignetting effect according to one embodiment.

[0161] Referring to FIG. 14, a display device (1400) according to one embodiment may include a display as a device for processing an image signal and displaying an image.

[0162] A display device (1400) according to one embodiment may be implemented in various forms, such as a TV including a display, a smart monitor, a mobile phone, a smart phone, a tablet PC, a digital camera, a camcorder, a laptop computer, a desktop, an e-book reader, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, a DVD (Digital Video Disk) player, a wearable device, a video wall, a digital signage, a DID (Digital Information Display), a projector display, a refrigerator, a washing machine, and the like. In addition, the display device (1400) may be a fixed electronic device placed in a fixed location or a mobile electronic device having a portable form, and may be a digital broadcasting receiver capable of receiving digital broadcasting. However, the present invention is not limited thereto.

[0163] A display device (1400) according to one embodiment can provide a vignetting effect to an image displayed on a display. The display device (1400) according to one embodiment can perform the same operations as the projection device (100) described in FIGS. 1 to 13.

[0164] For example, the display device (1400) may generate a blurred image based on an image to be displayed, and perform image processing to create a vignetting effect in the edge area of ​​the blurred image, thereby generating a background image. The display device (1400) may synthesize the image to be displayed into the background image, and display the synthesized image on the display.

[0165] A display device (1400) according to one embodiment may determine whether to apply a vignetting effect based on user input. For example, if a vignetting function that applies a vignetting effect based on user input is activated, the display device (1400) may process an image so that a vignetting effect appears in the edge area of ​​the image displayed on the display.

[0166] The display device (1400) can determine whether to apply a vignetting effect based on the ambient illuminance. For example, the display device (1400) can obtain illuminance information surrounding the display device, and if the ambient illuminance value is below a threshold value (when the video viewing environment is dark), the display device (1400) can process the image so that a vignetting effect appears in the edge area of ​​the image displayed on the display.

[0167] Fig. 15 is a block diagram showing the configuration of a display device according to one embodiment.

[0168] The display device (1500) of FIG. 15 may be an embodiment of the display device (1400) of FIG. 14.

[0169] Referring to FIG. 15, a display device (1500) according to one embodiment may include a tuner unit (1540), a processor (1510), a display (1520), a communication unit (1550), a detection unit (1530), an input / output unit (1570), a video processing unit (1580), an audio processing unit (1585), an audio output unit (1560), a memory (1590), and a power supply unit (1595).

[0170] A tuner unit (1540) according to one embodiment can select and tune only the frequency of a channel to be received by a display device (1500) among many radio wave components through amplification, mixing, resonance, etc. of a broadcast signal received wired or wirelessly. The broadcast signal includes audio, video, and additional information (e.g., EPG (Electronic Program Guide)).

[0171] The tuner unit (1540) can receive broadcast signals from various sources, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, and Internet broadcasting. The tuner unit (1540) can also receive broadcast signals from sources, such as analog broadcasting or digital broadcasting.

[0172] According to one embodiment, the communication unit (1550) can transmit and receive data or signals with an external device or server. For example, the communication unit (1550) can include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, a LAN module, an Ethernet module, a wired communication module, etc. In this case, each communication module can be implemented in the form of at least one hardware chip.

[0173] Wi-Fi modules and Bluetooth modules communicate using Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi module or Bluetooth module, various connection information such as SSID and session key are first transmitted and received, and then various information can be transmitted and received after establishing a communication connection using this. Wireless communication modules include Zigbee, 3G (3 rd Generation), 3GPP(3 rd Generation Partnership Project), Long Term Evolution (LTE), LTE Advanced (LTE-A), 4G (4 thGeneration), 5G(5 th It may include at least one communication chip that performs communication according to various wireless communication standards such as (Generation).

[0174] According to one embodiment, the communication unit (1550) may receive a control signal or a control command, etc. from an external control device. For example, the communication unit (1550) may include an IR module capable of transmitting and receiving signals with the external control device according to the IR communication standard. Specifically, the communication unit (1550) may receive a control signal or a control command, etc. corresponding to a user input (e.g., a key or button input of the control device, etc.) from the control device.

[0175] According to one embodiment, a detection unit (1530) detects a user's voice, a user's image, or a user's interaction, and may include a microphone (1531), a camera unit (1532), and a light receiving unit (1533).

[0176] The microphone (1531) receives the user's spoken voice. The microphone (1531) can convert the received voice into an electrical signal and output it to the processor (1510). The user's voice may include, for example, a voice corresponding to a menu or function of the display device (1500). For example, the microphone (1531) can receive a user's voice corresponding to a rotation command of the display (1520), convert the received voice into an electrical signal, and output it to the processor (1510).

[0177] The camera unit (1532) can receive an image (e.g., a series of frames) corresponding to a user's motion including a gesture within the camera recognition range. The processor (1510) can use the recognition result of the received motion to select a menu displayed on the display device (1500) or perform a control corresponding to the motion recognition result. For example, the processor (1510) can receive an image from the camera unit (1532), recognize a user's motion corresponding to the rotation of the display (1520) from the received image, and rotate the display (1520) in response to the recognition result.

[0178] The optical receiver (1533) receives an optical signal (including a control signal) from an external control device through an optical window of the bezel of the display unit (1520), etc. The optical receiver (1533) can receive an optical signal corresponding to a user input (e.g., touch, pressing, touch gesture, voice, or motion) from the control device. A control signal can be extracted from the received optical signal under the control of the processor (1510).

[0179] The input / output unit (1570) according to one embodiment can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the display device (1500). The input / output unit (1570) can include any one of a High-Definition Multimedia Interface (HDMI), a Mobile High-Definition Link (MHL), a Universal Serial Bus (USB), a Display Port (DP), a Thunderbolt, a Video Graphics Array (VGA) port, an RGB port, a D-subminiature (D-SUB), a Digital Visual Interface (DVI), a component jack, and a PC port.

[0180] A video processing unit (1580) according to one embodiment performs processing on video data received by a display device (1500). The video processing unit (1580) can perform various image processing operations, such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on the video data.

[0181] The processor (1510) may include single cores, dual cores, triple cores, quad cores, and multiples thereof. Furthermore, the processor (1510) may include multiple processors. For example, the processor (1510) may be implemented as a main processor and a subprocessor operating in sleep mode.

[0182] Additionally, the processor (1510) may include at least one of a Central Processing Unit (CPU), a Graphic Processing Unit (GPU), and a Video Processing Unit (VPU). According to an embodiment, the processor (1510) may be implemented in the form of a System On Chip (SoC) that integrates at least one of a CPU, a GPU, and a VPU. The processor (1510) may further include a Neural Processing Unit (NPU).

[0183] The processor (1510) may include a RAM that stores signals or data input from the outside of the display device (1500) or is used as a storage area corresponding to various tasks performed in the display device (1500), a ROM that stores a control program for controlling the display device (1500), and a processor.

[0184] According to one embodiment, the memory (1590) can store various data, programs or applications for driving and controlling the display device (1500).

[0185] Additionally, the program stored in the memory (1590) may include one or more instructions. The program (one or more instructions) or application stored in the memory (1590) may be executed by the processor (1510).

[0186] According to one embodiment, the processor (1510) may obtain an image to be displayed by executing one or more instructions stored in the memory (1590). The image according to one embodiment may be an image previously stored in the memory (1590) or an image received from an external device through the tuner unit (1540) or the communication unit (1550). In addition, the image may be an image on which various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion are performed in the video processing unit (1580).

[0187] According to one embodiment, the processor (1510) may generate a blurred image based on an image by executing one or more instructions stored in the memory (1590). For example, the processor (1510) may generate a blurred image by blurring the image. Here, blurring or blurring refers to making the image blurry by reducing the sharpness of the image and applying a soft blurring effect.

[0188] A processor (1510) according to one embodiment can blur an image by performing filtering. The processor (1510) can perform filtering on an image using various filters. For example, the processor (1510) can perform blur processing using a Gaussian filter (Gaussian blurring), blur processing using an average filter (average blurring), blur processing using a median filter (median blurring), etc. The above filters are merely examples, and the processor (1510) according to one embodiment can perform blur processing using various filters.

[0189] The processor (1510) may acquire an image to be blurred (e.g., a background original image) based on an image to be displayed. For example, the processor (1510) may analyze the image to be displayed, acquire information about the mood, theme, etc. appearing in the image, and generate a background original image based on the acquired information. The processor (1510) may receive a background original image corresponding to the information acquired from an external device via the communication unit (1550). The processor (1510) may generate a blurred image by performing blur processing on the background original image.

[0190] The processor (1510) can generate a blurred image by performing blur processing on another image associated with the image to be displayed. For example, the other image associated with the image to be displayed may include another image stored in the same area as the image to be displayed, another image classified into the same group as the image to be displayed based on specific criteria, another image having the same or similar atmosphere as the image to be displayed, another image exhibiting the same or similar theme as the image to be displayed, etc. However, the present invention is not limited thereto.

[0191] According to one embodiment, a processor (1510) may perform image processing to produce a background image by executing one or more instructions stored in the memory (1590) to produce a vignetting effect at the edge of a blurred image.

[0192] According to one embodiment, a processor (1510) can generate a vignetting effect by generating a shadow (shade) in an area at the edge of a blurred image. At this time, the processor (1510) can apply a different vignetting ratio depending on the position of the edge area. The vignetting ratio is a value indicating the degree of vignetting. A larger value increases the dark area, and a smaller value decreases the dark area.

[0193] According to one embodiment, the processor (1510) may apply a vignetting ratio to a blurred image differently over time. Accordingly, the vignetting effect appearing in the edge area of ​​the background image may vary over time.

[0194] According to one embodiment, the processor (1510) may synthesize an image to be displayed and a background image by executing one or more instructions stored in the memory (1590). For example, the processor (1510) may generate a final image by synthesizing the image to be displayed with the generated background image. At this time, the processor (1510) may generate the final image by scaling the background image or the image to be displayed based on the size of the screen. The final image may be an image in which a vignetting effect appears in an area around the edge of the image to be displayed.

[0195] The processor (1510) can control the display (1520) to display a final image that is a composite of a background image and an image to be displayed.

[0196] A display (1520) according to one embodiment converts image signals, data signals, OSD signals, control signals, etc. processed by a processor (1510) to generate a driving signal. The display (1520) may be implemented as a PDP, LCD, OLED, flexible display, etc., and may also be implemented as a 3D display. In addition, the display (1520) may be configured as a touch screen and may be used as an input device in addition to an output device.

[0197] According to one embodiment, a display (1520) can display a final image synthesized with a background image including a vignetting effect and an image to be displayed, under the control of a processor (1510).

[0198] The audio processing unit (1585) processes audio data. The audio processing unit (1585) may perform various processing operations, such as decoding, amplification, and noise filtering, on audio data. Meanwhile, the audio processing unit (1585) may include multiple audio processing modules to process audio corresponding to multiple contents.

[0199] The audio output unit (1560) outputs audio included in a broadcast signal received through the tuner unit (1540) under the control of the processor (1510). The audio output unit (1560) can output audio (e.g., voice, sound) input through the communication unit (1550) or the input / output unit (1570). In addition, the audio output unit (1560) can output audio stored in the memory (1590) under the control of the processor (1510). The audio output unit (1560) can include at least one of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface:) output terminal.

[0200] The power supply unit (1595) supplies power input from an external power source to components inside the display device (1500) under the control of the processor (1510). In addition, the power supply unit (1595) can supply power output from one or more batteries located inside the display device (1500) to the internal components under the control of the processor (1510).

[0201] The memory (1590) can store various data, programs, or applications for driving and controlling the display device (1500) under the control of the processor (1510). The memory (1590) can include a broadcast reception module (not shown), a channel control module, a volume control module, a communication control module, a voice recognition module, a motion recognition module, an optical reception module, a display control module, an audio control module, an external input control module, a power control module, a power control module for an external device connected wirelessly (e.g., Bluetooth), a voice database (DB), or a motion database (DB). The modules and database of the memory (1590) can be implemented in the form of software to perform a broadcast reception control function, a channel control function, a volume control function, a communication control function, a voice recognition function, a motion recognition function, an optical reception control function, a display control function, an audio control function, an external input control function, a power control function, or a power control function for an external device connected wirelessly (e.g., Bluetooth). The processor (1510) can perform each function using the software stored in the memory (1590).

[0202] The block diagram of the display device (1500) illustrated in FIG. 15 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the display device (1500) actually implemented. That is, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0203] A projection device according to one embodiment may include a projector, a memory storing one or more instructions, and at least one processor executing the one or more instructions.

[0204] The at least one processor can obtain a first image by executing the one or more instructions.

[0205] The at least one processor can generate a blurred image based on the first image by executing the one or more instructions.

[0206] The at least one processor can obtain a background image by performing image processing to cause a vignetting effect to appear in an edge area of ​​the blurred image by executing the one or more instructions.

[0207] The at least one processor can control the projector to project a second image that is a composite of the background image and the first image by executing the one or more instructions.

[0208] The at least one processor can perform the image processing by applying a different vignetting ratio depending on the position of the edge area of ​​the blurred image by executing the one or more instructions.

[0209] The at least one processor may perform the image processing so that the vignetting effect appearing in the edge area of ​​the background image varies over time by executing the one or more instructions.

[0210] The at least one processor can generate the blurred image by performing blur processing on the first image by executing the one or more instructions.

[0211] The at least one processor can generate the blurred image by performing masking processing on a central region of the first image and blurring the masked first image by executing the one or more instructions.

[0212] The at least one processor may generate the blurred image by adding black padding to an edge of the first image and blurring the first image to which the black padding has been added by executing the one or more instructions.

[0213] The at least one processor can generate the blurred image by removing the letter box from the first image based on the first image including the letter box by executing the one or more instructions and performing blur processing on the first image from which the letter box has been removed.

[0214] The at least one processor can obtain a third image based on the first image by executing the one or more instructions, and generate the blurred image by performing blur processing on the third image.

[0215] The at least one processor can analyze the first image by executing the one or more instructions to obtain at least one of the mood and theme of the first image, and obtain the third image based on at least one of the mood and theme of the first image.

[0216] A method of operating a projection device according to one embodiment may include a step of acquiring a first image.

[0217] A method of operating a projection device according to one embodiment may include a step of generating a blurred image based on the first image.

[0218] A method of operating a projection device according to one embodiment may include a step of obtaining a background image by performing image processing so that a vignetting effect appears in an edge area of ​​the blurred image.

[0219] A method of operating a projection device according to one embodiment may include a step of projecting a second image that is a composite of the background image and the first image.

[0220] The step of obtaining the above background image may include a step of performing the image processing by applying a different vignetting ratio depending on the position of the edge area of ​​the blurred image.

[0221] The step of obtaining the background image may include a step of performing image processing so that the vignetting effect appearing in the edge area of ​​the background image varies over time.

[0222] The step of generating the above-mentioned blurred image may include a step of generating the above-mentioned blurred image by performing blur processing on the above-mentioned first image.

[0223] The step of generating the above-mentioned blurred image may include the step of masking a central area of ​​the first image, and the step of blurring the masked first image to generate the blurred image.

[0224] The step of generating the above-mentioned blurred image may include the step of adding black padding to the edge of the first image, and the step of blurring the first image to which the black padding has been added, thereby generating the blurred image.

[0225] The method of operating the projection device may further include a step of removing a letter box from the first image based on the fact that the first image includes a letter box, and the step of generating a blurred image may include a step of generating the blurred image by performing blur processing on the first image from which the letter box has been removed.

[0226] The step of generating the above-described blurred image may include the step of obtaining a third image based on the first image, and the step of generating the blurred image by performing blur processing on the third image.

[0227] The step of obtaining a third image based on the first image may include the step of analyzing the first image to obtain at least one of the mood and theme of the first image, and the step of obtaining the third image based on at least one of the mood and theme of the first image.

[0228] A projection device according to one embodiment can provide a vignetting effect by generating a shadow (shade) in an area at the edge of projected image content.

[0229] By applying a vignetting effect to the edges of projected video content, the sense of disconnect between the space where the video content is displayed and the viewer's presence can be minimized. This allows viewers to focus more on the video content and experience a connected viewing experience between the video content space and the real world.

[0230] According to one embodiment, a method of operating a projection device or a method of operating a display device may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the medium may be those specially designed and configured for the present invention or may be those known to and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0231] Additionally, the method of operating a projection device or a method of operating a display device according to the disclosed embodiments may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a commodity.

[0232] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable app) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a storage medium of a manufacturer's server, an electronic marketplace server, or a relay server that temporarily stores the software program.

[0233] In a system comprising a server and a client device, the computer program product may include a storage medium of the server or a storage medium of the client device. If a third device (e.g., a smartphone) exists that communicates with the server or the client device, the computer program product may include a storage medium of the third device. The computer program product may include a software program itself that is transmitted from the server to the client device or the third device, or from the third device to the client device.

[0234] In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Two or more of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0235] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) may execute a computer program product stored on the server, thereby controlling a client device in communication with the server to perform a method according to the disclosed embodiments.

[0236] Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concept of the present invention defined in the following claims also fall within the scope of the present invention.

Claims

1. In the projection device (100), Projector (140); At least one memory (130) storing one or more instructions; and At least one processor (120) for executing one or more of the above instructions, The one or more instructions, when executed by the at least one processor, cause the projection device to Obtain the first image, Based on the first image above, a blurred image is generated, By performing image processing so that a vignetting effect appears in the edge area of ​​the above blurred image, a background image is obtained, A projection device that controls the projector to project a second image that is a composite of the background image and the first image.

2. In paragraph 1, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to A projection device that performs image processing by applying a different vignetting ratio depending on the location of the edge area of ​​the blurred image.

3. In paragraph 1 or 2, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to A projection device that performs image processing so that the vignetting effect appearing in the edge area of ​​the background image varies over time.

4. In any one of paragraphs 1 to 3, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to A projection device that generates the blurred image by performing blur processing on the first image.

5. In paragraph 4, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to Masking the central area of ​​the first image, A projection device that blurs the first image that has been masked to generate the blurred image.

6. In paragraph 4 or 5, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to Add black padding to the edges of the first image above, A projection device that blurs a first image to which the black padding has been added, thereby generating the blurred image.

7. In any one of paragraphs 1 to 6, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to Based on the fact that the first image contains a letter box, the letter box is removed from the first image, A projection device that performs blur processing on a first image from which the letter box has been removed to generate the blurred image.

8. In any one of paragraphs 1 to 3, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to Based on the first image above, a third image is obtained, A projection device that generates the blurred image by performing blur processing on the third image.

9. In paragraph 8, The above one or more instructions, when executed by the at least one processor (120), cause the projection device to By analyzing the first image, at least one of the mood and theme of the first image is obtained, A projection device that obtains the third image based on at least one of the atmosphere and theme of the first image.

10. In the method of operating the projection device, Step of acquiring the first image (S210); A step of generating a blurred image based on the first image (S220); Step (S230) of obtaining a background image by performing image processing so that a vignetting effect appears in the edge area of ​​the above-mentioned blurred image; and A method of operating a projection device, comprising the step (S240, S250) of projecting a second image that is a composite of the above-mentioned background image and the above-mentioned first image.

11. In paragraph 10, The steps for obtaining the above background image are: A method of operating a projection device, comprising the step of performing image processing by applying a vignetting ratio differently depending on the position of an edge area of ​​the blurred image.

12. In clause 10 or 11, The steps for obtaining the above background image are: A method of operating a projection device, comprising the step of performing image processing so that the vignetting effect appearing in an edge area of ​​the background image varies over time.

13. In any one of paragraphs 10 to 12, The steps for generating the above blur image are: A method of operating a projection device, comprising the step of generating the blurred image by performing blur processing on the first image.

14. In paragraph 13, The steps for generating the above blur image are: A step of masking the central area of ​​the first image; and A method of operating a projection device, comprising the step of blurring the first image that has been masked to generate the blurred image.

15. One or more computer-readable, non-transitory recording media having stored thereon a program causing the method of any one of claims 10 to 14.

Images