Projector and method for identifying touch input thereof

Abstract

A projector is disclosed. The projector comprises: a projection unit including a light source and for projecting an image; an infrared light-emitting unit including a circuit and for outputting infrared rays to a projection area onto which the image is projected; an infrared camera module including an infrared camera and for generating an image by photographing the projection area using an image sensor; a memory storing correction data including correction values for correcting the brightness of the image; and at least one processor which corrects the brightness of the image acquired by means of the infrared camera module using the correction data and identifies whether a touch input has been inputted to the projected image on the basis of the corrected brightness, wherein the correction data is generated on the basis of first correction data and second correction data, the first correction data may include correction values for correcting a decrease in intensity of infrared rays according to a distance from the infrared light-emitting unit, and the second correction data may include correction values for lens shading correction.

Description

Projector and its touch input identification method

[0001] The present disclosure relates to a projector for identifying a touch input for a projected image and a method for identifying a touch input thereof.

[0002] A projector is a device that projects images. By projecting light onto a screen, a projector can easily create large screens compared to other types of display devices.

[0003] Recently, projectors have been able to perform not only the unique function of projecting images, but also receive input from hands or pens positioned on the projected image and perform functions accordingly.

[0004] A projector according to an embodiment of the present disclosure includes a light source, a projection unit for projecting an image, a circuit, an infrared emitting unit for outputting infrared rays to a projection area on which the image is projected, an infrared camera, an infrared camera module for capturing the projection area using an image sensor to generate an image, a memory for storing correction data including correction values ​​for correcting brightness of the image, and at least one processor. At least one processor corrects the brightness of an image acquired through the infrared camera module using the correction data. At least one processor identifies whether a touch input has been input for the projected image based on the corrected brightness. The correction data is generated based on first correction data and second correction data. The first correction data includes correction values ​​for correcting a decrease in intensity of the infrared ray according to a distance from the infrared emitting unit. The second correction data includes correction values ​​for lens shading correction.

[0005] Here, the correction values ​​included in the first correction data can be determined based on the intensity of the infrared rays measured in a plurality of areas within the projection area.

[0006] In addition, the correction values ​​included in the first correction data may include correction values ​​for a plurality of pixels of the image sensor. The correction values ​​for the plurality of pixels of the image sensor may include correction values ​​for pixels corresponding to the plurality of areas among the plurality of pixels and correction values ​​for pixels corresponding to the remaining areas. The correction values ​​for the pixels corresponding to the plurality of areas may include correction values ​​for the plurality of areas. The correction values ​​for the plurality of areas may be determined such that when the correction values ​​for the plurality of areas are applied to the intensities of the plurality of infrared rays measured in the plurality of areas, the intensities of the plurality of infrared rays to which the correction values ​​are applied become identical to each other.

[0007] Additionally, the second correction data may include correction values ​​for a plurality of pixels of the image sensor. The correction values ​​of the first correction data and the correction values ​​of the second correction data may be multiplied pixel by pixel to obtain the correction values ​​of the correction data.

[0008] In addition, when the infrared ray output from the infrared emitting unit is reflected by an object existing in the projection area and received by the infrared camera module, the at least one processor can obtain pixel values ​​of a plurality of pixels of the image sensor and apply correction values ​​included in the correction data to the pixel values ​​to correct the brightness of the image. The pixel values ​​can include the Y component of YUV data.

[0009] In addition, the at least one processor can identify whether there is an area in the image whose brightness is greater than a specific value based on the corrected brightness, and if it is identified that there is an area greater than the preset value, it can identify that the touch input has been input at a location in the projected image corresponding to the identified area.

[0010] A method for identifying a touch input of a projector according to an embodiment of the present disclosure may include the steps of projecting an image, outputting infrared rays to a projection area on which the image is projected using an infrared emitting unit, capturing the projection area using an infrared camera module including an infrared camera to generate an image, correcting brightness of an image acquired through the infrared camera module using the correction data, and identifying whether a user's touch input has been input for the projected image based on the corrected brightness. The correction data may be generated based on first correction data and second correction data. The first correction data may include correction values ​​for correcting a decrease in intensity of the infrared rays according to a distance from the infrared emitting unit. The second correction data may include correction values ​​for lens shading correction.

[0011] A non-transitory computer-readable medium storing computer instructions that, when executed by at least one processor of a projector according to an embodiment of the present disclosure, cause the projector to perform an operation, the operation may include the steps of projecting an image, outputting infrared rays to a projection area on which the image is projected using an infrared emitting unit, capturing the projection area using an infrared camera module including an infrared camera to generate an image, correcting brightness of an image acquired through the infrared camera module using the correction data, and identifying whether a user's touch input has been input for the projected image based on the corrected brightness. The correction data may be generated based on first correction data and second correction data. The first correction data may include correction values ​​for correcting a decrease in intensity of the infrared rays according to a distance from the infrared emitting unit. The second correction data may include correction values ​​for lens shading correction.

[0012] The above and other aspects, features and advantages of specific embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

[0013] FIG. 1A and FIG. 1B are drawings illustrating an example of a projector according to various embodiments of the present disclosure;

[0014] FIG. 2a is a block diagram illustrating an example of a configuration of a projector according to various embodiments of the present disclosure;

[0015] FIG. 2b and FIG. 2c are drawings showing an example of the configuration of an infrared emitting unit according to various embodiments of the present disclosure;

[0016] FIG. 2d is a block diagram illustrating an example of a configuration of an infrared camera module according to various embodiments of the present disclosure;

[0017] FIG. 2e is a block diagram illustrating an example of a configuration of a projector according to various embodiments of the present disclosure;

[0018] FIG. 3 is a block diagram illustrating an example of a configuration of an electronic device according to various embodiments of the present disclosure.

[0019] FIG. 4A and FIG. 4B are diagrams illustrating an example of a method for generating first correction data according to various embodiments of the present disclosure;

[0020] FIG. 5 is a diagram illustrating an example of first correction data according to various embodiments of the present disclosure;

[0021] FIG. 6 is a diagram illustrating an example of second correction data according to various embodiments of the present disclosure;

[0022] FIG. 7 is a diagram illustrating examples of correction data according to various embodiments of the present disclosure;

[0023] FIG. 8A and FIG. 8B are diagrams illustrating an example of a method for detecting a direction of a touch input according to various embodiments of the present disclosure;

[0024] FIGS. 9A and 9B are diagrams illustrating an example of a method for detecting a touch input approaching a projection area according to various embodiments of the present disclosure;

[0025] FIG. 10A and FIG. 10B are diagrams illustrating an example of a method for detecting a touch input moving away from a projection area according to various embodiments of the present disclosure; and

[0026] FIG. 11 is a flowchart illustrating an example of a method for identifying a touch position of a projector according to various embodiments of the present disclosure.

[0027] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0028] The present embodiments may be modified and have various embodiments, and various examples are illustrated in the drawings and described in more detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0029] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0030] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0031] The terminology used in this disclosure is intended to describe specific embodiments and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0032] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0033] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0034] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0035] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0036] When it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it is understood that no other component (e.g., a third component) exists between said component and said other component.

[0037] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0038] The phrase "a device configured to" can mean, for example, that the device is "capable of" doing something in conjunction with other devices or components. For example, the phrase "a processor configured (or set) to perform A, B, and C" can mean, for example, a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0039] In various embodiments, a "module" or "part" performs at least one function or operation, and may be implemented in hardware, software, or a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor, excluding any "modules" or "parts" that require specific hardware implementation.

[0040] Various embodiments of the present disclosure will be described in more detail with reference to the attached drawings below.

[0041] FIGS. 1A and 1B are drawings illustrating examples of projectors according to various embodiments of the present disclosure.

[0042] Referring to FIGS. 1A and 1B, a projector (100) (or projector device) may be a device that enlarges and projects an image onto a projection surface (e.g., a floor surface, etc.). The projector (100) may be a movable projector (or portable projector) that a user can carry. In addition, the projector (100) is implemented as an ultra short throw (UST) projector and can display a large-screen image.

[0043] The projector (100) can project an image (11) onto the floor surface (1) using the projection unit (110) and irradiate infrared rays (IR) (12) in a direction parallel to the floor surface (1) using the infrared emitting unit (120). In addition, the projector (100) can photograph the floor surface (1) using the infrared camera module (130). The area (13) photographed by the infrared camera module (130) can include an area (e.g., projection area) (14) on which the image (11) is projected.

[0044] When an object (15) is positioned within a projection area (14), infrared rays (12) output from the projector (100) can be reflected by the object (15). The projector (100) can obtain an image by receiving the infrared rays (16) reflected by the object (15) using an infrared camera module (130), and can identify the position of the object (15) based on the brightness value of the image. The projector (100) can identify the position where a touch input is input in the image (11) based on the position of the object (15), and perform a function corresponding to the touch input.

[0045] As described above, the projector (100) can acquire an image through the infrared camera module (130) and identify the location of an object based on the brightness value of the image.

[0046] The image sensor of the infrared camera module (130) captures an image through a lens. However, due to the optical characteristics of the lens, such as its convex shape, a lens shading phenomenon may occur, in which the brightness of the edge area of ​​the image is reduced compared to the brightness of the center area. If this lens shading is not corrected, the location of the object may be inaccurately identified.

[0047] In addition, the brightness of the image can be determined by the intensity of the infrared ray reflected by the object and received by the infrared camera module (130). Since the intensity of the infrared ray reaching the object decreases as the distance from the infrared emitting unit (120) increases, the intensity of the infrared ray reflected by the object also decreases as the object is located in an area farther from the infrared emitting unit (120). In this way, if the intensity of the infrared ray reflected varies depending on the position of the object, the brightness of the object captured in the image also varies depending on the position of the object, and this can also affect the identification of the position of the object.

[0048] The projector (100) according to the present disclosure can perform lens shading correction when identifying the location of an object using an image acquired through an infrared camera module (130), and can also perform correction for the difference in intensity of infrared rays reaching an object depending on the location of the object. Accordingly, the recognition rate for touch input can be improved.

[0049] FIG. 2a is a block diagram illustrating an example of a configuration of a projector according to various embodiments of the present disclosure.

[0050] Referring to FIG. 2a, the projector (100) includes a projection unit (110) (e.g., including a light source), an infrared emitting unit (120), an infrared camera module (130) (e.g., including an infrared camera), a memory (140), and one or more processors (150) (e.g., including a processing circuit).

[0051] The projection unit (110) can project an image. The projection unit (110) can include a light source. For example, the projection unit (110) can include at least one light source among a lamp, an LED, and a laser.

[0052] The projection unit (110) can project images using various projection methods. For example, the projection unit (110) can project images using one of the projection methods of the CRT (cathode-ray tube) method, the LCD (Liquid Crystal Display) method, the DLP (Digital Light Processing) method, and the laser method. However, the present disclosure is not limited thereto.

[0053] The projection unit (110) can perform various functions for adjusting images under the control of one or more processors (150).

[0054] For example, the projection unit (11) can adjust the focus of the image according to the distance from the floor surface (e.g., projection distance) and project the image onto the floor surface.

[0055] In addition, the projection unit (110) can perform a keystone correction function. The keystone correction function refers to a function for correcting a distorted image. For example, the projection unit (110) can perform horizontal keystone correction when an image is distorted in the left-right direction, and can perform vertical keystone correction when an image is distorted in the up-down direction. In addition, the projection unit (110) can also perform quick corner keystone correction to correct an imbalance in the corners of an area.

[0056] The infrared emitting unit (120) outputs (or irradiates) infrared rays. The infrared emitting unit (120) may include a laser diode (e.g., an IR emitter) for emitting infrared rays. The infrared emitting unit (120) may output infrared rays to a projection area where an image is projected by the projector (110). For example, the infrared emitting unit (120) may output infrared rays parallel to the projection area.

[0057] For example, the infrared emitting unit (120) may include a reflector for reflecting infrared rays emitted by the laser diode toward the front of the projector (100).

[0058] For example, as shown in FIG. 2b, the shape of the reflector (122) may be a cone. A material capable of reflecting infrared rays, such as a mirror, may be formed on the side surface of the reflector (122). In addition, the laser diode (121) may be positioned above the reflector (122). Accordingly, the infrared rays output from the laser diode (121) may be reflected from the side surface of the reflector (122) and output to the front of the projector (100).

[0059] As another example, as shown in FIG. 2c, the reflector (122) may have a curved shape. A material capable of reflecting infrared rays, such as a mirror, may be formed on the curved surface of the reflector (122). In addition, the laser diode (121) may output infrared rays toward the curved surface of the reflector (122). Accordingly, the infrared rays output from the laser diode (121) may be reflected by the curved surface of the reflector (122) and output to the front of the projector (100).

[0060] In this way, when a reflector exists, infrared rays can be reflected by the reflector and output widely to the front of the projector (100), and accordingly, the FOV (field of view) of the infrared camera module (130) can be improved.

[0061] The infrared camera module (130) includes an infrared camera and uses an image sensor to capture a projection area to generate an image. For example, the infrared camera module (130) can receive light and generate an image corresponding to the received light. When an object exists in the projection area, the infrared light output from the infrared emitting unit (120) can be reflected by the object. The infrared camera module (130) can receive the infrared light reflected by the object and generate an image using an electrical signal corresponding to the received infrared light.

[0062] Referring to FIG. 2D, the infrared camera module (130) may include a lens assembly (131) (e.g., including a lens), a filter (132), and an image sensor (133). However, this configuration is exemplary, and it is obvious that new configurations may be added or some configurations may be omitted in addition to this configuration when practicing the present disclosure. For example, the infrared camera module (130) may further include an image signal processor (ISP) including various processing circuits. The image signal processor may be configured as at least a part of one or more processors (150).

[0063] The lens assembly (131) can collect light incident from the outside. The lens assembly (131) can include one or more lenses. For example, the lens assembly (131) can refract light incident from the outside. The refracted light can be focused on the image sensor (133).

[0064] The filter (132) can pass light in the infrared band. For example, the filter (132) may include a band pass filter that passes light in a specific band. The filter (132) can pass light in the infrared band among the light that passes through the lens assembly (131).

[0065] The image sensor (133) can generate an image corresponding to infrared rays by using infrared rays that have passed through the filter (132). The image sensor (133) can be implemented as a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. The image sensor (133) can include a pixel array composed of a plurality of pixels. For example, the image sensor (133) can generate an image by converting infrared rays that have passed through the filter (132) into an electrical signal by using a plurality of pixels. In addition, the image sensor (133) can transmit the image to one or more processors (150).

[0066] The memory (140) can store data necessary for the projector (100) to operate according to various embodiments of the present disclosure. For example, the memory (140) can store correction data including correction values ​​for correcting the brightness of an image.

[0067] The memory (140) may be implemented as a memory embedded in the projector (100) (e.g., volatile memory, non-volatile memory, hard drive, solid state drive, etc.) depending on the purpose of data storage, or may be implemented as a memory that can be attached or detached to the projector (100) (e.g., memory card, external memory, etc.).

[0068] One or more instructions may be stored in the memory (140). One or more processors (150) may execute one or more instructions stored in the memory (140) to perform operations of the projector (100) according to various embodiments of the present disclosure. Programs, applications, and data for driving the projector (100) may be stored in the memory (140).

[0069] One or more processors (150) include various processing circuits and control the overall operation of the projector (100). For example, one or more processors (150) may be connected to components of the projector (100) to control the overall operation of the projector (100). For example, one or more processors (150) may be connected to a projection unit (110), an infrared emitting unit (120), an infrared camera module (130), and a memory (140) to control the projector (100). One or more processors (150) may include one or more processors.

[0070] One or more processors (150) can perform operations of the projector (100) according to various embodiments of the present disclosure by executing one or more instructions stored in the memory (140).

[0071] The one or more processors (150) may include one or more of an Image Signal Processor (ISP), a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (150) may control one or any combination of other components of the projector (100) and may perform operations related to communication or data processing. The one or more processors (150) may execute one or more programs or instructions stored in the memory (140). For example, the one or more processors (150) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in the memory (140).

[0072] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0073] One or more processors (150) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (150) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory, such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0074] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0075] In various embodiments of the present disclosure, a processor may mean, for example, a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, and a core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but various embodiments of the present disclosure are not limited thereto.

[0076] Hereinafter, for convenience of explanation, one or more processors (150) will be referred to as processors (150). For example, a processor (150) according to an embodiment of the present disclosure may include various processing circuits and / or multiple processors. For example, the term "processor" as used in this disclosure, including the claims, may include various processing circuits including at least one processor, wherein one or more of the at least one processor may be individually and / or collectively configured to perform various functions described in the present disclosure. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform various functions, these terms may include, for example, without limitation, a situation where one processor performs some functions and another processor performs other functions, and a situation where one processor performs all functions. Furthermore, the at least one processor may include a combination of processors that perform the various functions enumerated / disclosed, for example, in a distributed manner. The at least one processor may execute program instructions to achieve or perform various functions.

[0077] FIG. 2e is a block diagram illustrating an example of a configuration of a projector according to various embodiments of the present disclosure.

[0078] Referring to FIG. 2e, the projector (100) may include a projection unit (110), an infrared emitting unit (120), an infrared camera module (130), a memory (140), one or more processors (150), a user interface (160) (e.g., including an interface circuit), a communication interface (170) (e.g., including a communication circuit), a speaker (180), and a camera module (190) (e.g., including a camera). However, such a configuration is exemplary, and it is obvious that new configurations may be added or some configurations may be omitted in addition to such configurations when implementing the present disclosure. A detailed description of configurations that overlap with the configurations illustrated in FIG. 2a among the configurations illustrated in FIG. 2e will be omitted.

[0079] The user interface (160) includes circuitry. The user interface (160) can receive user input and transmit the user input to the processor (150).

[0080] The user interface (160) may include various circuits including various types of input devices.

[0081] For example, the user interface (160) may include a physical button. The physical button may include a function key, a directional key, or a dial button. The physical button may be implemented as multiple keys. The physical button may also be implemented as a single key. If the physical button is implemented as a single key, the processor (150) may perform a function corresponding to the user input when a user input is received in which the key is pressed for a threshold time or longer.

[0082] For example, the user interface (160) may receive user input using a touch method. The user interface (160) may include a touch sensor or a touch screen.

[0083] For example, the user interface (160) may receive user input from an external device. The external device may include a remote control device (e.g., a remote control) for controlling the projector (100) or a user's mobile device (e.g., a smartphone, tablet PC, or wearable device). The mobile device may have an application stored thereon for controlling the projector (100). The mobile device may receive user input through the application and transmit the user input to the projector (100).

[0084] For example, the user interface (160) can receive user input using voice recognition. The user interface (160) can receive the user's voice using a microphone. The processor (150) can perform a function corresponding to the user's voice. For example, the processor (150) can convert the user's voice into text data using the STT (Speech To Text) function, obtain control command data based on the text data, and perform a function corresponding to the user's voice based on the control command data. Depending on the embodiment, the STT function may be performed on a server.

[0085] The communication interface (170) includes various communication circuits and can communicate with external devices. For example, the communication interface (170) can communicate with external devices such as servers and mobile devices through a surrounding access point (AP). The access point (AP) can connect a local area network (LAN) to which the projector (100) or the mobile device is connected to a wide area network (WAN) to which the server is connected. The projector (100) can be connected to the server through the wide area network (WAN). In addition, the communication interface (170) can also communicate with external devices without going through the access point.

[0086] The communication interface (170) may include a wireless communication module or a wired communication module. The communication module may be implemented with at least one hardware chip.

[0087] The wireless communication module may include a module that wirelessly communicates with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, or an infrared communication module. However, the wireless communication module is not limited to this example, and may include a communication module that communicates according to various wireless communication standards, such as LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0088] The wired communication module may include a module that communicates with an external device via a wire. For example, the wired communication module may include at least one wired communication module among a LAN module, an Ethernet module, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB), a USB C-type, and a Display Port (DP).

[0089] The communication interface (170) can be powered from an external source. For example, the projector (100) can be powered from an external battery via HDMI, USB, USB C-type, etc., or from an outlet via a power adapter. Additionally, the projector (100) can be powered from an external device (e.g., a laptop, a monitor, etc.) via DP.

[0090] The speaker (180) can output an audio signal. The speaker (180) can include an audio output module. For example, the audio output module can include a plurality of audio output units. The plurality of audio output units can be symmetrically arranged inside the main body of the projector (100). The processor (150) can output an audio signal in a 360-degree direction using the plurality of audio output units.

[0091] The camera module (190) includes a camera and can capture images by taking pictures. For example, the camera module (190) may be an RGB camera. The camera module (190) can capture images of the projection area by capturing the direction in which the projection unit (110) projects the image. The camera module (190) may include a lens assembly including one or more lenses, an image sensor, an image signal processor, and the like. The image signal processor may be configured as at least a part of one or more processors (150). When distortion occurs in an image projected from the projection unit (110), the processor (150) can control the projection unit (110) to correct the distortion of the image using an image captured through the camera module (190).

[0092] Hereinafter, a method for generating correction data according to an embodiment of the present disclosure will be described in more detail.

[0093] The process of acquiring correction data can be performed in an electronic device. FIG. 3 is a block diagram illustrating an example of a configuration of an electronic device according to various embodiments of the present disclosure.

[0094] Referring to FIG. 3, the electronic device (200) may include an infrared sensor (210), a camera module (220) (e.g., including a camera), a communication interface (230) (e.g., including a communication circuit), a memory (240), and one or more processors (250) (e.g., including a processing circuit).

[0095] The infrared sensor (210) can receive infrared rays and measure the intensity of the infrared rays. For example, the infrared sensor (210) may include a filter for removing signals in a band other than infrared rays, a photodiode for converting infrared rays into electrical signals, an amplifier for amplifying the electrical signals, and the like. In addition, the infrared sensor (210) can transmit information about the measured intensity to one or more processors (250).

[0096] The camera module (220) includes a camera and can capture images by taking pictures. For example, the camera module (220) may be an RGB camera. The camera module (220) may include a lens assembly including one or more lenses, an image sensor, an image signal processor, and the like. The image signal processor may include at least a portion of one or more processors (250).

[0097] The communication interface (230) includes various communication circuits and can communicate with external devices. For example, the communication interface (230) can communicate with external devices, such as a projector (100), through a peripheral access relay. The access relay (AP) can connect a local area network (LAN) to which an electronic device (200) or a mobile device is connected to a wide area network (WAN) to which a server is connected. The electronic device (200) can be connected to the server through the wide area network (WAN). In addition, the communication interface (230) can also communicate with external devices without going through a access relay.

[0098] The communication interface (230) may include a wireless communication module or a wired communication module. The communication module may be implemented with at least one hardware chip.

[0099] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, or an infrared communication module. However, this example is not limited to this, and the wireless communication module may include a communication module that communicates according to various wireless communication standards, such as LTE, LTE-A, 4G, and 5G.

[0100] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one wired communication module among a LAN module, an Ethernet module, HDMI, USB, USB C-type, and DP.

[0101] The memory (240) can store data necessary for the electronic device (200) to operate according to various embodiments of the present disclosure.

[0102] The memory (240) may be implemented as a memory embedded in the electronic device (200) (e.g., volatile memory, non-volatile memory, hard drive, solid state drive, etc.) depending on the purpose of data storage, or may be implemented as a memory that can be attached or detached to the electronic device (200) (e.g., memory card, external memory, etc.).

[0103] One or more instructions may be stored in the memory (240). One or more processors (250) may execute one or more instructions stored in the memory (240) to perform operations of the electronic device (200) according to various embodiments of the present disclosure. The memory (240) may store programs, applications, and data for operating the electronic device (200).

[0104] One or more processors (250) include various processing circuits and control the overall operation of the electronic device (200). Specifically, one or more processors (250) may be connected to components of the electronic device (200) to control the overall operation of the electronic device (200). For example, one or more processors (250) may be connected to an infrared sensor (210), a camera module (210), a communication interface (230), and a memory (240) to control the electronic device (200). One or more processors (250) may include one or more processors.

[0105] One or more processors (250) may perform operations of the electronic device (200) in various embodiments of the present disclosure by executing one or more instructions stored in the memory (240).

[0106] The one or more processors (250) may include one or more of an ISP, a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator. The one or more processors (250) may control one or any combination of other components of the electronic device (200) and perform operations related to communication or data processing. The one or more processors (250) may execute one or more programs or instructions stored in the memory (240). For example, the one or more processors (250) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in the memory (240).

[0107] Hereinafter, for convenience of explanation, one or more processors (250) will be referred to as processors (250). For example, a processor (250) according to an embodiment of the present disclosure may include various processing circuits and / or multiple processors. For example, the term "processor" as used in this disclosure, including the claims, may include various processing circuits including at least one processor, wherein one or more of the at least one processor may be individually and / or collectively configured to perform various functions described in the present disclosure. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform various functions, these terms may include, for example, without limitation, a situation where one processor performs some functions and another processor performs other functions, and a situation where one processor performs all functions. Furthermore, the at least one processor may include a combination of processors that perform the various functions enumerated / disclosed, for example, in a distributed manner. The at least one processor may execute program instructions to achieve or perform various functions.

[0108] The processor (250) can generate correction data. The correction data can be generated based on first correction data and second correction data.

[0109] The first correction data may include correction values ​​for correcting a decrease in infrared intensity according to the distance from the infrared emitting unit (120). The correction values ​​may be determined based on the intensity of infrared rays measured in multiple areas within the projection area.

[0110] The processor (250) can detect the intensity of infrared rays in each area using an infrared sensor (210). For example, the projection area can be divided into multiple areas. The processor (250) can detect the intensity of infrared rays in each of the multiple areas using an infrared sensor (210) positioned in each of the multiple areas while infrared rays are output from the infrared emitting unit (120). In addition, the processor (250) can store information about the intensity of infrared rays detected in each area in the memory (240).

[0111] For example, as shown in Fig. 4a, the projection area (410) can be divided into n×m areas. Here, n and m are natural numbers greater than or equal to 2. An infrared sensor (210) can be placed in an area (41) among the plurality of areas. The infrared sensor (210) can receive infrared light output from the infrared emitting unit (120) and detect the intensity of the received infrared light. The infrared sensor (210) can transmit information about the intensity of the detected infrared light to the processor (250).

[0112] If this process is performed sequentially for the remaining areas, the infrared intensity can be measured in each of the multiple areas.

[0113] The processor (250) can identify correction values ​​for multiple areas. The processor (250) can then store the identified correction values ​​in the memory (240).

[0114] For example, when the processor (250) applies correction values ​​for a plurality of areas to the intensities of a plurality of infrared rays measured in the plurality of areas, the processor (250) can determine correction values ​​for the plurality of areas so that the intensities of the plurality of infrared rays to which the correction values ​​are applied become the same. As an example, assume that the intensities of the infrared rays measured in a plurality of areas (e.g., a11, a12, ..., anm) are r11, r12, ..., rnm. The processor (250) can calculate correction values ​​w11, w12, ..., wnm for the plurality of areas so as to satisfy r11 × w11 = r12 × w12 = ... = rnm × wnm.

[0115] The processor (250) can identify pixels of the image sensor (133) corresponding to each region through ROI (Region of Interest) matching.

[0116] For example, a marker may be placed in an area (41) within a projection area (410). The marker may be an object for distinguishing an area from other areas. The processor (250) may capture an image by photographing the projection area through the camera module (220). The camera module (220) may be placed at the same position as the position where the infrared camera module (130) is placed in the projector (100) when the projector (100) is placed on the floor, and the shooting direction of the infrared camera module (130) and the shooting direction of the camera module (220) may be the same. The angle of view of the camera module (220), the number of pixels of the image sensor, etc. may be the same as the angle of view of the infrared camera module (130), the number of pixels of the image sensor (133), etc.

[0117] The processor (250) can identify pixels that have captured a marker among a plurality of pixels of the image sensor of the camera module (220). For example, as shown in FIG. 4B, an image (420) acquired through the camera module (220) can include an area (42) in which a marker placed in an area (41) has been captured. For example, the processor (250) can identify pixels that have captured a region (42) among the plurality of pixels by using pixel values ​​of the plurality of pixels of the image sensor of the camera module (220).

[0118] The processor (250) can identify pixels corresponding to pixels that photographed the marker among the plurality of pixels of the image sensor (133) based on the positions of pixels that photographed the marker among the plurality of pixels of the image sensor of the camera module (220). The pixels corresponding to pixels that photographed the marker may include pixels of the image sensor (133) that have the same positions as the pixels that photographed the marker. For example, the processor (250) can identify coordinate values ​​of pixels that photographed the marker in the image sensor of the camera module (220), and identify pixels that have the same coordinate values ​​as the identified coordinate values ​​among the plurality of pixels of the image sensor (133), thereby identifying pixels corresponding to pixels that photographed the marker among the plurality of pixels of the image sensor (133). However, this is just an example, and the processor (250) can also identify pixels of the image sensor (133) corresponding to pixels that photographed the marker by considering the total number of pixels, the field of view, the positions of the pixels that photographed the marker, etc.

[0119] If this process is performed sequentially for the remaining areas, pixels of the image sensor (133) corresponding to each of the multiple areas can be identified.

[0120] The processor (250) may store the correction values ​​for each area calculated based on the infrared intensity as correction values ​​for the pixels of the image sensor (133) corresponding to each area in the memory (240), thereby generating first correction data. In the first correction data, the correction values ​​for the pixel values ​​of the remaining pixels may be 0. For example, the processor (250) may store w11 as correction values ​​for correcting the pixel values ​​of the pixels of the image sensor (133) corresponding to the area (41). In addition, the processor (250) may store w12,..., wnm as correction values ​​for correcting the pixel values ​​of the pixels of the image sensor (133) corresponding to each of the remaining areas.

[0121] Accordingly, the first correction data may include correction values ​​for a plurality of pixels of the image sensor (133). The correction values ​​for the plurality of pixels may be values ​​used to correct pixel values ​​of the plurality of pixels.

[0122] The correction values ​​may include correction values ​​for pixels corresponding to multiple areas among the multiple pixels and correction values ​​(e.g., 0) for pixels corresponding to the remaining areas.

[0123] The correction values ​​for pixels corresponding to multiple regions may include correction values ​​for multiple regions. The correction values ​​for multiple regions may be determined such that, when the correction values ​​for multiple regions are applied to the intensities of multiple infrared rays measured in the multiple regions, the intensities of the multiple infrared rays to which the correction values ​​are applied become identical.

[0124] FIG. 5 is a diagram illustrating an example of first correction data according to various embodiments of the present disclosure.

[0125] The first correction data (510) may include correction values ​​for correcting pixel values ​​of a plurality of pixels of the image sensor (133). In the case of correction values ​​(511) of pixels corresponding to a projection area among the plurality of pixels of the image sensor (133), the further the location of the area is from the infrared emitting unit (120), the greater the correction values ​​of the pixels corresponding to the area may be. Correction values ​​(512) of pixels corresponding to areas other than the projection area may be 0.

[0126] The second correction data may include correction values ​​for lens shading correction. The second correction data may include correction values ​​for a plurality of pixels of the image sensor (133). As described above, the lens shading phenomenon may occur due to the optical characteristics of the lens. The correction values ​​of the second correction data include correction values ​​for eliminating the lens shading phenomenon and may be determined by various methods already known in the art. The second correction data may be stored in the memory (240).

[0127] FIG. 6 is a diagram illustrating an example of second correction data according to various embodiments of the present disclosure.

[0128] The second correction data (610) may include correction values ​​for correcting pixel values ​​of a plurality of pixels of the image sensor (133). The correction values ​​may have a larger correction value as the pixel location moves from the center area to the edge area.

[0129] The processor (250) can generate correction data based on the first correction data and the second correction data. In addition, the processor (250) can store the correction data in the memory (240).

[0130] The correction data may be data used to correct the brightness of an image acquired by the projector (100) through the infrared camera module (130).

[0131] For example, as shown in FIG. 7, the processor (250) can obtain correction values ​​of correction data (710) by multiplying the correction values ​​of the first correction data (510) and the correction values ​​of the second correction data (520) pixel by pixel. Multiplying pixel by pixel may include multiplying correction values ​​between pixels at the same location. Accordingly, the correction data (710) may include correction values ​​for correcting a plurality of pixels of the image sensor (133).

[0132] The processor (250) can transmit correction data to the projector (100) via the communication interface (230). The processor (150) can receive correction data from the electronic device (200) via the communication interface (170) and store the received correction data in the memory (140).

[0133] Returning to FIG. 2a, the processor (150) can use the correction data to correct the brightness of the image acquired through the infrared camera module (130), and identify whether a user's touch input has been input to the projected image based on the corrected brightness.

[0134] For example, when infrared light output from an infrared emitting unit (120) is reflected by an object existing in the projection area and received through an infrared camera module (130), the processor (150) can obtain pixel values ​​of multiple pixels of the image sensor (133).

[0135] The object may include any object capable of reflecting infrared light. For example, the object may include a user's hand, fingers, or a fan.

[0136] The processor (150) can perform signal processing on an image received from the image sensor (133) to obtain pixel values. The format of the pixel values ​​may be a YUV data format, but is not limited to this example. The YUV data format refers to a data format that expresses, for example, a luminance signal and a chroma signal separately. Y refers to a luminance signal, and U and V refer to chroma signals. U refers to, for example, the difference between a luminance signal and a blue signal component, and V refers to, for example, the difference between a luminance signal and a red signal component. In YUV data, the Y component can represent information about brightness, and the UV component can represent information about color.

[0137] The processor (150) can correct the brightness of an image by applying correction values ​​included in the correction data to pixel values. The pixel values ​​can include the Y component of YUV data. For example, the processor (150) can correct the Y component by multiplying the Y component by the correction value included in the correction data for each pixel.

[0138] The processor (150) identifies whether there is an area in the image whose brightness is greater than a preset (e.g., specific) value based on the corrected brightness, and if it is identified that there is an area greater than the preset value, it can identify that a touch input has been input at a location of the projected image corresponding to the identified area.

[0139] For example, the processor (150) can identify whether there is an area in the image where the size of the corrected Y component is greater than or equal to a preset value. If the processor (150) identifies that there is an area where the size of the Y component is greater than or equal to the preset value, the processor (150) can identify the location of the area identified in the image. The location may include coordinate values. The processor (150) can identify an area corresponding to the identified location in the projected image. Information about the coordinates of the image projected by the projection unit (110) that matches the coordinates of the image acquired through the infrared camera module (130) may be stored in the memory (140). The processor (150) can identify an area of ​​the image that matches the area identified in the image using the information stored in the memory (140), and can identify that a touch input has been input at the location of the area identified in the image.

[0140] When the processor (150) identifies that a touch input has been input, it can perform a function corresponding to the touch input.

[0141] For example, if the processor (150) identifies that a touch input has been input for an icon of a projected image, it can execute an application corresponding to the icon. In addition, if the processor (150) identifies that a touch input has been input for a menu of a projected image, it can perform a function corresponding to the menu (e.g., changing the settings of the projector (100), adjusting the volume, etc.). However, the present invention is not limited to this example, and the processor (150) can perform various interaction functions that can be provided according to the touch input.

[0142] The projector (100) according to the present disclosure can perform lens shading correction and also perform correction for the difference in intensity of infrared rays reaching an object depending on the object's location when identifying the object's location using an image acquired through an infrared camera module (130). Accordingly, the recognition rate for touch input can be improved.

[0143] The processor (150) can identify the direction in which the touch input was input.

[0144] For example, infrared rays output from an infrared emitting unit (120) are reflected by an object located in a projection area, and an area where infrared rays are reflected from an object is determined based on the direction in which a touch input is input, and a shape of an area where the size of a corrected Y component in an image is greater than or equal to a preset value can be determined based on the shape of the area where the size of a corrected Y component in an image is greater than or equal to a preset value. Accordingly, the processor (150) can identify the direction of a touch input based on the shape of an area where the size of a corrected Y component in an image is greater than or equal to a preset value.

[0145] As an example, as shown in FIG. 8A, it is assumed that a user touches a point of a projection area (812) from the left to the right of the projection area (812) using a finger (811). Since the infrared ray (813) output from the infrared emitting unit (120) is reflected by the finger (811) pointing to the right, an area (815) in which the size of the corrected Y component in the image (814) acquired through the infrared camera module (130) is greater than a preset value may have a shape that is convex to the right (or upper right). If the processor (150) identifies that the shape of the area (815) is a shape that is convex to the right, it can identify that a touch input in the right direction has been input.

[0146] As an example, as shown in FIG. 8B, it is assumed that a user touches a point of a projection area (822) from the right side to the left side of the projection area (822) using a finger (821). Since the infrared ray (823) output from the infrared emitting unit (120) is reflected by the finger (821) pointing in the left direction, an area (825) in which the size of the corrected Y component in the image (824) acquired through the infrared camera module (130) is greater than a preset value may have a shape that is convex to the left (or upper left). If the processor (150) identifies that the shape of the area (825) is a shape that is convex to the left, it can identify that a touch input in the left direction has been input.

[0147] Meanwhile, in addition to the examples described above, the processor (150) can detect various directions of touch input. For example, if an area in the image has a shape that is convex in the upward direction, the processor (150) can identify that a touch input has been input in an upward direction (e.g., in the direction toward the projector (100)). In addition, if an area in the image has a shape that is convex in the downward direction, the processor (150) can identify that a touch input has been input in a downward direction (e.g., in the opposite direction of the projector (100)).

[0148] The processor (150) can perform a function corresponding to the direction of the touch input. According to one example, the processor (150) can change the image to be projected depending on the direction of the touch input. For example, if the processor (150) identifies that a touch input has been input in a right direction, the processor (150) can control the projection unit (110) to project the previous image. If the processor (150) identifies that a touch input has been input in a left direction, the processor (150) can control the projection unit (110) to project the next image. However, the present invention is not limited to this example, and the processor (150) can perform various interaction functions depending on the direction of the touch input.

[0149] According to an embodiment of the present disclosure, the infrared emitting unit (120) can output infrared rays having a first height from the floor surface and infrared rays having a second height from the floor surface. The first height may be higher than the second height. For example, the infrared emitting unit (120) may include a first laser diode and a second laser diode arranged at a lower height than the first laser diode. In this way, the projector (100) can output infrared rays at different heights by using laser diodes installed in a multi-layer structure.

[0150] The processor (150) can use infrared rays output at different heights to identify whether a touch input is approaching the projection area or moving away from the projection area. For example, if the user's finger is close to the floor, both the infrared rays at the first height and the infrared rays at the second height may be reflected by the finger. In this way, when the infrared rays at the first height and the infrared rays at the second height are reflected by an object, there may be two areas in the image where the size of the corrected Y component is greater than or equal to a preset value. However, if the user's finger is positioned higher than the second height but lower than the first height from the floor, only the infrared rays at the first height may be reflected by the finger. In this way, when only the infrared rays at the first height are reflected by an object, there may be one area in the image where the size of the corrected Y component is greater than or equal to a preset value.

[0151] Accordingly, the processor (150) can identify the number of regions in the image and, based on the number of regions, identify whether the touch input is approaching the projection region or moving away from the projection region.

[0152] According to an example, as shown in FIGS. 9a and 9b, the projector (100) can output infrared rays (921) having a first height from the floor surface and infrared rays (922) having a second height using the infrared emitting unit (120).

[0153] Assume that the user's finger (911) approaches the projection area. For example, as shown in FIG. 9a, if the finger (911) is positioned higher than the second height but lower than the first height, the infrared ray (921) of the first height may be reflected by the finger (911). In this case, there may be only one area (932) in which the size of the corrected Y component in the image (931) acquired through the infrared camera module (130) is greater than a preset value. For example, as shown in FIG. 9b, if the user's finger (911) moves further toward the projection area and is positioned lower than the second height, both the infrared ray (921) of the first height and the infrared ray (922) of the second height may be reflected by the finger (911). In this case, there may be two areas (933, 934) in which the size of the corrected Y component in the image (931) acquired through the infrared camera module (130) is greater than or equal to a preset value. When the processor (150) identifies that the number of areas in the image increases from one to two, it can identify that the touch input is approaching the projection area.

[0154] According to an example, as shown in FIGS. 10a and 10b, the projector (100) can output infrared rays (1021) having a first height from the floor surface and infrared rays (1022) having a second height using an infrared emitting unit (120).

[0155] Let us assume that the user's finger (1011) moves away from the projection area. For example, as in FIG. 10a, if the user's finger (1011) is positioned at a position lower than the second height, both the infrared ray (1021) at the first height and the infrared ray (1022) at the second height may be reflected by the finger (1011). In this case, there may be two areas (1032, 1033) in which the size of the corrected Y component in the image (1031) acquired through the infrared camera module (130) is greater than a preset value. For example, as in FIG. 10b, if the user's finger (1011) moves away from the projection area and is positioned at a position higher than the second height but lower than the first height, the infrared ray (1021) at the first height may be reflected by the finger (1011). In this case, there may be one area (1034) in which the size of the corrected Y component in the image (1031) acquired through the infrared camera module (130) is greater than or equal to a preset value. When the processor (150) identifies that the number of areas in the image is reduced from two to one, it can identify that the touch input is moving away from the projection area.

[0156] In addition, the processor (150) can perform a corresponding function depending on whether the touch input approaches the projection area or moves away from the projection area. According to one example, if the processor (150) identifies that the touch input approaches the projection area, it can control the projection unit (110) to zoom in and project the image. In addition, if the processor (150) identifies that the touch input moves away from the projection area, it can control the projection unit (110) to zoom out and project the image. However, the present invention is not limited to this example, and the processor (150) can perform various interaction functions depending on whether the touch input approaches the projection area or moves away from the projection area.

[0157] FIG. 11 is a flowchart illustrating an example of a method for identifying a touch input of a projector according to various embodiments of the present disclosure.

[0158] Project the image (S1110).

[0159] An infrared ray is output to the projection area where the image is projected using an infrared emitting unit (S1120).

[0160] An image is created by capturing the projection area using an infrared camera module (S1130).

[0161] The brightness of the image acquired through the infrared camera module is corrected using correction data (S1140).

[0162] It is identified whether a user's touch input has been input to the projected image based on the corrected brightness (S1150).

[0163] The correction data is generated based on the first correction data and the second correction data. The first correction data includes correction values ​​for compensating for the decrease in intensity of infrared rays according to the distance from the infrared emitting unit. The second correction data includes correction values ​​for lens shading compensation.

[0164] The correction values ​​included in the first correction data can be determined based on the intensity of infrared rays measured in multiple areas within the projection area.

[0165] For example, the correction values ​​included in the first correction data may include correction values ​​for a plurality of pixels of the image sensor of the infrared camera module. In addition, the correction values ​​for the plurality of pixels of the image sensor may include correction values ​​for pixels corresponding to a plurality of areas among the plurality of pixels and correction values ​​for pixels corresponding to the remaining areas. In addition, the correction values ​​for the pixels corresponding to the plurality of areas may include correction values ​​for the plurality of areas. In addition, the correction values ​​for the plurality of areas may be determined such that when the correction values ​​for the plurality of areas are applied to the intensities of the plurality of infrared rays measured in the plurality of areas, the intensities of the plurality of infrared rays to which the correction values ​​are applied become identical to each other.

[0166] The second correction data may include correction values ​​for a plurality of pixels of the image sensor of the infrared camera module. The correction values ​​of the first correction data and the correction values ​​of the second correction data may be multiplied pixel by pixel to obtain the correction values ​​of the correction data.

[0167] In step S1140, when infrared rays output from an infrared emitting unit are reflected and received by an object existing in a projection area, pixel values ​​of a plurality of pixels of an image sensor of an infrared camera module are acquired, and correction values ​​included in correction data are applied to the pixel values ​​to correct the brightness of the image. The pixel values ​​may include the Y component of YUV data.

[0168] Step S1150 identifies whether there is an area in the image whose brightness is greater than or equal to a preset value based on the corrected brightness, and if it is identified that there is an area greater than or equal to the preset value, it can be identified that a touch input has been input at a location in the projected image corresponding to the identified area.

[0169] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call instructions stored in the storage medium and operate according to the called instructions, and may include an electronic device (e.g., a projector (100), an electronic device (200)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. A 'non-transitory' storage medium does not contain a signal and means that it is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0170] Furthermore, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0171] Furthermore, according to one embodiment of the present disclosure, the various embodiments described above may be implemented in a computer-readable recording medium or a similar device using software, hardware, or a combination thereof. Some embodiments of the present disclosure may be implemented by the processor itself. In a software implementation, various embodiments, such as the procedures and functions described in the present disclosure, may be implemented as separate software. Each software may perform one or more functions and operations described in the present disclosure.

[0172] Computer instructions for performing processing operations of a device according to the various embodiments described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in such a non-transitory computer-readable medium, when executed by a processor of a specific device, cause the specific device to perform processing operations in the device according to the various embodiments described above. A non-transitory computer-readable medium is a medium that stores data, and refers to a medium that can be read by the device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Various examples of non-transitory computer-readable media may include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, ROMs, etc. However, the present disclosure is not limited thereto.

[0173] In addition, each of the components (e.g., modules or programs) according to the various embodiments described above may include one or more entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0174] While the present disclosure has been described with reference to various embodiments, it is to be understood that the various examples are illustrative and not limiting, and that the present disclosure is not limited to the various examples described above. It will be further understood by those skilled in the art that various modifications may be made without departing from the true spirit and scope of the present disclosure, including the appended claims and their equivalents. It will also be understood that any of the embodiments described in the present disclosure can be used in conjunction with any other embodiments described in the present disclosure.

Claims

1. In the projector, A projection unit including a light source and for projecting an image; An infrared emitting unit including a circuit and for outputting infrared rays to a projection area on which the image is projected; An infrared camera module including an infrared camera and configured to capture the projection area using an image sensor to generate an image; A memory storing correction data including correction values ​​for correcting the brightness of the image; and At least one processor for correcting the brightness of an image acquired through the infrared camera module using the correction data and identifying whether a touch input has been input to the projected image based on the corrected brightness; The above correction data is generated based on the first correction data and the second correction data, The above first correction data includes correction values ​​for correcting the decrease in intensity of the infrared ray according to the distance from the infrared emitting unit, The second correction data is a projector including correction values ​​for lens shading correction.

2. In paragraph 1, The correction values ​​included in the above first correction data are: A projector whose intensity is determined based on the intensity of the infrared rays measured in a plurality of areas within the projection area.

3. In paragraph 2, The correction values ​​included in the above first correction data include correction values ​​for a plurality of pixels of the image sensor, The correction values ​​for multiple pixels of the above image sensor are: It includes correction values ​​for pixels corresponding to the plurality of areas among the plurality of pixels and correction values ​​for pixels corresponding to the remaining areas, The correction values ​​for pixels corresponding to the plurality of areas include correction values ​​for the plurality of areas, The correction values ​​for the plurality of areas are determined based on the correction values ​​for the plurality of areas applied to the intensities of the plurality of infrared rays measured in the plurality of areas, and the intensities of the plurality of infrared rays to which the correction values ​​are applied are the same projector.

4. In paragraph 1, The second correction data includes correction values ​​for a plurality of pixels of the image sensor, A projector wherein the correction values ​​of the above correction data are based on the multiplication of the correction values ​​of the first correction data and the correction values ​​of the second correction data for each pixel.

5. In paragraph 1, At least one processor of the above, When the infrared ray output from the infrared emitting unit is reflected by an object existing in the projection area and received through the infrared camera module, pixel values ​​of a plurality of pixels of the image sensor are acquired, Correcting the brightness of the image by applying the correction values ​​included in the above correction data to the pixel values. The above pixel values ​​are a projector containing the Y component of YUV data.

6. In paragraph 5, At least one processor of the above, Based on the above-mentioned corrected brightness, identify whether there is an area in the image whose brightness is greater than a specific value, A projector that identifies that the touch input has been input at a location of the projected image corresponding to the identified area when it is identified that an area exceeding the above specific value exists.

7. In the method of identifying touch input of the projector, Step of projecting the image; A step of outputting infrared rays to a projection area where the image is projected using an infrared emitting unit; A step of generating an image by photographing the projection area using an infrared camera module including an infrared camera; A step of correcting the brightness of an image acquired through the infrared camera module using the above correction data; and A step of identifying whether a touch input has been input to the projected image based on the corrected brightness; The above correction data is generated based on the first correction data and the second correction data, The above first correction data includes correction values ​​for correcting the decrease in intensity of the infrared ray according to the distance from the infrared emitting unit, A method for identifying a touch input, wherein the second correction data includes correction values ​​for lens shading correction.

8. In paragraph 7, The correction values ​​included in the above first correction data are: A touch input identification method determined based on the intensity of the infrared rays measured in a plurality of areas within the projection area.

9. In paragraph 8, The correction values ​​included in the above first correction data include correction values ​​for a plurality of pixels of the image sensor of the infrared camera module, The correction values ​​for multiple pixels of the above image sensor are: It includes correction values ​​for pixels corresponding to the plurality of areas among the plurality of pixels and correction values ​​for pixels corresponding to the remaining areas, The correction values ​​for pixels corresponding to the plurality of areas include correction values ​​for the plurality of areas, A touch input identification method wherein the correction values ​​for the plurality of areas are determined based on the correction values ​​for the plurality of areas applied to the intensities of the plurality of infrared rays measured in the plurality of areas, and the intensities of the plurality of infrared rays to which the correction values ​​are applied are identical to each other.

10. In paragraph 7, The second correction data includes correction values ​​for a plurality of pixels of the image sensor of the infrared camera module, A touch input identification method wherein the correction values ​​of the above correction data are based on the multiplication of the correction values ​​of the first correction data and the correction values ​​of the second correction data for each pixel.

11. In paragraph 7, The above correction steps are: When the infrared ray output from the infrared emitting unit is reflected by an object existing in the projection area and received through the infrared camera module, pixel values ​​of a plurality of pixels of the image sensor of the infrared camera module are acquired, and correction values ​​included in the correction data are applied to the pixel values ​​to correct the brightness of the image. The above pixel values ​​are a method for identifying a touch input including the Y component of YUV data.

12. In paragraph 11, The above identifying step is, A step of identifying whether there is an area in the image whose brightness is greater than a specific value based on the corrected brightness; and A touch input identification method, comprising: a step of identifying that the touch input has been input at a location of the projected image corresponding to the identified area when it is identified that an area exceeding the specific value exists; 13. A non-transitory computer-readable medium storing computer instructions that, when executed by at least one processor of the projector, cause the projector to perform an operation, the operation comprising: Step of projecting the image; A step of outputting infrared rays to a projection area on which the image is projected using an infrared emitting unit including an infrared camera; A step of generating an image by photographing the projection area using an infrared camera module; A step of correcting the brightness of an image acquired through the infrared camera module using the above correction data; and A step of identifying whether a touch input has been input to the projected image based on the corrected brightness; The above correction data is generated based on the first correction data and the second correction data, The above first correction data includes correction values ​​for correcting the decrease in intensity of the infrared ray according to the distance from the infrared emitting unit, The second correction data is a touch-non-transitory computer-readable medium including correction values ​​for lens shading correction.

14. In paragraph 13, The correction values ​​included in the above first correction data are: A non-transitory computer-readable medium determined based on the intensity of said infrared rays measured in a plurality of areas within said projection area.

15. In paragraph 14, The correction values ​​included in the above first correction data include correction values ​​for a plurality of pixels of the image sensor of the infrared camera module, The correction values ​​for multiple pixels of the above image sensor are: It includes correction values ​​for pixels corresponding to the plurality of areas among the plurality of pixels and correction values ​​for pixels corresponding to the remaining areas, The correction values ​​for pixels corresponding to the plurality of areas include correction values ​​for the plurality of areas, A non-transitory computer-readable medium in which the correction values ​​for the plurality of areas are determined based on the correction values ​​for the plurality of areas applied to the intensities of the plurality of infrared rays measured in the plurality of areas, and the intensities of the plurality of infrared rays to which the correction values ​​are applied are identical to each other.

Images