Projector and method for recognizing touch input thereof

Abstract

A projector is disclosed. The projector includes: a projection unit including a light source and configured to project an image; an infrared light emitting unit including a circuit and configured to output infrared light to a projection area where the image is projected; an infrared camera module including an infrared camera and for generating an image by photographing the projection area using an image sensor; a memory that stores correction data, in which the correction data includes a correction value for correcting brightness of the image; and at least one processor that corrects a brightness of an image acquired by the infrared camera module using correction data, which is generated based on first correction data and second correction data, and identifies whether a touch input has been input to the projection image based on the corrected brightness, and determines whether the touch input has been input to the projection image based on the corrected brightness. The first correction data may include a correction value for correcting a decrease in the intensity of the infrared light according to a distance from the infrared light emitting unit, and the second correction data may include a correction value for lens shading correction.

Description

Technical Field

[0001] This disclosure relates to a projector for recognizing touch input to a projected image and a method for recognizing touch input. Background Technology

[0002] A projector is a device that projects images. Projectors create images by projecting light onto a screen, thus easily enabling larger screens compared to other types of display devices.

[0003] Recently, projectors have not only been able to perform their own function of projecting images, but also to receive input from hands or pens located on the projected image and perform corresponding functions. Summary of the Invention

[0004] Technical solution A projector according to an example embodiment includes: a projection component including a light source configured to project an image; an infrared emitter including circuitry configured to output infrared light to a projection area where the image is projected; an infrared camera module including an infrared camera configured to generate an image by capturing the projection area using an image sensor; a memory storing correction data, wherein the correction data includes correction values ​​for correcting the brightness of the image; and at least one processor. The at least one processor is configured to: use the correction data to correct the brightness of the image obtained by the infrared camera module; and identify whether touch input to the projected image has been input based on the corrected brightness, wherein the correction data is generated based on first correction data and second correction data, the first correction data including correction values ​​for correcting a reduction in the intensity of the infrared light based on a distance from the infrared emitter, and the second correction data including correction values ​​for correcting lens shading.

[0005] The correction value included in the first correction data can be determined based on the intensity of infrared radiation measured in multiple regions within the projection area.

[0006] The correction values ​​included in the first correction data include correction values ​​for a plurality of pixels of the image sensor. The correction values ​​for the plurality of pixels of the image sensor may include correction values ​​for pixels corresponding to a plurality of regions and correction values ​​for pixels corresponding to the remaining regions. The correction values ​​for pixels corresponding to a plurality of regions may include correction values ​​for a plurality of regions. The correction values ​​for a plurality of regions may be determined such that when the correction values ​​for a plurality of regions are applied to a plurality of infrared intensities measured in a plurality of regions, the plurality of infrared intensities to which the correction values ​​have been applied become equal to each other.

[0007] The second correction data may include correction values ​​for multiple pixels of the image sensor. The correction values ​​of the correction data can be obtained by multiplying the correction values ​​of the first correction data pixel by pixel with the correction values ​​of the second correction data.

[0008] At least one processor may be configured individually and / or collectively to: obtain pixel values ​​of a plurality of pixels of an image sensor based on infrared light emitted from an infrared emitter being reflected by an object present in the projection area and received by an infrared camera module; and to correct the brightness of an image by applying correction values ​​included in correction data to the plurality of pixel values, wherein the plurality of pixel values ​​may include the Y component of YUV data.

[0009] At least one processor may be configured individually and / or collectively to: identify, based on corrected brightness, whether there is a region in the image with brightness equal to or greater than a specified value; and, based on the identification of a region with brightness equal to or greater than the specified value, to identify that touch input has been input at a location in the projected image corresponding to the identified region.

[0010] A method for identifying touch input from a projector according to an example embodiment may include: projecting an image; outputting infrared light to a projection area where the image is projected using an infrared emitter; generating an image by capturing the projection area using an infrared camera module including an infrared camera; correcting the brightness of the image obtained by the infrared camera module using correction data; and identifying whether touch input to the projected image has been input based on the corrected brightness, wherein the correction data is generated based on first correction data and second correction data, the first correction data including a correction value for correcting a reduction in the intensity of the infrared light based on the distance from the infrared emitter, and the second correction data including a correction value for correcting lens shading.

[0011] In a non-transitory computer-readable medium storing computer instructions, the computer instructions, when executed by at least one processor of the projector, cause the projector to perform operations including: projecting an image; outputting infrared light to a projection area where the image is projected using an infrared emitter; generating an image by capturing the projection area using an infrared camera module including an infrared camera; correcting the brightness of the image obtained by the infrared camera module using correction data; and identifying whether touch input to the projected image has been input based on the corrected brightness, wherein the correction data is generated based on first correction data and second correction data, the first correction data including a correction value for correcting a reduction in the intensity of the infrared light according to the distance from the infrared emitter, and the second correction data including a correction value for correcting lens shading. Attached Figure Description

[0012] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: Figure 1a and Figure 1b This is a diagram illustrating an example projector according to various embodiments; Figure 2a This is a block diagram illustrating example configurations of a projector according to various embodiments; Figure 2b and Figure 2c This is a diagram illustrating examples of configurations of infrared emitters according to various embodiments; Figure 2d This is a block diagram illustrating example configurations of an infrared camera module according to various embodiments; Figure 2e This is a block diagram illustrating example configurations of a projector according to various embodiments; Figure 3 This is a block diagram illustrating an example configuration of an electronic device according to various embodiments; Figure 4a and Figure 4b This is a diagram illustrating an example method for generating first correction data according to various embodiments; Figure 5 This is a diagram illustrating examples of first correction data according to various embodiments; Figure 6 This is a diagram illustrating examples of second correction data according to various embodiments; Figure 7 This is a diagram illustrating examples of correction data according to various embodiments; Figure 8a and Figure 8b This is a diagram illustrating example methods for detecting the direction of touch input according to various embodiments; Figure 9a and Figure 9b This is a diagram illustrating example methods for detecting touch input near a projection area according to various embodiments; Figure 10a and 10b This is a diagram illustrating example methods for detecting touch input moving away from the projection area according to various embodiments; and Figure 11 This is a flowchart illustrating an example method for recognizing the location of a touch input using a projector according to various embodiments. Detailed Implementation

[0013] The present disclosure will be described in more detail below with reference to the accompanying drawings.

[0014] Because this disclosure is subject to various modifications and has multiple exemplary embodiments, various exemplary embodiments of this disclosure will be shown in the accompanying drawings and described in more detail in the detailed description. However, it will be understood that this disclosure is not limited to the specific exemplary embodiments, but includes all modifications, equivalents, and / or alternatives to the exemplary embodiments of this disclosure. Throughout the drawings, similar components may be indicated by similar reference numerals.

[0015] In describing this disclosure, detailed descriptions may be omitted where it is determined that a detailed description of a known function or configuration used in connection with this disclosure may unnecessarily obscure the gist of the disclosure.

[0016] Furthermore, the following example embodiments can be modified in many different forms, and the scope and spirit of this disclosure are not limited to the following example embodiments. Rather, these example embodiments make this disclosure full and complete, and are provided so that they will fully convey the spirit of this disclosure to those skilled in the art.

[0017] The terminology used in this disclosure is for describing particular example embodiments and not for limiting the scope of this disclosure. Unless the context clearly indicates otherwise, the singular forms are intended to include the plural forms.

[0018] In this disclosure, the expressions “have,” “may have,” “include,” or “may include” as used herein indicate the presence of a corresponding feature (e.g., an element such as a numerical value, function, operation, or component), but do not exclude the presence of additional features.

[0019] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A and / or B” may include any one and all combinations of one or more items listed together. For example, the terms “A or B,” “at least one of A and B,” or “at least one of A or B” may refer to all of the following cases: (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0020] The expressions “first,” “second,” “1st,” “2nd,” etc., used in this disclosure may refer to various components regardless of the order and / or importance of the components. These expressions are only used to distinguish one component from another and do not limit the corresponding components.

[0021] When a descriptive element (e.g., a first element) is referred to as being "operably or communicatively combined" with "another element (e.g., a second element)" / "operably or communicatively combined to" or "connected to" another element (e.g., a second element), it should be understood that the element (e.g., the first element) may be directly combined with / combined to or connected to the other element, or there may be an intermediate element (e.g., a third element).

[0022] When an element (e.g., the first element) is referred to as being "directly coupled" to or "directly connected" to another element (e.g., the second element), it should be understood that there is no intermediate element (e.g., the third element).

[0023] The expression “~ is configured (or set) to” as used in this disclosure may be replaced, as appropriate, by expressions such as “suitable for,” “capable of,” “~ is designed to,” “~ is adapted to,” “~ is manufactured to,” or “~ is able to.” The term “~ is configured (or set) to” may not necessarily refer to “specifically designed to” in hardware.

[0024] The phrase “~a device configured to…” can refer to, for example, the device being able to… together with other devices or components. For example, “a processor configured (or set) to perform A, B, and C” can refer to, for example, a dedicated processor (e.g., an embedded processor) for performing the respective operations, or a general-purpose processor (e.g., a central processing unit (CPU) or application processor) that can perform the respective operations by running one or more software programs stored in a memory device.

[0025] In various example embodiments, a "module" or "unit" may perform at least one function or operation and may be implemented by hardware or software, or by a combination of hardware and software. Furthermore, in addition to "modules" or "units" that require implementation by specific hardware, multiple "modules" or multiple "units" may be integrated into at least one module and implemented by at least one processor.

[0026] In the following, various exemplary embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings.

[0027] Figure 1a and Figure 1b This is a diagram illustrating an example projector according to various embodiments.

[0028] Reference Figure 1a and Figure 1b The projector 100 (or projector device) can be a means for magnifying and projecting an image onto a projection surface (e.g., a floor surface, etc.). The projector 100 can be a portable projector (or a handheld projector) that can be carried by a user. The projector 100 can also be implemented as an ultra-short throw (UST) projector and can display large-screen images.

[0029] Projector 100 can project image 11 onto floor surface 1 using projection component 110 and illuminate infrared light (IR) 12 in a direction parallel to floor surface 1 using infrared emitter 120. Projector 100 can photograph floor surface 1 using infrared camera module 130. Area 13 photographed by infrared camera module 130 may include the area where image 11 is projected (e.g., projection area 14).

[0030] When object 15 is located within projection area 14, infrared light 12 emitted from projector 100 can be reflected by object 15. Projector 100 can acquire an image by receiving infrared light 16 reflected by object 15 using infrared camera module 130, and can identify the position of object 15 based on the brightness value of the image. Projector 100 can identify the position of touch input in image 11 based on the position of object 15, and can execute functions corresponding to the touch input.

[0031] As described above, the projector 100 can acquire images through the infrared camera module 130 and identify the location of objects based on the brightness values ​​of the images.

[0032] The image sensor of the infrared camera module 130 captures images through a lens, and the optical characteristics of the lens (such as the convex shape of the lens) may cause lens shading, in which the brightness of the edge areas of the image is reduced compared to the brightness of the center area. If this lens shading is not corrected, the position of the object may be inaccurately identified.

[0033] Furthermore, the brightness of the image can be determined by the intensity of the infrared light reflected by the object and received by the infrared camera module 130. Considering that the greater the distance to the infrared emitter 120, the weaker the intensity of the arriving infrared light, and the farther the object is from the infrared emitter 120, the weaker the intensity of the infrared light reflected by the object. Thus, if the intensity of the reflected infrared light varies depending on the object's position, the brightness of the object captured in the image can also vary depending on the object's position, which may affect the identification of the object's location.

[0034] The projector 100 according to an embodiment can perform lens shading correction when recognizing the position of an object using an image obtained by the infrared camera module 130, and correct for differences in the intensity of infrared light arriving at the object based on the object's position. This can lead to improved recognition of touch input.

[0035] Figure 2a This is a block diagram illustrating example configurations of a projector according to various embodiments.

[0036] Reference Figure 2aThe projector 100 includes a projection component (e.g., including a light source) 110, an infrared emitter 120, an infrared camera module (e.g., including an infrared camera) 130, a memory 140, and one or more processors (e.g., including processing circuitry) 150.

[0037] The projection component 110 can project images. The projection component 110 may include a light source. For example, the projection component 110 may include at least one of a lamp, an LED, or a laser.

[0038] The projection component 110 can project images using various projection methods. For example, the projection component 110 can project images using one of the following methods: cathode ray tube (CRT) projection method, liquid crystal display (LCD) projection method, digital light processing (DLP) projection method, laser projection method, etc., but this disclosure is not limited thereto.

[0039] The projection unit 110 can perform various functions to adjust the image under the control of one or more processors 150.

[0040] For example, the projection component 110 can adjust the focus of the image according to the distance from the floor surface (e.g., projection distance) and project the image onto the floor surface.

[0041] Furthermore, the projection unit 110 can perform trapezoidal distortion correction. Trapezoidal distortion correction refers to a function used to correct distorted images. For example, when the image is distorted in the left-right direction, the projection unit 110 can perform horizontal trapezoidal distortion correction, and when the image is distorted in the up-down direction, the projection unit 110 can perform vertical trapezoidal distortion correction. The projection unit 110 can also perform fast angle trapezoidal distortion correction to correct unbalanced angles in the region.

[0042] Infrared emitter 120 outputs (or illuminates) infrared light. Infrared emitter 120 may include a laser diode (e.g., an IR emitter) for emitting infrared light. Infrared emitter 120 may output infrared light to a projection area of ​​an image projected by projection component 110. For example, infrared emitter 120 may output infrared light parallel to the projection area.

[0043] In the example, the infrared emitter 120 may include a reflector for reflecting infrared light emitted from the laser diode toward the front of the projector 100.

[0044] For example, such as Figure 2b As shown, the reflector 122 can be conical in shape. A material capable of reflecting infrared light (such as a mirror) can be formed on the side of the reflector 122. A laser diode 121 can be disposed on the top of the reflector 122. Therefore, infrared light output from the laser diode 121 can be reflected from the side of the reflector 122 and output to the front of the projector 100.

[0045] In another example, such as Figure 2c As shown, reflector 122 may have a curved surface shape. The curved surface of reflector 122 may be formed of a material capable of reflecting infrared light (such as a mirror). Laser diode 121 may output infrared light toward the curved surface of reflector 122. Therefore, the infrared light output from laser diode 121 may be reflected from the curved surface of reflector 122 and output to the front of projector 100.

[0046] In this way, if a reflector is present, infrared light can be reflected by the reflector and output to a wide area in front of the projector 100, thereby enhancing the field of view (FOV) of the infrared camera module 130.

[0047] Infrared camera module 130 includes an infrared camera and generates an image by capturing the projection area using an image sensor. For example, infrared camera module 130 can receive light and generate an image corresponding to the received light. If an object is present in the projection area, infrared light emitted from infrared emitter 120 can be reflected by the object. Infrared camera module 130 can receive the infrared light reflected by the object and can generate an image using an electrical signal corresponding to the received infrared light.

[0048] Reference Figure 2d The infrared camera module 130 may include a lens assembly (e.g., including a lens) 131, a filter 132, and an image sensor 133. However, such a configuration is merely an example, and new configurations may be added or some configurations may be omitted in practice with this disclosure. For example, the infrared camera module 130 may also include an image signal processor (ISP), which may include various processing circuitry. The image signal processor may be configured as at least a portion of one or more processors 150.

[0049] Lens assembly 131 can collect light incident from the outside. Lens assembly 131 may include one or more lenses. For example, lens assembly 131 can refract light incident from the outside. The refracted light can be focused onto image sensor 133.

[0050] Filter 132 allows infrared light to pass through. For example, filter 132 may include a bandpass filter that allows light in a specific wavelength band to pass through. Filter 132 allows infrared light that has already passed through lens assembly 131 to pass through.

[0051] Image sensor 133 can use infrared light that has passed through filter 132 to generate an image corresponding to the infrared light. Image sensor 133 can be implemented as a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor. Image sensor 133 can generate an image by using multiple pixels to convert the infrared light that has passed through filter 132 into an electrical signal. Subsequently, image sensor 133 can send the image to one or more processors 150.

[0052] The memory 140 may store data required for the projector 100 to operate according to various embodiments. For example, the memory 140 may store correction data including correction values ​​for correcting the brightness of an image.

[0053] Depending on the purpose of storing data, the memory 140 may be implemented as a memory embedded in the projector 100 (e.g., volatile memory, non-volatile memory, hard disk drive or solid-state drive, etc.), or it may be implemented as a memory removably attached to the projector 100 (e.g., memory card, external memory, etc.).

[0054] Memory 140 may store one or more instructions. One or more processors 150 may perform operations of the projector according to various embodiments by executing one or more instructions stored in the memory. Memory 140 may store programs, applications, and data for driving the projector 100.

[0055] One or more processors 150 may include various processing circuits and control the overall operation of the projector 100. For example, one or more processors 150 may be connected to components of the projector 100 to control the overall operation of the projector 100. For example, one or more processors 150 may be connected to the projection component 110, the infrared emitter 120, the infrared camera module 130, and the memory 140 to control the projector 100. One or more processors 150 may include one or more processors.

[0056] One or more processors 150 may perform operations of the projector 100 according to various embodiments by executing one or more instructions stored in memory 140.

[0057] One or more processors 150 may include one or more of an image signal processor (ISP), a central processing unit (CPU), a graphics processing unit (GPU), an accelerometer processing unit (APU), an integrated many-core processor (MIC), a digital signal processor (DSP), a neural processing unit (NPU), a hardware accelerator, or a machine learning accelerator. One or more processors 150 may control one or any combination of other components of the projector 100 and may perform communication-related operations or data processing. One or more processors 150 may run one or more programs or instructions stored in memory 140. For example, one or more processors 150 may perform a method according to an embodiment by running one or more instructions stored in memory 140.

[0058] When the method according to the embodiments includes multiple operations, the multiple operations may be executed by one processor or multiple processors. For example, when the first operation, the second operation, and the third operation are performed by the method according to the embodiments, all of the first operation, the second operation, and the third operation may be executed by the first processor, or the first operation and the second operation may be executed by the first processor (e.g., a general-purpose processor), while the third operation may be executed by the second processor (e.g., an artificial intelligence-specific processor).

[0059] One or more processors 150 may be implemented as a single-core processor including a single core, or as one or more multi-core processors including multiple cores (e.g., homogeneous multi-core or heterogeneous multi-core). When one or more processors 150 are implemented as multi-core processors, each of the multiple cores included in the multi-core processor may include processor internal memory (such as cache memory, on-chip memory), and a common cache shared by the multiple cores may be included in the multi-core processor. Furthermore, each (or some) of the multiple cores included in the multi-core processor may independently read and execute program instructions for implementing the methods according to the embodiments, or all (or some) of the multiple cores may be combined to read and execute program instructions for implementing the methods according to the embodiments.

[0060] When the method according to the embodiment includes multiple operations, the multiple operations may be executed by one core of a plurality of cores included in a multi-core processor, or may be executed by a plurality of cores. For example, when the first operation, the second operation, and the third operation are performed by the method according to the embodiment, all of the first operation, the second operation, and the third operation may be executed by the first core included in the multi-core processor, or the first operation and the second operation may be executed by the first core included in the multi-core processor, while the third operation may be executed by the second core included in the multi-core processor.

[0061] In various embodiments of this disclosure, a processor may refer to, for example, a system-on-a-chip (SoC) that integrates one or more processors and other electronic components, a single-core processor, a multi-core processor, or a core included in a single-core or multi-core processor. A core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but is not limited to the various embodiments of this disclosure.

[0062] In the following text, for ease of explanation, one or more processors 150 will be referred to as processor 150. For example, processor 150 according to embodiments of the present disclosure may include various processing circuitry and / or multiple processors. For example, as used herein (including the claims), the term "processor" may include various processing circuitry, including at least one processor, wherein one or more of the at least one processor may be configured individually and / or collectively in a distributed manner to perform the various functions described herein. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform a number of functions, these terms cover, for example, a case in which one processor performs some of the functions and another processor performs other functions, and a case in which a single processor can perform all of the functions. Additionally, at least one processor may include, for example, a combination of processors performing various described / disclosed functions in a distributed manner. At least one processor may execute program instructions to implement or perform various functions.

[0063] Figure 2e This is a block diagram illustrating example configurations of a projector according to various embodiments.

[0064] Reference Figure 2e The projector 100 may include a projection component 110, an infrared emitter 120, an infrared camera module 130, a memory 140, one or more processors 150, a user interface (e.g., including interface circuitry) 160, a communication interface (e.g., including communication circuitry) 170, a speaker 180, and a camera module (e.g., including a camera) 190. However, the above components are merely examples, and new configurations may be added or some configurations may be omitted when practicing this disclosure. Further description is unnecessary here. Figure 2e The one shown in the middle is the same as Figure 2a The configuration shown is a duplicate configuration.

[0065] User interface 160 includes circuitry. User interface 160 can receive user input and send user input to processor 150.

[0066] User interface 160 may include various circuits, including various types of input devices.

[0067] For example, user interface 160 may include physical buttons. Physical buttons may include function keys, directional keys, or dial buttons. Physical buttons may be implemented as multiple keys. Physical buttons may be implemented as a single key. If a physical button is implemented as a single key, then when user input is received that the key has been pressed for more than a threshold amount of time, processor 150 may execute a function corresponding to the user input.

[0068] For example, user interface 160 may use a touch method to receive user input. User interface 160 may include a touch sensor or a touch screen.

[0069] For example, user interface 160 can receive user input from an external device. The external device may include a remote control (e.g., a remote controller) for controlling projector 100 or a user's mobile device (e.g., a smartphone, tablet PC, or wearable device). The mobile device may store applications for controlling projector 100. The mobile device can receive user input through the application and can send user input to projector 100.

[0070] For example, user interface 160 may use speech recognition to receive user input. User interface 160 may use a microphone to receive user voice. Processor 150 may execute functions corresponding to user voice. For example, processor 150 may use speech-to-text (STT) functionality to convert user voice into text data, obtain control command data based on the text data, and execute functions corresponding to user voice based on the control command data. According to an embodiment, the STT function may be executed on a server.

[0071] The communication interface 170 may include various communication circuits and perform communication with external devices. For example, the communication interface 170 may perform communication with external devices (such as servers, mobile devices, etc.) via a nearby access point (AP). The access point (AP) may connect the local area network (LAN) to which the projector 100 or mobile device is connected to to a wide area network (WAN) to which the server is connected. The projector 100 may be connected to the server via the WAN. The communication interface 170 may also perform communication with external devices without going through an access point.

[0072] The communication interface 170 may include a wireless communication module or a wired communication module. The communication module may be implemented as at least one hardware chip.

[0073] The wireless communication module may include a module that performs communication with external devices. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, or an infrared communication module. However, the wireless communication module is not limited to these and may include a communication module that performs communication according to various wireless communication standards, such as Long Term Evolution (LTE), LTE-A Advanced (LTE-A), 4G, 5G, etc.

[0074] The wired communication module may include a module that performs communication with external devices. For example, the wired communication module may include at least one of a LAN module, an Ethernet module, an HDMI high-definition multimedia interface, a universal serial bus (USB), a USB Type-C port, or a DisplayPort (DP).

[0075] External power can be supplied to the communication interface 170. For example, power from an external battery can be supplied to the projector 100 via HDMI, USB, USB Type-C, etc., or power from a power outlet can be supplied to the projector 100 via a power adapter. In addition, power from external devices (e.g., laptops, monitors, etc.) can be supplied to the projector 100 via DisplayPort.

[0076] The speaker 180 can output audio signals. The speaker 180 may include an acoustic output module. For example, the acoustic output module may include multiple acoustic output units. The multiple acoustic output units may be symmetrically arranged within the main body of the projector 100. The processor 150 may use the multiple acoustic output units to output audio signals in a 360-degree direction.

[0077] Camera module 190 may include a camera and acquire an image by performing a capture. For example, camera module 190 may be an RGB camera. Camera module 190 may acquire an image of a projection area by capturing the direction in which the projection component 110 projects the image. Camera module 190 may include a lens assembly having one or more lenses, an image sensor, and an image signal processor. The image signal processor may include at least a portion of one or more processors 150. If the image projected by the projection component 110 is distorted, the processor 150 may control the projection component 110 to use the image acquired by camera module 190 to correct the distortion in the image.

[0078] The method for generating correction data according to the embodiments will be described in more detail below.

[0079] The process of obtaining calibration data can be performed in electronic devices. Figure 3 This is a block diagram illustrating example configurations of an electronic device according to various embodiments; Reference Figure 3 The electronic device 200 may include an infrared sensor 210, a camera module (e.g., including a camera) 220, a communication interface (e.g., including communication circuitry) 230, a memory 240, and one or more processors (e.g., including processing circuitry) 250.

[0080] Infrared sensor 210 can receive infrared light and measure its intensity. For example, infrared sensor 210 may include a filter for removing signals from frequency bands other than infrared light, a photodiode for converting infrared light into an electrical signal, an amplifier for amplifying the electrical signal, etc. Infrared sensor 210 can then send information about the measured intensity to one or more processors 250.

[0081] Camera module 220 may include a camera and acquire images by performing a shooting action. For example, camera module 220 may be an RGB camera. Camera module 220 may include a lens assembly having one or more lenses, an image sensor, and an image signal processor. The image signal processor may include at least a portion of one or more processors 250.

[0082] Communication interface 230 may include various communication circuits and perform communication with external devices. For example, communication interface 230 may perform communication with external devices (such as projector 100) via a nearby access point (AP). The access point (AP) connects the local area network (LAN) to which electronic device 200 or mobile device is connected to the wide area network (WAN) to which the server is connected. Electronic device 200 may connect to the server via the wide area network (WAN). Communication interface 230 may also perform communication with external devices without going through an access point.

[0083] The communication interface 230 may include a wireless communication module or a wired communication module. The communication module may be implemented as at least one hardware chip.

[0084] A wireless communication module can be a module that performs communication with external devices. For example, a wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, or an infrared communication module. However, a wireless communication module is not limited to these and may include a communication module that performs communication according to various wireless communication standards, such as LTE, LTE-A, 4G, 5G, etc.

[0085] A wired communication module can be a module that performs communication with external devices. For example, a wired communication module may include at least one of a LAN module, an Ethernet module, an HDMI module, a USB module, a USB Type-C module, or a DisplayPort module.

[0086] The memory 240 can store data required for the operation of the electronic device 200 according to various embodiments.

[0087] Depending on the purpose of storing data, the memory 240 may be implemented as a memory embedded in the electronic device 200 (e.g., volatile memory, non-volatile memory, hard disk drive or solid-state drive, etc.), or it may be implemented as a memory removably attached to the electronic device 200 (e.g., memory card, external memory, etc.).

[0088] Memory 240 may store one or more instructions. One or more processors 250 may perform operations of electronic device 200 according to various embodiments by executing one or more instructions stored in memory 240. Memory 240 may store programs, applications, and data for driving electronic device 200.

[0089] One or more processors 250 may include various processing circuits and control the overall operation of the electronic device 200. Specifically, one or more processors 250 may be connected to components of the electronic device 200 to control the overall operation of the electronic device 200. For example, one or more processors 250 may be connected to an infrared sensor 210, a camera module 210, a communication interface 230, and a memory 240 to control the electronic device 200. One or more processors 250 may include one or more processors.

[0090] One or more processors 250 may perform operations of the electronic device 200 according to various embodiments by executing one or more instructions stored in memory 240.

[0091] One or more processors 250 may include one or more of an ISP, CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator. One or more processors 250 may control one or any combination of other components of the electronic device 200 and may perform communication-related operations or data processing. One or more processors 250 may run one or more programs or instructions stored in memory. For example, one or more processors 250 may perform a method according to an embodiment by running one or more instructions stored in memory 240.

[0092] In the following text, for ease of explanation, one or more processors 250 will be referred to as processor 250. For example, processor 250 according to embodiments of the present disclosure may include various processing circuitry and / or multiple processors. For example, as used herein (including the claims), the term "processor" may include various processing circuitry, including at least one processor, wherein one or more of the at least one processor may be configured individually and / or collectively in a distributed manner to perform the various functions described herein. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform a number of functions, these terms cover, for example, a case in which one processor performs some of the functions and another processor performs other functions, and a case in which a single processor can perform all of the functions. Additionally, at least one processor may include, for example, a combination of processors performing various described / disclosed functions in a distributed manner. At least one processor may execute program instructions to implement or perform various functions.

[0093] Processor 250 can generate correction data. Correction data can be generated based on first and second correction data.

[0094] The first correction data may include correction values ​​used to correct for a decrease in infrared intensity based on the distance from the infrared emitter 120. These correction values ​​may be determined based on measured infrared intensities in multiple regions within the projection area.

[0095] The processor 250 can use the infrared sensor 210 to detect the intensity of infrared radiation in each region. For example, the projection area can be divided into multiple regions. When infrared radiation is being emitted from the infrared emitter 120, the processor 250 can use the infrared sensor 210 disposed in each of the multiple regions to detect the intensity of infrared radiation in each of the multiple regions. Subsequently, the processor 250 can store information about the intensity of infrared radiation detected in each of the multiple regions in the memory 240.

[0096] For example, such as Figure 4a As shown, the projection area 410 can be divided into n×m regions. Here, n and m are natural numbers equal to or greater than 2. An infrared sensor 210 can be disposed in one of the regions 41 of the multiple regions. The infrared sensor 210 can receive infrared radiation output from the infrared emitter 120 and can detect the intensity of the received infrared radiation. The infrared sensor 210 can send information about the intensity of the detected infrared radiation to the processor 250.

[0097] If the above process is performed sequentially on the remaining regions, infrared intensity can be measured in each of the multiple regions.

[0098] The processor 250 can identify correction values ​​for multiple regions. The processor 250 can then store the identified correction values ​​in the memory 240.

[0099] For example, processor 250 can determine correction values ​​for multiple regions such that when the correction values ​​for multiple regions are applied to the intensities of multiple infrared rays measured in the multiple regions, the intensities of the multiple infrared rays to which the correction values ​​are applied are equal. For example, suppose the intensities of infrared rays measured in multiple regions (e.g., a11, a12, ..., anm) are r11, r12, ..., rnm. Processor 250 can calculate correction values ​​w11, w12, ..., wnm for the multiple regions such that r11 × w11 = r12 × w12 = ... = rnm × wnm.

[0100] The processor 250 can identify the pixels of the image sensor 133 corresponding to each region by region of interest (ROI) matching.

[0101] For example, a marker can be placed on area 41 within the projection area 410. The marker can be an object used to distinguish one area from other areas. The processor 250 can obtain an image of the projection area by using the camera module 220 to capture images of the projection area. When the projector 100 is placed on a floor surface, the camera module 220 can be positioned in the same location as the infrared camera module 130 within the projector 100, and the shooting direction of the infrared camera module 130 and the camera module 220 can be the same. The viewing angle, the number of pixels of the image sensor, etc., of the camera module 220 can be the same as those of the infrared camera module 130, the number of pixels of the image sensor 133, etc.

[0102] The processor 250 can identify which of the multiple pixels of the image sensor in the camera module 220 captured the marker. For example, as Figure 4b As shown, the image 420 obtained by the camera module 220 may include region 42, in which the marker set in region 41 is captured. In one example, the processor 250 may use the pixel values ​​of multiple pixels of the image sensor of the camera module 220 to identify which of the multiple pixels captured region 42.

[0103] The processor 250 can identify a pixel corresponding to a captured marked pixel from a plurality of pixels in the image sensor 133, based on the position of a marked pixel captured in a plurality of pixels in the image sensor of the camera module 220. The pixel corresponding to the captured marked pixel may include pixels in the image sensor 133 that have the same position as the captured marked pixel. For example, the processor 250 can identify the coordinate values ​​of the captured marked pixel in the image sensor of the camera module 220 and identify pixels in the plurality of pixels in the image sensor 133 that have coordinate values ​​equal to the identified coordinate values, thereby identifying the pixel corresponding to the captured marked pixel in the plurality of pixels in the image sensor 133. However, this is only an example, and the processor 250 can also identify the pixel corresponding to the captured marked pixel in the image sensor 133 by taking into account the total number of pixels, the viewing angle, the position of the captured marked pixel, etc.

[0104] When the above processing is performed sequentially over the remaining regions, the corresponding pixels of the image sensor 133 in each of the multiple regions can be identified.

[0105] The processor 250 can store the correction value calculated based on infrared intensity for each region in the memory 240 as a correction value for the pixel corresponding to each region of the image sensor 133, to generate first correction data. In the first correction data, the correction value for the pixel values ​​of the remaining pixels can be zero. For example, the processor 250 can store w11 as a correction value for correcting the pixel value of the pixel corresponding to region 41 of the image sensor 133. In addition, the processor 250 can store w12, ..., wnm as correction values ​​for correcting the pixel value of each corresponding pixel in the remaining regions of the image sensor 133.

[0106] Therefore, the first correction data may include correction values ​​for a plurality of pixels of the image sensor 133. The correction values ​​for the plurality of pixels may be values ​​used to correct pixel values ​​for the plurality of pixels.

[0107] The correction values ​​may include correction values ​​for pixels corresponding to multiple regions among a plurality of pixels and correction values ​​(e.g., zero) for pixels corresponding to the remaining regions.

[0108] The correction values ​​for pixels corresponding to multiple regions can include correction values ​​for multiple regions. Correction values ​​for multiple regions can be determined such that when the correction values ​​for multiple regions are applied to multiple infrared intensities measured in multiple regions, the multiple infrared intensities to which the correction values ​​are applied are equal to each other.

[0109] Figure 5 This is a diagram illustrating examples of first correction data according to various embodiments.

[0110] The first correction data 510 may include correction values ​​for correcting pixel values ​​of a plurality of pixels of the image sensor 133. For the correction value 511 of the pixels of the image sensor 133 corresponding to the projection area, the farther the area is from the infrared emitter 120, the larger the correction value for the pixel corresponding to that area. The correction value 512 for pixels corresponding to the remaining areas other than the projection area may be zero.

[0111] The second correction data may include correction values ​​for lens shading correction. The second correction data may include correction values ​​for a plurality of pixels of the image sensor 133. As described above, lens shading may be caused by the optical characteristics of the lens. The correction values ​​of the second correction data may include correction values ​​for eliminating such lens shading and may be determined in various ways known in the art. The second correction data may be stored in memory 240.

[0112] Figure 6 This is a diagram illustrating examples of second correction data according to various embodiments.

[0113] The second correction data 610 may include correction values ​​for correcting pixel values ​​of multiple pixels of the image sensor 133. As the position of a pixel moves from the center region to the edge region, the correction value of the pixel may have a larger value.

[0114] Processor 250 can generate correction data based on the first correction data and the second correction data. Processor 250 can store the correction data in memory 240.

[0115] The correction data can be data used by the projector 100 to correct the brightness of the image obtained by the infrared camera module 130.

[0116] For example, such as Figure 7 As shown, the processor 250 can obtain the correction value of the correction data 710 by multiplying the correction value of the first correction data 510 with the correction value of the second correction data 520 pixel by pixel. Pixel-by-pixel multiplication may include multiplying the correction values ​​between pixels at the same location. Therefore, the correction data 710 may include correction values ​​for correcting a plurality of pixels of the image sensor 133.

[0117] Processor 250 can send calibration data to projector 100 via communication interface 230. Processor 150 can receive calibration data from electronic device 200 via communication interface 170 and store the received calibration data in memory 140.

[0118] Return to reference Figure 2a The processor 150 can correct the brightness of the image obtained by the infrared camera module 130, and can identify whether touch input from a user to the projected image has been received based on the corrected brightness.

[0119] For example, when infrared light emitted from infrared emitter 120 is reflected by an object in the projection area and received by infrared camera module 130, processor 150 can obtain pixel values ​​of multiple pixels of image sensor 133.

[0120] The object can include any object that reflects infrared light. For example, the object can include a user's hand, fingers, pen, etc.

[0121] The processor 150 can obtain pixel values ​​by performing signal processing on an image received from the image sensor 133. The format of the pixel values ​​can be, but is not limited to, YUV data format. YUV data format can refer to, for example, data formats representing luminance and chrominance signals, respectively. Y refers to the luminance signal, and U and V refer to the chrominance signals. U can refer to, for example, the difference between the luminance signal and the blue signal component, and V can refer to, for example, the difference between the luminance signal and the red signal component. In YUV data, the Y component can represent information about luminance, and the UV components can represent information about color.

[0122] Processor 150 can correct the brightness of an image by applying a correction value included in the correction data to pixel values. Pixel values ​​may include the Y component of YUV data. For example, processor 150 can correct the Y component by multiplying the correction value included in the correction data with the Y component pixel by pixel.

[0123] The processor 150 can identify, based on the corrected brightness, whether there is a region in the image with a brightness equal to or greater than a predetermined (e.g., specified) value, and if a region with a brightness equal to or greater than the predetermined value is identified, the processor 150 can identify that touch input has been entered at the location in the projected image corresponding to the identified region.

[0124] For example, processor 150 can identify whether there is a region in the image where the magnitude of the corrected Y component is equal to or greater than a predetermined value. If processor 150 identifies a region in the image where the magnitude of the Y component is equal to or greater than the predetermined value, processor 150 can identify the location of the identified region in the image. This location may include coordinate values. Processor 150 can identify a region in the projected image corresponding to the identified location. Information about the coordinates of the image projected from projection unit 110 that match the coordinates of the image obtained by infrared camera module 130 can be stored in memory 140. Processor 150 can use the information stored in memory 140 to identify a region in the image that matches the identified region in the image, and can identify that touch input has been input at the location of the identified region in the image.

[0125] When touch input is detected, the processor 150 can execute the function corresponding to the touch input.

[0126] For example, when a touch input is recognized that an icon for a projected image is entered, the processor 150 can run the application corresponding to that icon. Furthermore, when a touch input is recognized that a menu for a projected image is entered, the processor 150 can execute the function corresponding to the menu (e.g., changing the settings of the projector 100, adjusting the volume, etc.). However, this disclosure is not limited to this, and the processor 150 can execute various interactive functions that can be provided in response to touch input.

[0127] When recognizing the position of an object using an image obtained by the infrared camera module 130, the projector 100 according to the embodiment can not only perform lens shading correction, but also correct for differences in the intensity of infrared light reaching the object based on the object's position. Therefore, the recognition rate for touch input can be improved.

[0128] The processor 150 can recognize the direction of the touch input.

[0129] For example, infrared rays emitted from infrared emitter 120 are reflected by an object located in the projection area, and the area where the infrared rays are reflected by the object is determined according to the direction of the input touch. Furthermore, the shape of the area in the image where the infrared rays are reflected can be determined based on the shape of the area where the infrared rays are reflected, and the shape of the area where the corrected Y component is equal to or greater than a predetermined value can be determined. Therefore, processor 150 can identify the direction of the touch input based on the shape of the area in the image where the corrected Y component is equal to or greater than a predetermined value.

[0130] In the example, such as Figure 8a As shown, suppose a user touches a point in the projection area 812 from left to right using their finger 811. Since the infrared light 813 emitted from the infrared emitter 120 is reflected by the right-facing finger 811, the region 815 in the image 814 obtained by the infrared camera module 130, where the corrected Y component is equal to or greater than a predetermined value, may have a rightward (or upper right) convex shape. When the processor 150 recognizes that region 815 has a rightward convex shape, it can identify that a rightward touch input has been received.

[0131] In the example, such as Figure 8b As shown, suppose a user touches a point in the projection area 822 from right to left using their finger 821. Since the infrared light 823 emitted from the infrared emitter 120 is reflected by the left-facing finger 821, the region 825 in the image 824 obtained by the infrared camera module 130, where the corrected Y component is equal to or greater than a predetermined value, may have a shape that bulges to the left (or upper left). When the processor 150 recognizes that region 825 has a left-bulging shape, it can identify that a touch input in the left direction has been entered.

[0132] In addition to the examples described above, the processor 150 can also detect various directions of touch input. For example, when a region in an image has an upwardly convex shape, the processor 150 can recognize touch input input in an upward direction (e.g., towards the projector 100). Alternatively, when a region in an image has a downwardly convex shape, the processor 150 can recognize touch input input in a downward direction (e.g., opposite to the projector 100).

[0133] Processor 150 can perform functions corresponding to the direction of the touch input. In one example, processor 150 can change the projected image based on the direction of the touch input. For example, when processor 150 recognizes a touch input to the right, processor 150 can control projector 110 to project the previous image. When processor 150 recognizes a touch input to the left, processor 150 can control projector 110 to project the next image. However, these are just examples, and processor 150 can perform various interactive functions based on the direction of the touch input.

[0134] According to an embodiment, the infrared emitter 120 can output infrared light at a first height above the floor surface and infrared light at a second height above the floor surface. The first height may be higher than the second height. For example, the infrared emitter 120 may include a first laser diode and a second laser diode disposed at a lower height than the first laser diode. In this way, the projector 100 can use laser diodes mounted in a multi-layer structure to output infrared light at different heights.

[0135] The processor 150 can use infrared light output at different heights to identify whether the touch input is approaching or moving away from the projection area. For example, if the user's finger is close to the floor, both infrared light at the first height and infrared light at the second height can be reflected by the finger. Therefore, when infrared light at the first height and infrared light at the second height are reflected by the object, there may be two regions in the image where the corrected Y component is equal to or greater than a predetermined value. However, when the user's finger is at a height above the floor surface that is higher than the second height but lower than the first height, only infrared light at the first height can be reflected by the finger. In this way, when only infrared light at the first height is reflected by the object, the number of regions in the image where the corrected Y component is equal to or greater than the predetermined value can be one.

[0136] Therefore, the processor 150 can identify the number of regions in the image and, based on the number of regions, determine whether the touch input is approaching or moving away from the projection area.

[0137] According to the embodiments, such as Figure 9a and Figure 9b As shown, the projector 100 can use the infrared emitter 120 to output infrared rays 921 at a first height above the floor surface and infrared rays 922 at a second height above the floor surface.

[0138] Suppose the user's finger 911 is close to the projection area. For example, as Figure 9aAs shown, when finger 911 is at a height higher than the second height but lower than the first height, infrared light 921 at the first height can be reflected by finger 911. In this case, in the image 931 obtained by the infrared camera module 130, there may be a region 932 where the magnitude of the corrected Y component is equal to or greater than a predetermined value. For example, as Figure 9b As shown, when the user's finger 911 moves further toward the projection area and is at a height below the second height, both the infrared rays 921 at the first height and 922 at the second height can be reflected by the finger 911. In this case, two regions 933 and 934 with corrected Y components equal to or greater than a predetermined value may exist in the image 931 obtained by the infrared camera module 130. When the processor 150 recognizes that the number of regions in the image has increased from one to two, the processor 150 can recognize that touch input is approaching the projection area.

[0139] According to the example, such as Figure 10a and Figure 10b As shown, the projector 100 can use the infrared emitter 120 to output infrared rays 1021 at a first height above the floor surface and infrared rays 1022 at a second height above the floor surface.

[0140] Assume the user's finger 1011 is far from the projection area. For example, as... Figure 10a As shown, when the user's finger 1011 is at a height lower than the second height, both the infrared rays 1021 at the first height and the infrared rays 1022 at the second height can be reflected by the finger 1011. In this case, in the image 1031 obtained by the infrared camera module 130, there may be two regions 1032 and 1033 where the magnitude of the corrected Y component is equal to or greater than a predetermined value. For example, as Figure 10b As shown, when the user's finger 1011 moves away from the projection area and is at a height higher than the second height but lower than the first height, infrared light 1021 at the first height can be reflected by the finger 1011. In this case, in the image 1031 obtained by the infrared camera module 130, there may be a region 1034 where the corrected Y component is equal to or greater than a predetermined value. If the processor 150 detects that the number of regions in the image decreases from two to one, the processor 150 can detect that the touch input is moving away from the projection area.

[0141] Furthermore, the processor 150 can perform corresponding functions based on whether the touch input is approaching or moving away from the projection area. According to an embodiment, when the touch input is recognized as approaching the projection area, the processor 150 can control the projection component 110 to zoom in and project an image. Optionally, when the touch input is recognized as moving away from the projection area, the processor 150 can control the projection component 110 to zoom out and project an image. However, the above embodiments are merely examples, and the processor 150 can perform various interactive functions based on whether the touch input is approaching or moving away from the projection area.

[0142] Figure 11 This is a flowchart illustrating an example method for recognizing the location of a touch input using a projector according to various embodiments.

[0143] Project the image (S1110).

[0144] Infrared light is output to the projection area where the image is projected using an infrared emitter (S1120).

[0145] An image is generated by using an infrared camera module to capture the projection area (S1130).

[0146] The brightness of the image obtained by the infrared camera module is corrected using the correction data (S1140).

[0147] The system identifies whether a user has made a touch input to the projected image based on the corrected brightness (S1150).

[0148] Correction data is generated based on the first and second correction data. The first correction data includes correction values ​​for correcting the reduction in infrared intensity based on the distance from the infrared emitter. The second correction data includes correction values ​​for lens shading correction.

[0149] The correction value included in the first correction data can be determined based on the intensity of infrared radiation measured in multiple regions within the projection area.

[0150] For example, the correction values ​​included in the first correction data may include correction values ​​for multiple pixels of the image sensor of the infrared camera module. The correction values ​​for the multiple pixels of the image sensor may include correction values ​​for pixels corresponding to multiple regions and correction values ​​for pixels corresponding to remaining regions. The correction values ​​for pixels corresponding to multiple regions may include correction values ​​for multiple regions. The correction values ​​for multiple regions may be determined such that when the correction values ​​for multiple regions are applied to multiple infrared intensities measured in multiple regions, the multiple infrared intensities to which the correction values ​​are applied are equal to each other.

[0151] The second correction data may include correction values ​​for multiple pixels of the image sensor of the infrared camera module. The correction values ​​of the correction data can be obtained by multiplying the correction values ​​of the first correction data and the correction values ​​of the second correction data pixel by pixel.

[0152] In step S1140, when infrared light emitted from the infrared emitter is reflected and received by an object present in the projection area, pixel values ​​of multiple pixels of the image sensor of the infrared camera module can be obtained, and the brightness of the image can be corrected by applying correction values ​​included in the correction data to the pixel values. The pixel values ​​may include the Y component of the YUV data.

[0153] In step S1150, the presence of a region in the image with a brightness equal to or greater than a predetermined value can be identified based on the corrected brightness. When a region with a brightness equal to or greater than the predetermined value is identified, it can be identified that a touch input has been entered at the position in the projected image corresponding to the identified region.

[0154] According to embodiments, the various embodiments described above can be implemented in software including instructions stored in a machine-readable storage medium, which can be read by a machine (e.g., a computer). The machine can be an apparatus that invokes stored instructions from the storage medium and operates based on the invoked instructions, and may include electronic devices according to embodiments (e.g., projector 100, electronic device 200). When the instructions are executed by a processor, the processor can directly execute the function corresponding to the instructions, or execute the function corresponding to the instructions using other components under the control of the processor. Instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. A "non-transitory" storage medium is tangible, does not include signals, and does not distinguish whether data is semi-permanently stored or temporarily stored in the storage medium.

[0155] Furthermore, according to embodiments of this disclosure, methods according to the various embodiments described above can be provided in a computer program product. The computer program product is a commodity and can be traded between a seller and a buyer. The computer program product can be distributed in the form of a device-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)) or through an app store (e.g., the Play Store). TM Online distribution. In the case of online distribution, at least a portion of the computer program product may be stored or at least temporarily generated in a storage medium, such as the manufacturer's server, the application store's server, or the memory of a relay server.

[0156] Furthermore, according to embodiments, the various embodiments described above can be implemented using software, hardware, or a combination of software and hardware on a computer or a recording medium readable by a computer or similar device. In some cases, the various embodiments described in this disclosure can be implemented by the processor itself. According to software implementation, the various embodiments (such as the processes and functions described in this disclosure) can be implemented by separate software. Each software can perform one or more functions and operations described in this disclosure.

[0157] Computer instructions for performing processing operations of a device according to the various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in the non-transitory computer-readable medium allow a particular device to perform processing operations according to the various embodiments described above, provided that the computer instructions are executed by the processor of that particular device. A non-transitory computer-readable medium is a medium that stores data and can be read by a device, as opposed to media that store data for short periods (such as registers, caches, memories, etc.). Various examples of non-transitory computer-readable media include, but are not limited to, CDs, DVDs, hard disks, Blu-ray discs, USB drives, memory cards, and ROMs.

[0158] Furthermore, each of the components (e.g., modules or programs) according to various embodiments may include a single entity or multiple entities, and some of the corresponding sub-components described above may be omitted, or other sub-components may be included in various embodiments. Optionally or additionally, some of the components (e.g., modules or programs) may be integrated into a single entity, and may perform the functions performed by the respective components prior to integration in the same or similar manner. According to various embodiments, the operations performed by modules, programs, or other components may be performed sequentially, in parallel, iteratively, or heuristically, and at least some of the operations may be performed in a different order or omitted, or other operations may be added.

[0159] While this disclosure has been shown and described with reference to various exemplary embodiments, it will be understood that these exemplary embodiments are intended to be illustrative and not restrictive, and that this disclosure is not limited to the various exemplary embodiments described above. Those skilled in the art will also understand that various modifications can be made without departing from the true spirit and full scope of this disclosure, including the appended claims and their equivalents. It will also be understood that any of the embodiments described herein may be used in conjunction with any other embodiments described herein.

Claims

1. A projector comprising: a projection part including a light source configured to project an image; an infrared emitter including a circuit configured to output infrared rays to a projection area in which the image is projected; an infrared camera module including an infrared camera configured to generate an image by photographing the projection area using an image sensor; a memory storing correction data, wherein the correction data includes a correction value for correcting brightness of an image; and at least one processor configured to correct brightness of an image obtained through the infrared camera module using the correction data, and identify whether a touch input for a projected image is input based on the corrected brightness, wherein the correction data is generated based on first correction data and second correction data; wherein the first correction data includes a correction value for correcting a decrease in intensity of infrared rays according to a distance from the infrared emitter; and wherein the second correction data includes a correction value for correcting a lens shadow.

2. The projector of claim 1, wherein, The correction value included in the first correction data is determined based on intensities of infrared rays measured in a plurality of regions within the projection area.

3. The projector of claim 2, wherein, The correction value included in the first correction data includes correction values for a plurality of pixels of the image sensor; wherein the correction values for the plurality of pixels of the image sensor include correction values for pixels corresponding to the plurality of regions and correction values for pixels corresponding to a remaining region among the plurality of pixels; wherein the correction values for the pixels corresponding to the plurality of regions include correction values for the plurality of regions; and wherein the correction values for the plurality of regions are determined based on the correction values of the plurality of regions being applied to the intensities of the plurality of infrared rays measured in the plurality of regions, and the intensities of the plurality of infrared rays to which the correction values are applied become equal to each other.

4. The projector of claim 1, wherein, The second correction data includes correction values for a plurality of pixels of the image sensor; and wherein the correction values of the correction data are multiplied pixel by pixel based on the correction values of the first correction data and the correction values of the second correction data.

5. The projector of claim 1, wherein, The at least one processor is configured to: obtain pixel values of the plurality of pixels of the image sensor based on infrared rays output from the infrared emitter being reflected by an object existing in the projection area and being received by the infrared camera module; and correct brightness of an image obtained through the infrared camera module by applying the correction values included in the correction data to the plurality of pixel values, wherein the plurality of pixel values include Y components of YUV data. The at least one processor is configured to:

6. The projector of claim 5, wherein, identify whether there is a region in which brightness is equal to or greater than a specified value in an image obtained through the infrared camera module based on the corrected brightness; and identify that the touch input is input at a position of the projected image corresponding to the identified region based on it being identified that there is a region in which brightness is equal to or greater than the specified value. 7.A method of identifying a touch input of a projector, the method comprising: projecting an image; outputting infrared rays to a projection area in which the image is projected using an infrared emitter; ​ ​ generating an image by photographing the projection area using an infrared camera module including an infrared camera; correcting luminance of an image obtained through the infrared camera module using the correction data; and identifying whether a touch input for a projection image is input based on the corrected luminance, wherein the correction data is generated based on first correction data and second correction data; wherein the first correction data includes correction values for correcting reduction of intensity of infrared rays according to distance from the infrared emitter; and wherein the second correction data includes correction values for correcting lens shading.

8. The method of claim 7, wherein, The correction values included in the first correction data are determined based on intensity of infrared rays measured in a plurality of regions in the projection area.

9. The method of claim 8, wherein, The correction values included in the first correction data include correction values for a plurality of pixels of an image sensor of the infrared camera module; wherein the correction values for the plurality of pixels of the image sensor include correction values for pixels of the plurality of pixels corresponding to the plurality of regions and correction values for pixels corresponding to remaining regions; wherein the correction values for the pixels corresponding to the plurality of regions include correction values for the plurality of regions; and wherein the correction values for the plurality of regions are determined based on correction values of the plurality of regions being applied to a plurality of intensities of infrared rays measured in the plurality of regions, and the plurality of intensities of infrared rays to which the correction values are applied become equal to each other.

10. The method of claim 7, wherein, The second correction data includes correction values for a plurality of pixels of the image sensor; and wherein the correction values of the correction data are pixel-by-pixel multiplied based on the correction values of the first correction data and the correction values of the second correction data.

11. The method of claim 7, wherein, The operation of correcting luminance of an image obtained through the infrared camera module includes: obtaining pixel values of the plurality of pixels of the image sensor based on infrared rays output from the infrared emitter being reflected by an object existing in the projection area and being received by the infrared camera module; and correcting luminance of an image obtained through the infrared camera module by applying correction values included in the correction data to the plurality of pixel values, wherein the plurality of pixel values include Y components of YUV data.

12. The method of claim 11, wherein, The operation of identifying whether a touch input for the projection image is input includes: identifying whether there is a region in which luminance is equal to or greater than a specified value in an image obtained through the infrared camera module based on the corrected luminance; and based on it being identified that there is a region in which luminance is equal to or greater than the specified value, identifying that the touch input is input at a position of the projection image corresponding to the identified region. 13.A non-transitory computer-readable medium storing computer instructions which, when executed by at least one processor of a projector, cause the projector to perform operations, the operations comprising: projecting an image; outputting infrared rays to a projection area in which the image is projected using an infrared emitter; generating an image by photographing the projection area using an infrared camera module including an infrared camera; correcting brightness of an image obtained by the infrared camera module using the correction data; and identifying whether a touch input for a projection image is input based on the corrected brightness, wherein the correction data is generated based on first correction data and second correction data; wherein the first correction data includes correction values for correcting reduction of intensity of infrared rays according to distance from the infrared emitter; and wherein the second correction data includes correction values for correcting lens shading.

14. The non-transitory computer-readable medium of claim 13, wherein, The correction values included in the first correction data are determined based on intensity of infrared rays measured in a plurality of regions in the projection region.

15. The non-transitory computer-readable medium of claim 14, wherein, The correction values included in the first correction data include correction values for a plurality of pixels of an image sensor of the infrared camera module; wherein the correction values for the plurality of pixels of the image sensor include correction values for pixels of the plurality of pixels corresponding to the plurality of regions and correction values for pixels corresponding to remaining regions; wherein the correction values for the pixels corresponding to the plurality of regions include correction values for the plurality of regions; and wherein the correction values for the plurality of regions are determined based on correction values for the plurality of regions being applied to a plurality of intensities of infrared rays measured in the plurality of regions, and the plurality of intensities of infrared rays to which the correction values are applied become equal to each other.

Images