DETECTION METHOD, DETECTION SYSTEM, AND PROGRAM

JP2023111194A5Active Publication Date: 2024-12-05SEIKO EPSON CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2022012931
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2022-01-31
Publication Date
2024-12-05
Estimated Expiration
2042-01-31

AI Technical Summary

Technical Problem

Existing image correction methods struggle with distinguishing pattern images having luminance distributions from noise in captured images, leading to decreased detection accuracy.

Method used

A pattern image is displayed comprising first dots with non-uniform brightness and a second pattern with a single-color region, allowing for the detection of the single-color region in a photographed image to identify the position of the first dots accurately.

Benefits of technology

This approach enhances the detection accuracy of the first dots, improving the correction of image distortions on projection surfaces by clearly distinguishing the pattern elements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

To provide a detection method and a detection system having improved accuracy of detecting a pattern image having a brightness distribution.SOLUTION: A detection system 1 comprises: a projector 200 that displays, on a projection surface 10, a pattern image 500A including a first pattern 510A having first dots 515A with uneven brightness and a second pattern 530A surrounding the periphery of the first pattern 510A and having single color areas; a camera 300 that creates a photographed image obtained by photographing the pattern image 500A; and a processor 100 that executes detecting the single color areas in the second pattern 530A from the image photographed by the camera 300, and identifying the positions of the first dots 515A based on the detected single color areas.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a detection method and a detection system.

Background Art

[0002] Conventionally, a technique for correcting the distortion of an image projected onto a projection surface based on a captured image obtained by capturing a pattern image projected onto the projection surface with a camera is known. For example, Patent Document 1 discloses an image projection system that projects a pattern image including a plurality of unit patterns having a luminance distribution onto a projection surface, detects a reference point from the pattern image captured by an imaging unit, and corrects the image projected by an image projection unit based on the position of the detected reference point.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, a pattern image having a luminance distribution is difficult to distinguish from noise captured in a captured image of a camera, and the detection accuracy may decrease.

Means for Solving the Problems

[0005] One aspect of the detection method of the present disclosure includes displaying a pattern image including a first pattern having a first dot with non-uniform luminance and a second pattern having a single-color region surrounding the first pattern on a display surface, obtaining a captured image obtained by capturing the pattern image, detecting the single-color region of the second pattern from the captured image, and specifying the position of the first dot based on the single-color region.

[0006] One aspect of the detection system of the present disclosure is a detection system that includes a display device that displays a pattern image on a display surface, the pattern image having a first pattern having a first dot with non-uniform brightness and a second pattern having a single-color region surrounding the first pattern; a shooting device that generates a captured image of the pattern image; and a processing device that performs the following actions: detecting the single-color region of the second pattern from the captured image taken by the shooting device, and identifying the position of the first dot based on the single-color region. [Brief explanation of the drawing]

[0007] [Figure 1] A block diagram showing the system configuration of the detection system. [Figure 2] This is a diagram showing a pattern image. [Figure 3] A diagram showing the brightness distribution of the first dot. [Figure 4] A diagram showing variations of the pattern image. [Figure 5] A diagram showing variations of the pattern image. [Figure 6] A diagram showing a portion of the captured pattern image within the captured image. [Figure 7] A flowchart illustrating the operation of the processing unit. [Figure 8] A flowchart illustrating the operation of a projector. [Modes for carrying out the invention]

[0008] 1. Detection System Configuration Figure 1 is a block diagram showing the system configuration of detection system 1. The detection system 1 comprises a processing unit 100, a display device (projector 200), and a camera 300. The projector 200 and camera 300 are connected to the processing unit 100. Figure 1 shows an example where the projector 200 and camera 300 are connected to the processing unit 100 by wire, but the connection between the processing unit 100 and the projector 200 and camera 300 may be made by wireless communication such as Bluetooth or Wi-Fi. Bluetooth and Wi-Fi are registered trademarks. Furthermore, the display device is not limited to the projector 200, and a direct-view flat panel display may be used.

[0009] 2. Configuration of the processing unit The processing unit 100 is comprised of, for example, a desktop or notebook-type personal computer. Alternatively, the processing unit 100 may be a smartphone or tablet device. The processing unit 100 comprises a first interface 110, an operation unit 120, a display unit 130, and a first control unit 150. Hereinafter, the interface will be abbreviated as I / F.

[0010] The first I / F110 includes connection terminals and an I / F circuit that support standards such as HDMI (High-Definition Multimedia Interface) and USB (Universal Serial Bus). HDMI is a registered trademark. Illustrations of the connection terminals and I / F circuit are omitted. The first interface (I / F110) is wired to external devices such as the camera 300 and projector 200, and transmits and receives data between it and the connected external devices. The first interface 110 may be equipped with a communication antenna for wireless communication with external devices.

[0011] The operation unit 120 is equipped with an operation device such as a mouse or keyboard and functions as a reception unit that receives user input.

[0012] The display unit 130 includes, for example, a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel. Illustration of the display panel is omitted. The display unit 130 displays an image based on the image data input from the first control unit 150 on the display panel.

[0013] The first control unit 150 is a computer device including a first storage unit 160 and a first processor 170.

[0014] The first storage unit 160 includes a volatile memory such as a RAM (Random Access Memory) and a non-volatile memory such as a ROM (Read Only Memory). Further, the first storage unit 160 may be configured to include an auxiliary storage device such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).

[0015] The RAM is used for temporary storage of various data, etc., and the ROM stores a control program 161 and a pattern image 500 used for controlling the operation of the processing device 100. The pattern image 500 is an image used for correcting the distortion of the image projected by the projector 200 on the projection surface 10. Details of the pattern image 500 will be described later. <N

[0016] The first processor 170 is an arithmetic processing device including a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The first processor 170 executes the control program 161 to control each part of the processing device 100.

[0017] 3. Configuration of the Projector The projector 200 includes a remote control light receiving unit 210, a second I / F 220, an image processing unit 231, a frame memory 233, a projection unit 240, and a second control unit 250.

[0018] The remote control receiver 210 receives infrared signals transmitted from the remote control 5. The remote control receiver 210 is, for example, a photodiode. The remote control 5 has multiple operation buttons for operating the projector 200 and functions as a reception unit that receives user input. The remote control 5 transmits infrared signals to the projector 200 corresponding to the operation buttons operated by the user. The remote control receiver 210 decodes the received infrared signals and generates operation signals corresponding to the received infrared signals. The remote control receiver 210 outputs the generated operation signals to the second control unit 250.

[0019] The second interface 220 includes, for example, connection terminals and an interface circuit. The illustration of the connection terminals and interface circuit is omitted. The second interface 220 is wired to an external device, the processing unit 100, and transmits and receives data between it and the connected processing unit 100. The second interface 220 may also be equipped with a communication antenna for wireless communication with the external device.

[0020] The image processing unit 231 is connected to the frame memory 233. The image processing unit 231 expands the image data input from the second interface 220 into the frame memory 233. The frame memory 233 is configured, for example, as SDRAM (Synchronous Dynamic Random Access Memory).

[0021] The image processing unit 231 performs image processing on the image data expanded in the frame memory 233, such as resolution conversion or resizing, distortion correction, shape correction, digital zoom, and adjustment of image hue and brightness. The image processing unit 231 executes the image processing specified by the second control unit 250 and, if necessary, uses parameters input from the second control unit 250. The image processing unit 231 can also, of course, combine and execute multiple of the above image processing operations. The image processing unit 231 reads the processed image data from the frame memory 233 and outputs the read image data to the optical modulator 243 of the projection unit 240.

[0022] The image processing unit 231 and the frame memory 233 are composed of, for example, integrated circuits. Integrated circuits include LSIs (Large Scale Integrated Circuits), ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), FPGAs (Field-Programmable Gate Arrays), SoCs (System-on-a-chip), etc. Furthermore, the configuration of the integrated circuit may include analog circuits as part of its configuration, and the second control unit 250 may be combined with an integrated circuit.

[0023] The projection unit 240 includes a light source 241, an optical modulator 243, and an optical unit 245.

[0024] The light source 241 consists of lamps such as halogen lamps, xenon lamps, and ultra-high pressure mercury lamps, or solid-state light sources such as LEDs (Light Emitting Diodes) and laser light sources.

[0025] The optical modulator 243 includes an optical modulator element. Based on image data input from the image processing unit 231, the optical modulator 243 modulates the light emitted by the light source 241 to generate image light. The image light modulated by the optical modulator 243 is emitted to the optical unit 245. The optical modulator element may be a transmissive liquid crystal panel or a reflective liquid crystal panel. Alternatively, the optical modulator element may be configured using a digital mirror device.

[0026] The optical unit 245 includes projection lenses such as a focus lens for adjusting focus and a zoom lens for adjusting zoom. The projection lenses are not shown in the diagram. The optical unit 245 uses the projection lenses to focus the image light emitted by the light modulator 243 onto the projection surface 10. As a result, an image based on the image light is projected onto the projection surface 10. The projection surface 10 corresponds to the display surface.

[0027] The second control unit 250 is a computer device comprising a second storage unit 260 and a second processor 270.

[0028] The second memory unit 260 includes a volatile memory such as RAM and a non-volatile memory such as ROM. The RAM is used for temporary storage of various data, and the ROM stores the control program 261 used to control the operation of the projector 200 and various setting information.

[0029] The second processor 270 is a processing unit equipped with a CPU and an MPU. The second processor 270 executes the control program 261 to control various parts of the projector 200.

[0030] 4. Camera Configuration Camera 300 corresponds to an imaging device and comprises an imaging lens, an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary MOS), and a data processing circuit. The imaging lens, image sensor, and data processing circuit are not shown in the diagram. Camera 300 captures an area including at least the projection surface 10 and generates an image based on instructions from the processing device 100. Camera 300 outputs the generated image to the processing device 100.

[0031] 5. Composition of pattern images When the first control unit 150 receives an operation from the operation unit 120 to instruct it to start a correction process to correct the distortion of the image to be displayed on the projector 200, it reads the pattern image data 163 from the first storage unit 160. The first control unit 150 then transmits the read pattern image data 163 to the projector 200. The correction process is performed by the projector 200 and is a shape correction that corrects the distortion of the image displayed by the projector 200 on the projection surface 10. In addition, it can also include adjustment of the color tone and brightness of the image, resizing, and correction of distortion aberration.

[0032] When the second control unit 250 receives pattern image data 163 from the processing unit 100, it controls the image processing unit 231 and the projection unit 240 to generate image light based on the pattern image data 163, and projects the generated image light onto the projection surface 10 using the projection unit 240. As a result, a pattern image 500 corresponding to the pattern image data 163 is displayed on the projection surface 10.

[0033] Now, we will explain pattern image 500 with reference to Figures 2 to 5. Below, we will describe three examples of pattern image 500: pattern images 500A, 500B, and 500C. When referring to pattern images 500A, 500B, and 500C collectively, we will use the term "pattern image 500."

[0034] Figure 2 shows pattern image 500A. Pattern image 500A is an image that includes the first pattern 510A and the second pattern 530A.

[0035] The first pattern 510A is an image in which multiple first dots 515A are arranged in a matrix. Figure 2 shows an example in which multiple first dots 515A are arranged in a matrix of three vertically and three horizontally in the drawing view. For the sake of simplicity, Figure 2 shows an example in which nine first dots 515A are arranged in a 3x3 grid, but the number of first dots 515A included in the pattern image 500A is not limited to 3x3, and the pattern image 500A can contain many more first dots 515A. For example, the number of first dots 515A included in the pattern image 500A can be changed according to the resolution of the optical modulator 243 equipped in the projector 200. Also, the number of first dots 515A arranged vertically in the pattern image 500A and the number of first dots 515A arranged horizontally do not need to match, and may be changed according to the resolution of the optical modulator 243.

[0036] Figure 3 shows the brightness distribution of the first dot 515A. Now, with reference to Figure 3, we will explain the brightness distribution of the first dot 515A. The first dot 515A is a dot with a non-uniform brightness distribution, i.e., a dot with a non-uniform brightness distribution. The first dot 515A is a circular dot with a diameter of R pixels, and its brightness value changes gradually from the center to the outer edge. If the brightness value is expressed using RGB values, for example, this means that at least one of the R, G, and B values ​​changes gradually from the center to the outer edge. If the brightness value is expressed using HSV values, this means that the H value changes gradually from the center to the outer edge. Alternatively, at least one of the R, G, and B values, or the H value, may change gradually from the center to the outer edge.

[0037] In detail, the first dot 515A is divided into multiple regions with a number of gradation steps stp, and has a multi-level luminance distribution in which the luminance decreases sequentially from the central region to the outer region. The luminance distribution of the first dot 515A shown in Figure 3 is a shape that simulates a Gaussian distribution. stp is an integer of 3 or greater. Also, although Figure 3 shows the case where the shape of the first dot 515A is circular, the shape of the first dot 515A may also be elliptical.

[0038] The number of the central region in the first row is n=0, its luminance value is V0, and its radius is r0. The unit of radius r0 is pixels. The luminance value is also represented, for example, by an 8-bit grayscale value. n is a code indicating the number of each region, and numbers from 0 to stp-1 are assigned sequentially from the center outwards. Similarly, the number of the region in the second row is n=1, its luminance value is V1, and its radius is r1. The unit of radius r1 is also pixels. The number of the region in the third row is n=2, its luminance value is V2, and its radius is r2. In the same manner, the number of the region in the nth row is n=0 to stp-1, its luminance value is Vn, and its radius is rn pixels.

[0039] For example, the third-row region with a brightness value of V2, a radius of r2, and a region number of n=2 corresponds to the first region. Similarly, the second-row region with a brightness value of V1, a radius of r1, and a region number of n=1 corresponds to the second region. The centroid of the first dot 515A is contained within the first-row region with a brightness value of V0, a ​​radius of r0, and a region number of n=0. In this case, the distance between the second region and the centroid of the first dot 515A is shorter than the distance between the first region and the centroid of the first dot 515A.

[0040] Next, we will explain the second pattern, 530A. The second pattern 530A is an image used as the background for the first dot 515A and has a single-color region surrounding the first pattern. Here, the single-color region is a region with a uniform luminance distribution and color. The second pattern 530A contains multiple rectangular regions. The second pattern 530A includes the first rectangular region 531A and the second rectangular region 533A as rectangular regions. The first rectangular region 531A corresponds to the third region, and the second rectangular region 533A corresponds to the fourth region. Figure 2 shows an example in which the first rectangular region 531A and the second rectangular region 533A are arranged in a 7x7 matrix. For the sake of simplicity, Figure 2 shows an example with 7x7 rectangular regions, but the number of rectangular regions included in the pattern image 500A is not limited to 7x7, and the pattern image 500A can contain many more rectangular regions. Furthermore, the number of first dots 515A included in the pattern image 500A can be changed according to the resolution of the optical modulator 243 equipped in the projector 200.

[0041] Furthermore, Figure 2 shows an example in which a first rectangular region 531A and a second rectangular region 533A of the same shape and size are arranged, but the sizes of the first rectangular region 531A and the second rectangular region 533A do not have to be the same. The first rectangular region 531A and the second rectangular region 533A are formed in different colors. The first rectangular region 531A is formed in a first color, and the second rectangular region 533A is formed in a second color. In this embodiment, the first rectangular region 531A is formed in black as an example of the first color, and the second rectangular region 533A is formed in white as an example of the second color.

[0042] In Figure 2, with the top left corner as the origin in the drawing, the odd-numbered rows (1st, 3rd, 5th, and 7th rows) have the first rectangular region 531A and the second rectangular region 533A arranged alternately from left to right. Similarly, the even-numbered rows (2nd, 4th, and 6th rows) have the second rectangular region 533A and the first rectangular region 531A arranged alternately from left to right.

[0043] Figure 2 shows an example where the first dot 515A is placed in the first rectangular area 531A of an even-numbered row. The first dot 515C, placed within the first rectangular region 531A, is positioned such that, for example, the center or centroid of the first dot 515A coincides with the center or centroid of the first rectangular region 531A. That is, the second pattern 530A is positioned to surround the first dot 515A. The first dot 515A may be placed in all of the first rectangular regions 531A of the pattern image 500A, but in this embodiment, in order to widen the spacing between the first dots 515A, it is placed only in the first rectangular regions 531A of even-numbered rows. Alternatively, the first dot 515A may be placed in the first rectangular regions 531A of odd-numbered rows.

[0044] Furthermore, if the first dot 515A has a multi-level luminance distribution in which the luminance increases sequentially from the central area to the outer area, it is also possible to place the first dot 515A in an even-numbered row of the second rectangular area 533A. Alternatively, the first dot 515A may be placed in an odd-numbered row of the second rectangular area 533A.

[0045] 6. Variations of pattern images Figure 4 shows the pattern image 500B of modified example 1. The pattern image 500B of the modified example 1 is also an image that includes the first pattern 510B and the second pattern 530B.

[0046] The first pattern 510B, like the first pattern 510A, is an image in which the first dot 515B, which has a brightness distribution, is arranged in a matrix.

[0047] In the pattern image 500B of the modified example 1, the shape of the second pattern 530B, which serves as the background for the first dot 515B, is circular, similar to the first dot 515A. The second pattern 530B is positioned so that its center coincides with the center of the first dot 515B. The radius of the second pattern 530B is larger than the radius of the first dot 515B, and the first dot 515B is superimposed on the second pattern 530B. In this configuration, the second pattern 530B is adjacent to the first dot 515A on the outside and is positioned to surround the first dot 515A. The second pattern 530B is formed in, for example, black, but any color that makes it easy to detect the first dot 515B located in the center is acceptable.

[0048] Figure 5 shows the pattern image 500C of modified example 2. The pattern image 500C of modified example 2 shown in Figure 5 is also an image that includes the first pattern 510C and the second pattern 530C.

[0049] The first pattern 510C, like the first pattern 510A shown in Figure 2, is equipped with multiple first dots 515C, and these multiple first dots 515A are arranged in a matrix. The first dot 515A shown in Figures 2 and 3 has a multi-level luminance distribution in which the luminance decreases sequentially from the center to the outer periphery. In contrast, the first pattern 510C of the modified example 2 has a multi-level luminance distribution in which the luminance increases sequentially from the center to the outer periphery.

[0050] If the first pattern 510C is a multi-level luminance distribution where the luminance increases sequentially from the center to the outer region, then, for example, the second-level region with a luminance value of V1, radius of r1, and region number n=1 corresponds to the second region. Similarly, the third-level region with a luminance value of V2, radius of r2, and region number n=2 corresponds to the first region. The centroid of the first dot 515A is contained within the first-level region with a luminance value of V0, radius of r0, and region number n=0. Therefore, the distance between the first region and the centroid of the first dot 515A is shorter than the distance between the second region and the centroid of the first dot 515A.

[0051] The second pattern 530C in modified example 2 is also an image that forms the background of the first dot 515C and is divided into multiple rectangular regions. These rectangular regions are called the third rectangular regions 537C. In the pattern image 500C of modified example 2 shown in Figure 5, the third rectangular regions 537C are formed with the same shape and size, but the sizes of the third rectangular regions 537C may differ.

[0052] In the second pattern 530C of the modified example 2, marks 540C indicating the boundaries of each of the multiple divided third rectangular regions 537C are placed at the four vertices of each third rectangular region 537C. The pattern image 500C shown in Figure 5 shows an example where a cross symbol is displayed as the mark 540C, but the mark 540C is not limited to a cross symbol and may be a square, diamond, or other mark, for example.

[0053] In the pattern image 500C of the modified example, the first dot 515C is placed in each of the multiple divided third rectangular regions 537C. The first dot 515C, which is placed within the third rectangular region 537C, is positioned such that, for example, the center or centroid of the first dot 515C coincides with the center or centroid of the third rectangular region 537C.

[0054] When the pattern image 500 is displayed on the projection surface 10 by the projector 200, the first control unit 150 instructs the camera 300 to take a picture. The camera 300 is adjusted so that its field of view includes the projection surface 10. The camera 300 takes a picture upon instruction from the processing unit 100 and transmits the captured image generated by the capture to the processing unit 100.

[0055] The first control unit 150 stores the received captured image in the first storage unit 160. In the following explanation, we will use the case where the pattern image 500 captured in the captured image is pattern image 500A as an example.

[0056] Figure 6 shows a portion of the pattern image 500A captured in the captured image. The first control unit 150 analyzes the captured image and first detects a first rectangular region 531A and a second rectangular region 533A. The first rectangular region 531A and the second rectangular region 533A are formed of different colors. Therefore, the first control unit 150 detects the first rectangular region 531A and the second rectangular region 533A based on the colors captured in the image.

[0057] Figure 6 shows a portion of the captured image, illustrating four 2x2 rectangular regions arranged in a matrix. The first rectangular region 531A is located in the upper right and lower left corners of the drawing, and the second rectangular region 533A is located in the upper left and lower right corners of the drawing. Furthermore, the first dot 515A is located within the first rectangular region 531A in the upper right corner.

[0058] The first rectangular region 531A in the upper right is a region demarcated by the first line segment 561, the second line segment 562, the third line segment 563, and the fourth line segment 564. In Figure 6, as viewed from the drawing, the first line segment 561 corresponds to the top edge of the first rectangular region 531A, the second line segment 562 corresponds to the left edge of the first rectangular region 531A, the third line segment 563 corresponds to the bottom edge of the first rectangular region 531A, and the fourth line segment 564 corresponds to the right edge of the first rectangular region 531A. The first control unit 150 detects the first line segment 561, the second line segment 562, the third line segment 563, and the fourth line segment 564 that demarcate the first rectangular region 531A in the upper right, based on the color changes captured in the captured image.

[0059] The upper left second rectangular region 533A is a region demarcated by the fifth line segment 565, the sixth line segment 566, the seventh line segment 567, and the eighth line segment 568. Since the first rectangular region 531A and the second rectangular region 533A are adjacent, the eighth line segment 568 also corresponds to the second line segment 562. In Figure 6, as seen from the drawing, the fifth line segment 565 corresponds to the top edge of the second rectangular region 533A, the sixth line segment 566 corresponds to the left edge of the second rectangular region 533A, the seventh line segment 567 corresponds to the bottom edge of the second rectangular region 533A, and the eighth line segment 568 corresponds to the right edge of the second rectangular region 533A. The first control unit 150 also detects the fifth line segment 565, the sixth line segment 566, the seventh line segment 567, and the eighth line segment 568 that demarcate the upper left second rectangular region 533A, based on the color changes captured in the captured image.

[0060] The first control unit 150 similarly detects line segments that demarcate each region, including the first rectangular region 531A in the lower left and the second rectangular region 533A in the lower right. The first control unit 150 detects the first rectangular region 531A and the second rectangular region 533A that are included in multiple instances in the captured image.

[0061] When the first control unit 150 detects the first rectangular region 531A and the second rectangular region 533A, it identifies the position of the first dot 515A that is included in the first rectangular region 531A, which is set in advance, among the first rectangular region 531A and the second rectangular region 533A which are arranged in a matrix. In the case of the pattern image 500A shown in Figure 2, the first dot 515A is detected from the first rectangular region 531A located in an even-numbered row and even-numbered column. For example, the first control unit 150 determines the centroid position of the first dot 515A by calculating a weighted average of the pixel values ​​of the captured image or the pixel values ​​of the first rectangular region 531A. When using the pattern image 500B of the modified example 1, one can detect the second pattern 530B which forms the background of the first dot 515B, and then identify the position of the first dot 515B contained within the detected second pattern 530B. Furthermore, when using the pattern image 500C of the modified example 2, it is sufficient to detect the third rectangular region 537C which has been divided into multiple parts, and then identify the position of the first dot 515C contained within the detected third rectangular region 537C.

[0062] Next, the first control unit 150 generates correction information to correct the distortion of the image displayed by the projector 200 on the projection surface 10, based on the position of the first dot 515A in the pattern image data 163 and the position of the first dot 515A in the detected captured image. Correction information is information used when the second control unit 250 controls the image processing unit 231 to correct an image. For example, the correction information includes parameters for the image processing performed by the image processing unit 231. This image processing may be, for example, a process to correct the shape of the image, or it may be an adjustment of the color tone or brightness of the image, a resizing process, or a correction of distortion aberration.

[0063] When the first control unit 150 generates correction information, it transmits the generated correction information to the projector 200. The second control unit 250 stores the correction information received from the processing unit 100 in the second storage unit 260. When the second control unit 250 receives notification from the processing unit 100 that it has started supplying image data, it reads the correction information from the second storage unit 260 and outputs the read correction information to the image processing unit 231. The image processing unit 231 corrects the image data input from the second interface 220 using correction information and outputs the corrected image data to the projection unit 240. As a result, an image with corrected distortion is displayed on the projection surface 10.

[0064] 7. Operation of the processing unit Figure 7 is a flowchart showing the operation of the processing unit 100. The operation of the processing unit 100 will be explained with reference to the flowchart shown in Figure 7. First, the first control unit 150 determines whether or not it has received an operation from the operation unit 120 to instruct the start of the correction process (step S1). If the first control unit 150 has not received an operation to instruct the start of the correction process (step S1 / NO), it waits to start the process until it receives an operation to instruct the start of the correction process.

[0065] When the first control unit 150 receives an operation to instruct the start of correction (step S1 / YES), it transmits the pattern image data 163, which will be the basis for the pattern image 500, to the projector 200 (step S2). The projector 200 generates image light based on the pattern image data 163 received from the processing unit 100 and projects the generated image light onto the projection surface 10. As a result, the pattern image 500 is displayed on the projection surface 10.

[0066] Next, the first control unit 150 instructs the camera 300 to take a picture (step S3). The camera 300 takes a picture according to the instructions of the processing unit 100, generates a captured image, and outputs the generated captured image to the processing unit 100.

[0067] Next, the first control unit 150 determines whether or not it has received an image from the camera 300 (step S4). If the first control unit 150 has not received an image (step S4 / NO), it waits until it receives an image.

[0068] When the first control unit 150 receives the captured image (step S4 / YES), it performs image analysis on the received image and detects the second pattern 530 captured in the image (step S5). The first control unit 150 detects a preset color region from the captured image and determines that the detected region is the second pattern 530.

[0069] Next, the first control unit 150 calculates the center of gravity position of each of the detected second patterns 530 (step S6). Next, the first control unit 150 detects the first pattern 510 based on the calculated center of gravity position of the second pattern 530 (step S7).

[0070] Next, the first control unit 150 generates correction information based on the detected first pattern 510 (step S8). When the first control unit 150 generates correction information, it transmits the generated correction information to the projector 200 (step S9).

[0071] Next, the first control unit 150 determines whether or not image data to be displayed on the projector 200 has been selected (step S10). More specifically, the first control unit 150 determines whether or not an operation to select image data has been received by the operation unit 120. If no image data has been selected (step S10 / NO), the first control unit 150 waits until image data is selected.

[0072] When image data is selected (step S10 / YES), the first control unit 150 transmits the selected image data to the projector 200 (step S11).

[0073] 8. Projector Operation Figure 8 is a flowchart showing the operation of projector 200. The operation of Projector 200 will be explained with reference to the flowchart shown in Figure 8. The second control unit 250 determines whether or not it has received pattern image data 163 from the processing unit 100 (step T1). If the second control unit 250 has not received pattern image data 163 (step T1 / NO), it waits to start processing until it receives pattern image data 163.

[0074] When the second control unit 250 receives the pattern image data 163 (step T1 / YES), it causes the image processing unit 231 to process the received pattern image data 163 and causes the projection unit 240 to generate image light based on the image-processed pattern image data 163. The projection unit 240 projects the generated image light onto the projection surface 10, thereby displaying the pattern image 500 on the projection surface 10 (step T2).

[0075] Next, the second control unit 250 determines whether or not it has received correction information from the processing unit 100 (step T3). If the second control unit 250 has not received correction information from the processing unit 100 (step T3 / NO), it waits to start processing until it receives the correction information.

[0076] When the second control unit 250 receives correction information (step T3 / YES), it outputs the received correction information to the image processing unit 231 and also stores the correction information in the second storage unit 260 (step T4).

[0077] Next, the second control unit 250 determines whether or not it has received image data from the processing unit 100 (step T5). If the second control unit 250 has not received image data (step T5 / NO), it waits until it receives image data.

[0078] When the second control unit 250 receives image data from the processing unit 100 (step T5 / YES), it instructs the image processing unit 231 to correct the received image data (step T6). The image processing unit 231 corrects the image data input from the second I / F 220 using the correction information and outputs the corrected image data to the projection unit 240. The projection unit 240 generates image light corresponding to the input image data and projects the generated image light onto the projection surface 10. As a result, an image corresponding to the image data is displayed on the projection surface 10 (step T7).

[0079] 9. Effectiveness of the detection method As described above, in this embodiment, the detection method involves the projector 200 displaying a pattern image 500A with non-uniform brightness on the projection surface 10. The pattern image 500A includes a first pattern 510A having a first dot 515A, and a second pattern 530A having a single-color region surrounding the first pattern 510A. The processing unit 100 performs the following actions: acquires a captured image of the pattern image 500A, detects a single-color region of the second pattern 530A from the captured image, and determines the position of the first dot 515A based on the single-color region.

[0080] This allows for the detection of a single-color area of ​​the second pattern 530A from the captured image, and the position of the first dot is determined based on the detected single-color area. Therefore, a decrease in the detection accuracy of the first dot 515A, which is a dot with non-uniform brightness, can be suppressed. Furthermore, by suppressing the decrease in the detection accuracy of the first dot 515A, the accuracy of correcting distortion in the image displayed on the projection surface 10 can be improved.

[0081] The first dot 515A has a first region where the brightness value is a first brightness value, and a second region where the brightness value is a second brightness value that is higher than the first brightness value. As a second region, for example, a third-stage region with a luminance value of V2, a radius of r2, and a region number of n=2 can be cited. Furthermore, the second region, designated as the first region, has a luminance value of V1, a radius of r1, and a region number of n=1. The distance between the second region and the centroid of the first dot is shorter than the distance between the first region and its centroid.

[0082] This makes it possible to display a dot 515A with a brightness distribution where the brightness increases from the outer region to the central region. Therefore, the detection accuracy of the centroid position of the first dot 515A can be improved.

[0083] Furthermore, the first dot 515A may be configured such that the distance between the first region and the centroid of the first dot is shorter than the distance between the second region and the centroid.

[0084] This makes it possible to display a dot 515A with a brightness distribution where the brightness increases from the central area to the outer area. Therefore, the detection accuracy of the centroid position of the first dot 515A can be improved.

[0085] The second pattern 530A comprises a first rectangular region 531A enclosed by the first line segment 561, the second line segment 562, the third line segment 563, and the fourth line segment 564, and a second rectangular region 533A enclosed by the fifth line segment 565, the sixth line segment 566, the seventh line segment 567, and the eighth line segment 568. The first rectangular region 531A is formed with a first color, and the second rectangular region 533A is formed with a second color different from the first color. The first pattern 510A is included in the first rectangular region 531A.

[0086] As a result, the second pattern 530A includes the first rectangular region 531A and the second rectangular region 533A, and by detecting the first rectangular region 531A, the first dot 515 is detected. Therefore, the region containing the first dot 515A can be reduced, and the time required to pinpoint the location of the first dot 515A can be shortened.

[0087] Detecting a single-color region of the second pattern 530A from the captured image includes detecting a first-color region from the captured image to detect the first line segment 561, second line segment 562, third line segment 563, and fourth line segment 564 that demarcate the first rectangular region 531A. Furthermore, detecting a single-color region of the second pattern 530A includes detecting a second-color region from the captured image to detect the fifth line segment 565, sixth line segment 566, seventh line segment 567, and eighth line segment 568 that demarcate the second rectangular region 533A. The position of the first dot is determined within the first rectangular region 531A, which is demarcated by the detected first line segment 561, second line segment 562, third line segment 563, and fourth line segment 564.

[0088] This allows for the detection of a first rectangular region 531A and a second rectangular region 533A from the captured image, and enables the accurate detection of the first dot 515 contained within the first rectangular region 531A.

[0089] 10. Effectiveness of the detection system The detection system 1 of this embodiment includes a projector 200, a camera 300, and a processing unit 100. The projector 200 displays a pattern image 500A on the projection surface 10, which includes a first pattern 510A having a first dot 515A with non-uniform brightness, and a second pattern 530A having a single-color area surrounding the first pattern 510A. Camera 300 generates an image captured by taking a picture of pattern image 500A. The processing unit 100 performs the following actions: detect a single-color region of the second pattern 530A from the image captured by the camera 300, and determine the position of the first dot 515A based on the single-color region.

[0090] This configuration detects a single-color area of ​​the second pattern 530A from the captured image and determines the position of the first dot based on the detected single-color area. This suppresses a decrease in the detection accuracy of the first dot 515A, which is a dot with non-uniform brightness. Furthermore, by suppressing a decrease in the detection accuracy of the first dot 515A, the accuracy of correcting distortion in the image displayed on the projection surface 10 can be improved.

[0091] 11. Other Embodiments The embodiments and modifications described above are preferred embodiments of the present invention. However, the invention is not limited thereto, and various modifications can be made without departing from the spirit of the invention. For example, the above-described embodiment illustrates a configuration in which the detection system 1 comprises a processing unit 100, a projector 200, and a camera 300, but the system is not limited to this configuration. For example, the processing unit 100 or the projector 200 may be configured to include a camera. Furthermore, although the above-described embodiment described a case in which the processing unit 100 and the projector 200 are configured as separate units, it is also possible to operate the projector 200 as the processing unit 100. In other words, the second control unit 250 of the projector 200 may be configured to perform the operations of the processing unit 100 shown in the flowchart of Figure 7 and the operations of the projector 200 shown in the flowchart of Figure 8.

[0092] Furthermore, the processing units in the flowchart shown in Figure 7 are divided according to their main processing content in order to facilitate understanding of the processing of the processing device 100. The present invention is not limited by the way the processing units are divided or the names of the processing units shown in the flowchart in Figure 7. In addition, the processing of the processing device 100 can be further divided into more processing units depending on the processing content, or a single processing unit can be divided to include even more processing. Moreover, the processing order in the flowchart above is not limited to the example shown. The same applies to the processing units of the projector 200 shown in Figure 8.

[0093] Furthermore, the functional units of the processing unit 100 and projector 200 shown in Figure 1 represent a functional configuration realized through the cooperation of hardware and software, and the specific implementation form is not particularly limited. Therefore, it is not necessarily required that hardware corresponding to each functional unit be implemented individually, and it is certainly possible to have a configuration in which a single processor executes a program to realize the functions of multiple functional units. In addition, some of the functions realized by software in the above embodiment may be realized by hardware, or some of the functions realized by hardware may be realized by software.

[0094] Furthermore, when the projection method of this disclosure is implemented using a computer mounted on the processing unit 100, the program to be executed by this computer can be configured in the form of a recording medium. The program to be executed by the computer can also be configured in the form of a transmission medium for transmitting the program. Magnetic, optical, or semiconductor memory devices can be used as the recording medium. Specifically, examples include portable or fixed recording media such as flexible disks, HDDs, CD-ROMs (Compact Disc Read-Only Memory), DVDs (Digital Versatile Discs), Blu-ray Discs, magneto-optical disks, flash memory, and card-type recording media. The recording media may also be non-volatile storage devices such as RAM, ROM, or HDDs, which are internal storage devices of a server device. Blu-ray is a registered trademark. [Explanation of symbols]

[0095] 1...Detection system, 5...Remote control, 10...Projection surface, 100...Processing device, 110...First I / F, 120...Operation unit, 130...Display unit, 150...First control unit, 160...First memory unit, 161...Control program, 163...Pattern image data, 170...First processor, 200...Projector, 210...Remote control receiver, 220...Second I / F, 231...Image processing unit, 233...Frame memory, 240...Projection unit, 241...Light source, 243...Optical modulator, 245...Optical unit, 250...Second control unit, 260...Second memory unit, 261...Control program, 270...Second processor, 300...Camera, 500...Pattern image, 500A...Pattern Image, 500B...Pattern image, 500C...Pattern image, 510...First pattern, 510A...First pattern, 510B...First pattern, 510C...First pattern, 515...First dot, 515A...First dot, 515B...First dot, 515C...First dot, 530...Second pattern, 530A...Second pattern, 530B...Second pattern, 530C...Second pattern, 531A...First rectangular area, 533A...Second rectangular area, 537C...Third rectangular area, 540C...Mark, 561...First line segment, 562...Second line segment, 563...Third line segment, 564...Fourth line segment, 565...Fifth line segment, 566...Sixth line segment, 567...Seventh line segment, 568...Eighth line segment.

Claims

1. Displaying a pattern image on a display surface, the pattern image including a first pattern having first dots with non-uniform luminance and a second pattern having a single-color area surrounding the first pattern; Obtaining a captured image of the pattern image; detecting the single-color area from the captured image; determining a position of the first dot based on the single color region; A detection method comprising:

2. the first dot has a first region having a first luminance value and a second region having a second luminance value higher than the first luminance value; 2. The detection method according to claim 1, wherein a distance between the second region and a center of gravity of the first dot is shorter than a distance between the first region and the center of gravity.

3. the first dot has a first region having a first luminance value and a second region having a second luminance value higher than the first luminance value; 2. The detection method according to claim 1, wherein a distance between the first region and a center of gravity of the first dot is shorter than a distance between the second region and the center of gravity.

4. the second pattern includes a third region surrounded by a first line segment, a second line segment, a third line segment, and a fourth line segment, and a fourth region surrounded by a fifth line segment, a sixth line segment, a seventh line segment, and an eighth line segment, the third region is formed in a first color; the fourth region is formed in a second color different from the first color, The detection method according to claim 1 , wherein the first pattern is included in the third region.

5. Detecting the single-color area from the captured image includes: detecting an area of ​​the first color from the captured image, thereby detecting the first line segment, the second line segment, the third line segment, and the fourth line segment which partition the third area; detecting an area of ​​the second color from the captured image, thereby detecting the fifth line segment, the sixth line segment, the seventh line segment, and the eighth line segment that partition the fourth area, The detection method according to claim 4 , further comprising the step of identifying the position of the first dot in the third region defined by the first line segment, the second line segment, the third line segment, and the fourth line segment.

6. a display device that displays a pattern image on a display surface, the pattern image including a first pattern having first dots with non-uniform luminance and a second pattern having a single-color area surrounding the first pattern; an image capturing device for capturing the pattern image and generating a captured image; detecting the single-color area from the captured image; determining a position of the first dot based on the single color region; and a processor for executing the above steps.

7. Displaying a pattern image on a display surface, the pattern image including a first pattern having first dots with non-uniform luminance and a second pattern having a single-color area surrounding the first pattern; Obtaining a captured image of the pattern image; detecting the single-color area from the captured image; determining a position of the first dot based on the single color region; A program that causes a computer to execute the following.