Display method, display system, and program

The display method and system address the trade-off between accuracy and time in projector image correction by offering modes with varying numbers of pattern images, enabling users to select between high-precision and fast correction based on their needs.

JP7593382B2Active Publication Date: 2024-12-03SEIKO EPSON CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022148839
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-09-20
Publication Date
2024-12-03
Estimated Expiration
2042-09-20

AI Technical Summary

Technical Problem

The increase in accuracy of image correction with more pattern images projected from a projector is offset by the increased time required for the correction process, leading to user inconvenience.

Method used

A display method and system that includes different operation modes: a first mode with M pattern images for higher accuracy and a second mode with N pattern images for faster correction, where N < M, allowing for selective adjustment based on user input or environmental conditions.

Benefits of technology

The method enables accurate and efficient image correction by balancing accuracy and time through the use of multiple pattern images, allowing users to choose between high-precision and fast correction modes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593382000001
    Figure 0007593382000001
  • Figure 0007593382000002
    Figure 0007593382000002
  • Figure 0007593382000003
    Figure 0007593382000003
Patent Text Reader

Abstract

To put priority on one of the accuracy of correction and processing time.SOLUTION: One aspect of a display method of the present disclosure includes: when an operation mode of a display unit displaying a display image is a first operation mode, sequentially displaying, by the display unit, M pattern images GOP different from each other, where M is a natural number; correcting the display image based on a first picked-up image group acquired by picking up images of the M pattern images GOP different from each other; when the operation mode of the display unit is a second operation mode different from the first operation mode, sequentially displaying, by the display unit, N pattern images GOP different from each other, where N is a natural number smaller than M; acquiring a second picked-up image group acquired by picking up images of the N pattern images different from each other; and correcting the display image based on the second picked-up image group.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a display method, a display system, and a program. [Background technology]

[0002] 2. Description of the Related Art There is known a technique for correcting an image projected from a projector based on a result of capturing a pattern image projected from the projector. For example, Patent Document 1 discloses a technique in which a plurality of pattern images are projected from a projector, and the color tone of the images projected from the projector is corrected based on the results of capturing the respective pattern images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-161918 A Summary of the Invention [Problem to be solved by the invention]

[0004] The more pattern images projected from the projector, the more accurate the correction can be, but the more time it takes to make the correction, so the user has to wait until the correction is complete. [Means for solving the problem]

[0005] One aspect of the display method of the present disclosure includes, when an operation mode of a display device displaying a display image is a first operation mode, the display device sequentially displays M mutually different pattern images when M is a natural number, and correcting the display image based on a first group of captured images obtained by respectively capturing the M mutually different pattern images; and, when an operation mode of the display device is a second operation mode different from the first operation mode, the display device sequentially displays N mutually different pattern images when N is a natural number smaller than M, and obtains a second group of captured images obtained by respectively capturing the N mutually different pattern images, and correcting the display image based on the second group of captured images.

[0006] One aspect of a display system of the present disclosure includes a display device that displays a display image, an imaging device, and a processing device that executes the following operations when an operation mode of the display device is a first operation mode, where M is a natural number: sequentially displaying M mutually different pattern images on the display device, and correcting the display image based on a first group of captured images obtained by the imaging device capturing each of the M mutually different pattern images; and when an operation mode of the display device is a second operation mode different from the first operation mode, where N is a natural number smaller than M: sequentially displaying N mutually different pattern images on the display device, acquiring a second group of captured images obtained by the imaging device capturing each of the N mutually different pattern images, and correcting the display image based on the second group of captured images.

[0007] One aspect of the program of the present disclosure causes a computer to execute the following operations when an operation mode of a display device displaying a display image is a first operation mode, where M is a natural number, by the display device sequentially displaying M mutually different pattern images, and correcting the display image based on a first group of captured images obtained by respectively capturing the M mutually different pattern images; and when an operation mode of the display device is a second operation mode different from the first operation mode, where N is a natural number smaller than M, by the display device sequentially displaying N mutually different pattern images, and obtaining a second group of captured images obtained by respectively capturing the N mutually different pattern images, and correcting the display image based on the second group of captured images. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a display system according to an embodiment of the present disclosure. [Diagram 2] 5A to 5C are explanatory diagrams of a pattern image, a captured image, a measurement result of a current color, and linear interpolation. [Diagram 3] 5A to 5C are explanatory diagrams of a pattern image, a captured image, a measurement result of a current color, and curve interpolation. [Figure 4] FIG. 4 is a diagram illustrating an example of an operation mode of image correction. [Diagram 5] 10 is a flowchart illustrating an example of an image correction process. [Figure 6] FIG. 13 is a diagram showing an operation mode according to a modified example of the present disclosure. [Figure 7] 10 is a flowchart showing an example of a process for determining a gradation in an automatic mode. [Figure 8] FIG. 13 is a diagram showing an operation mode according to a modified example of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, a preferred embodiment of the present disclosure will be described with reference to the drawings. In the drawings, the dimensions and scale of each part may differ from the actual ones, and some parts may be shown diagrammatically to facilitate understanding. In the following description, unless otherwise specified to limit the present disclosure, the scope of the present disclosure is not limited to the embodiments described in the following description. In addition, the scope of the present disclosure includes the equivalent scope of the embodiments.

[0010] 1. Embodiment [Configuration of Display System 1] FIG. 1 is a schematic diagram showing an example of a display system 1 according to the present embodiment. As shown in FIG. 1, the display system 1 includes a projector 10, an image supply device 20, and an imaging device 30. The projector 10 is an example of a display device. Specifically, the projector 10 displays an image by projecting image light LG based on an image of a projection target onto a projection surface SP. That is, projecting the image light LG of an image onto the projection surface SP corresponds to displaying an image. The projection surface SP is a surface of a projection target onto which the image light LG is projected. The projection target is, for example, a screen, a whiteboard, and an indoor or outdoor wall surface. The surface of the projection surface SP does not necessarily have to be a flat surface, and may include a curved surface, a step, and unevenness. In the following description, the image of the target projected by the projector 10 onto the projection surface SP is referred to as a "target image GO", and the image that appears on the projection surface SP by projection is referred to as a "projected image GP". The target image GO is an example of a display image displayed by a display device.

[0011] The image supply device 20 is a device that is connected to the projector 10 by wire or wirelessly and supplies image data DG of a target image GO to the projector 10. The image supply device 20 is, for example, an optical disk playback device, a hard disk recorder, a television tuner device, a video game device, a personal computer, or a smartphone. There are no limitations on the standard used for the connection between the image supply device 20 and the projector 10. The image data DG corresponds to an image signal.

[0012] The imaging device 30 is a device that performs imaging in response to an operation by a user U. The imaging device 30 is connected to the projector 10 by wire or wirelessly, and supplies the projector 10 with captured image data DC acquired by imaging. The standard used for the connection between the image capture device 30 and the projector 10 is not limited.

[0013] [Projector 10 Configuration] The projector 10 includes a first processing device 100, a first storage device 120, an optical device 130, and an operation input device 150, each of which is connected to a bus. The first processing device 100 includes one or more processors, such as a CPU (Central Processing Unit). The first storage device 120 is a recording medium readable by the first processing device 100. The first storage device 120 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory).

[0014] The optical device 130 is a device that emits image light LG based on the target image GO under the control of the first processing device 100. Specifically, the optical device 130 includes a light source, a light modulation device, and an optical system. The light source is a discharge lamp, a semiconductor light source, etc. Representative examples of the discharge lamp are a halogen lamp, a xenon lamp, and an extra-high pressure mercury lamp, etc. Representative examples of the semiconductor light source are an LED (light-emitting diode), a laser diode, etc. The light modulation device includes a light modulation element that optically modulates the light of the light source based on the control of the first processing device 100. The light modulation element is, for example, a liquid crystal panel, a digital mirror device, etc. The optical system includes one or more optical elements that adjust the magnification ratio and imaging position of the light output from the light modulation device. The optical element is, for example, a lens or a mirror. The output light of the optical system is emitted from the optical device 130 as image light LG and projected onto the projection surface SP.

[0015] The operation input device 150 is a device that accepts input through operations by the user U. The operation input device 150 is, for example, a button provided on the main body of the projector 10, or a remote controller that remotely controls the projector 10. For example, the operation input device 150 accepts, from the user U, an operation to specify an operation mode or a setting mode for color correction, which will be described later.

[0016] In this embodiment, the first storage device 120 stores an image correction program 122. The image correction program 122 is an example of a program. The projector 10 including the first processing device 100 that executes the image correction program 122 is also an example of a computer. The image correction program 122 of this embodiment includes a program for causing the first processing device 100 to execute the following series of processes. This series of processes is related to the display method of the projector 10. This series of processes includes projecting a pattern image GOP from the projector 10, acquiring captured image data DC of a captured image acquired by capturing a projected image GP that appears on the projection surface SP by projecting the pattern image GOP, and correcting the target image GO projected from the projector 10 based on the captured image data DC.

[0017] In this embodiment, the image correction includes color correction. The operation modes of this color correction include three operation modes, a 0th operation mode, a 1st operation mode, and a 2nd operation mode, which have different correction accuracies. The 0th operation mode is a mode in which the number of pattern images projected in the GOP is L. The first operation mode is a mode in which the number of pattern images projected in the GOP is M, which is less than L. The second operation mode is a mode in which the number of pattern images projected in the GOP is N, which is less than M. Note that L, M, and N are all natural numbers.

[0018] The accuracy of color correction increases as the number of projected pattern images in a GOP increases, and the time required for image correction decreases as the number of projected images decreases. In other words, there is a trade-off between the accuracy of color correction and the time required. In the following description, the 0th operation mode, which has the highest number of projected images, is referred to as the "high accuracy mode," and the 2nd operation mode, which has the lowest number of projected images, is referred to as the "short time mode." In addition, the 1st operation mode, which has a number of projected images between the number of projected images in the 0th operation mode and the number of projected images in the 2nd operation mode, is referred to as the "intermediate mode."

[0019] The first processing device 100 realizes each function required for image correction of the target image GO by executing the above-mentioned image correction program 122. Specifically, the first processing device 100 functions as an input acquisition unit 102, a pattern image generation unit 104, a pattern image projection control unit 106, a captured image data acquisition unit 108, and a correction unit 110.

[0020] The input acquisition unit 102 is a functional unit that acquires an output signal from the operation input device 150, and accepts an input of an operation indicating a designation of an operation mode by the user U. The pattern image generating unit 104 is a functional unit that generates image data DG of a pattern image GOP of the number of sheets corresponding to a specified operation mode. The pattern image GOP will be described in detail later. The pattern image projection control unit 106 sequentially projects image light LG based on each pattern image GOP by controlling the optical device 130 based on the image data DG of each pattern image GOP generated by the pattern image generating unit 104. As a result, projection images GP corresponding to each pattern image GOP appear sequentially on the projection surface SP.

[0021] The captured image data acquisition section 108 acquires a group of captured image data DC acquired by capturing, with the imaging device 30, each of the projection images GP that appear by projecting each pattern image GOP. In the following description, the groups of captured image data DC acquired in the zeroth operation mode, the first operation mode, and the second operation mode are referred to as the “zeroth captured image group data,” the “first captured image group data,” and the “second captured image group data,” respectively. The correction unit 110 calculates a correction value for color correcting the target image GO based on the 0th captured image group data, the first captured image group data, or the second captured image group data, and performs color correction on the target image GO based on the correction value.

[0022] [Image correction: Color correction] The image correction of this embodiment includes color correction. The processing related to this color correction also includes correcting the color of the target image GO to make the color of the projected image GP a target color. In the following description, the color of the projected image GP is referred to as the "current color," and the target color is referred to as the "target color."

[0023] In this embodiment, a plurality of different pattern images GOP described above are used to detect the current color of the projection image GP. The pattern image GOP is an image of a pattern having a predetermined gradation and predetermined color components, or painted black. The predetermined color components are the color components that make up the color space. In this embodiment, the color components are three: a red component (R), a green component (G), and a blue component (B). That is, the multiple different pattern images GOP include four: a first pattern image GOP1 painted with a red component of a first gradation, which is a predetermined gradation; a second pattern image GOP2 painted with a green component of the first gradation; a third pattern image GOP3 painted with a blue component of the first gradation; and a fourth pattern image GOP4 painted with a black component. Moreover, the pattern image GOP of this embodiment is an image whose entire area is painted with a single color.

[0024] In the following description, the projected images GP that appear on the projection surface SP by projecting the first pattern image GOP1, the second pattern image GOP2, the third pattern image GOP3, and the fourth pattern image GOP4 will be referred to as the "first projected image GP1," the "second projected image GP2," the "third projected image GP3," and the "fourth projected image GP4," respectively.

[0025] As shown in Fig. 2, the relative values ​​of "X", "Y" and "Z" in the XYZ color system when the gradation is the first gradation are calculated for each of the red, green and blue components based on the captured image data DC of the first projected image GP1, the captured image data DC of the second projected image GP2 and the captured image data DC of the third projected image GP3. Since black corresponds to gradation "0", the relative values ​​of "X", "Y" and "Z" in the XYZ color system when the gradation is "0" are calculated based on the captured image data DC of the fourth projected image GP4. The current color when the gradation is the first gradation and the current color when the gradation is "0" are specified by these relative values. Next, the current color is determined for the gradations for which no measurement has been performed by linearly interpolating between the gradation "0" and the first gradation. Then, a correction value for each gradation is calculated based on the current color and the target color.

[0026] Here, the more gradations of the current color are measured, the higher the accuracy of the interpolation of the correction value becomes. For example, as shown in Fig. 3, by performing measurements for each of three or more gradations, it is possible to use more accurate curved interpolation instead of linear interpolation, and the current color for each gradation can be obtained by interpolation with higher accuracy. For example, spline interpolation is used for this curved interpolation.

[0027] FIG. 4 is a diagram showing an example of an operation mode of the image correction. The inventors have found through experiments that by measuring at least seven gradations other than black, the current color can be determined with sufficient accuracy for unmeasured gradations by curve interpolation of these measurement results, and the accuracy of the correction value for each gradation can also be improved. Therefore, as shown in Fig. 4, in the high-precision mode, the current color is measured for seven gradation steps and black. In this case, in the high-precision mode, seven each of the first pattern image GOP1, the second pattern image GOP2, and the third pattern image GOP3 are used, and one fourth pattern image GOP4 corresponding to black is used. Therefore, in the high-precision mode, a total of 22 pattern image GOPs are used.

[0028] On the other hand, in the short-time mode, the current color is measured for one grayscale and black, so that a total of four pattern images GOP are used in the short-time mode. Also, in intermediate mode, measurements of the current color are made for three steps and black, so a total of 10 pattern image GOPs are used in intermediate mode. Note that curved line interpolation only needs to be performed for at least three points. Therefore, measurements need only be performed for black and the other two gradations, and the number of pattern images GOP used in this case is seven in total.

[0029] In this embodiment, the gradations that are the subject of the current color measurement in the high-precision mode, the intermediate mode, and the short-time mode are as follows. That is, as shown in Fig. 4, in the high-precision mode, there are eight gradations, seven gradations, "146", "292", "438", "584", "730", "876", and "1023", and a gradation of "0" (black). In the intermediate mode, there are four gradations, three gradations, "292", "730", and "1023", and a gradation of "0" (black). In addition, in the short-time mode, there is one step of "730" and two gradations, one gradation of "0" (black).

[0030] [Display System 1 Operation] FIG. 5 is a flowchart of the image correction process. In the projector 10, when the first processing device 100 executes the image correction program 122, the input acquisition unit 102 receives an input of an operation for designating an operation mode as shown in Fig. 5 (step Sa1). Next, the pattern image generation unit 104 generates image data DG of a plurality of different pattern images GOPs according to the designated operation mode (step Sa2). Specifically, the pattern image generation unit 104 generates a 22-image pattern image GOP when a high-precision mode is designated, and generates a 10-image pattern image GOP when a medium mode is designated, Short time When the mode is specified, a GOP of four pattern images is generated.

[0031] Then, the pattern image projection control section 106 controls the optical device 130 based on the image data DG of each of the pattern images GOP to sequentially project the image light LG based on each of the pattern images GOP (step Sa3). In step Sa3, the projection images GP corresponding to the respective pattern images GOP appear sequentially on the projection surface SP. Then, the user U operates the imaging device 30 to capture images, thereby obtaining captured image data DC of the respective projection images GP.

[0032] The captured image data acquisition section 108 acquires captured image data DC of captured images acquired by capturing each projection image GP from the imaging device 30 (step Sa4). Specifically, when the high-precision mode is specified, the captured image data acquisition section 108 acquires the 0th captured image group data including the captured image data DC of each captured image of the 22 pattern images GOP. When the medium mode is specified, the captured image data acquisition section 108 acquires the first captured image group data including the captured image data DC of each captured image of the 10 pattern images GOP. When the short-time mode is specified, the captured image data acquisition section 108 acquires the second captured image group data including the captured image data DC of each captured image of the 4 pattern images GOP.

[0033] Then, the correction unit 110 calculates a correction value for correcting the target image GO based on the 0th captured image group data, the first captured image group data, or the second captured image group data, and corrects the target image GO based on the correction value (step Sa5). In step Sa5, when the correction unit 110 calculates the correction value based on the 0th captured image group data or the 1st captured image group data, the correction unit 110 calculates the correction value by obtaining the current color of the unmeasured gradation by curved line interpolation. When the correction unit 110 calculates the correction value based on the 2nd captured image group data, the correction unit 110 calculates the correction value by obtaining the current color of the unmeasured gradation by linear interpolation.

[0034] As described above, the first processing device 100 included in the projector 10 of the present embodiment executes the following series of processes. That is, the series of processes includes, when the operation mode of the projector 10 that projects the target image GO is a first operation mode, sequentially displaying M mutually different pattern images GOP when M is a natural number, acquiring a first captured image group acquired by capturing each of the projection images GP by projecting each of the M pattern images GOP, and correcting the target image GO based on the first captured image group, and, when the operation mode of the projector 10 is a second operation mode different from the first operation mode, sequentially displaying N mutually different pattern images GOP smaller than M when N is a natural number, acquiring a second captured image group acquired by capturing each of the projection images GP by projecting each of the N pattern images GOP, and correcting the target image GO based on the second captured image group.

[0035] Therefore, by performing the first operation mode, it is possible to perform correction with higher accuracy than in the second operation mode, and by performing the second operation mode, it is possible to perform correction in a shorter time than in the first operation mode.

[0036] In this embodiment, the natural number N is equal to or greater than 4. The N different pattern images GOP include one or more first pattern images GOP1 having red, one or more second pattern images GOP2 having green, one or more third pattern images GOP3 having blue, and one fourth pattern image GOP4 having black.

[0037] By using such N mutually different pattern images GOP, color correction of the target image GO can be performed in a short time.

[0038] In this embodiment, M, a natural number, is equal to or greater than 7. The M different pattern images GOP include two or more first pattern images GOP1 with different gradations, two or more second pattern images GOP2 with different gradations, two or more third pattern images GOP3 with different gradations, and one fourth pattern image GOP4. Correcting the target image GO based on the first captured image group includes correcting the target image GO with a correction value calculated using curved interpolation based on the first captured image group. Correcting the target image GO based on the second captured image group includes correcting the target image GO with a correction value calculated using linear interpolation different from curved interpolation based on the second captured image group.

[0039] Therefore, in the first operation mode, the correction values ​​for color correction are obtained with higher accuracy than in the second operation mode. In the second operation mode, the correction values ​​for color correction are obtained in a shorter time than in the first operation mode.

[0040] In this embodiment, the first processing device 100 executes the process of accepting an operation specifying an operation mode, and if the accepted operation is an operation specifying a first operation mode, changing the operation mode to the first operation mode, and if the accepted operation is an operation specifying a second operation mode, changing the operation mode to the second operation mode.

[0041] Therefore, the user U can select a desired operation mode from the first operation mode and the second operation mode by performing an operation.

[0042] 2. Variations The above-mentioned exemplary embodiments may be modified in various ways. Specific modified embodiments that may be applied to the above-mentioned embodiments are exemplified below. Two or more embodiments selected from the following examples may be appropriately combined as long as they are not mutually contradictory.

[0043] (Variation 1) In the above embodiment, the operation modes of image correction include a “high accuracy mode”, a “medium accuracy mode”, and a “low accuracy mode” which are different from each other in the number of gradations to be measured. Short time However, the number of modes may be at least two or more. For example, the operation modes may be two, namely, a "high accuracy mode" and a "medium mode", a "high resolution mode" and a "low resolution mode". Short time Mode" or "Intermediate Mode" and " Short time For example, the operation modes may include a mode in which the number of gradations to be measured is even greater than that in the "high accuracy mode."

[0044] (Variation 2) The operation modes may include modes in which the number of gradations to be measured is the same, in addition to modes in which the number of gradations to be measured is different. FIG. 6 is an explanatory diagram of the operation mode according to this modified example. As shown in the figure, the operation mode according to this modification includes two modes: a preset mode and an indefinite mode. In the preset mode, the gradation of the measurement target is specified in advance, and in the indefinite mode, the gradation of the measurement target is indefinite. The preset mode is a mode corresponding to the first operation mode. That is, in the preset mode, M mutually different pattern image GOPs are displayed by projection by the projector 10. On the other hand, the indefinite mode is a mode corresponding to the second operation mode. That is, in the indefinite mode, N mutually different pattern image GOPs, which is less than M, are displayed by projection by the projector 10. In this modification, measurements are made for three gradations in the preset mode, and a total of nine different pattern image GOPs are used, whereas measurements are made for two gradations in the indefinite mode, and a total of six different pattern image GOPs are used.

[0045] Moreover, each of the preset mode and the indefinite mode includes a first setting mode and a second setting mode which are different from each other. In this modification, the first setting mode and the second setting mode include some of the gradations to be measured which are different from each other, and the number of gradations to be measured, i.e., the number of pattern images GOP used for the measurement, are the same. In this modified example, the preset modes include a light priority mode and a dark priority mode as the first and second setting modes, and the indefinite mode includes a user-specified mode and an automatic mode as the first and second setting modes.

[0046] The bright priority mode is a setting mode suitable for cases where the gradation of the target image GO is relatively bright. This type of target image GO corresponds to an image with a white base, such as an image of a presentation document or an image on a personal computer screen. The dark priority mode is a setting mode suitable for cases where the gradation of the target image GO is relatively dark. This type of target image GO corresponds to an image with a base color other than white, such as a frame image that constitutes a moving image such as a movie.

[0047] In the light priority mode, a plurality of relatively high gradations are designated in advance as the measurement targets, and in the dark priority mode, a plurality of relatively dark gradations are designated in advance as the measurement targets. Specifically, as shown in Fig. 6, in the bright priority mode, the gradation to be measured is specified in advance as "1023" corresponding to the second gradation, and "876" and "730" corresponding to the third gradation darker than the second gradation. In the dark priority mode, the gradation to be measured is specified in advance as "1023" corresponding to the second gradation, and "292" and "146" corresponding to the fourth gradation darker than the third gradation in the bright priority mode.

[0048] In this modification, the first pattern image GOP1, the second pattern image GOP2, and the third pattern image GOP3 of the gradation "1023" corresponding to the second gradation correspond to the fifth pattern image. The first pattern image GOP1, the second pattern image GOP2, and the third pattern image GOP3 of the gradation "876" and "730" corresponding to the third gradation correspond to the sixth pattern image. The first pattern image GOP1, the second pattern image GOP2, and the third pattern image GOP3 of the gradation "292" and "146" corresponding to the fourth gradation correspond to the seventh pattern image.

[0049] In both the light priority mode and the dark priority mode, since the measurement target gradations of the current color are three or more points, the correction unit 110 uses curved interpolation to interpolate the current color for unmeasured gradations and calculates the correction value for each gradation. In this case, since the measurement is performed for relatively high gradations in the light priority mode, the accuracy of the correction value is improved in the high gradation range of the 1024-step gradation range. Conversely, since the measurement is performed for relatively dark gradations in the dark priority mode, the accuracy of the correction value is improved in the dark gradation range of the 1024-step gradation range.

[0050] The user-specified mode is a mode in which one gradation to be measured is specified by an operational input from the user U. In the user-specified mode, measurements are performed for two gradations: the gradation specified by an operational input from the user U, and the gradation "1023" which corresponds to the second gradation described above. The automatic mode is a mode in which measurements are performed for two gradations: a gradation determined according to the ambient light, and the gradation "1023" which corresponds to the second gradation described above. Ambient light is light that exists in the space in which the projection surface SP is placed, and is, for example, illumination light, sunlight, etc.

[0051] In the modified example, the first pattern image GOP1, the second pattern image GOP2, and the third pattern image GOP3 of the gradation designated by the operation input of the user U correspond to the eighth pattern image. Also, a pattern image GOP described below used to determine the gradation according to the ambient light corresponds to the ninth pattern image, and the first pattern image GOP1, the second pattern image GOP2, and the third pattern image GOP3 of the gradation determined according to the ambient light correspond to the tenth pattern image.

[0052] In both the user-specified mode and the automatic mode, since there are two gradations to be measured for the current color, the correction unit 110 uses linear interpolation to interpolate the current color for the unmeasured gradations and calculates the correction value for each gradation.

[0053] In this modified example, the gradations to be measured in any operation mode and setting mode include the gradation "1023" corresponding to the maximum brightness, as shown in Fig. 6. This makes it possible to reduce errors in each gradation when determining the current color of all gradations from maximum to minimum using interpolation.

[0054] FIG. 7 is a flowchart showing an example of a process for determining a gradation in the automatic mode. To go into more detail about the automatic mode, when the projection surface SP is illuminated by ambient light, if the contrast ratio between the brightness of the projection surface SP due to the ambient light and the brightness of the projected image GP falls below a predetermined threshold, measurement results of sufficient accuracy cannot be obtained. Therefore, in the automatic mode, the gradation to be measured is determined as follows. That is, as shown in Fig. 7, the projector 10 first measures the brightness of the projection surface SP due to the ambient light (step Sb1), and also measures the brightness of the projected image GP when a pattern image GOP of a reference gradation is projected (step Sb2). Then, based on the results of the brightness measurements, the projector 10 identifies one gradation from the 1024-step gradation range at which the contrast ratio to the brightness of the projection surface SP due to the ambient light exceeds a predetermined value, and designates the identified gradation as the gradation to be measured (step Sb3). This process prevents deterioration of the correction accuracy by excluding gradations that are inappropriate for the brightness of the ambient light from the measurement object. Decrease This allows correction to be performed in a short time.

[0055] The operation of the projector 10 in each step shown in FIG. 7 will now be described in more detail. In step Sb1, first, the pattern image generating unit 104 generates image data DG of the fourth pattern image GOP4 having black color. Next, the pattern image projection control unit 106 projects the image light LG of the fourth pattern image GOP4 on the projection surface SP based on the image data DG of the fourth pattern image GOP4. By this projection, a fourth projection image GP4 corresponding to the fourth pattern image GOP4 appears on the projection surface SP. Next, the user U captures the fourth projection image GP4 with the imaging device 30. The captured image data acquisition unit 108 acquires the captured image data DC of the fourth captured image acquired by capturing the fourth projection image GP4 from the imaging device 30. The brightness of this fourth captured image indicates the brightness caused by the ambient light on the projection surface SP.

[0056] In step Sb2, the pattern image generating unit 104 first generates image data DG of a ninth pattern image of a reference gradation. This reference gradation corresponds to the fifth gradation. In this modification, the fifth gradation is the maximum brightness gradation in the entire gradation range, that is, "1023". In addition, a pattern image GOP having white color is used for the ninth pattern image. Next, the pattern image projection control unit 106 projects the image light LG of the ninth pattern image on the projection surface SP based on the image data DG of the ninth pattern image. By this projection, a ninth projection image corresponding to the ninth pattern image appears on the projection surface SP. Next, the user U captures the ninth projection image with the imaging device 30. The captured image data acquisition unit 108 acquires captured image data DC of the ninth captured image acquired by capturing the ninth projection image from the imaging device 30. The brightness of this ninth captured image indicates the brightness of the ninth projection image by projecting the ninth pattern image of the reference gradation.

[0057] The order of steps Sb1 and Sb2 may be reversed.

[0058] In step Sb3, the correction unit 110 of the first processing device 100, for example, identifies one gradation from the 1024-step gradation range at which the brightness of the projection surface SP due to ambient light, i.e., the contrast ratio with respect to the fourth captured image, is equal to or greater than a predetermined threshold value based on the brightness of the fourth captured image and the ninth captured image, and designates that gradation as the gradation to be measured.

[0059] In the automatic mode of this modified example, the gradation "1023" may be excluded from the gradation measurement targets for determining the correction value, and instead the measurement results of the fourth pattern image GOP4 having black (gradation "0") may be used.

[0060] According to this modification, the first operation mode includes a bright priority mode, which is a first setting mode, and a dark priority mode, which is a second setting mode different from the first setting mode. priorityWhen the operation mode is the dark priority mode of the first operation mode, the M mutually different pattern images GOP include a fifth pattern image of a gradation "1023" corresponding to the second gradation, and sixth pattern images of gradations "876" and "730" corresponding to a third gradation that is a gradation darker than the second gradation. When the operation mode is the dark priority mode of the first operation mode, the M mutually different pattern images include the fifth pattern image and seventh pattern images of gradations "292" and "146" corresponding to a fourth gradation that is a gradation darker than the third gradation.

[0061] Therefore, the user U can specify an appropriate correction operation mode for the brightness of the target image GO.

[0062] In this modification, when the operation mode is the second operation mode and the user-specified mode, the first processing device 100 accepts input of a gradation. In addition, the N different pattern images GOP in the user-specified mode includes the fifth pattern image and an eighth pattern image of the gradation of the accepted input.

[0063] Therefore, the user U can perform correction targeting the desired gradation in a short time.

[0064] In addition, in this modified example, when the operation mode is the second operation mode and the automatic mode, the first processing device 100 executes the following series of processes. That is, the series of processes includes displaying a fourth pattern image GOP4 having black color, acquiring captured image data DC of a fourth captured image acquired by capturing a fourth projected image GP4 by projecting the fourth pattern image GOP4, projecting a ninth pattern image of a fifth gradation different from that of the fourth pattern image GOP4, acquiring captured image data DC of a ninth captured image acquired by capturing a ninth projected image by projecting the ninth pattern image, and designating a tenth pattern image of a gradation whose contrast ratio with the fourth captured image is equal to or greater than a predetermined threshold value based on the captured image data DC of each of the fourth captured image and the ninth captured image.

[0065] This series of processes eliminates from the measurement targets gradations that are inappropriate for the brightness of the ambient light, preventing a decrease in correction accuracy. In addition, by reducing the number of measurement targets, correction can be performed in a short time.

[0066] (Variation 3) In the above-described second modification, the operation modes may further include a high-precision indefinite mode, as shown in Fig. 8. The high-precision indefinite mode is a mode in which the number of gradations to be measured is greater than that in the above-described indefinite mode, i.e., the number of gradations to be measured is three or more, and corresponds to the first operation mode. In this modified example, the high-precision undefined mode includes a high-precision user-specified mode corresponding to the above-mentioned user-specified mode, and a high-precision automatic mode corresponding to the above-mentioned automatic mode. In the high-precision user-specified mode, the number of gradations specified by the user U is set to two or more, and in the high-precision automatic mode, the number of gradations determined by the ambient light is set to two or more. According to this modification, the user U can perform more accurate correction by specifying more gradations as measurement targets. In addition, the user U can perform more accurate correction according to the ambient light.

[0067] (Variation 4) In the above embodiment, the first processing device 100 of the projector 10 determines the operation mode based on the operation of the user U. However, the first processing device 100 may select one of the following modes based on the input method of the target image GO from the image supply device 20: “high accuracy mode”, “intermediate mode”, and “ Short time You may select an appropriate mode from the "Mode" menu. Specifically, the first processing device 100 further executes the process of setting the operation mode to the zeroth operation mode or the first operation mode when the image data DG of the target image GO is input from the image supply device 20 by a first input method, and setting the operation mode to the second operation mode when the image data DG of the target image GO is input from the image supply device 20 by a second input method different from the first input method. The first input method is, for example, a method in which image data DG with a relatively high image quality can be input to the projector 10, and the second input method is a method in which image data DG with a lower image quality than that of the first input method is input to the projector 10. The first input method includes, for example, input methods based on standards such as HDMI (High-Definition Multimedia Interface) and DisplayPort. HDMI is a registered trademark. The second input method includes, for example, a method in which image data DG is input to the projector 10 through an RCA terminal or an S terminal. In addition, in a method in which image data DG is input to the projector 10 wirelessly, a situation in which the data transmission speed is low or there is a large delay due to poor radio wave reception conditions, etc., also falls under the second input method.

[0068] According to this modification, an appropriate correction of the operation mode is executed according to the image quality of the target image GO.

[0069] (Variation 5) In the above-mentioned variants 2 and 3, the first processing device 100 of the projector 10 may specify a first setting mode, which is a bright priority mode, and a second setting mode, which is a dark priority mode, based on the histogram of the target image GO. Specifically, the first processing device 100 of the projector 10 further executes the processes of receiving an input of image data DG of the target image GO from the image supply device 20, acquiring a histogram of the target image GO based on the image data DG, and setting a first setting mode or a second setting mode based on the histogram. For example, the first processing device 100 obtains the number of bright pixels and the number of dark pixels included in the target image GO based on the histogram, and designates the bright priority mode when the number of bright pixels is greater than the number of dark pixels, and designates the dark priority mode when the number of dark pixels is greater than the number of bright pixels. Note that, when the target image GO is a frame image of a moving image, the first processing device 100 may set the first setting mode or the second setting mode based on the average value of each histogram of a plurality of frame images, or the like.

[0070] According to this modification, an appropriate correction operation mode is automatically designated according to the histogram of the target image GO, and the correction is executed.

[0071] (Variation 6) In the above-described embodiment, the display system 1 may further include an information processing device having a second processing device. The information processing device is, for example, a personal computer, a mobile phone, or a smartphone. Each functional unit realized by the first processing device 100 of the projector 10 executing the image correction program 122 may be realized by the second processing device of the information processing device.

[0072] (Other variations) In the present disclosure, the projector 10 may be another display device that displays a display image. For example, the display device may be a self-luminous display device such as a liquid crystal display device that displays an image on a liquid crystal display panel, a display device that displays an image on an organic EL panel, a monitor, a liquid crystal television, or a flat panel display. In the present disclosure, the correction of the displayed image is not limited to color correction, and may be other corrections.

[0073] 3. Summary of this disclosure The following is a summary of this disclosure.

[0074] (Appendix 1) When an operation mode of a display device that displays a display image is a first operation mode, the display device sequentially displays M mutually different pattern images, where M is a natural number; correcting the display image based on a first captured image group acquired by capturing the M mutually different pattern images; When an operation mode of the display device is a second operation mode different from the first operation mode, the display device sequentially displays N mutually different pattern images, where N is a natural number smaller than M; acquiring a second group of captured images obtained by capturing the N mutually different pattern images; correcting the display image based on the second group of captured images; Display methods including.

[0075] According to Supplementary Note 1, the first operation mode can perform correction with higher accuracy than the second operation mode. Also, the second operation mode can perform correction in a shorter time than the first operation mode.

[0076] (Appendix 2) The N is 4 or more, The N mutually different pattern images are one or more first pattern images having a red color; one or more second pattern images having a green color; one or more third pattern images having a blue color; a fourth pattern image having a black color; Includes Display method as described in Appendix 1.

[0077] According to Supplementary Note 2, color correction of a displayed image can be performed in a short time.

[0078] (Appendix 3) The M is 7 or more, The M mutually different pattern images are Two or more of the first pattern images having different gradations; Two or more of the second pattern images having different gradations; Two or more of the third pattern images having different gradations; one fourth pattern image; Including, Correcting the display image based on the first captured image group includes: correcting the display image with a correction value calculated using curved-line interpolation based on the first captured image group; Correcting the display image based on the second captured image group includes: correcting the display image with a correction value calculated using linear interpolation different from the curved interpolation based on the second captured image group. Display method as described in Appendix 2.

[0079] According to Supplementary Note 3, the first operation mode allows the correction value of the color correction to be determined with higher accuracy than the second operation mode. Also, the second operation mode allows the correction value of the color correction to be determined in a shorter time than the first operation mode.

[0080] (Appendix 4) The first mode of operation includes: a first setting mode and a second setting mode different from the first setting mode, When the operation mode is the first setting mode of the first operation mode, the M mutually different pattern images are a fifth pattern image of a second gradation; and a sixth pattern image having a third gradation that is darker than the second gradation; and Including, When the operation mode is the second setting mode of the first operation mode, the M mutually different pattern images are the fifth pattern image, and a seventh pattern image of a fourth gradation that is darker than the third gradation; Including, 5. The display method according to any one of appendix 1 to 3.

[0081] According to Supplementary Note 4, an appropriate correction operation mode can be executed according to the brightness of the displayed image.

[0082] (Appendix 5) When the operation mode is the first operation mode or the second operation mode, receiving an input of a gray scale; The M mutually different pattern images or the N mutually different pattern images, The fifth pattern image; and an eighth pattern image of the gray scale of the input; Including, Display method as described in Appendix 4.

[0083] According to Supplementary Note 5, the user can execute an operation mode of correction targeting a desired gradation.

[0084] (Appendix 6) When the operation mode is the first operation mode or the second operation mode, displaying a fourth pattern image having a black color; acquiring a fourth captured image by capturing the fourth pattern image; displaying a ninth pattern image having a fifth gradation different from the gradation of the fourth pattern image; acquiring a ninth captured image by capturing the ninth pattern image; designating a tenth pattern image having a gradation such that a contrast ratio with respect to the fourth captured image is equal to or greater than a predetermined threshold value based on the fourth captured image and the ninth captured image; Further comprising: Display method as described in Appendix 5.

[0085] According to Supplementary Note 6, correction can be performed using a pattern image of gradations that excludes gradations that are inappropriate for the brightness of the ambient light.

[0086] (Appendix 7) accepting an operation for designating the operation mode; When the received operation is an operation for designating the first operation mode, setting the operation mode to the first operation mode; When the received operation is an operation for designating the second operation mode, setting the operation mode to the second operation mode; Further comprising: 6. The display method according to any one of Supplementary Note 1 to Supplementary Note 6.

[0087] According to Supplementary Note 7, the user can select a desired operation mode from the first operation mode and the second operation mode by operating the device.

[0088] (Appendix 8) When the display device displays the display image based on an image signal input in a first input method, the operation mode is set to the first operation mode; When the display device displays the display image based on an image signal input in a second input method different from the first input method, the operation mode is set to the second operation mode; Further comprising: Display method as described in Appendix 7.

[0089] According to Supplementary Note 8, appropriate correction of the operation mode can be performed according to the image quality of the displayed image.

[0090] (Appendix 9) Receiving an input of an image signal; obtaining a histogram of an image represented by the image signal; designating the first setting mode or the second setting mode based on the histogram; Further comprising: Display method as described in Appendix 4.

[0091] According to Supplementary Note 9, appropriate correction of the operation mode can be performed according to the histogram of the displayed image.

[0092] (Appendix 10) a display device for displaying a display image; An imaging device; When the operation mode of the display device is a first operation mode, sequentially displaying M mutually different pattern images on the display device, where M is a natural number; correcting the display image based on a first captured image group acquired by capturing the M mutually different pattern images by the imaging device; When an operation mode of the display device is a second operation mode different from the first operation mode, N different pattern images are sequentially displayed on the display device, where N is a natural number smaller than M; acquiring a second group of captured images obtained by capturing the N mutually different pattern images with the imaging device; correcting the display image based on the second group of captured images; A processing unit for executing the above-mentioned A display system including:

[0093] According to Supplementary Note 10, the same effect as that of Supplementary Note 1 can be obtained.

[0094] (Appendix 11) When an operation mode of a display device that displays a display image is a first operation mode, the display device sequentially displays M mutually different pattern images, where M is a natural number; correcting the display image based on a first captured image group acquired by capturing the M mutually different pattern images; When an operation mode of the display device is a second operation mode different from the first operation mode, the display device sequentially displays N mutually different pattern images, where N is a natural number smaller than M; acquiring a second group of captured images obtained by capturing the N mutually different pattern images; correcting the display image based on the second group of captured images; A program that causes a computer to execute the following.

[0095] According to Supplementary Note 11, the same effect as that of Supplementary Note 1 can be obtained. [Explanation of symbols]

[0096] 1...display system, 10...projector (display device), 20...image supply device, 30...imaging device, 100...first processing device (processing device), 102...input acquisition section, 104...pattern image generation section, 106...pattern image projection control section, 108...captured image data acquisition section, 110...correction section, 122...image correction program (program), 150...operation input device, DG...image data (image signal), GO...target image (display image), GOP...pattern image, GP...projected image, L, M, N...natural numbers, SP...projection surface, U...user.

Claims

1. When the operation mode of the display device that displays the display image is the first operation mode, M is a natural number. When the pattern image is displayed, the display device sequentially displays M different pattern images. 、 The M different pattern images are acquired by capturing the M different pattern images. correcting the display image based on one captured image group; The operation mode of the display device is a second operation mode different from the first operation mode. In this case, when N is a natural number smaller than M, N different pattern images are the display device sequentially displays the The N different pattern images are acquired by capturing the N different pattern images. acquiring a second group of captured images; correcting the display image based on the second group of captured images; Including, The N is 4 or more, The N different pattern images are one or more first pattern images having a red color; one or more second pattern images having a green color; one or more third pattern images having a blue color; a fourth pattern image having a black color; Including, The M is 7 or more, The M mutually different pattern images are Two or more of the first pattern images having different gradations; Two or more of the second pattern images having different gradations; Two or more of the third pattern images having different gradations; one fourth pattern image; Including, Correcting the display image based on the first captured image group includes: The display is adjusted based on a correction value calculated by using a curved-line interpolation based on the first captured image group. Correcting the image, Correcting the display image based on the second captured image group includes: The second captured image group is calculated using linear interpolation different from the curved interpolation. and correcting the displayed image with a correction value.

2. The first mode of operation includes: a first setting mode and a second setting mode different from the first setting mode, When the operation mode is the first setting mode of the first operation mode, The different pattern images are a fifth pattern image of the second gradation; and a sixth pattern image having a third gradation level that is darker than the second gradation level; and Including, When the operation mode is the second setting mode of the first operation mode, The different pattern images are The fifth pattern image and a seventh pattern image of a fourth gradation that is darker than the third gradation. A pattern image, Including, The display method according to claim 1 .

3. When the operation mode is the first operation mode or the second operation mode, and accepting input of a key. The M mutually different pattern images or the N mutually different pattern images are 、 the fifth pattern image; an eighth pattern image of the grayscale of the input; Including, The display method according to claim 2.

4. When the operation mode is the first operation mode or the second operation mode, displaying a fourth pattern image having a black color; A fourth captured image is obtained by capturing the fourth pattern image. And, A ninth pattern image having a fifth gradation different from the gradation of the fourth pattern image is displayed. And, A ninth captured image is obtained by capturing the ninth pattern image. And, Based on the fourth captured image and the ninth captured image, a comparison with the fourth captured image is performed. Specifying a tenth pattern image having a gradation whose trust ratio is equal to or greater than a predetermined threshold; Further comprising: The display method according to claim 3.

5. accepting an operation for designating the operation mode; If the accepted operation is an operation for designating the first operation mode, setting the operation mode to the first operation mode; If the accepted operation is an operation for designating the second operation mode, setting the operation mode to the second operation mode; Further comprising: The display method according to claim 1 .

6. The display device displays the display image based on an image signal input in a first input method. if so, setting the operation mode to the first operation mode; The display device receives an image signal in a second input method different from the first input method. When the display image is to be displayed, the operation mode is changed to the second operation mode based on the To do, Further comprising: The display method according to claim 5.

7. Receiving an input of an image signal; obtaining a histogram of an image represented by the image signal; The first setting mode or the second setting mode is selected based on the histogram. To do, Further comprising: The display method according to claim 2.

8. a display device for displaying a display image; An imaging device; When the operation mode of the display device is the first operation mode, when M is a natural number, Sequentially displaying M mutually different pattern images on the display device; The M mutually different pattern images are captured by the imaging device. correcting the display image based on a first captured image group acquired by The operation mode of the display device is a second operation mode different from the first operation mode. In this case, when N is a natural number smaller than M, N different pattern images are sequentially displayed on the display device; The N mutually different pattern images are captured by the imaging device. acquiring a second group of captured images obtained by the above method; correcting the display image based on the second group of captured images; A processing unit for executing the above-mentioned Including, The N is 4 or more, The N different pattern images are one or more first pattern images having a red color; one or more second pattern images having a green color; one or more third pattern images having a blue color; a fourth pattern image having a black color; Including, The M is 7 or more, The M mutually different pattern images are Two or more of the first pattern images having different gradations; Two or more of the second pattern images having different gradations; Two or more of the third pattern images having different gradations; one fourth pattern image; Including, Correcting the display image based on the first captured image group includes: The display is adjusted based on a correction value calculated by using a curved-line interpolation based on the first captured image group. Correcting the image, Correcting the display image based on the second captured image group includes: The second captured image group is calculated using linear interpolation different from the curved interpolation. and correcting the displayed image with a correction value.

9. When the operation mode of the display device that displays the display image is the first operation mode, M is a natural number. When the pattern image is displayed, the display device sequentially displays M different pattern images. 、 The M different pattern images are acquired by capturing the M different pattern images. correcting the display image based on one captured image group; The operation mode of the display device is a second operation mode different from the first operation mode. In this case, when N is a natural number smaller than M, N different pattern images are the display device sequentially displays the The N different pattern images are acquired by capturing the N different pattern images. acquiring a second group of captured images; correcting the display image based on the second group of captured images; Run the following on your computer: The N is 4 or more, The N different pattern images are one or more first pattern images having a red color; one or more second pattern images having a green color; one or more third pattern images having a blue color; a fourth pattern image having a black color; Including, The M is 7 or more, The M mutually different pattern images are Two or more of the first pattern images having different gradations; Two or more of the second pattern images having different gradations; Two or more of the third pattern images having different gradations; one fourth pattern image; Including, Correcting the display image based on the first captured image group includes: The display is adjusted based on a correction value calculated by using a curved-line interpolation based on the first captured image group. Correcting the image, Correcting the display image based on the second captured image group includes: The second captured image group is calculated using linear interpolation different from the curved interpolation. and correcting the display image using a correction value.

Citation Information

Patent Citations

  • Data processor, picture display device, and image pickup device

    JP2001134252A

  • Method for calculating display characteristics correction data of image display apparatus, display characteristic correction data program, and apparatus for calculating display characteristics correction data

    JP2005150779A

  • Projector and control method thereof

    JP2016161918A

  • Image processing device, image processing method, and image processing program

    JP2019029789A

  • Projector system, projection image unevenness correction method, and program

    JP2019186761A